Alibaba

Introduction

Alibaba Cloud's AI models are integrated into the Runware platform through our unified API, providing access to advanced generative capabilities across language, vision, and video domains. The Wan model family specializes in video generation with support for multi-shot sequencing, native audio, and strong temporal consistency.

Through the providerSettings.alibaba object, you can access Alibaba-specific features such as prompt extension, automatic audio generation, and multi-shot composition, while maintaining the consistency of Runware's standard API structure. This page documents the technical specifications, parameter requirements, and provider-specific settings for all Alibaba models available through our platform.

Image models

providerSettings » alibaba

alibaba

object

Configuration object for Alibaba-specific image generation settings. These parameters provide control over prompt enhancement for Wan image models.

View example

{
  "taskType": "imageInference",
  "taskUUID": "a770f077-f413-47de-9dac-be0b26a35da6",
  "model": "alibaba:wan@2.5-image",
  "positivePrompt": "A cinematic still with rich detail",
  "width": 1280,
  "height": 1280,
  "providerSettings": {
    "alibaba": {
      "promptExtend": true
    }
  }
}

Properties ⁨1⁩ property

providerSettings » alibaba » promptExtend

promptExtend

boolean Default: true

Enables LLM-based prompt rewriting to improve generation quality by expanding and clarifying the input prompt. When enabled, the system analyzes and enhances the prompt to produce more detailed and coherent video output.

Enabling prompt extension increases generation time but typically results in higher quality output with better scene composition and narrative flow.

{
  "taskType": "imageInference",
  "taskUUID": "24cd5dff-cb81-4db5-8506-b72a9425f9d8",
  "model": "alibaba:wan@2.5-image",
  "positivePrompt": "A cinematic still of a dramatic landscape with detailed depth structure and rich atmospheric lighting",
  "width": 1280,
  "height": 1280,
  "providerSettings": {
    "alibaba": {
      "promptExtend": true
    }
  }
}

Video models

advancedFeatures » wanAnimate

wanAnimate

object

Configuration object for Wan2.2 Animate character animation and replacement features. These parameters control animation strategies, pose retargeting, and temporal consistency for character-focused video generation.

View example

{
  "taskType": "videoInference",
  "taskUUID": "a770f077-f413-47de-9dac-be0b26a35da6",
  "model": "alibaba:wan@2.2-animate",
  "inputs": {
    "referenceImages": ["c64351d5-4c59-42f7-95e1-eace013eddab"],
    "referenceVideos": ["d7e8f9a0-2b5c-4e7f-a1d3-9c8b7a6e5d4f"]
  },
  "advancedFeatures": {
    "wanAnimate": {
      "mode": "animate",
      "retargetPose": true,
      "prevSegCondFrames": 3
    }
  }
}

Properties ⁨3⁩ properties

advancedFeatures » wanAnimate » mode

mode

"animate" | "replace" Default: animate

Selects the animation strategy for character generation and integration into video footage.

Available values:

• animate: Uses pose detection from the reference image and video, with optional skeleton retargeting to adjust the reference pose to match video movements. Ideal for bringing static characters to life with natural motion.
• replace: Uses pose detection and segmentation models to determine character pose and shape, then replaces the character in the video while preserving background and motion. Best for character substitution in existing footage.

advancedFeatures » wanAnimate » retargetPose

retargetPose

boolean Default: false

Retargets the pose of the video to match the reference image's initial pose, with bone positions (notably hands) adjusted according to video movements. This creates more natural alignment between the reference character's pose and the video motion.

This parameter is only supported in animate mode and has no effect when using replace mode.

advancedFeatures » wanAnimate » prevSegCondFrames

prevSegCondFrames

integer Min: 1 Max: 5 Default: 1

Number of frames taken from the previous segment to maintain temporal consistency across video segments. Higher values improve visual continuity between segments but increase inference time, while lower values reduce consistency but generate faster.

providerSettings » alibaba

alibaba

object

Configuration object for Alibaba-specific video generation settings. These parameters provide control over prompt enhancement, audio generation, and shot composition for Wan video models.

View example

{
  "taskType": "videoInference",
  "taskUUID": "a770f077-f413-47de-9dac-be0b26a35da6",
  "model": "alibaba:wan@2.6",
  "positivePrompt": "A cinematic scene with multiple shots",
  "duration": 10,
  "width": "1920",
  "height": "1080",
  "providerSettings": {
    "alibaba": {
      "promptExtend": true,
      "audio": true,
      "shotType": "multi"
    }
  }
}

Properties ⁨3⁩ properties

providerSettings » alibaba » promptExtend

promptExtend

boolean Default: true

Enables LLM-based prompt rewriting to improve generation quality by expanding and clarifying the input prompt. When enabled, the system analyzes and enhances the prompt to produce more detailed and coherent video output.

Enabling prompt extension increases generation time but typically results in higher quality output with better scene composition and narrative flow.

providerSettings » alibaba » audio

audio

boolean Default: true

Controls automatic audio generation for the video. When enabled, the model generates native audio that aligns with the visual content and scene progression.

This parameter is ignored if custom audio is provided via inputs.audio.

providerSettings » alibaba » shotType

shotType

"single" | "multi" Default: single

Determines the shot composition style for the generated video. This parameter controls whether the video is generated as a continuous single shot or as multiple shots with transitions.

Available values:

• single: Generate video as a continuous single shot.
• multi: Generate video with multiple shots and transitions between them.

This parameter only takes effect when promptExtend is set to true. Multi-shot composition works best with prompts that explicitly describe shot changes or scene transitions.

{
  "taskType": "videoInference",
  "taskUUID": "24cd5dff-cb81-4db5-8506-b72a9425f9d9",
  "model": "alibaba:wan@2.2-animate",
  "inputs": {
    "referenceImages": ["c64351d5-4c59-42f7-95e1-eace013eddab"],
    "referenceVideos": ["d7e8f9a0-2b5c-4e7f-a1d3-9c8b7a6e5d4f"]
  },
  "steps": 6,
  "advancedFeatures": {
    "wanAnimate": {
      "mode": "animate",
      "retargetPose": false,
      "prevSegCondFrames": 1
    }
  }
}

{
  "taskType": "videoInference",
  "taskUUID": "6ba7b835-9dad-11d1-80b4-00c04fd430c8",
  "model": "alibaba:wan@2.2-animate",
  "inputs": {
    "referenceImages": ["c64351d5-4c59-42f7-95e1-eace013eddab"],
    "referenceVideos": ["d7e8f9a0-2b5c-4e7f-a1d3-9c8b7a6e5d4f"]
  },
  "steps": 6,
  "advancedFeatures": {
    "wanAnimate": {
      "mode": "replace"
    }
  }
}

{
  "taskType": "videoInference",
  "taskUUID": "550e8400-e29b-41d4-a716-446655440017",
  "model": "alibaba:wan@2.2-animate",
  "inputs": {
    "referenceImages": ["c64351d5-4c59-42f7-95e1-eace013eddab"],
    "referenceVideos": ["d7e8f9a0-2b5c-4e7f-a1d3-9c8b7a6e5d4f"]
  },
  "steps": 6,
  "advancedFeatures": {
    "wanAnimate": {
      "mode": "animate",
      "retargetPose": true,
      "prevSegCondFrames": 3
    }
  }
}

{
  "taskType": "videoInference",
  "taskUUID": "24cd5dff-cb81-4db5-8506-b72a9425f9d8",
  "model": "alibaba:wan@2.5-preview",
  "positivePrompt": "A cinematic narrative scene with smooth character movement and atmospheric storytelling",
  "duration": 10,
  "width": 1920,
  "height": 1080,
  "providerSettings": {
    "alibaba": {
      "promptExtend": true,
      "audio": true
    }
  }
}

{
  "taskType": "videoInference",
  "taskUUID": "6ba7b834-9dad-11d1-80b4-00c04fd430c8",
  "model": "alibaba:wan@2.5-preview",
  "inputs": {
    "frameImages": [
      {
        "inputImage": "c64351d5-4c59-42f7-95e1-eace013eddab",
        "frame": "first"
      }
    ]
  },
  "positivePrompt": "The character begins to move naturally through the scene with smooth motion",
  "duration": 5,
  "resolution": "720p",
  "providerSettings": {
    "alibaba": {
      "audio": true
    }
  }
}

{
  "taskType": "videoInference",
  "taskUUID": "550e8400-e29b-41d4-a716-446655440016",
  "model": "alibaba:wan@2.5-preview",
  "positivePrompt": "Visual narrative synchronized with the provided audio track",
  "inputs": {
    "audio": "b4c57832-2075-492b-bf89-9b5e3ac02503"
  },
  "duration": 10,
  "width": 1280,
  "height": 720,
  "providerSettings": {
    "alibaba": {
      "promptExtend": true
    }
  }
}

{
  "taskType": "videoInference",
  "taskUUID": "24cd5dff-cb81-4db5-8506-b72a9425f9d7",
  "model": "alibaba:wan@2.6",
  "positivePrompt": "A cinematic chase through a rain-soaked city, opening with a wide street shot, cutting to a close-up of footsteps splashing through puddles, followed by an overhead tracking shot",
  "duration": 10,
  "width": "1920",
  "height": "1080",
  "providerSettings": {
    "alibaba": {
      "promptExtend": true,
      "audio": true,
      "shotType": "multi"
    }
  }
}

{
  "taskType": "videoInference",
  "taskUUID": "6ba7b833-9dad-11d1-80b4-00c04fd430c8",
  "model": "alibaba:wan@2.6",
  "inputs": {
    "frameImages": ["c64351d5-4c59-42f7-95e1-eace013eddab"]
  },
  "positivePrompt": "The scene comes alive with gentle movement and atmospheric effects",
  "duration": 5,
  "resolution": "720p",
  "providerSettings": {
    "alibaba": {
      "audio": true
    }
  }
}

{
  "taskType": "videoInference",
  "taskUUID": "550e8400-e29b-41d4-a716-446655440015",
  "model": "alibaba:wan@2.6",
  "inputs": {
    "referenceVideos": [
      "c64351d5-4c59-42f7-95e1-eace013eddab",
      "d7e8f9a0-2b5c-4e7f-a1d3-9c8b7a6e5d4f"
    ]
  },
  "positivePrompt": "character1 walks through a forest while character2 follows behind, maintaining their visual characteristics and movement styles",
  "duration": 15,
  "width": "1920",
  "height": "1080",
  "providerSettings": {
    "alibaba": {
      "promptExtend": true,
      "audio": true,
      "shotType": "single"
    }
  }
}

{
  "taskType": "videoInference",
  "taskUUID": "f47ac10b-58cc-4372-a567-0e02b2c3d489",
  "model": "alibaba:wan@2.6",
  "inputs": {
    "audio": "b4c57832-2075-492b-bf89-9b5e3ac02503"
  },
  "positivePrompt": "A dramatic scene with synchronized visuals matching the provided audio track",
  "duration": 10,
  "width": "1920",
  "height": "1080",
  "providerSettings": {
    "alibaba": {
      "promptExtend": true
    }
  }
}