Grok Imagine Video
Grok Imagine Video is a multimodal generative video model that produces short video clips with native audio from text descriptions or static images. It supports text-to-video and image-to-video generation with synchronized sound effects and dialogue, enabling developers to animate scenes with motion, camera dynamics, and audio in a single API workflow.
API Options
Platform-level options for task execution and delivery.
-
taskType
string required value: videoInference -
Identifier for the type of task being performed
-
taskUUID
string required UUID v4 -
UUID v4 identifier for tracking tasks and matching async responses. Must be unique per task.
-
outputType
string default: URL -
Video output type.
Allowed values 1 value
-
outputFormat
string default: MP4 -
Specifies the file format of the generated output. The available values depend on the task type and the specific model's capabilities.
- `MP4`: Widely supported video container (H.264), recommended for general use.
- `WEBM`: Optimized for web delivery.
- `MOV`: QuickTime format, common in professional workflows (Apple ecosystem).
Allowed values 3 values
-
outputQuality
integer min: 20 max: 99 default: 95 -
Compression quality of the output. Higher values preserve quality but increase file size.
-
webhookURL
string URI -
Specifies a webhook URL where JSON responses will be sent via HTTP POST when generation tasks complete. For batch requests with multiple results, each completed item triggers a separate webhook call as it becomes available.
Learn more 1 resource
- Webhooks PLATFORM
- Webhooks
-
deliveryMethod
string default: async -
Determines how the API delivers task results.
Allowed values 1 value
- Returns an immediate acknowledgment with the task UUID. Poll for results using getResponse. Required for long-running tasks like video generation.
Learn more 1 resource
- Task Polling PLATFORM
-
uploadEndpoint
string URI -
Specifies a URL where the generated content will be automatically uploaded using the HTTP PUT method. The raw binary data of the media file is sent directly as the request body. For secure uploads to cloud storage, use presigned URLs that include temporary authentication credentials.
Common use cases:
- Cloud storage: Upload directly to S3 buckets, Google Cloud Storage, or Azure Blob Storage using presigned URLs.
- CDN integration: Upload to content delivery networks for immediate distribution.
// S3 presigned URL for secure upload https://your-bucket.s3.amazonaws.com/generated/content.mp4?X-Amz-Signature=abc123&X-Amz-Expires=3600 // Google Cloud Storage presigned URL https://storage.googleapis.com/your-bucket/content.jpg?X-Goog-Signature=xyz789 // Custom storage endpoint https://storage.example.com/uploads/generated-image.jpgThe content data will be sent as the request body to the specified URL when generation is complete.
-
safety
object -
Content safety checking configuration for video generation.
Properties 2 properties
-
safety»checkContentcheckContent
boolean default: false -
Enable or disable content safety checking. When enabled, defaults to
fastmode.
-
safety»modemode
string default: none -
Safety checking mode for video generation.
Allowed values 3 values
- Disables checking.
- Checks key frames.
- Checks all frames.
-
-
ttl
integer min: 60 -
Time-to-live (TTL) in seconds for generated content. Only applies when
outputTypeisURL.
-
includeCost
boolean default: false -
Include task cost in the response.
-
numberResults
integer min: 1 max: 4 default: 1 -
Number of results to generate. Each result uses a different seed, producing variations of the same parameters.
Inputs
Input resources for the task (images, audio, etc). These must be nested inside the inputs object.
inputs object.-
inputs»referenceImagesreferenceImages
array of strings min items: 1max items: 7 -
List of reference images (UUID, URL, Data URI, or Base64).
-
inputs»frameImagesframeImages
array of strings or objects items: 1 -
An array of frame-specific image inputs to guide video generation. Each item can be either a plain image input (UUID, URL, Data URI, or Base64) or an object that pairs an image with a target frame position.
The
frameImagesparameter allows you to constrain specific frames within the video sequence, ensuring that particular visual content appears at designated points. This is different fromreferenceImages, which provide overall visual guidance without constraining specific timeline positions.When the
frameparameter is omitted, automatic distribution rules apply:- 1 image: Used as the first frame.
Examples 2 examples
Shorthand format: When you don't need to specify a frame position, you can pass a plain image input directly.
"frameImages": [ "aac49721-1964-481a-ae78-8a4e29b91402" ]Object format: When you need to specify a frame position, use an object with
imageandframe."frameImages": [ { "image": "aac49721-1964-481a-ae78-8a4e29b91402", "frame": "first" } ]Format 1: string[]
-
Image input (UUID, URL, Data URI, or Base64).
Format 2: object[] 2 properties
-
inputs»videovideo
string -
Video input (UUID or URL).
Generation Parameters
Core parameters for controlling the generated content.
-
model
string required value: xai:grok-imagine@video -
Identifier of the model to use for generation.
Learn more 3 resources
-
positivePrompt
string required min: 1 -
Text prompt describing elements to include in the generated output.
Learn more 2 resources
-
Width of the generated media in pixels.
Learn more 2 resources
-
Height of the generated media in pixels.
Learn more 2 resources
-
resolution
string default: 480p -
Resolution preset for the output. When used with input media, automatically matches the aspect ratio from the input.
Allowed values 2 values
-
duration
integer min: 1 max: 15 default: 6 -
Length of the generated video in seconds. The total number of frames produced is determined by duration multiplied by the model's frame rate (fps).
Moonlit Clockwork Carnival Alley
{
"taskType": "videoInference",
"taskUUID": "6378aa49-9f31-414a-8e00-3076dea79124",
"model": "xai:grok-imagine@video",
"positivePrompt": "A moonlit steampunk carnival tucked inside a narrow cobblestone alley, brass automatons performing for a small midnight crowd, glowing paper lanterns swaying overhead, a carousel horse mounted on mechanical rails gliding past the camera, curls of steam venting from copper pipes, sparkling puddles reflecting amber and cyan light. The camera begins with a slow dolly forward through hanging banners, then gently pans to reveal a violin-playing clockwork fox on a velvet crate while a tiny piston-driven drummer taps a lively rhythm nearby. A distant ferris wheel turns above the rooftops, gears clicking softly, carnival chimes ringing, murmuring spectators, fluttering fabric, footsteps on wet stone, occasional hiss of steam, and a warm female ringmaster voice off-screen saying, 'Step closer, the midnight wonders have only just awakened.' Cinematic, highly detailed, magical yet tactile, expressive lighting, atmospheric depth, dynamic motion, synchronized sound design.",
"width": 1280,
"height": 720,
"duration": 8
}{
"taskType": "videoInference",
"taskUUID": "6378aa49-9f31-414a-8e00-3076dea79124",
"videoUUID": "c8b6b301-7a5e-4aa8-a3e5-0f4377da76ea",
"videoURL": "https://vm.runware.ai/video/os/a16d07/ws/5/vi/c8b6b301-7a5e-4aa8-a3e5-0f4377da76ea.mp4",
"cost": 0.56
}Bioluminescent Reef Dreamscape
{
"taskType": "videoInference",
"taskUUID": "050f2911-487c-49eb-820f-e2e47f39ec6f",
"model": "xai:grok-imagine@video",
"positivePrompt": "Transform the reference video into a luminous fantasy undersea vision. The tunnel becomes an ancient submerged coral cathedral with glowing arches, drifting jellyfish lanterns, shimmering schools of silver fish, soft shafts of turquoise light, bioluminescent particles, and vast whale-song atmosphere. Preserve the original pacing and camera movement from the source video, but restylize the walking figure as a mysterious traveler in a flowing deep-sea cloak with reflective details. Add synchronized native audio: distant whale calls, bubbling water resonance, gentle current swells, soft footsteps echoing on wet stone, and a faint whispered line, 'The reef remembers.' Cinematic, dreamlike, richly detailed, immersive, high-end visual effects, coherent motion, natural scene continuity.",
"inputs": {
"referenceVideos": [
"https://assets.runware.ai/assets/inputs/931713e7-94a4-46ff-b6a2-a450a9ab9e53.mp4"
]
}
}{
"taskType": "videoInference",
"taskUUID": "050f2911-487c-49eb-820f-e2e47f39ec6f",
"videoUUID": "ff8ba334-00f7-4158-8296-6dbc1f2fd2d2",
"videoURL": "https://vm.runware.ai/video/os/a17d13/ws/5/vi/ff8ba334-00f7-4158-8296-6dbc1f2fd2d2.mp4",
"cost": 0.404
}Stormy Lighthouse Rescue
{
"taskType": "videoInference",
"taskUUID": "ba22dba3-0b1d-44e1-ad81-b3eb720d91fe",
"model": "xai:grok-imagine@video",
"positivePrompt": "A cinematic night storm on a rocky coastline, waves crashing against black cliffs below a tall lighthouse. The camera begins with a wide aerial sweep through rain and sea mist, then pushes toward the lighthouse window glowing warm amber. Inside, a soaked coast guard captain grabs a radio and shouts, 'Hold on, we're coming for you!' Cut to the beam of the lighthouse slicing through sheets of rain as a rescue boat battles the surf below. Thunder rolls, wind howls, rain lashes metal railings, sirens pulse faintly in the distance, and the ocean roars with deep, immersive sound. Realistic water physics, dramatic lightning flashes, high contrast cinematic lighting, tense atmosphere, natural lip sync for the spoken line, polished blockbuster look.",
"width": 1280,
"height": 720,
"duration": 8
}{
"taskType": "videoInference",
"taskUUID": "ba22dba3-0b1d-44e1-ad81-b3eb720d91fe",
"videoUUID": "ed30ad9a-6693-4ff3-8775-796ae3cd8fe7",
"videoURL": "https://vm.runware.ai/video/os/a03d21/ws/5/vi/ed30ad9a-6693-4ff3-8775-796ae3cd8fe7.mp4",
"cost": 0.56
}