Memories Video Captioning
Memories Video Captioning converts spoken audio and key visual context in videos into structured text. It supports speaker labeling for dialogue heavy content. It can also generate optional chapter style summaries for quick navigation and review.
API Options
Platform-level options for task execution and delivery.
-
taskType
string required value: caption -
Identifier for the type of task being performed
-
taskUUID
string required UUID v4 -
UUID v4 identifier for tracking tasks and matching async responses. Must be unique per task.
-
outputType
string default: URL -
Video output type.
Allowed values 1 value
-
outputFormat
string default: MP4 -
Specifies the file format of the generated output. The available values depend on the task type and the specific model's capabilities.
- `MP4`: Widely supported video container (H.264), recommended for general use.
- `WEBM`: Optimized for web delivery.
- `MOV`: QuickTime format, common in professional workflows (Apple ecosystem).
Allowed values 3 values
-
outputQuality
integer min: 20 max: 99 default: 95 -
Compression quality of the output. Higher values preserve quality but increase file size.
-
webhookURL
string URI -
Specifies a webhook URL where JSON responses will be sent via HTTP POST when generation tasks complete. For batch requests with multiple results, each completed item triggers a separate webhook call as it becomes available.
Learn more 1 resource
- Webhooks PLATFORM
- Webhooks
-
deliveryMethod
string default: async -
Determines how the API delivers task results.
Allowed values 1 value
- Returns an immediate acknowledgment with the task UUID. Poll for results using getResponse. Required for long-running tasks like video generation.
Learn more 1 resource
- Task Polling PLATFORM
-
uploadEndpoint
string URI -
Specifies a URL where the generated content will be automatically uploaded using the HTTP PUT method. The raw binary data of the media file is sent directly as the request body. For secure uploads to cloud storage, use presigned URLs that include temporary authentication credentials.
Common use cases:
- Cloud storage: Upload directly to S3 buckets, Google Cloud Storage, or Azure Blob Storage using presigned URLs.
- CDN integration: Upload to content delivery networks for immediate distribution.
// S3 presigned URL for secure upload https://your-bucket.s3.amazonaws.com/generated/content.mp4?X-Amz-Signature=abc123&X-Amz-Expires=3600 // Google Cloud Storage presigned URL https://storage.googleapis.com/your-bucket/content.jpg?X-Goog-Signature=xyz789 // Custom storage endpoint https://storage.example.com/uploads/generated-image.jpgThe content data will be sent as the request body to the specified URL when generation is complete.
-
ttl
integer min: 60 -
Time-to-live (TTL) in seconds for generated content. Only applies when
outputTypeisURL.
-
includeCost
boolean default: false -
Include task cost in the response.
Inputs
Input resources for the task (images, audio, etc). These must be nested inside the inputs object.
inputs object.-
inputs»videovideo
string required -
Video input (UUID or URL).
Generation Parameters
Core parameters for controlling the generated content.
-
model
string required value: memories:1@1 -
Identifier of the model to use for generation.
Learn more 3 resources
Harbor Festival Puppet Rehearsal
[0] (0s-7s): A man in a dark jacket gestures with his hands while speaking to a group of people gathered on a wooden pier. Behind him, a large, colorful bird puppet stands on display, its wings spread. Colorful flags and lanterns are strung overhead. Several people are seated on benches to the left, while others stand to the right, some holding musical instruments. The scene is set by a body of water with boats and a distant cityscape.{
"taskType": "caption",
"taskUUID": "8f8b6989-96fc-47c2-8bb5-bffce0493823",
"model": "memories:1@1",
"inputs": {
"video": "https://assets.runware.ai/assets/inputs/4e60cdc6-6f3a-4d29-9319-6dd8ba2caf8c.mp4"
}
}{
"taskType": "caption",
"taskUUID": "8f8b6989-96fc-47c2-8bb5-bffce0493823",
"text": "[0] (0s-7s): A man in a dark jacket gestures with his hands while speaking to a group of people gathered on a wooden pier. Behind him, a large, colorful bird puppet stands on display, its wings spread. Colorful flags and lanterns are strung overhead. Several people are seated on benches to the left, while others stand to the right, some holding musical instruments. The scene is set by a body of water with boats and a distant cityscape.",
"cost": 0.0015
}Windy Harbor Rescue Rehearsal
[0] (0s-3s): A man in a dark blue uniform stands on a wooden pier, pointing at a large map on an easel. He is surrounded by several people wearing orange life vests and dark pants. To the left, a rigid inflatable boat is docked in the water. The sky is overcast, and the sea is choppy.
[1] (3s-4s): The man in the uniform continues to gesture emphatically at the map while holding a walkie-talkie to his ear. The people in life vests stand attentively. The scene remains on the pier with the boat in the background.
[2] (4s-7s): Two individuals in orange life vests are inside a rigid inflatable boat, which is bobbing in the water near the pier. One person appears to be adjusting equipment, while the other is tending to a beige blanket covering something in the boat. Other boats are visible in the distance.{
"taskType": "caption",
"taskUUID": "fbe0f3d8-b9e3-44be-80a7-3459300c1593",
"model": "memories:1@1",
"inputs": {
"video": "https://assets.runware.ai/assets/inputs/d3523738-d309-453a-9502-391c347cb117.mp4"
}
}{
"taskType": "caption",
"taskUUID": "fbe0f3d8-b9e3-44be-80a7-3459300c1593",
"text": "[0] (0s-3s): A man in a dark blue uniform stands on a wooden pier, pointing at a large map on an easel. He is surrounded by several people wearing orange life vests and dark pants. To the left, a rigid inflatable boat is docked in the water. The sky is overcast, and the sea is choppy.\n[1] (3s-4s): The man in the uniform continues to gesture emphatically at the map while holding a walkie-talkie to his ear. The people in life vests stand attentively. The scene remains on the pier with the boat in the background.\n[2] (4s-7s): Two individuals in orange life vests are inside a rigid inflatable boat, which is bobbing in the water near the pier. One person appears to be adjusting equipment, while the other is tending to a beige blanket covering something in the boat. Other boats are visible in the distance.",
"cost": 0.0019
}Windy Rooftop Proposal Rehearsal
[0] (0s-7s): Two men stand on a rooftop overlooking a city skyline at dusk. A helicopter flies in the background. One man, wearing a blue button-down shirt, looks towards the other man who is wearing a grey jacket and holding a piece of paper. The man in the grey jacket appears to be speaking.{
"taskType": "caption",
"taskUUID": "8a34ac55-7011-4486-a334-d244ca97db3d",
"model": "memories:1@1",
"inputs": {
"video": "https://assets.runware.ai/assets/inputs/c66ee3e7-65b5-4c6c-bcef-525b8b904130.mp4"
}
}{
"taskType": "caption",
"taskUUID": "8a34ac55-7011-4486-a334-d244ca97db3d",
"text": "[0] (0s-7s): Two men stand on a rooftop overlooking a city skyline at dusk. A helicopter flies in the background. One man, wearing a blue button-down shirt, looks towards the other man who is wearing a grey jacket and holding a piece of paper. The man in the grey jacket appears to be speaking.",
"cost": 0.0014
}Windy Harbor Reunion Picnic
[0] (0s-2s): A family enjoys a picnic by the water. A woman in a yellow dress, a young girl in pink, an older woman in a blue shirt, and a man in a white polo shirt sit on a red and white checkered blanket. In front of them are sandwiches and strawberries. The water is calm with sailboats in the background.
[1] (2s-5s): A young boy, wearing a teal t-shirt with a dinosaur graphic, holds up a colorful kite. He is sitting with his family on a picnic blanket near the water. The other family members watch him.
[2] (5s-7s): The family smiles and poses for a photo, all holding up two fingers in a peace sign. The woman in yellow, the older woman, the boy, and the man are all looking at the camera. The young girl is also smiling.{
"taskType": "caption",
"taskUUID": "728d1620-a306-46a5-8dff-c6123f5429d9",
"model": "memories:1@1",
"inputs": {
"video": "https://assets.runware.ai/assets/inputs/42b64dcb-3c21-4b50-83ab-779d338dde47.mp4"
}
}{
"taskType": "caption",
"taskUUID": "728d1620-a306-46a5-8dff-c6123f5429d9",
"text": "[0] (0s-2s): A family enjoys a picnic by the water. A woman in a yellow dress, a young girl in pink, an older woman in a blue shirt, and a man in a white polo shirt sit on a red and white checkered blanket. In front of them are sandwiches and strawberries. The water is calm with sailboats in the background.\n[1] (2s-5s): A young boy, wearing a teal t-shirt with a dinosaur graphic, holds up a colorful kite. He is sitting with his family on a picnic blanket near the water. The other family members watch him.\n[2] (5s-7s): The family smiles and poses for a photo, all holding up two fingers in a peace sign. The woman in yellow, the older woman, the boy, and the man are all looking at the camera. The young girl is also smiling.",
"cost": 0.0012
}