live
MODEL IDheygen:video-translate@1.0

HeyGen Video Translate 1.0

HeyGen
by
Available with Zero Data Retention

HeyGen Video Translate 1.0 is a video translation model that transcribes the speech in a video, translates it, and dubs it in the speaker's cloned voice. It redraws the mouth to match the translated speech, with a speed mode for fast turnaround and a precision mode for higher lip sync quality on moving faces, side angles, and occlusions. It suits localization of marketing, training, and social video, with options for multiple speakers, partial translation, audio-only dubbing, and custom subtitles.

HeyGen Video Translate 1.0

API Options

Platform-level options for task execution and delivery.

taskType

stringrequiredvalue: videoInference

Identifier for the type of task being performed.

taskUUID

stringrequiredUUID v4

UUID v4 identifier for tracking tasks and matching async responses. Must be unique per task.

outputType

stringdefault: URL

Video output type.

Allowed values1 value

outputFormat

stringdefault: MP4

Specifies the file format of the generated output. The available values depend on the task type and the specific model's capabilities.

  • `MP4`: Widely supported video container (H.264), recommended for general use.
  • `WEBM`: Optimized for web delivery.
  • `MOV`: QuickTime format, common in professional workflows (Apple ecosystem).
Allowed values3 values

outputQuality

integermin: 20max: 99default: 95

Compression quality of the output. Higher values preserve quality but increase file size.

webhookURL

stringuri

Webhook URL that receives JSON responses via HTTP POST when generation tasks complete. For batch requests with multiple results, each completed item triggers a separate webhook call as it becomes available.

Learn more1 resource

deliveryMethod

stringdefault: async

Determines how the API delivers task results.

Allowed values2 values
Returns results directly in the API response. Over HTTP, a task still running after 120 seconds continues as an async task and comes back with status 'processing'. Poll for its results using getResponse.
Returns an immediate acknowledgment with the task UUID. Poll for results using getResponse.
Learn more1 resource

Specifies a URL where the generated content will be automatically uploaded using the HTTP PUT method. The raw binary data of the media file is sent directly as the request body. For secure uploads to cloud storage, use presigned URLs that include temporary authentication credentials.

Common use cases:

  • Cloud storage: Upload directly to S3 buckets, Google Cloud Storage, or Azure Blob Storage using presigned URLs.
  • CDN integration: Upload to content delivery networks for immediate distribution.
// S3 presigned URL for secure upload
https://your-bucket.s3.amazonaws.com/generated/content.mp4?X-Amz-Signature=abc123&X-Amz-Expires=3600

// Google Cloud Storage presigned URL
https://storage.googleapis.com/your-bucket/content.jpg?X-Goog-Signature=xyz789

// Custom storage endpoint
https://storage.example.com/uploads/generated-image.jpg

The content data will be sent as the request body to the specified URL when generation is complete.

safety

object

Content safety checking configuration for video generation.

Properties2 properties
safety » checkContent

Enable or disable content safety checking. Increases total generation time.

safety » mode

mode

stringdefault: fast

Safety checking mode for video generation.

Allowed values2 values
Checks key frames.
Checks all frames.

ttl

integermin: 60

Time-to-live (TTL) in seconds for generated content. Only applies when outputType is URL.

Include task cost in the response.

numberResults

integermin: 1max: 4default: 1

Number of results to generate. Each result uses a different seed, producing variations of the same parameters.

Inputs

Input resources for the task (images, audio, etc). These must be nested inside the inputs object.

inputs » video

video

string | objectrequired

Video input (UUID or URL). Also accepted as an object that adds the language spoken in the video.

inputs » audio

audio

string

Audio input (UUID or URL). Custom audio track the video is dubbed with. Its length must be within 15% of the length of inputs.video.

inputs » subtitles

subtitles

string | object1 limit

Document input (UUID, URL, or Base64). Custom subtitle file used in place of the automatic transcript or translation. Also accepted as an object that adds the role of the file.

Core Parameters

Primary parameters that define the task output.

model

stringrequiredvalue: heygen:video-translate@1.0

Send auto instead of an AIR identifier to have the model router choose the model for this task. The rest of the request is unchanged, every value you send is kept, and only the parameters you leave out are filled in. See Model Router.

Learn more3 resources

speech

objectrequired

Settings for speech generation.

Properties1 property
speech » language

language

stringrequiredmin: 1

Language code for speech generation. The speech in the video is translated into this language.

Allowed values190 values

Settings

Technical parameters to fine-tune the inference process. These must be nested inside the settings object.

settings » dynamicDuration

dynamicDuration

booleandefault: true

Lets the output grow or shrink to match the pacing of the translated speech. When disabled, the output keeps the source length.

settings » endTime

endTime

float

End time in seconds of the part of the video to translate. Must be greater than startTime.

settings » enhanceSpeech

Enhances the quality of the speech.

settings » fpsMode

fpsMode

string

Frame rate mode of the output video.

Allowed values3 values
Variable frame rate.
Constant frame rate.
Frame rate of the source video.
settings » keepSourceFormat

Keeps the resolution and bitrate of the source video.

settings » mode

mode

stringdefault: speed

Speed and quality trade-off of the translation.

Allowed values2 values
Faster turnaround with standard lip sync.
Context-aware translation and higher lip sync quality, with longer processing.
settings » removeBackgroundMusic

Removes the background music track.

settings » speakerCount

speakerCount

integermin: 1max: 10

Number of speakers in the video. Improves speaker separation.

settings » startTime

startTime

floatmin: 0

Start time in seconds of the part of the video to translate.

settings » translateAudioOnly

Translates the audio and keeps the original video, with no lip sync.