HeyGen Video Translate 1.0

HeyGen Video Translate 1.0 is a video translation model that transcribes the speech in a video, translates it, and dubs it in the speaker's cloned voice. It redraws the mouth to match the translated speech, with a speed mode for fast turnaround and a precision mode for higher lip sync quality on moving faces, side angles, and occlusions. It suits localization of marketing, training, and social video, with options for multiple speakers, partial translation, audio-only dubbing, and custom subtitles.

Complete technical specification for integration
Ready-to-use code snippets for common workflows
API Options
Platform-level options for task execution and delivery.
taskType
stringrequiredvalue: videoInferenceIdentifier for the type of task being performed.
taskUUID
stringrequiredUUID v4UUID v4 identifier for tracking tasks and matching async responses. Must be unique per task.
outputType
stringdefault: URLVideo output type.
Allowed values1 value
outputFormat
stringdefault: MP4Specifies the file format of the generated output. The available values depend on the task type and the specific model's capabilities.
- `MP4`: Widely supported video container (H.264), recommended for general use.
- `WEBM`: Optimized for web delivery.
- `MOV`: QuickTime format, common in professional workflows (Apple ecosystem).
Allowed values3 values
outputQuality
integermin: 20max: 99default: 95Compression quality of the output. Higher values preserve quality but increase file size.
webhookURL
stringuriWebhook URL that receives JSON responses via HTTP POST when generation tasks complete. For batch requests with multiple results, each completed item triggers a separate webhook call as it becomes available.
Learn more1 resource
- WebhooksPLATFORM
- Webhooks
deliveryMethod
stringdefault: asyncDetermines how the API delivers task results.
Allowed values2 values
- Returns results directly in the API response. Over HTTP, a task still running after 120 seconds continues as an async task and comes back with status 'processing'. Poll for its results using getResponse.
- Returns an immediate acknowledgment with the task UUID. Poll for results using getResponse.
Learn more1 resource
- Task PollingPLATFORM
uploadEndpoint
stringuriSpecifies a URL where the generated content will be automatically uploaded using the HTTP PUT method. The raw binary data of the media file is sent directly as the request body. For secure uploads to cloud storage, use presigned URLs that include temporary authentication credentials.
Common use cases:
- Cloud storage: Upload directly to S3 buckets, Google Cloud Storage, or Azure Blob Storage using presigned URLs.
- CDN integration: Upload to content delivery networks for immediate distribution.
// S3 presigned URL for secure upload https://your-bucket.s3.amazonaws.com/generated/content.mp4?X-Amz-Signature=abc123&X-Amz-Expires=3600 // Google Cloud Storage presigned URL https://storage.googleapis.com/your-bucket/content.jpg?X-Goog-Signature=xyz789 // Custom storage endpoint https://storage.example.com/uploads/generated-image.jpgThe content data will be sent as the request body to the specified URL when generation is complete.
safety
objectContent safety checking configuration for video generation.
Properties2 properties
safety»checkContentcheckContent
booleanEnable or disable content safety checking. Increases total generation time.
safety»modemode
stringdefault: fastSafety checking mode for video generation.
Allowed values2 values
- Checks key frames.
- Checks all frames.
ttl
integermin: 60Time-to-live (TTL) in seconds for generated content. Only applies when
outputTypeisURL.
includeCost
booleanInclude task cost in the response.
numberResults
integermin: 1max: 4default: 1Number of results to generate. Each result uses a different seed, producing variations of the same parameters.
Inputs
Input resources for the task (images, audio, etc). These must be nested inside the inputs object.
inputs object.inputs»videovideo
string | objectrequiredVideo input (UUID or URL). Also accepted as an object that adds the language spoken in the video.
inputs»audioaudio
stringAudio input (UUID or URL). Custom audio track the video is dubbed with. Its length must be within 15% of the length of
inputs.video.
inputs»subtitlessubtitles
string | object1 limitDocument input (UUID, URL, or Base64). Custom subtitle file used in place of the automatic transcript or translation. Also accepted as an object that adds the role of the file.
Core Parameters
Primary parameters that define the task output.
model
stringrequiredvalue: heygen:video-translate@1.0Send
autoinstead of an AIR identifier to have the model router choose the model for this task. The rest of the request is unchanged, every value you send is kept, and only the parameters you leave out are filled in. See Model Router.Learn more3 resources
Settings
Technical parameters to fine-tune the inference process. These must be nested inside the settings object.
settings object.settings»dynamicDurationdynamicDuration
booleandefault: trueLets the output grow or shrink to match the pacing of the translated speech. When disabled, the output keeps the source length.
settings»endTimeendTime
floatEnd time in seconds of the part of the video to translate. Must be greater than
startTime.
settings»enhanceSpeechenhanceSpeech
booleanEnhances the quality of the speech.
settings»fpsModefpsMode
stringFrame rate mode of the output video.
Allowed values3 values
- Variable frame rate.
- Constant frame rate.
- Frame rate of the source video.
settings»keepSourceFormatkeepSourceFormat
booleanKeeps the resolution and bitrate of the source video.
settings»modemode
stringdefault: speedSpeed and quality trade-off of the translation.
Allowed values2 values
- Faster turnaround with standard lip sync.
- Context-aware translation and higher lip sync quality, with longer processing.
settings»removeBackgroundMusicremoveBackgroundMusic
booleanRemoves the background music track.
settings»speakerCountspeakerCount
integermin: 1max: 10Number of speakers in the video. Improves speaker separation.
settings»startTimestartTime
floatmin: 0Start time in seconds of the part of the video to translate.
settings»translateAudioOnlytranslateAudioOnly
booleanTranslates the audio and keeps the original video, with no lip sync.