sync-3

sync-3 is a lip synchronization model that processes entire shots as a single generation rather than stitching independent segments. It builds a global understanding of the speaker across all frames, enabling consistent output on close-ups, extreme face angles, partially obscured faces, and obstructed mouths. The model preserves the original speaker's style, cadence, and emotional expression across 95+ languages.

Complete technical specification for integration
API Options
Platform-level options for task execution and delivery.
taskType
stringrequiredvalue: videoInferenceIdentifier for the type of task being performed
taskUUID
stringrequiredUUID v4UUID v4 identifier for tracking tasks and matching async responses. Must be unique per task.
outputType
stringdefault: URLVideo output type.
Allowed values1 value
outputFormat
stringdefault: MP4Specifies the file format of the generated output. The available values depend on the task type and the specific model's capabilities.
- `MP4`: Widely supported video container (H.264), recommended for general use.
- `WEBM`: Optimized for web delivery.
- `MOV`: QuickTime format, common in professional workflows (Apple ecosystem).
Allowed values3 values
outputQuality
integermin: 20max: 99default: 95Compression quality of the output. Higher values preserve quality but increase file size.
webhookURL
stringURISpecifies a webhook URL where JSON responses will be sent via HTTP POST when generation tasks complete. For batch requests with multiple results, each completed item triggers a separate webhook call as it becomes available.
Learn more1 resource
- WebhooksPLATFORM
- Webhooks
deliveryMethod
stringdefault: asyncDetermines how the API delivers task results.
Allowed values1 value
- Returns an immediate acknowledgment with the task UUID. Poll for results using getResponse. Required for long-running tasks like video generation.
Learn more1 resource
- Task PollingPLATFORM
uploadEndpoint
stringURISpecifies a URL where the generated content will be automatically uploaded using the HTTP PUT method. The raw binary data of the media file is sent directly as the request body. For secure uploads to cloud storage, use presigned URLs that include temporary authentication credentials.
Common use cases:
- Cloud storage: Upload directly to S3 buckets, Google Cloud Storage, or Azure Blob Storage using presigned URLs.
- CDN integration: Upload to content delivery networks for immediate distribution.
// S3 presigned URL for secure upload https://your-bucket.s3.amazonaws.com/generated/content.mp4?X-Amz-Signature=abc123&X-Amz-Expires=3600 // Google Cloud Storage presigned URL https://storage.googleapis.com/your-bucket/content.jpg?X-Goog-Signature=xyz789 // Custom storage endpoint https://storage.example.com/uploads/generated-image.jpgThe content data will be sent as the request body to the specified URL when generation is complete.
safety
objectContent safety checking configuration for video generation.
Properties2 properties
safety»checkContentcheckContent
booleandefault: falseEnable or disable content safety checking.
safety»modemode
stringdefault: noneSafety checking mode for video generation.
Allowed values3 values
- Disables checking.
- Checks key frames.
- Checks all frames.
ttl
integermin: 60Time-to-live (TTL) in seconds for generated content. Only applies when
outputTypeisURL.
includeCost
booleandefault: falseInclude task cost in the response.
numberResults
integermin: 1max: 4default: 1Number of results to generate. Each result uses a different seed, producing variations of the same parameters.
Inputs
Input resources for the task (images, audio, etc). These must be nested inside the inputs object.
inputs object.Core Parameters
Primary parameters that define the task output.
Settings
Technical parameters to fine-tune the inference process. These must be nested inside the settings object.
settings object.settings»temperaturetemperature
floatmin: 0max: 1step: 0.01default: 0.5Expressiveness of lip sync and facial movements.
settings»activeSpeakerDetectionactiveSpeakerDetection
objectSpeaker-targeting for multi-person clips.
Properties4 properties
settings»activeSpeakerDetection»autoDetectautoDetect
booleandefault: falseAutomatically detect and target the active speaker.
settings»activeSpeakerDetection»boundingBoxesboundingBoxes
array of arraysPer-frame face bounding boxes across the clip. Each box is [x1, y1, x2, y2].
settings»activeSpeakerDetection»coordinatescoordinates
array of numbersitems: 2[x, y] point on the target speaker's face in the selected frame.
settings»emotionemotion
stringEmotional tone for performance re-animation.
Allowed values6 values
settings»modemode
stringControls the region of facial animation applied during lip sync.
Allowed values3 values
settings»occlusionDetectionocclusionDetection
booleandefault: falseEnable occlusion handling for obstructed faces.
settings»segmentssegments
array of objectsmin items: 1Time segments with audio sources for segmented lip sync workflows.
Properties5 properties
settings»segments»startTimestartTime
floatrequiredmin: 0step: 0.01Start time in seconds for the segment.
settings»segments»endTimeendTime
floatrequiredstep: 0.01End time in seconds for the segment. Must be greater than startTime.
settings»segments»audioaudio
stringrequiredAudio source URL for this segment.
settings»segments»audioStartTimeaudioStartTime
floatmin: 0step: 0.01default: 0Start time in seconds within the source audio file.
settings»segments»audioEndTimeaudioEndTime
floatmin: 0step: 0.01End time in seconds within the source audio file.
settings»syncModesyncMode
stringdefault: cut_offSynchronization strategy when audio and video durations don't match.
Allowed values4 values
- Audio bounces back and forth to fill video duration.
- Audio is cut when video ends.
- Remaining video plays with silence after audio ends.
- Audio is time-stretched or compressed to match video duration.
settings»ttstts
objectConfiguration for the text-to-speech provider used with speech input.
Properties3 properties
settings»tts»providerprovider
stringdefault: elevenlabsName of the TTS provider.
settings»tts»stabilitystability
floatmin: 0max: 1Voice stability for the TTS provider. Higher values produce more consistent output.
settings»tts»similarityBoostsimilarityBoost
floatmin: 0max: 1Voice similarity enforcement for the TTS provider. Higher values make the voice more closely match the target.