Sync Lipsync 3 | AI Digital Human API

LipSync-3

LipSync-3 is Sync's advanced lip synchronization model. Upload a video and an audio track — the model automatically syncs the speaker's lip movements to the new audio with high accuracy and natural motion. Supports multiple sync modes to handle length mismatches between video and audio.

Why Choose This?

High-accuracy lip synchronization Precisely maps audio phonemes to lip movements for natural, believable sync across a wide range of speakers and languages.
Flexible sync mode control Choose how the model handles video-audio length mismatches — loop, bounce, cut off, silence, or remap — to fit your specific use case.
Broad video compatibility Works on talking head videos, interviews, presentations, and any footage with visible facial movement.
Simple two-input workflow Just a video and an audio file — no manual keyframing, no masking, no technical setup required.

Parameters

Parameter	Required	Description
video	Yes	Input video to apply lip sync to (URL or file upload).
audio	Yes	Audio track to sync the lip movements to (URL, file upload, or microphone recording).
sync_mode	No	How to handle video-audio length mismatches. Options: bounce, loop, cut_off (default), silence, remap.

Sync Mode Options

cut_off — Cuts the output at whichever is shorter, video or audio.
loop — Loops the video to match the length of the audio.
bounce — Plays the video forward then backward repeatedly to match audio length.
silence — Pads the shorter input with silence or a still frame to match the longer one.
remap — Remaps the video timing to match the audio duration.

How to Use

Upload your video — provide the talking head or speaker video via URL or drag-and-drop.
Upload your audio — provide the replacement audio track via URL, file upload, or microphone recording.
Select sync_mode (optional) — choose how to handle length differences between the video and audio.
Submit — generate, preview, and download your lip-synced video.

Pricing

$0.134 per second of input video.

Best Use Cases

Dubbing & Localization — Replace the original audio with a translated voiceover and sync lip movements to match.
Voice Replacement — Swap out a speaker's audio while maintaining natural facial animation.
AI Avatar Video — Generate talking head videos with custom audio for virtual presenters and digital avatars.
Content Repurposing — Update or correct existing video audio without reshooting.
Accessibility — Create lip-synced versions of content for accessibility and localization workflows.

Pro Tips

Use clean, well-lit talking head footage with a clearly visible face for the most accurate sync results.
Minimize background noise in your audio track — cleaner audio produces better phoneme mapping.
If your audio is shorter than your video, use cut_off or silence mode depending on whether you want the video trimmed or padded.
For seamless looping content, bounce or loop modes work well when the video is shorter than the audio.

Notes

Both video and audio are required fields.
Pricing is based on the duration of the input video at $0.134 per second.
Ensure video and audio URLs are publicly accessible if using links rather than direct uploads.

Lipsync 3 API — Quick start

Grab a WaveSpeedAI API key, then call POST https://api.wavespeed.ai/api/v3/sync/lipsync-3 with your input as JSON. The endpoint returns a prediction id; poll the prediction endpoint until status flips to completed, then read the output URL from data.outputs[0]. Examples for Lipsync 3 below.

HTTP example

# Submit the prediction
curl -X POST "https://api.wavespeed.ai/api/v3/sync/lipsync-3" \
  -H "Content-Type: application/json" \
  -H "Authorization: Bearer $WAVESPEED_API_KEY" \
  -d '{
    "video": "https://example.com/your-input.mp4",
    "audio": "https://example.com/your-audio.mp3",
    "sync_mode": "cut_off"
}'

# Response includes a prediction id. Poll for the result:
curl -X GET "https://api.wavespeed.ai/api/v3/predictions/{request_id}/result" \
  -H "Authorization: Bearer $WAVESPEED_API_KEY"

# When status is "completed", read the output from data.outputs[0].

Node.js example

// npm install wavespeed
const WaveSpeed = require('wavespeed');

const client = new WaveSpeed(); // reads WAVESPEED_API_KEY from env

const result = await client.run("sync/lipsync-3", {
        "video": "https://example.com/your-input.mp4",
        "audio": "https://example.com/your-audio.mp3",
        "sync_mode": "cut_off"
});

console.log(result.outputs[0]); // → URL of the generated output

Python example

# pip install wavespeed
import wavespeed

output = wavespeed.run(
    "sync/lipsync-3",
    {
    "video": "https://example.com/your-input.mp4",
    "audio": "https://example.com/your-audio.mp3",
    "sync_mode": "cut_off"
}
)

print(output["outputs"][0])  # → URL of the generated output

Lipsync 3 API — Frequently asked questions

What is the Lipsync 3 API?

Lipsync 3 is a Sync model for talking-avatar generation, exposed as a REST API on WaveSpeedAI. Sync Lipsync 3 synchronizes lip movements in any video to supplied audio using zero-shot lip-sync technology. Supports multiple sync modes for handling duration mismatches, works with live-action, 3D characters, and AI-generated avatars. Ready-to-use REST inference API, best performance, no coldstarts, affordable pricing. You can call it programmatically or try it from the playground above.

How do I call the Lipsync 3 API?

POST your input parameters to the model's REST endpoint (shown in the API tab of this playground) with your WaveSpeedAI API key in the Authorization header. Submission returns a prediction ID; poll the prediction endpoint until status flips to "completed", then read the output URL from the result. The playground generates a ready-to-paste code sample in Python, JavaScript, or cURL for whatever inputs you've set. Full request/response shape is documented at https://wavespeed.ai/docs/docs-api/sync/sync-lipsync-3.

How much does Lipsync 3 cost per run?

Lipsync 3 starts at $0.13 per run. That figure is the base price — the final charge scales with the parameters you set in the form (output size, length, count, references, or whatever knobs this model exposes), so a higher-quality or larger output costs more than a minimal one. The exact cost for your current input is shown live next to the Generate button before you submit, and the actual per-call charge is recorded on the prediction afterwards.

What inputs does Lipsync 3 accept?

Key inputs: `video`, `audio`, `sync_mode`. The full JSON schema (types, defaults, allowed values) is rendered above the Generate button and mirrored in the API reference at https://wavespeed.ai/docs/docs-api/sync/sync-lipsync-3.

How do I get started with the Lipsync 3 API?

Sign up for a free WaveSpeedAI account to claim starter credits, copy your API key from /accesskey, then call the endpoint shown in the API tab of the playground. The playground also auto-generates a code sample in Python, JavaScript, or cURL for the parameters you've set.

Can I use Lipsync 3 outputs commercially?

Commercial usage rights depend on the model's license, set by its provider (Sync). The license summary appears on the model card above; see WaveSpeedAI's Terms of Service for platform-level conditions.

ExamplesView all

Related Models

README