Infinitetalk Video to Video Multi | AI Digital Human API

InfiniteTalk Video-to-Video Multi

InfiniteTalk Video-to-Video Multi creates lip-synced videos for multiple characters by combining an input video with two audio tracks. It maintains identity across unlimited-length videos, ensuring precise lip synchronization while matching head, face, and body movements to each audio source — perfect for dialogues, interviews, and multi-speaker content.

Why Choose This?

Multi-character lip sync Synchronizes lip motion precisely with audio for two characters simultaneously.
Flexible speaking order Choose left-to-right, right-to-left, or simultaneous (meanwhile) speaking patterns.
Full-body coherence Captures head movements, facial expressions, and posture changes beyond the lips.
Identity preservation Maintains consistent facial identity and visual style across all frames.
Mask control Optional mask images define which regions can move for precise control.
Long-form support Process videos up to 10 minutes in length with consistent quality.

Parameters

Parameter	Required	Description
video	Yes	Source video with two visible characters
left_audio	Yes	Audio track for the left character
right_audio	Yes	Audio track for the right character
mask_image	No	Mask defining animatable regions
prompt	No	Text prompt to guide scene or behavior
order	No	Speaking order: meanwhile, left_right, or right_left
resolution	No	Output resolution: 480p (default) or 720p
seed	No	Random seed for reproducibility (-1 for random)

How to Use

Upload your video — provide a video clearly showing two people.
Upload left audio — add audio file for the left character.
Upload right audio — add audio file for the right character.
Add mask image (optional) — define which regions should animate.
Write prompt (optional) — guide scene, pose, or behavior.
Select speaking order — choose meanwhile (simultaneous), left_right, or right_left.
Choose resolution — 480p for faster processing, 720p for higher quality.
Run — submit and download your lip-synced video.

Pricing

Resolution	Cost per 5s	Per-Second Rate
480p	$0.15	$0.03/s
720p	$0.30	$0.06/s

Billing Rules

Minimum charge: 5 seconds ($0.15 at 480p, $0.30 at 720p)
Maximum duration: 600 seconds (10 minutes)
Duration calculation:
Sequential (left_right / right_left): left_audio + right_audio
Simultaneous (meanwhile): max(left_audio, right_audio)

Best Use Cases

Dialogue Scenes — Create realistic conversations between two characters.
Interview Content — Generate interviewer-interviewee videos with synced audio.
Podcast Visuals — Add visual elements to two-person podcast recordings.
Educational Content — Create instructor dialogues and Q&A sessions.
Digital Presenters — Build multi-character presentation videos.

Pro Tips

Ensure both characters are clearly visible in the source video.
Use "meanwhile" for overlapping dialogue or simultaneous speech.
Use "left_right" or "right_left" for sequential conversation flow.
Mask only the regions you want to animate — uploading the full image as mask will result in a black output.
Higher quality source videos produce better lip-sync results.

Notes

Maximum video length: 10 minutes (600 seconds).
Processing time: approximately 10–30 seconds per 1 second of video.
Mask safety: Do not upload the full image as mask — only cover animatable regions.
Ensure uploaded file URLs are publicly accessible.

Related Models

InfiniteTalk Video-to-Video — Single-character video-to-video lip sync.
InfiniteTalk Multi — Multi-character image-to-video.
InfiniteTalk — Single-character image-to-video lip sync.

Reference

Build your own digital human

Infinitetalk Video To Video Multi API — Quick start

Grab a WaveSpeedAI API key, then call POST https://api.wavespeed.ai/api/v3/wavespeed-ai/infinitetalk/video-to-video-multi with your input as JSON. The endpoint returns a prediction id; poll the prediction endpoint until status flips to completed, then read the output URL from data.outputs[0]. Examples for Infinitetalk Video To Video Multi below.

HTTP example

# Submit the prediction
curl -X POST "https://api.wavespeed.ai/api/v3/wavespeed-ai/infinitetalk/video-to-video-multi" \
  -H "Content-Type: application/json" \
  -H "Authorization: Bearer $WAVESPEED_API_KEY" \
  -d '{
    "video": "https://example.com/your-input.mp4",
    "prompt": "A cinematic shot of a city at sunset, soft golden light",
    "order": "meanwhile",
    "resolution": "480p",
    "seed": -1
}'

# Response includes a prediction id. Poll for the result:
curl -X GET "https://api.wavespeed.ai/api/v3/predictions/{request_id}/result" \
  -H "Authorization: Bearer $WAVESPEED_API_KEY"

# When status is "completed", read the output from data.outputs[0].

Node.js example

// npm install wavespeed
const WaveSpeed = require('wavespeed');

const client = new WaveSpeed(); // reads WAVESPEED_API_KEY from env

const result = await client.run("wavespeed-ai/infinitetalk/video-to-video-multi", {
        "video": "https://example.com/your-input.mp4",
        "prompt": "A cinematic shot of a city at sunset, soft golden light",
        "order": "meanwhile",
        "resolution": "480p",
        "seed": -1
});

console.log(result.outputs[0]); // → URL of the generated output

Python example

# pip install wavespeed
import wavespeed

output = wavespeed.run(
    "wavespeed-ai/infinitetalk/video-to-video-multi",
    {
    "video": "https://example.com/your-input.mp4",
    "prompt": "A cinematic shot of a city at sunset, soft golden light",
    "order": "meanwhile",
    "resolution": "480p",
    "seed": -1
}
)

print(output["outputs"][0])  # → URL of the generated output

Infinitetalk Video To Video Multi API — Frequently asked questions

What is the Infinitetalk Video To Video Multi API?

Infinitetalk Video To Video Multi is a WaveSpeedAI model for talking-avatar generation, exposed as a REST API on WaveSpeedAI. InfiniteTalk Video-to-Video Multi converts a video and two audio inputs into multi-character talking or singing videos at up to 720p. Ready-to-use REST inference API, best performance, no coldstarts, affordable pricing. You can call it programmatically or try it from the playground above.

How do I call the Infinitetalk Video To Video Multi API?

POST your input parameters to the model's REST endpoint (shown in the API tab of this playground) with your WaveSpeedAI API key in the Authorization header. Submission returns a prediction ID; poll the prediction endpoint until status flips to "completed", then read the output URL from the result. The playground generates a ready-to-paste code sample in Python, JavaScript, or cURL for whatever inputs you've set. Full request/response shape is documented at https://wavespeed.ai/docs/docs-api/wavespeed-ai/infinitetalk-video-to-video-multi.

How much does Infinitetalk Video To Video Multi cost per run?

Infinitetalk Video To Video Multi starts at $0.15 per run. That figure is the base price — the final charge scales with the parameters you set in the form (output size, length, count, references, or whatever knobs this model exposes), so a higher-quality or larger output costs more than a minimal one. The exact cost for your current input is shown live next to the Generate button before you submit, and the actual per-call charge is recorded on the prediction afterwards.

What inputs does Infinitetalk Video To Video Multi accept?

Key inputs: `prompt`, `video`, `resolution`, `seed`, `left_audio`, `order`. The full JSON schema (types, defaults, allowed values) is rendered above the Generate button and mirrored in the API reference at https://wavespeed.ai/docs/docs-api/wavespeed-ai/infinitetalk-video-to-video-multi.

How do I get started with the Infinitetalk Video To Video Multi API?

Sign up for a free WaveSpeedAI account to claim starter credits, copy your API key from /accesskey, then call the endpoint shown in the API tab of the playground. The playground also auto-generates a code sample in Python, JavaScript, or cURL for the parameters you've set.

Can I use Infinitetalk Video To Video Multi outputs commercially?

Commercial usage rights depend on the model's license, set by its provider (WaveSpeedAI). The license summary appears on the model card above; see WaveSpeedAI's Terms of Service for platform-level conditions.

ExamplesView all

Related Models

README

InfiniteTalk Video-to-Video Multi

Why Choose This?

Parameters

How to Use

Pricing

Billing Rules

Best Use Cases

Pro Tips

Notes

Related Models

Reference

Infinitetalk Video To Video Multi API — Quick start

Infinitetalk Video To Video Multi API — Frequently asked questions