Infinitetalk Video To Video Multi
Playground
Try it on WavespeedAI!InfiniteTalk Video-to-Video Multi converts a video and two audio inputs into multi-character talking or singing videos at up to 720p. Ready-to-use REST inference API, best performance, no coldstarts, affordable pricing.
Features
InfiniteTalk Video-to-Video Multi
InfiniteTalk Video-to-Video Multi creates lip-synced videos for multiple characters by combining an input video with two audio tracks. It maintains identity across unlimited-length videos, ensuring precise lip synchronization while matching head, face, and body movements to each audio source — perfect for dialogues, interviews, and multi-speaker content.
Why Choose This?
-
Multi-character lip sync Synchronizes lip motion precisely with audio for two characters simultaneously.
-
Flexible speaking order Choose left-to-right, right-to-left, or simultaneous (meanwhile) speaking patterns.
-
Full-body coherence Captures head movements, facial expressions, and posture changes beyond the lips.
-
Identity preservation Maintains consistent facial identity and visual style across all frames.
-
Mask control Optional mask images define which regions can move for precise control.
-
Long-form support Process videos up to 10 minutes in length with consistent quality.
Parameters
| Parameter | Required | Description |
|---|---|---|
| video | Yes | Source video with two visible characters |
| left_audio | Yes | Audio track for the left character |
| right_audio | Yes | Audio track for the right character |
| mask_image | No | Mask defining animatable regions |
| prompt | No | Text prompt to guide scene or behavior |
| order | No | Speaking order: meanwhile, left_right, or right_left |
| resolution | No | Output resolution: 480p (default) or 720p |
| seed | No | Random seed for reproducibility (-1 for random) |
How to Use
- Upload your video — provide a video clearly showing two people.
- Upload left audio — add audio file for the left character.
- Upload right audio — add audio file for the right character.
- Add mask image (optional) — define which regions should animate.
- Write prompt (optional) — guide scene, pose, or behavior.
- Select speaking order — choose meanwhile (simultaneous), left_right, or right_left.
- Choose resolution — 480p for faster processing, 720p for higher quality.
- Run — submit and download your lip-synced video.
Pricing
| Resolution | Cost per 5s | Per-Second Rate |
|---|---|---|
| 480p | $0.15 | $0.03/s |
| 720p | $0.30 | $0.06/s |
Billing Rules
- Minimum charge: 5 seconds ($0.15 at 480p, $0.30 at 720p)
- Maximum duration: 600 seconds (10 minutes)
- Duration calculation:
- Sequential (left_right / right_left): left_audio + right_audio
- Simultaneous (meanwhile): max(left_audio, right_audio)
Best Use Cases
- Dialogue Scenes — Create realistic conversations between two characters.
- Interview Content — Generate interviewer-interviewee videos with synced audio.
- Podcast Visuals — Add visual elements to two-person podcast recordings.
- Educational Content — Create instructor dialogues and Q&A sessions.
- Digital Presenters — Build multi-character presentation videos.
Pro Tips
- Ensure both characters are clearly visible in the source video.
- Use “meanwhile” for overlapping dialogue or simultaneous speech.
- Use “left_right” or “right_left” for sequential conversation flow.
- Mask only the regions you want to animate — uploading the full image as mask will result in a black output.
- Higher quality source videos produce better lip-sync results.
Notes
- Maximum video length: 10 minutes (600 seconds).
- Processing time: approximately 10–30 seconds per 1 second of video.
- Mask safety: Do not upload the full image as mask — only cover animatable regions.
- Ensure uploaded file URLs are publicly accessible.
Related Models
- InfiniteTalk Video-to-Video — Single-character video-to-video lip sync.
- InfiniteTalk Multi — Multi-character image-to-video.
- InfiniteTalk — Single-character image-to-video lip sync.
Reference
Authentication
For authentication details, please refer to the Authentication Guide.
API Endpoints
Submit Task & Query Result
# Submit the task
curl --location --request POST "https://api.wavespeed.ai/api/v3/wavespeed-ai/infinitetalk/video-to-video-multi" \
--header "Content-Type: application/json" \
--header "Authorization: Bearer ${WAVESPEED_API_KEY}" \
--data-raw '{
"order": "meanwhile",
"resolution": "480p",
"seed": -1
}'
# Get the result
curl --location --request GET "https://api.wavespeed.ai/api/v3/predictions/${requestId}/result" \
--header "Authorization: Bearer ${WAVESPEED_API_KEY}"
Parameters
Task Submission Parameters
Request Parameters
| Parameter | Type | Required | Default | Range | Description |
|---|---|---|---|---|---|
| video | string | Yes | - | The video for generating the output. | |
| left_audio | string | Yes | - | - | The audio of the persion on the left for generating the output. |
| right_audio | string | Yes | - | - | The audio of the persion on the right for generating the output. |
| prompt | string | No | - | The positive prompt for the generation. | |
| order | string | No | meanwhile | meanwhile, left_right, right_left | The order of the two audio sources in the output video, "meanwhile" means both audio sources will play at the same time, "left_right" means the left audio will play first then the right audio will play, "right_left" means the right audio will play first then the left audio will play. |
| resolution | string | No | 480p | 480p, 720p | The resolution of the output video. |
| seed | integer | No | -1 | -1 ~ 2147483647 | The random seed to use for the generation. -1 means a random seed will be used. |
Response Parameters
| Parameter | Type | Description |
|---|---|---|
| code | integer | HTTP status code (e.g., 200 for success) |
| message | string | Status message (e.g., “success”) |
| data.id | string | Unique identifier for the prediction, Task Id |
| data.model | string | Model ID used for the prediction |
| data.outputs | array | Array of URLs to the generated content (empty when status is not completed) |
| data.urls | object | Object containing related API endpoints |
| data.urls.get | string | URL to retrieve the prediction result |
| data.has_nsfw_contents | array | Array of boolean values indicating NSFW detection for each output |
| data.status | string | Status of the task: created, processing, completed, or failed |
| data.created_at | string | ISO timestamp of when the request was created (e.g., “2023-04-01T12:34:56.789Z”) |
| data.error | string | Error message (empty if no error occurred) |
| data.timings | object | Object containing timing details |
| data.timings.inference | integer | Inference time in milliseconds |
Result Request Parameters
| Parameter | Type | Required | Default | Description |
|---|---|---|---|---|
| id | string | Yes | - | Task ID |
Result Response Parameters
| Parameter | Type | Description |
|---|---|---|
| code | integer | HTTP status code (e.g., 200 for success) |
| message | string | Status message (e.g., “success”) |
| data | object | The prediction data object containing all details |
| data.id | string | Unique identifier for the prediction, the ID of the prediction to get |
| data.model | string | Model ID used for the prediction |
| data.outputs | string | Array of URLs to the generated content (empty when status is not completed). |
| data.urls | object | Object containing related API endpoints |
| data.urls.get | string | URL to retrieve the prediction result |
| data.status | string | Status of the task: created, processing, completed, or failed |
| data.created_at | string | ISO timestamp of when the request was created (e.g., “2023-04-01T12:34:56.789Z”) |
| data.error | string | Error message (empty if no error occurred) |
| data.timings | object | Object containing timing details |
| data.timings.inference | integer | Inference time in milliseconds |