# Sync Lipsync 3 API

> 将任何说话视频的嘴部动作重新调整到新的音轨。

Sync Labs 的 lipsync-3 替换视频中人物的嘴部动作，使其匹配新的声音轨道，用于 配音、广告本地化以及后期修正台词。当音频和视频时长不一致时，可选择裁剪、循环、往返、 填充静音或重新映射。

- Model id: `sync-lipsync/v3`
- Made by: Sync Labs
- Category: Lipsync & Avatars
- Output: video
- Price per minute of your output video: $8.00 / minute of output video (cheapest run $8.00 (8000 API credits))
- Run: `POST https://api.doitong.com/v1/run/sync-lipsync/v3`
- Quote: `POST https://api.doitong.com/v1/quote/sync-lipsync/v3`
- Docs page: https://doitong.com/zh-CN/developers/models/sync-lipsync/v3

## Pricing

Price: **$8.00 / minute of output video**. Price per minute of your output video: the input files are measured before the run (length, resolution, frame rate). The quote measures the same files and is exactly what the run charges.

The full example input below costs $1.334 = 1334 API credits (0.1667 min output video × $8.00).

Prices are the upstream price in USD, paid from the API balance in API credits (1000 API credits = 1 USD). `POST https://api.doitong.com/v1/quote/sync-lipsync/v3` with the same JSON body returns the exact price for that input; the quote is exactly what a run charges. Invalid input is never charged and failed or canceled requests are refunded automatically.

## Input parameters

Send either the canonical name or the native field name (not both). Canonical names are the same across models.

| Parameter | Canonical name | Type | Required | Default | Allowed values / range | Description |
|---|---|---|---|---|---|---|
| `video_url` | `video` | string (video URL) | yes |  |  | 指向输入视频的 URL。 |
| `audio_url` | `audio` | string (audio URL) | yes |  |  | 输入音频位置，以 URL 表示。 |
| `sync_mode` |  | enum (string) | no | `cut_off` | `cut_off`, `loop`, `bounce`, `silence`, `remap` | 用于处理音频和视频时长差异的唇形同步模式。 |
| `options` |  | object {sync_mode, model_mode, prompt, temperature, active_speaker_detection, occlusion_detection_enabled} \| null | no |  |  | 在此配置其他 Sync.so 生成行为；提供的 options.sync_mode 优先于顶层 sync_mode 值。 |
| `options.sync_mode` |  | enum (string) \| null | no |  | `cut_off`, `loop`, `bounce`, `silence`, `remap` | 顶层 sync_mode 的覆盖值，指定输入音频和视频时长不同时的处理方式。 |
| `options.model_mode` |  | enum (string) \| null | no |  | `lips`, `face`, `head`, `lipsync`, `emotion`, `talking_head` | 编辑区域选择，主要用于 react-1，指定模型修改的区域。 |
| `options.prompt` |  | enum (string) \| null | no |  | `happy`, `sad`, `angry`, `disgusted`, `surprised`, `neutral` | 主要由 react-1 使用的情绪指导，用于引导生成。 |
| `options.temperature` |  | number \| null | no |  | 0 – 1 | 表现力设置，对原生管理此功能的 sync-3 无效。对于使用此设置的模型，0 表示最低唇形同步表现力，1 表示最高。 |
| `options.active_speaker_detection` |  | object {auto_detect, v3, use_v2, frame_number, coordinates, bounding_boxes, bounding_boxes_url, face_image} \| null | no |  |  | 用于识别包含多人的视频中的当前说话人的设置。 |
| `options.active_speaker_detection.auto_detect` |  | boolean \| null | no |  |  | 自动识别当前说话人，并对该人物应用生成。 |
| `options.active_speaker_detection.v3` |  | boolean \| null | no |  |  | 使用 v3 当前说话人检测。 |
| `options.active_speaker_detection.use_v2` |  | boolean \| null | no |  |  | 用于 v2 当前说话人检测的已弃用设置。 |
| `options.active_speaker_detection.frame_number` |  | integer \| null | no |  | ≥ 0 | 用于手动选择说话人坐标的帧索引。 |
| `options.active_speaker_detection.coordinates` |  | array of integer \| null | no |  | 2 – 2 items | 在 frame_number 中以 [x, y] 表示的说话人面部参考点。 |
| `options.active_speaker_detection.bounding_boxes` |  | array of array of integer \| null | no |  |  | 每帧检测到的人脸边界框，以 [x1, y1, x2, y2] 表示。 |
| `options.active_speaker_detection.bounding_boxes_url` |  | string \| null | no |  |  | 提供每帧边界框的 JSON 文件 URL。 |
| `options.active_speaker_detection.face_image` |  | string \| null | no |  |  | 以 Base64 编码的人脸图像，用于手动选择说话人。 |
| `options.occlusion_detection_enabled` |  | boolean \| null | no |  |  | 遮挡检测开关；由于 sync-3 会自动检测，因此对其无效；对于其他模型，该开关控制生成是否包含遮挡检测。 |

File parameters (`video`, `audio`) take a public `https://` URL, a `data:` URI up to 10 MB, or the `file_url` of an upload from `POST /files`.

## Example input

Required parameters only:

```json
{
  "video": "https://content.doitong.com/video/showcase/v3/avatar/talking_avatar_loop.mp4",
  "audio": "https://content.doitong.com/audio/showcase/v3/tools/dub_es.mp3"
}
```

A fuller example:

```json
{
  "video": "https://content.doitong.com/video/showcase/v3/avatar/talking_avatar_loop.mp4",
  "audio": "https://content.doitong.com/audio/showcase/v3/tools/dub_es.mp3"
}
```

## Run it

Set `DOITONG_API_KEY` to a key from https://doitong.com/developers/dashboard#keys. `?wait=20` returns the finished request in the same call when it is ready within 20 seconds; otherwise poll `GET /requests/{id}` (it also accepts `?wait=`), or pass `webhook_url`.

### curl

```bash
# Run the model; wait up to 20 s for the finished result in the same call
curl -X POST "https://api.doitong.com/v1/run/sync-lipsync/v3?wait=20" \
  -H "Authorization: Bearer $DOITONG_API_KEY" \
  -H "Content-Type: application/json" \
  -d '{
    "video": "https://content.doitong.com/video/showcase/v3/avatar/talking_avatar_loop.mp4",
    "audio": "https://content.doitong.com/audio/showcase/v3/tools/dub_es.mp3"
  }'

# Still "queued" or "running"? Poll with the id from the response:
curl "https://api.doitong.com/v1/requests/REQUEST_ID?wait=20" \
  -H "Authorization: Bearer $DOITONG_API_KEY"
```

### JavaScript

```javascript
const API = "https://api.doitong.com/v1";
const headers = {
  "Authorization": "Bearer " + process.env.DOITONG_API_KEY,
  "Content-Type": "application/json",
};

// Run the model; wait up to 20 s for the finished result in the same call
let res = await fetch(API + "/run/sync-lipsync/v3?wait=20", {
  method: "POST",
  headers,
  body: JSON.stringify({
    "video": "https://content.doitong.com/video/showcase/v3/avatar/talking_avatar_loop.mp4",
    "audio": "https://content.doitong.com/audio/showcase/v3/tools/dub_es.mp3"
  }),
});
let request = await res.json();
if (!res.ok) throw new Error(request.error.code + ": " + request.error.message);

// Not finished yet: long-poll until it is
while (request.status === "queued" || request.status === "running") {
  res = await fetch(API + "/requests/" + request.id + "?wait=20", { headers });
  request = await res.json();
}
if (request.status !== "succeeded") throw new Error(JSON.stringify(request.error));
console.log(request.outputs.map((o) => o.url), request.cost.credits + " API credits ($" + request.cost.usd + ")");
```

### Python

```python
import os
import requests

API = "https://api.doitong.com/v1"
headers = {"Authorization": "Bearer " + os.environ["DOITONG_API_KEY"]}

payload = {
    "video": "https://content.doitong.com/video/showcase/v3/avatar/talking_avatar_loop.mp4",
    "audio": "https://content.doitong.com/audio/showcase/v3/tools/dub_es.mp3",
}

# Run the model; wait up to 20 s for the finished result in the same call
r = requests.post(API + "/run/sync-lipsync/v3", params={"wait": 20}, json=payload, headers=headers)
request = r.json()
if not r.ok:
    raise RuntimeError(request["error"]["code"] + ": " + request["error"]["message"])

# Not finished yet: long-poll until it is
while request["status"] in ("queued", "running"):
    request = requests.get(API + "/requests/" + request["id"], params={"wait": 20}, headers=headers).json()
if request["status"] != "succeeded":
    raise RuntimeError(request["error"])
print([o["url"] for o in request["outputs"]], request["cost"]["credits"], "API credits", "$" + request["cost"]["usd"])
```

### MCP

The MCP server at `https://api.doitong.com/v1/mcp` exposes the tools `search_models`, `get_model`, `quote`, `run`, `get_request`, `cancel_request`, `list_requests`, `create_upload` and `get_account`. A `run` call for this model:

```json
{
  "jsonrpc": "2.0",
  "id": 1,
  "method": "tools/call",
  "params": {
    "name": "run",
    "arguments": {
      "model_id": "sync-lipsync/v3",
      "input": {
        "video": "https://content.doitong.com/video/showcase/v3/avatar/talking_avatar_loop.mp4",
        "audio": "https://content.doitong.com/audio/showcase/v3/tools/dub_es.mp3"
      },
      "wait_seconds": 20
    }
  }
}
```

## Response

Every call returns a request object. `status` is one of `queued`, `running`, `succeeded`, `failed`, `canceled`. `outputs` lists the generated files with URLs on our storage (kept forever, or 7 days with `?storage=temporary`; `storage` says which); `output` is the model's own result object with the same URLs.

```json
{
  "id": "req_8k2m4q7x1z9c3v5b6n0p2r4t",
  "object": "request",
  "model": "sync-lipsync/v3",
  "status": "succeeded",
  "created_at": "2026-10-20T12:00:00Z",
  "started_at": "2026-10-20T12:00:02Z",
  "completed_at": "2026-10-20T12:00:09Z",
  "queue_position": null,
  "cost": {
    "credits": 1334,
    "usd": "1.334",
    "charged": 1334,
    "refunded": 0
  },
  "input": {
    "video": "https://content.doitong.com/video/showcase/v3/avatar/talking_avatar_loop.mp4",
    "audio": "https://content.doitong.com/audio/showcase/v3/tools/dub_es.mp3"
  },
  "output": {
    "video": {
      "url": "https://content.doitong.com/dev-api/2026/10/20/req_8k2m4q7x1z9c3v5b6n0p2r4t/0-output.mp4",
      "content_type": "video/mp4",
      "file_name": "0-output.mp4",
      "file_size": 1843200
    }
  },
  "outputs": [
    {
      "type": "video",
      "url": "https://content.doitong.com/dev-api/2026/10/20/req_8k2m4q7x1z9c3v5b6n0p2r4t/0-output.mp4",
      "content_type": "video/mp4",
      "file_size": 1843200,
      "width": 1280,
      "height": 720,
      "duration": 5,
      "stored": true
    }
  ],
  "error": null,
  "metrics": {
    "inference_seconds": 6.8
  },
  "urls": {
    "self": "https://api.doitong.com/v1/requests/req_8k2m4q7x1z9c3v5b6n0p2r4t",
    "cancel": "https://api.doitong.com/v1/requests/req_8k2m4q7x1z9c3v5b6n0p2r4t/cancel"
  }
}
```

### Output fields (`output`)

| Field | Type | Description |
|---|---|---|
| `video` | object {url, content_type, file_name, file_size} | 模型生成的视频。 |

## Related models

- [Sync React-1](https://doitong.com/developers/models/sync-lipsync/react-1.md) (`sync-lipsync/react-1`): $10.00 / minute of output video
- [sync-3 Avatar Image to Video](https://doitong.com/developers/models/sync-lipsync/v3/image-to-video.md) (`sync-lipsync/v3/image-to-video`): $8.00 / minute of input audio
- [Kling AI Avatar 2.0 Pro](https://doitong.com/developers/models/kling-video/ai-avatar/v2/pro.md) (`kling-video/ai-avatar/v2/pro`): $0.115 / second of input audio
- [VEED Fabric 1.0](https://doitong.com/developers/models/veed/fabric-1.0.md) (`veed/fabric-1.0`): from $0.08 / second of input audio
- [Sync Lipsync](https://doitong.com/developers/models/sync-lipsync/v2/pro.md) (`sync-lipsync/v2/pro`): $5.00 / minute of output video
- [Sync Lipsync 2.0](https://doitong.com/developers/models/sync-lipsync/v2.md) (`sync-lipsync/v2`): from $3.00 / minute of output video
- [sync.so -- lipsync 1.9.0-beta](https://doitong.com/developers/models/sync-lipsync.md) (`sync-lipsync`): $0.70 / minute of output video
- [AI Avatar Multi](https://doitong.com/developers/models/ai-avatar/multi.md) (`ai-avatar/multi`): from $0.20 / second of output video

## Links

- HTML page: https://doitong.com/developers/models/sync-lipsync/v3
- All models and guides for AI agents: https://doitong.com/developers/llms.txt
- OpenAPI 3.1 with this model's typed request body: https://doitong.com/developers/openapi.json?model=sync-lipsync/v3
- Errors: https://doitong.com/developers/docs/errors
- Model details as JSON: https://api.doitong.com/v1/models/sync-lipsync/v3