# AI Lip Sync

> AI changes a person's mouth in a video to match new speech.

**Field:** Artificial Intelligence  
**Category:** Multimodal  
**Also known as:** Lip Sync AI, AI Lip-Syncing, Visual Dubbing

## Think of it like

It is like a puppet whose mouth moves to match a new voice. The rest of the puppet stays still.

## Definition

AI lip sync changes the mouth of a person in a video so it matches new speech. The model watches the face and listens to the new sound. Then it redraws only the mouth and jaw, frame by frame. It is most often used for dubbing, so a speaker seems to say the words of another language. It also fixes small sound edits. Like voice cloning, it can be misused to put words in someone's mouth.

## Example

Emma's company films a training video in English. With a new voice track and AI lip sync, the same speaker now seems to speak Spanish. The lips match the words.

## Why it matters

A dubbed video looks natural when the lips match. Viewers stop noticing it was made in another language.

## Common mistake

Using it on someone without their consent. Making a real person seem to say things they never said can break laws and trust.

## Three principles

- **New audio in.** Mouth redrawn.
- **Only the mouth.** The rest stays.
- **Dubbing.** The main use.

## Related terms

- [Voice Cloning](https://learn.benibix.com/term/ai/voice-cloning)
- [Text-to-Speech](https://learn.benibix.com/term/ai/text-to-speech)
- [Image-to-Video](https://learn.benibix.com/term/ai/image-to-video)
- [Generative AI](https://learn.benibix.com/term/ai/generative-ai)
- [AI Avatar Video](https://learn.benibix.com/term/ai/ai-avatar-video)
- [AI Dubbing](https://learn.benibix.com/term/ai/ai-dubbing)

## Told apart from

- [AI Dubbing vs AI Lip Sync](https://learn.benibix.com/compare/ai-dubbing-vs-ai-lip-sync): People think AI dubbing and AI lip sync are one tool. Dubbing changes what you hear: it puts the speech into a new language, often in the same voice. Lip sync changes what you see: it moves the mouth to match a sound track. A full dub often uses both, but either one can be used alone.

![A video of a person talking and a new audio track in another language go into a model. Only the mouth area is redrawn so the lips match the new words.](https://learn.benibix.com/diagrams/mm-ai-lip-sync.svg)

---

Source: https://learn.benibix.com/term/ai/ai-lip-sync
Author: Behnia Zarei (a developer in Vienna, Austria, who builds and teaches data, AI and business intelligence at BENIBIX)
Publisher: BENIBIX Learn (https://learn.benibix.com/)
Last updated: 2026-11-17
Licence: CC BY 4.0 (https://creativecommons.org/licenses/by/4.0/). Quote freely with attribution.
