Guide

How to Dub a Video with AI

AI dubbing replaces the spoken audio of a video with a translated voice. It takes minutes instead of studio days — but it helps to know how it works, so you can prepare your video and judge the result.

01 Upload

Your video

Full translation outputVideo, translated audio, and transcripts in the result panel.
Server assistOff by default. When on, this job uploads your media file so our servers can decode it (helpful on phones). Uploads this file (max 500 MB). Same credit cost as a normal run. Max length still 2 hours.

By default the video file stays in this browser (only audio chunks go to the cloud). Language is required for full translation.

02 Result

Your translated video

Your translated video will appear here.

Waiting for upload

25 languages available

What this looks like in mydubly

mydubly choice between cloned speaker voice and stock male or female voice
mydubly dub editor fixing one translated line with retake and timing nudge
mydubly dub editor voice versus background music balance sliders

How AI dubbing works

Behind the single 'translate' button are five steps:

  1. Speech recognition turns the original audio into text with timings.
  2. Machine translation converts each segment into the target language.
  3. Text-to-speech reads each translated segment in a copy of the voice of the person who said it, made from a short, clean sample of their speech.
  4. Timing fit places each voiced segment where the original was spoken, speeding it up slightly when the translation is longer.
  5. Vocal separation removes the original speech, and the new voice is mixed over the remaining music and effects, which dip automatically while it speaks.

In mydubly, timing fit speeds speech up by at most 1.15× and keeps the pitch natural, so voices don't sound chipmunked. The finished audio is then combined with your original picture on your own device.

What AI dubbing is good at

  • Explainers, tutorials, lectures, training, interviews and conversations.
  • Making long videos watchable for people who won't read subtitles for 30 minutes.
  • Testing a new market cheaply before paying for professional voice-over.

Where it falls short

  • Telling speakers apart is automatic and can slip: crosstalk, very short interjections or two similar voices can end up in the wrong voice, and overlapping speech overlaps in the dub by at most about two seconds.
  • Emotion and comic timing are flatter than a human actor's.
  • There's no lip-sync; on-camera close-ups look like a traditional voice-over.
  • Music and effects are kept, but separation isn't perfect: faint traces of the original voice can remain in dense mixes, and sung lyrics are removed with the speech.

If those matter more than speed and cost, subtitles may be the better choice — or use AI dubbing as a draft for human voice actors.

How to dub a video, step by step

  1. Pick a video with clear audio.
  2. Open the AI dubbing tool, drop in the file and choose the target language.
  3. Leave the voices to mydubly: it copies each person from a short, clean sample of their speech in the file, so there's nothing to pick. Someone with too little clean speech gets the copied voice of a similar-sounding person in the file, or otherwise a stock voice matching their voice (female or male).
  4. Switch Full translation output on and start the job.
  5. Download the dubbed MP4 and the translated transcript, and spot-check a few minutes.
Cost check

Dubbing is 120 credits per minute with a 2-minute minimum: a 5-minute video costs 600 credits (60¢), a 30-minute lecture 3,600 credits ($3.60).

Tips for a better dub

  • Speak clearly and avoid talking over music in future recordings meant for dubbing — it hurts recognition and makes separating your voice from the music harder.
  • Shorter sentences translate and time better than long, nested ones.
  • Your music and effects stay automatically; for the cleanest result, dub a dialogue-only export of your edit project and mix the translated voice with your clean music stem in an editor.

Pre-flight: is this video a good dubbing candidate?

Five minutes with the source file predicts most of what you will think of the dub. Play it through once and answer these questions before spending credits:

How many speakers?
Up to 8 is fine: each person is dubbed in a copy of their own voice. Heavy crosstalk, very short interjections and voices that sound alike are where a line can land in the wrong voice, and overlapping speech comes out as separate lines.
Speech over music?
The original speech is separated out and the music stays under the translated voices, lowered while they speak. Loud music under speech makes recognition and separation harder, and songs lose their sung vocals.
Speaker in close-up on camera?
There is no lip-sync, so mouths won't match the words. Wide shots, slides and screen recordings hide this; tight face shots expose it.
Fast, dense delivery?
When a translation runs longer than the original, lines are shortened to fit the timing, so rapid talkers lose more detail than relaxed ones.
Jokes, slogans, wordplay?
Expect literal results. Flag those lines for a human rewrite or keep them as subtitles only.

How the dubbed voices are made

  • There is no voice to choose. mydubly works out how many people speak (up to 8) and which lines each one says, splitting a line where the speaker changes partway through. It takes a short, clean sample of each person, up to about 10 seconds with music and background noise removed, and speaks that person's lines in a copy of their voice.
  • Each copy keeps the speaker's timbre and pitch, while pronunciation follows the target language; the original accent stays behind. Every dubbed line follows the pace and energy of the original delivery, and lines that were louder or quieter stay that way relative to each other.
  • Clean, close-mic speech copies best. Someone with too little clean speech, under about 3 seconds, is voiced with the copied voice of the person they sound most like, if they sound alike; otherwise a stock voice matching theirs (female or male) is used automatically, as it is for a music-heavy clip with almost no clean speech.
  • Only dub voices you have the right to use, and if a familiar presenter is on screen, consider a line in the description saying the translation uses an AI copy of their voice.

More on how listeners react to synthetic voices in choosing an AI voice.

Reviewing the dub in a single pass

  1. Play the preview at 1.5× from start to finish and note the timecode of every gap, abrupt cut or rushed passage.
  2. Go back to each note at 0.75× and read the original and translated text side by side on the result screen.
  3. Open the downloaded SRT next to the video. It reflects what the voice says, so comparing it with the full translated text shows where lines were shortened.
  4. Ask a speaker of the target language to watch the first two minutes plus any section containing numbers, prices or instructions.
  5. Finally, play the translated audio file on its own, without the picture. Gaps, sudden level changes and clipped word endings are easier to hear when nothing on screen pulls your attention.

The AI dubbing quality checklist turns these steps into a sign-off sheet you can reuse.

Symptoms after download, and what to do

Faint original voice, or the music sounds thinner
Vocal separation isn't perfect in dense or loud mixes. If you have your edit project, dub a dialogue-only export and mix the translated voices with your clean music stem in an editor, as described in background music in translated videos.
A line comes out in the wrong person's voice
Telling people apart is automatic, and crosstalk, one-word replies or two similar voices can confuse it. Recordings where people take clear turns, each on their own microphone, give it the easiest job.
The file is an MKV
Your source codec can't be stored in an MP4, so the browser merged into MKV. Re-export from an editor if the destination requires MP4.
A name is mispronounced every time
Repairs happen after download: record a short pickup of the correct pronunciation over those words in your editor, or let the subtitles carry the correct spelling.
One key sentence lost its meaning
Check the original-language transcript first. If recognition misheard a word, every later step inherited the mistake.
Long passages sound crammed
The translated text ran longer than the source. For future recordings, shorter sentences and small pauses give the voice room; see text expansion in translation.

Worked example: a 7-minute onboarding video into French

An HR team has a 7-minute onboarding video: one presenter at mid-distance from the camera, quiet music underneath, and slides with headings. Dub mode into French costs 350 credits (35¢). They download the translated video, the M4A and the French SRT. The quiet music stays under the French voice, so in their editor they only rebuild the slide headings in French, because text in the picture isn't translated. A 90-second welcome clip from the same series is billed at the 2-minute minimum: 240 credits (24¢). The French video dubbing tool page covers language-specific checks, and training video dubbing shows how this fits a wider course rollout.

Frequently asked questions

Is AI dubbing the same as voice cloning?

They overlap. Voice cloning recreates a specific person's voice; AI dubbing translates speech and voices it again. mydubly's dub speaks each person in a copy of their own voice, taken automatically from the uploaded file, with pronunciation that suits the target language. Only upload voices you have the right to use.

How long does dubbing take?

It depends on video length and how busy the service is; audio is processed in 30-second chunks, and progress is shown as it goes.

Can each speaker get a different voice?

Yes, automatically. Each person, up to 8 per file, is dubbed in a copy of their own voice, taken from a short, clean sample of their speech. Telling people apart can slip when they talk over each other or sound very alike, so for heavy crosstalk, or for viewers who prefer the original voices, translated subtitles remain a good choice.

Can I download the dubbed audio without the video?

Yes. The translated audio download is an M4A file, which is what you need for editing in a video editor or for platforms that accept an extra audio track. It already includes the original background, so to mix in your own music, dub a dialogue-only export first.

Do the subtitles from a dub match what the voice says?

Yes. In dub mode the SRT and VTT follow the spoken translation, including lines that were shortened to fit the timing, so viewers who turn them on read what they hear.