Skip to content

Dubbing basics

How to translate a video while keeping the background music

· 6 min read · By Alex, founder of WaveShift

The short answer

To translate a video without losing its background music, use a tool that separates speech from background audio before translating, then mixes the new dubbed speech back over the original music and ambience. WaveShift does this automatically, so the soundtrack, sound effects, and room tone stay intact.

Why most translation tools flatten your audio

Many video translation tools treat the audio as one inseparable track. When they generate dubbed speech, they either replace the whole soundtrack or talk over it, so the original music, sound effects, and ambient room tone get muffled or lost entirely.

For a talking-head clip that may be acceptable. For a music video, a vlog with a soundtrack, an ad, or a tutorial with ambient demonstration sound, losing the background audio changes how the video feels — and viewers notice immediately.

The fix: separate speech from background before you translate

The reliable way to keep the music is to split the audio into two stems first: the spoken voice, and everything else (music, effects, ambience). You translate and re-voice only the speech stem, then mix the new dubbed speech back over the untouched background stem.

Because the background stem is never regenerated, the music and sound effects stay as they were in the original — only the spoken words change language. The one caveat is the separation itself, which is an estimate: where speech and music overlap closely, some of one can end up in the other (more on that below).

How WaveShift preserves background audio, step by step

WaveShift runs this separate-translate-remix pipeline automatically. You do not configure stems or touch an audio editor:

  • Add your video by uploading a file or pasting a YouTube, Bilibili, Twitch, or X (Twitter) link.
  • WaveShift separates the speech from the background music and sound effects.
  • It translates the speech and clones each speaker's voice so the dubbed audio keeps the original speaker identity where possible.
  • It mixes the translated speech back over the original background audio, so music and effects stay intact.
  • Playback streams as it renders — you hear the first dubbed segment in minutes while the rest continues.
  • If one line sounds off, you can edit that single subtitle line and regenerate only that line, without redoing the whole video.

When keeping the background matters most

Background preservation is the difference between a usable localized video and one you have to re-edit. It matters most for:

  • Music videos and performances, where the track is the point.
  • Vlogs and lifestyle content with a continuous soundtrack.
  • Ads and trailers, where sound design carries the mood.
  • Tutorials and product demos with ambient or on-screen sound.

Tips for the cleanest result

A few habits make the separated-and-remixed output sound natural:

  • Start from a source where the speech is reasonably clear over the music — cleaner input separates better.
  • Review one representative segment first, including a line with music underneath it, before processing a long video.
  • Use single-line re-dubbing to fix any line that lands awkwardly instead of regenerating the whole file.

Where separation still struggles, and how to check the result

Separation is a model's best estimate, not an undo button. It works best when the speech sits clearly above the music, and it degrades when the two overlap in the same frequencies: a sung vocal over instruments, a speaker talking over a loud chorus, or crowd noise that sounds like speech. In those passages you may hear faint traces of the original voice in the background, or music that dips while a line plays.

A two-minute listening test catches most problems before you spend minutes on the whole video:

  • Pick the loudest music passage that has speech over it and play it twice with headphones.
  • Listen underneath the new voice for a faint ghost of the source language.
  • Check the joins between segments: the music should not jump in volume or restart.
  • Compare overall loudness with the original — dialogue should sit above the music without the music pumping.
  • If one line is the problem, re-dub that line; if the whole source is dense with sung vocals, subtitles may suit that video better than a dub.

Frequently asked questions

No. WaveShift separates speech from the background audio, translates only the speech, then mixes the dubbed speech back over the original music and sound effects, so the soundtrack stays intact.

Where possible, yes. WaveShift clones each speaker's voice so the translated speech keeps the original speaker identity rather than replacing it with a generic voice.

You can upload a video file or paste a YouTube, Bilibili, Twitch, or X (Twitter) link. WaveShift ingests the video and runs the full translate-and-dub pipeline.

Yes. WaveShift supports single-line re-dubbing, so you can edit one subtitle line and regenerate only that line.

That is separation residue: where speech and music overlap closely, some speech can stay in the background audio. It is most noticeable under loud, dense music. Cleaner source audio reduces it; if it stays distracting on a particular video, subtitles may suit that video better.

For uploaded and linked videos, WaveShift first holds the source duration, then charges only for dubbed audio actually delivered and returns the unused hold. The target language does not change this rule.

Eligible new users can receive up to 15 free minutes. With at least one available minute, a local upload can use the built-in option to dub only its beginning. This option does not apply to video links, live streams or extension-preloaded audio. To finish the same uploaded video later, use its full-video action; previously paid minutes are deducted from the new hold and settlement, so they are not charged twice. A new, separate upload does not automatically reuse that payment.

Each target language is a separate task: 30 minutes × 2 languages means an estimated total initial hold of 60 minutes. Available account balance can cover part of it; trial credit and first-purchase offers depend on eligibility. Uploaded and linked videos settle on the dubbed audio actually delivered, including delivered silence, and return unused held minutes. Compare smaller pack combinations as well as one larger pack.

Keep exploring

Try it on your own video

Eligible new users can receive up to 15 free minutes. Upload a file or paste a YouTube or Bilibili link and hear the first dubbed segment in minutes.