DEFINITION

Song Dubbing: The Same Singer, in Your Language

FAMILIAR LABS RESEARCHALL ARTICLES

ABSTRACT

Song Dubbing is the song you know, carried into another language: the same singer, the same recording, the same performance. The lyric is translated to keep its meaning, its rhyme and its syllables against the melody, and in the music video the lips follow. Nothing is sung again. It is the first true song dubbing, from Familiar Labs.
THE FIRST TRUE SONG DUBBING

What is Song Dubbing?

Song DubbingDEFINITION

The song you know, in another language: the singer's own voice, the original recording and performance carried over, the lyric translated for meaning, rhyme and syllables.

The melody, the breath and the emotion stay where the artist put them. In the music videos, the singer on screen sings the new words.

It sings in nine languages to start, any to any: English, French, German, Italian, Korean, Mandarin, Portuguese, Russian and Spanish.

Why is it the first true song dubbing?

Until now a song reached another language only by being sung again (by the artist, another singer or a new vocal made for it). In May 2023 HYBE released MIDNATT's "Masquerade" in six languages, every version sung by the artist. That November, Kevin Woo translated and sang Lauv's "Love U Like That" in Korean, and Hooky turned his take into Lauv's voice.

UNTIL NOW

  • The artist sings the song again in each language, or another singer sings it and the take is made to sound like the artist.
  • Or a new vocal is made in a copy of the singer's voice.
  • Each language is a new performance.

SONG DUBBING

  • Nothing is sung again.
  • The original recording and performance carry into the new language.
  • The breath, the phrasing and the emotion are the ones the artist recorded.

What we listen for in a lyric

A spoken line can stretch or shrink a little. A sung line cannot, and the voice is one people know by heart.

SYLLABLES

Never fewer than the original

No note of the melody is left empty.

THE RHYME SCHEME

Reproduced

Internal and multisyllabic rhymes carried where the language allows.

FLOW

Sung first, read second

A line that reads well and sings badly is the wrong line.

MEANING AND INTENTION

Never bent for a rhyme

Nothing is invented to fill a line.

GENRE AND REGISTER

Matched to the song

A rap verse sounds like rap in the new language, a ballad like a ballad.

THE HOOK

Kept where it is the song

The title phrase or the chant fans sing back can stay in the original language.

THE ARTIST

Decides

Where a line can land more than one way, the artist chooses. Every line is approved before release.

Is Song Dubbing AI music generation?

++

Dubbing, not generating. The singer stays the singer.

Our CEO, Andrew Liu: "We're the opposite of AI music generation. We oppose replacing the humans. This is what AI should be used for: letting my mom understand my favorite songs too." His side of it is in The Opposite of AI Music Generation.

Song dubbing came out of the dubbing work. The Multimodal Localization Foundation Model (MLFM) was trained to keep a person exactly who they are: the emotion, the intent, every small sound of a voice. A sung line is the hardest version of that job. More in What Is a Multimodal Localization Foundation Model (MLFM)?

Who is it for?

  1. 01

    The label sends the album.

  2. 02

    The lyric is translated.

    For meaning, rhyme and syllables, in every language.
  3. 03

    The artist approves every line.

  4. 04

    The album is dubbed.

    The music videos with it.
  5. 05

    The label releases it.

Song Dubbing is a white-glove service for record labels and their artists, worked album by album, line by line. There is no upload for songs. Email the team.

QUESTIONS

What is song dubbing?

Song dubbing carries a recorded song into another language in the same singer's voice and performance, with the lyric translated for meaning, rhyme and syllables against the melody. Familiar Labs' Song Dubbing is the first true song dubbing: nothing is sung again.

How do you translate a song so it can still be sung?

Line by line, against the melody: never fewer syllables than the original, the rhyme scheme reproduced, flow first, the meaning never bent for a rhyme. The artist chooses between alternatives.

Does the artist sing it again?

No. The original recording and performance carry over. The artist's part is the lyric: reviewing and approving it in every language before release.

How does a label get Song Dubbing?

Through the team, as a white-glove service, album by album; there is no self-serve upload for songs. Email the team.

REFERENCES

  1. [1]Music Business Worldwide, HYBE releases MIDNATT's "Masquerade" in six languages, May 15, 2023
  2. [2]Billboard Canada, Lauv's "Love U Like That" translated into Korean with Hooky, November 8, 2023
  3. [3]What Is a Multimodal Localization Foundation Model (MLFM)?
  4. [4]Our mission

Multimodal Translation

Familiar Labs builds generationally better dubbing with a Multimodal Localization Foundation Model (MLFM), the first foundation model for multimodal translation: one model decides what to localize across text, audio and visual, and shows you the choices. Your voice and lips, carried into new languages. They're a team of 7 with PhDs, backed by Samsung, RedBird, Gold House. Our mission