ABSTRACT
Whose voice sings the result?
Song Dubbing carries the artist's own recorded performance, so the take the fans know is the take they hear. It is the first true song dubbing: until now a song reached another language only by being sung again (by the artist, another singer or a new vocal made for it); here nothing is sung again.
Does the lyric keep its meaning, rhyme and syllables?
We tried Hindi twice but the diction and the meter of how you sing Hindi versus the western rhythms just didn't match and we just couldn't pull it off.
"Girlfriend" shipped in seven other languages, but not Hindi: a sung line has a fixed number of notes. Ask to see each line beside a translation back, the syllables counted against the notes. Song Dubbing: never fewer syllables than the original, the rhyme scheme reproduced, the meaning never bent for a rhyme. Rhyme and syllables goes line by line.
What happens to the video, and which masters arrive?
THE MUSIC VIDEO
Lips on the new lyric
Up to 4K.
THE MIX
Release-ready stereo
24-bit PCM WAV, 144 dB of dynamic range.
THE VOCAL
The voice track alone
Song Dubbing delivers all three. An audio-only version leaves the lips moving to words the listener no longer hears, and a compressed preview cannot be mastered.
Who approves the lyric, and which rights are documented?
A tool that publishes without the artist's sign-off puts words in the artist's mouth.
- The composition. US copyright law lists a translation as a "derivative work" (17 U.S.C. § 101): the publisher and songwriters clear the lyric.
- The recording. The label controls the master.
- The voice. Tennessee's ELVIS Act, signed on March 21, 2024, made the voice a personal right. Ask for the artist's written consent.
- The approval. Universal Music Group released Brenda Lee's Spanish version with her approval. Ask who approved each line, and when.
The six answers, in one place
SONG DUBBING
The singer stays the singer.
Song Dubbing sings in English, French, German, Italian, Korean, Mandarin, Portuguese, Russian and Spanish to start. Hear a dubbed song beside its original or read the Song Dubbing paper. It is a white-glove service for record labels: email the team with the album.
QUESTIONS
What is the difference between song dubbing and a voice-converted cover?
A voice-converted version starts from another singer's new performance and changes its timbre to sound like the artist. Song Dubbing from Familiar Labs starts from the artist's own recording, so the phrasing, the breath and the emotion are the artist's.
How do I check a translated lyric in a language I do not speak?
Ask for three columns per line: the original, the new lyric and a translation back, with the syllables counted against the melody.
Does an AI song translation need the publisher's permission?
Usually. US copyright law lists a translation as a derivative work, so the publisher and the songwriters clear the lyric. Confirm with your legal team for each territory.
REFERENCES
- [1]The Korea Times, Hybe uses AI voice technology for Midnatt's multilingual single, May 15, 2023
- [2]NME, Lauv taps AI and a former K-pop idol to create Korean version of 'Love U Like That', 2023
- [3]ABC News, Brenda Lee's 'Rockin' Around the Christmas Tree' in Spanish, October 25, 2024
- [4]The Daily Utah Chronicle, Avril Lavigne's 'Girlfriend' and its foreign-language versions, April 5, 2021
- [5]NPR, In this production of 'Hamilton,' everything is done in German, October 2022
- [6]17 U.S.C. § 101, definitions (Cornell Legal Information Institute)
- [7]Associated Press via News4JAX, Tennessee becomes the first state to protect musicians against AI, March 21, 2024
- [8]Song Dubbing: the paper
Multimodal Translation
Familiar Labs builds generationally better dubbing with a Multimodal Localization Foundation Model (MLFM), the first foundation model for multimodal translation: one model decides what to localize across text, audio and visual, and shows you the choices. Your voice and lips, carried into new languages. They're a team of 7 with PhDs, backed by Samsung, RedBird, Gold House. Our mission
