Latest in Tomorrow

Image credit: Axel Bueckert via Getty Images

AI localization tool claims to translate your words in your voice

Resemble AI's Localize could help YouTubers reach fans in other countries.
Kris Holt,
October 16, 2020
165 Shares
Share
Tweet
Share

Sponsored Links

microphone with pop filter on mic stand in soundproof isolation booth for vocal recording at sound studio
Axel Bueckert via Getty Images

Localization is a tricky issue for all content creators. It can take significant time and resources to make their work fully accessible to folks who speak different languages. One company thinks it has cracked part of that code with an artificial intelligence system that automatically translates speech into other languages in the same speaker’s voice.

Resemble AI its tool can keep voices consistent in various languages in movies, games, audiobooks, corporate videos and other formats. Google is working on similar tech, but we haven’t heard much about that since it published a paper on the Translatotron system last year.

The implications of Localize are intriguing. For instance, if it translated audio from Dune, Timothée Chalamet could sound like himself even in the German or Italian versions — whenever that movie actually makes it to theaters, anyway.

YouTubers might create versions of their videos for fans who otherwise rely on captions to understand them. Call centers could create chatbots that support multiple languages. All of that’s assuming Localize works as well as intended, though.

For now, Localize can translate speech between English, French, German, Dutch, Italian and Spanish. There are plans to add Korean, Japanese and Mandarin to the mix in the near future.

Resemble AI says Localize can translate recordings in a way that accurately reflects the speaker's words and meanings. The system, it claims, can turn the original audio into speech that uses colloquialisms and grammar structures of a certain region and language.

One major downside of this tech is that, if it works as well as Resemble AI suggests, actors could miss out on a lot of dubbing work. Given delicate nuances in certain languages, it would probably be best for a native speaker to review the translations as well. It wouldn’t be a great look if Keanu Reeves accidentally insulted all of the Netherlands in Cyberpunk 2077, for instance. Still, if Localize works as promised, it could allow creators of audio-based media to share their work with more fans with greater ease.

All products recommended by Engadget are selected by our editorial team, independent of our parent company. Some of our stories include affiliate links. If you buy something through one of these links, we may earn an affiliate commission.
Comment
Comments
Share
165 Shares
Share
Tweet
Share

Popular on Engadget

Jabra's ANC update for the Elite 75t earbuds is now available

Jabra's ANC update for the Elite 75t earbuds is now available

View
Hummer EV 'supertruck' has a UI built on Unreal Engine and runs Android

Hummer EV 'supertruck' has a UI built on Unreal Engine and runs Android

View
Quibi confirms it's shutting down

Quibi confirms it's shutting down

View
Jony Ive will help design 'the future of Airbnb'

Jony Ive will help design 'the future of Airbnb'

View
appٷ iPad Air (2020) review: Who needs the iPad Pro?

appٷ iPad Air (2020) review: Who needs the iPad Pro?

View

From around the web

Page 1 Page 1 ear icon eye icon Fill 23 text file vr