At VidCon 2023, YouTube announces it will allow creators to transcribe their videos into other languages using AI. Developed by Aloud and part of Google’s Area 120 incubator, the software will open content to a much wider audience when implemented.
Previously, creators had to directly partner with third-party dubbing providers to create their audio tracksIt turns out to be a long and expensive process. Aloud allows them to rip videos at no additional cost, but it’s unclear if Google will monetize this service in the future. YouTube also allows users to use automatic captioning if the author of the video has not provided subtitles but has not offered audio dubbing before.
Also read – YouTube may finally be reviving this super popular ranking feature
How will dubbing work on YouTube?
According to Aloud’s website, the tool transcribes your video and gives you a transcript that you can review and edit. The good news is that AI is not only responsible for translating the script, but also for dubbing production.. According to YouTube’s Amjad Hanif, the platform is already testing this tool with hundreds of creators.
He explained that Aloud currently supports several languages and more are coming in the future. Aloud spokesperson Jessica Gibby said the tool is currently available in English, Spanish and Portuguese.
With Aloud, a growing number of creators can add multilingual dubbing to their videos. and therefore opens up to a whole new audience. Aloud is not yet available to all users, but there is a waiting list users can join if they want to access it.
Hanif, YouTube’s ” tries to make translated audio tracks sound like the creator’s voice with more expression and lip sync Generative AI should also allow Aloud to launch features such as voice protection, better emotion transfer, and lip ‘re-enactment’.
Support our work ❤️
If you enjoyed this article, consider leaving a tip to help us keep publishing great content.
