ElevenLabs AI Voice Generator Can Produce 'Emotionally Rich' Recordings in 30 Languages

The AI voice generator is no longer in its beta phase.

ElevenLabs has established its name in the industry as one of the best companies when it comes to AI-powered voice generation. Its technology has been used in audiobook storytelling and other activities, yet it's always the subject of controversy.

With its AI voice generator, you can now speak in 30 languages while preserving your natural voice.

ElevenLabs AI Voice Generator Goes Out Of Beta

ElevenLabs AI Voice Generator Can Produce 'Emotionally Rich' Recordings in 30 Languages
With ElevenLabs' AI voice-cloning technology, you can now speak foreign languages while still sounding as the real you. Roaring Creations Private Limited from Pixabay

With almost every headline in the news linked to AI, it's about time to embrace its capability. However, no matter how advanced it may sound, other people just abuse it to gain the upper hand.

ElevenLabs is an example of a company with great projects but often placed in a bad light due to AI misuse.

As part of its expansion to 30 languages, ElevenLabs will be removing the beta version of its AI voice technology, per ZDNet. The beta which first started earlier this year, will be coming out as Eleven Multilingual v2, a new multilingual deep-learning model.

It's fascinating to know that ElevenLabs admits that this model can produce "emotionally" rich audio from a wide selection of available languages.

With this tool, users can utilize text-to-speech software and the VoiceLab. The second one is capable of cloning a person's voice by simply inputting a part of the recording into the platform.

According to ElevenLabs, the service kicked off on Tuesday, Aug. 22. To translate the voice into a different language such as Italian, Japanese, Chinese, or Dutch, the user should type the text first written in the original language.

When you test this out, you will hear the accented voice of the people living in a particular country. You can also learn how to properly produce tones in your speech. This is important if you are learning a language focused on tones such as Mandarin Chinese and Thai.

Deepfake Impersonators Are Ruining AI Voice Generators

ElevenLabs is subject to scrutiny when authorities learn that its AI voice generators are being abused by users who impersonate artists and other celebrities.

According to Gizmodo, this is concerning since these users from 4Chan have taken advantage of the beta platform and fooled others by throwing racial slurs, insults, misogynistic remarks, and other words which promote hate speech and violence.

With the widespread use of AI voice cloning technology, ElevenLabs needs to control its measures to avoid this kind of problem in the future. The company guarantees that each user can only clone their original voice.

To further secure the platform, a speech verification process will be asked of the users. This will be the key to identifying if the voice originally came from the person who wants to clone audio.

Even if it's already out of beta, ElevenLabs want to help narrators in their struggle with voice acting. It's efficient and a money-saver for companies who want to release more audiobooks in the future.

Joseph Henry
Tech Times
ⓒ 2024 TECHTIMES.com All rights reserved. Do not reproduce without permission.
Join the Discussion
Real Time Analytics