Use AI to Clone Voices & Speak OTHER LANGUAGES! - Elevenlabs + ChatGPT 4

ElevenLabs is a company that creates advanced speech synthesis models using deep learning and generative media. They have recently launched their Eleven Multilingual v1 model, which supports seven new languages: French, German, Hindi, Italian, Polish, Portuguese, and Spanish. This model can also identify multilingual text and articulate it appropriately, as well as adjust delivery based on context and convey intent and emotions hyper-realistically. You can try it out on their Beta platform! In today's video, we put it to the test!

▼ Link(s) From Today’s Video:

-------------------------------------------------

▼ Extra Links of Interest:

-------------------------------------------------

Thanks for watching Matt Video Productions! I make all sorts of videos here on Youtube! Technology, Tutorials, and Reviews! Enjoy Your stay here, and subscribe!

All Suggestions, Thoughts And Comments Are Greatly Appreciated… Because I Actually Read Them.

-------------------------------------------------

[MattVidPro]

I will pin anyone who gives a review in every single language! How many of you speak all eight??

[cbuchner]

That German produced by the multilingual model is flawless. I am impressed. The second generation with the accent was hilarious. The third generation had a few weird sounding spots in it. So the first German generation you made wins.

[jakeyulo]

Imagine this working in real time with airpods, being able to have a legible conversation in person with anyone on the planet who also has the same setup. Actually think this tech could be very beneficial for understanding one another and empathizing across cultures/borders.

[MrMiguelChaves]

You speak Spanish with perfect Peruvian accent! :D The Portuguese was Brazilian. Both were generated flawlessly. I'm a native speaker of both.

[avidlearner]

As a French Québécois, I was STUNNED by the French! It is Québécois, which is extremely surprising given we’re 10x less than the French from France, but the modulation of the voice was really flat. Also, there was an error in a “ce” that was extended “ceeee”. We don’t do that. Overall, it was stunning.

[arielcurra]

6:40 German
10:01 Spanish
18:47 Italian
20:45 Canadian French
22:07 Polish
23:06 Hindi
24:48 Portuguese

[DidaO]

I speak both German and Spanish, and by now, German sounds really well pronounced, see no issues nor accent!

[leandro]

Brazilian here. The intonation is on point. Sounds very natural.

[CesarDelgado-oizq]

I do speak 4 languages. The french was not bad, but it was Canadian French. Portuguese was Brazilian, which as you know is very different from Portuguese from Portugal. Spanish was pretty good. Italian was ok but a little bit mechanical...

[davestagler]

As a native German speaker, I can say that the first German version in the multilingual version was the best, perfect even. Additionally, it was really incredible to hear you speak German accent-free, it was surreal

[ashiga]

a blessed update for 11Labs, accents 👍🏻 next upgrade should be be emotions, intonations, pronunciations and styles

[OmegaGlops]

I've seen some of this on _that_ imageboard! I'm not sure if it was this exact tech, but they were cloning the Japanese voice actors from animes and creating perfect redubs by having their original voice actors speak their lines in English. It was really cool!

It's awesome that you can avoid the issue of dubbed actors not sounding anything like the voices the original director intended them to have, but it is kinda unfortunate for voice actors that work in the redubbing industry. AI ethics are once again are a complicated subject.

I'm certainly excited for AI fandubs, though! There's a lot of anime out there that had less than stellar English dubs that I'd love to see revisited by having voices truer to the source material!

[bardzobardzowredna]

The Polish language is almost perfect. If you listen several times, you may hear that the voice itself is a bit artificial, but it's very, very good. I think that this is the best artificial polish voice / generator you can find.

[felipe]

the spanish one is really good, the pronunciation is clear and the entonation is excelent the artifacts are weird, but it didn't interfere with anything, and you could understand everything, also the accent is pretty neutral. Is actually scary how it feels more alive that the voice of many youtube channels 💀💀💀

[Gordypow]

Elevenlabs is so game changing, it's mind blowing stuff.

[Hereicome.]

Hindi was amazing. It was like a real human is speaking. Difficult to tell that it was your voice though!

[youtube_fantastic]

Hindi was so surreal haha. It was very formal sounding but damn it sounded just like you. Strange to hear a perfect hindi accent from you, havin watched all your videos in English lol

[ecruells]

The spanish one sounded very good, almost perfect, it had a latin american accent.

[smartduck]

This would be perfect for video calls to friends from other countries

[hellonterna]

Portuguese was very Brazillian and it was incredibly good. Amazing how it puts your voice in another language!