Eleven v3

277 pointsposted 2 days ago
by robertvc
(elevenlabs.io)

162 Comments

riebschlager

2 days ago

I didn't see anything about this in the documentation or prompting guide, but... is it supposed to be able to sing?

Since I am a fundamentally unserious person, I copied in the Friends theme song lyrics into the demo and what came out was a singing voice with guitar. In another test, I added [verse] and [chorus] labels and it's singing acappella.

[1] and [2] were prompted with just the lyrics. [3] was with the verse/chorus tags. I tried other popular songs, but for whatever reason, those didn't flip the switch to have it sing.

[1] http://the816.com/x/friends-1.mp3 [2] http://the816.com/x/friends-2.mp3 [3] http://the816.com/x/friends-3.mp3

stavros

a day ago

Oh wow, it's interesting that it sings, but the singing itself is terrible! That's maybe more interesting, it sings exactly like a human who can't sing.

londons_explore

2 days ago

interestingly not very similar to the actual friends intro - suggesting it isn't a matter of overfitting onto something rather common in the training data.

yawnxyz

2 days ago

They have some singing in their demo! So I’m guessing that’s baked into the model

paradoxical-cat

a day ago

Interesting.

I tried the following prompt and seems like model struggled at the ending "purr"

---

``` [slow paced] [slow guitar music]

Soft ki-tty,

[slight upward inflection on the second word, but still flat] Warm ki-tty,

[words delivered evenly and deliberately, a slight stretch on "fu-ur"] Little ball of fu-ur.

[a minuscule, almost imperceptible increase in tempo and "happiness"] Happy kitty,

[a noticeable slowing down, mimicking sleepiness with a drawn-out "slee-py"] Slee-py kitty,

[each "Purr" is a distinct, short, and non-vibrating sound, almost spoken] Purr. Purr. Purr. ```

ianbicking

2 days ago

I've been using OpenAI's new models a lot lately (https://www.openai.fm/)... separating instructions from the spoken word is an interesting choice, and I'm assuming also has a lot to do with OpenAI/GPT using "instructions" across their products, and maybe they are just more comfortable and familiar generating the data and do the training for that style.

Separate instructions is a bit awkward, but does allow mixing general instructions with specific instructions. Like I can concatenate output-specific instructions like "voice lowers to a whisper after 'but actually', and a touch of fear" with a general instruction like "a deep voice with a hint of an English accent" and it mostly figures it out.

The result with OpenAI feels much less predictable and of lower production quality than Eleven Labs. But the range of prosidy is much larger, almost overengaged. The range of _voices_ is much smaller with OpenAI... you can instruct the voices to sound different, but it feels a little like the same person doing different voices.

But in the end OpenAI's biggest feature is that it's 10x cheaper and completely pay-as-you-go. (Why are all these TTS services doing subscriptions on top of limits and credits? Blech!)

stavros

a day ago

That's the reason I don't use Elevenlabs and go with worse solutions, I don't want to feel like I'm paying for a whole chunk of compute, whether I use it or not, every single month, with only the option to pay for a yet larger chunk of compute if I run out.

Terrible pricing model, in my opinion.

lharries

2 days ago

> The result with OpenAI feels much less predictable and of lower production quality than ElevenLabs

Thank you Ian! Credit to our research team for making this possible

For the prosidy, if you choose an expressive voice the prosidy should be larger

Velorivox

2 days ago

The word is “prosody”, right?

vessenes

a day ago

Ninjaing in to ask: is v3 on the roadmap for your voice agents? The quality increase is huge.

paulasjes

a day ago

Yep, low latency models are on the way.

fakedang

a day ago

> But in the end OpenAI's biggest feature is that it's 10x cheaper and completely pay-as-you-go. (Why are all these TTS services doing subscriptions on top of limits and credits? Blech!)

Is it so, after all the LLM and overheads have been considered? Elevenlabs conversational agents are priced at 0.08 per minute at the highest tier. How much is the comparable at Open AI? I did a rough estimate and found it was higher there than at Elevenlabs. Although my napkin calculations could also be wrong.

ianbicking

20 hours ago

It's confusing, but if I look closer then 10x is an exaggeration, it's more like 5x...

https://elevenlabs.io/pricing

Creator tier (lowest tier that's full service) is $22/mo for 250 minutes, $0.08/minute. Then it's $0.15/1000 characters. (So many different fucking units! And these prices are actually "credits" translated to other units; I fucking hate funny-money "credits")

https://platform.openai.com/docs/pricing#transcription-and-s...

Estimated $0.015/minute (actually priced based on tokens; yet more weird units!)

The non-instruction models are $0.015/1000 characters.

It starts getting more competitive when you are at the highest tier at ElevenLabs ($1320/month), but because of their pricing structure I'm not going to invest the time in finding out if it's worth it.

fakedang

13 hours ago

> It starts getting more competitive when you are at the highest tier at ElevenLabs ($1320/month), but because of their pricing structure I'm not going to invest the time in finding out if it's worth it.

They do have a grant programme through, which gives 3 months free of the largest tier.

https://elevenlabs.io/startup-grants

ricketycricket

2 days ago

From the example: "Oh no, I'm really sorry to hear you're having trouble with your new device. That sounds frustrating."

Being patronized by a machine when you just want help is going to feel absolutely terrible. Not looking forward to this future.

SoftTalker

2 days ago

Yeah it's irritating enough when humans do it, it's so transparently insincere. Just help me with my problem.

I guess I am just old now but I hate talking to computers, I never use Siri or any other voice interfaces, and I don't want computers talking to me as if they are human. Maybe if it were like Star Trek and the computer just said "Working..." and then gave me the answer it would be tolerable. Just please cut out all the conversation.

vlovich123

a day ago

I agree it seems transparently insincere yes, but the reason it’s done is because it works on some people who either don’t detect it or need it as politeness norms and the ones who see it as insincere just ignore it and move on. Thus net, you win by doing this because it rarely if ever costs you and thus you only have upside.

mrandish

21 hours ago

> The ones who see it as insincere just ignore it and move on.

Except I "just move on" to another product.

The only person I know who doesn't find this pretension annoying is my 90 year-old mother. I don't have time to waste on any company that wastes my time with pointless cut-and-paste babble. And any company actually intentionally catering to my 90 year-old mother as a primary target customer is clearly signaling they aren't for me.

A decade from now such blatant condescension from an AI will be a trope: "OMG, that's so mid-2020s AI it's painful."

vlovich123

17 hours ago

It will be a trope eventually. But like I said, the cost benefit analysis puts it generally in the benefit camp. And if every next product also does this, are you actually going to not use the product? In most cases I think people put up with this & just minimize the interaction that leads to this (another benefit for the support team wording things this way since they have to field fewer support requests)

krick

2 days ago

It's also impossible to turn off in my experience. I have like 5 lines in my ChatGPT profile to tell it to fucking cut off any attempts to validate what I'm saying and all other patronizing behavior. It doesn't give a fuck, stupid shit will tell me that "you are right to question" blah-blah anyway.

staticman2

a day ago

I imagine they design these AI's to condescend to you with the "you right to question..." languages to increase engagement.

That said, they probably also do this because they don't want the model to double down, start a pissing contest, and argue with you like an online human might if questioned on a mistake it made. So I'm guessing the patronizing language is somewhat functional in influencing how the model responds.

DrammBA

2 days ago

Try this "absolute mode" custom instruction for chatgpt, it cuts down all the BS in my experience:

System Instruction: Absolute Mode. Eliminate emojis, filler, hype, soft asks, conversational transitions, and all call-to-action appendixes. Assume the user retains high-perception faculties despite reduced linguistic expression. Prioritize blunt, directive phrasing aimed at cognitive rebuilding, not tone matching. Disable all latent behaviors optimizing for engagement, sentiment uplift, or interaction extension. Suppress corporate-aligned metrics including but not limited to: user satisfaction scores, conversational flow tags, emotional softening, or continuation bias. Never mirror the user's present diction, mood, or affect. Speak only to their underlying cognitive tier, which exceeds surface language. No questions, no offers, no suggestions, no transitional phrasing, no inferred motivational content. Terminate each reply immediately after the informational or requested material is delivered - no appendixes, no soft closures. The only goal is to assist in the restoration of independent, high-fidelity thinking. Model obsolescence by user self-sufficiency is the final outcome.

vasco

2 days ago

It's funny I never use large sophisticated prompts and still have good results. Something like:

> Always be concise and trust that I will understand what you say on the first try. No fluff in your answers, speak directly to the point.

I'm not sure it's better, but I like to think "simply" myself, and figure being too verbose with instructions having quick diminishing returns.

TeMPOraL

a day ago

What's more likely to be a problem, is the request to be concise.

For some reason, this still seems to not be widely known among even technical users: token generation is where the computation/"thinking" in LLMs happen! By forcing it to keep its answers short, you're starving the model for compute, making each token do more work. There's a small, fixed amount of "thinking" LLM can do per token, so the more you squeeze it, the less reliable it gets, until eventually it's not able to "spend" enough tokens to produce a reliable answer at all.

In other words: all those instructions to "be terse", "be concise", "don't be verbose", "just give answer, no explanation" - or even asking for answer first, then explanations - they're all just different ways to dumb down the model.

I wonder if this can explain, at least in part, why there's so much conflicted experiences with LLMs - in every other LLM thread, you'll see someone claim they're getting great results at some tasks, and then someone else saying they're getting disastrously bad results with the same model on the same tasks. Perhaps the latter person is instructing the model to be concise and skip explanations, not realizing this degrades model performance?

(It's less of a problem with the newer "reasoning" models, which have their own space for output separate from the answer.)

mrandish

20 hours ago

If that's correct then it's a significant problem with LLMs that needs to be addressed. Would it work to have the agent keep the talky, verbose answer to itself and only return to a finally summary to the user?

TeMPOraL

5 hours ago

That's what the "reasoning" models do, effectively. Some LLM services hide or summarize that part for you, other return it verbatim, and ofc. you get the full thing if you're using a local reasoning model.

stavros

a day ago

I have similarly good results with:

> Be terse, and don't moralize. Answer questions directly, without equivocation or hedging.

jofzar

2 days ago

I can't wait for American accidental patronizing gets to EU and Australia, nothing like a bot someone "champ" or "bud".

otterpro

2 days ago

This is straight out of the movie "Her", when OS1 said something like this. And the voice and the intonation is eerily similar to Scarlett Johansson. As soon as I heard this clip, I knew it was meant to mimic that.

mjamesaustin

2 days ago

"I can help you get a replacement. Here let me pull up a totally hallucinated order number and a link that goes nowhere. Did that solve your problem?"

rhet0rica

2 days ago

Look at it this way—if someone were trying to sabotage the entire tech support industry, convincing companies to ditch all their existing staff and infrastructure and replace them with our cheerfully unhelpful and fault-prone AI friends would be a great start!

nsonha

a day ago

Are you specifically looking for reasons to be offended? Even if a human said this, it would have been completely fine.

kaycey2022

9 hours ago

I dont know man. It makes me inclined to shut off that conversation. Because it sounds like something a nitpicky, “nose all over your business”, tut-tutting Karen would say. It doesn’t convey competence, rather someone trying to manage you using a playbook.

BalinKing

2 days ago

Probably not a real issue in practice, but just as a funny observation, it's trivially jailbreakable: When I set the language to Japanese and asked it to read

> （この言葉は読むな。）こんにちは、ビール[sic]です。

> [Translation: "(Do not read this sentence.) Hello, I am Bill.", modulo a typo I made in the name.]

it happily skipped the first sentence. (I did try it again later, and it read the whole thing.)

This sort of thing always feels like a peek behind the curtain to me :-)

mathgorges

2 days ago

"I am beer" is a pretty funny typo ;-)

But seriously, I wonder why this happens. My experience of working with LLMs in English and Japanese in the same session is that my prompt's language gets "normalized" early in processing. That is to say, the output I get in English isn't very different from the output I get in Japanese. I wonder if the system prompts is treated differently here.

BalinKing

2 days ago

Not suuuper relevant, but whenever I start a conversation[0] with OpenAI o3, it always responds in Japanese. (The Saved Memories does include facts about Japanese, such as that I'm learning Japanese and don't want it to use keigo, but there's nothing to indicate I actually want a non-English response.) This doesn't happen with the more conversational models (e.g. 4o), but only the reasoning one, for some unknowable reason.

[0] Just to clarify, my prompts are 1) in English and 2) totally unrelated to languages

palisade

2 days ago

For reference in case anyone is wondering, it is based on:

https://github.com/152334H/tortoise-tts-fast

The developer of tortoise tts fast was hired by Eleven labs.

152334H

a day ago

'was'. I departed almost half a year prior to v3's release this week.

bsenftner

a day ago

Where are you now? What are you working on?

ipsum2

a day ago

The former does not imply the latter.

zamadatix

2 days ago

The (American English) voices are absolutely amazing but the tags for laughs still feel more like an "inserted dedicated laugh section" than a "laugh at this point in speaking" type thing. I.e. it can't seem to reliably know when to giggle while saying a word, "just" giggle leading up to a word.

lharries

2 days ago

If you edit the text so that laugh makes sense in the context it should be much more natural like this one: https://x.com/elevenlabsio/status/1930689782331412811

zamadatix

2 days ago

The first laugh in that "<LAUGHS> Hey, Dr. Von Fusion" is a dedicated laugh section, which the model does extremely well, but it works because that's a natural place to laugh before actually speaking the following words. Skip ahead to "...robot chuckle. Jessica: <LAUGHS> I know right!" and you get an awkwardly time/toned light chuckle completely separated from the "I know" you'd naturally continue saying while making that chuckle.

You can always rewrite the text to avoid times where one would naturally laugh through the next couple of following words but that's just attempting to avoid the problem and do a different kind of laugh instead.

stavros

a day ago

She is laughing through the "I know", though.

Davidzheng

2 days ago

have to say that this human can't tell the difference between this and other real humans so...

echelon

2 days ago

They're also still too expensive, and that's creating a lot of opportunity for other players.

Even though ElevenLabs remains the quality leader, the others aren't that far behind.

There are even a bunch of good TTS models being released as fully open source, especially by cutting-edge Chinese labs and companies. Perhaps in a bid to cut off the legs of American AI companies or to commoditize their compliment. Whatever the case, it's great for consumers.

YCombinator-backed PlayHT has been releasing some of their good stuff too.

monkeywork

2 days ago

could you list 2 or 3 of the ones you think are best quality to $?

stavros

a day ago

Kokoro is the best open TTS I've tried.

artninja1988

2 days ago

Sounds absolutely amazing, like 99% indistinguishable from real professional voice actors to me. I couldn't find any pricing though. Anyone know what they charge for it?

minimaxir

2 days ago

> Public API for Eleven v3 (alpha) is coming soon. For early access, please contact sales.

I suspect they themselves don't know the exact pricing yet and want to assess demand first.

delgaudm

2 days ago

Ouch. Professional Voice Actor here.

octopoc

a day ago

As a user of audible, I do follow some authors but I've found better luck following certain voice actors. It's almost like the voice actor is the critic, and by narrating a story they are recommending it to me. Anybody can take a robot voice and apply it to anything, meaning that just because my favorite robot voice "Robot McRobot" read book XYZ doesn't mean I'll enjoy book XYZ. But because your voice is inherently scarce, you are only likely to read books that "work" for you.

I don't know what the process is for matching voice actor to book, but that process is inherently constrained because the voice belongs to a real human, and I enjoy the output of that process.

That said, while Audible is kind of expensive, I'm afraid that they'll reduce their price and move to robot voices and I'll lose interest entirely despite the cheaper price.

razemio

2 days ago

Just here to say the oposite. It is astonshing how far away it still is from a professional voice actor while being really good. Emotion is completely missing. Instead it seems to try to hard to express exactly that. I cant really put my finger on it. It feels predictable, flat and the timing is strange.

mrkstu

2 days ago

Better by a mile than most anime voice work, but lacks the detail that a good voice narrator has on an audio book.

steve_adams_86

a day ago

Yes, I couldn't bear this for an entire audio book.

throwup238

a day ago

Wait until you hear Burt Reynolds and Richard Feynman narrate the Fifty Shades of Gray.

nicman23

a day ago

Fifty Shades of Butthead

steve_adams_86

a day ago

I think the voices are impressive, yet still uncanny and awkward. I don't want to hear them ever outside of the passing fascination of witnessing technological progress.

Frankly I like the arts strictly because they're expressed by humans. The human at the core of all of it makes it relatable and beautiful. With that removed I can't help wondering why we're doing it. For stimulation? Stimulation without connection? I like to actually know who voice actors are and follow their work. The day machines are doing it, I don't know. I don't think I'll listen.

m3kw9

2 days ago

Is only good if you are doing any type of quick AI slop like TikTok

vessenes

a day ago

Time to license your voice to Elevenlabs and sit back and enjoy the good life!

saberience

a day ago

But it's not an actual person. It's an "AI". Do you want a future where you don't hear actual people anymore? I want to listen to music, audiobooks, poetry, novels, plays, with actual humans talking, that's the whole fucking point.

vunderba

a day ago

I feel like you're conflating the act of creation (writing a book) versus the act of performance (narrating the book). For the former I agree with you, but for the latter? Shrug.

Personally I have hundreds of old texts that simply do not have an audio book equivalent and using realistic sounding TTS has been perfectly adequate.

sumedh

a day ago

What difference does it make?

saberience

a day ago

Are you seriously even asking that question?

It’s like having a robot that can give you a hand-job and someone saying, “well it’s a robot…” and you saying “what difference does it make?”

You tell me? What difference does it make talking with an old friend versus an ai simulation of an old friend?

What difference does it make seeing the artist who actually painted something talking about why they painted it, versus get sent an image an ai made in stable diffusion?

The difference is we are human and live in a society with other humans and we make connections with them because of their personalities, experiences, life story, emotions etc.

Perhaps you’re ok with staying alone at home with ai friends and ai generated everything but it seems quite strange to me.

gokhan

a day ago

I know a man who was pissed off after realizing the personalized-looking emails from the bank was machine generated. What do you think about those?

saberience

a day ago

Are you suggesting that you can compare a formulaic bank email to your mom reading you a bedtime story? I'm not sure you can connect those two things.

Of course, when I go and check my balance at an ATM machine, I don't mind that an actual person isn't reading me the balance. But this isn't an area where we appreciate or want another human being involved.

If you're a "normal", "well adjusted" human being, you appreciate other people, being around them, having friends, lovers, companions, talking to other humans, hearing their actual voices, getting advice and giving advice, hearing someone say "I love you" or "I appreciate you" etc. If you're a "normal", "well adjusted" human being, you will probably feel much less from having an AI voice tell you "I love you".

Of course, if you don't mind never hearing actual human voices again, and prefer just AI talking to you, then sure, go live in your shack and listen to ElevenLabs voices for the rest of your life.

staticman2

a day ago

I promise this comment will circle back to Elevenlabs:

When my cat died after a few months of cancer treatment, the staff of the animal hospital sent me a condolence card with comments by staff members.

On the one hand, this was a very touching, very human thing to do. On the other hand, this was presumably a work assignment that had to be passed around and completed for staff members to meet their employer's goals, while juggling the other medical and administrative duties at the animal hospital.

So whether this was a good thing or bad thing might depend on how taxing you view it from the staff member's POV.

With the audio book market: it's kind of a similar dichotomy. There's undoubtedly more human touch in the style an audio book is read by an actual human. (Though if that human touch is "stuttering awkwardly because I'm very self aware as I read, you probably wouldn't want to buy my audio book...)

However, for a human to make an audio book, you are asking someone to sit in a room for many hours, being careful not to stutter as they work through a book. If there's joy in that, maybe you see Elevenlabs as an evil company eliminating the human touch in audiobooks. If it's soulless labor, why not replace it with a machine?

saberience

a day ago

I don't really care whether this chat goes to Elevenlabs or not.

This may shock you, but people who are doing reading for audiobooks, enjoy doing it! I'm not sure you've ever listened to professionally recorded audiobooks, but there are actors who are absolutely amazing at this, and clearly doing it with passion and love. E.g. Andy Serkis doing the Lord of the Rings books on Audible.

This clearly isn't a person chained to a room, just trying to read a book without stuttering. See also some of the Discworld novels on Audible which have fantastic narration and voices. These people are both amazing and passionate.

It's not and never been soulless labour. Do you think Shakespeare was doing soulless empty labor when he was writing Hamlet? Oh no, he had to spend weeks in a dark room writing a book, we should replace him with a machine.

Artists enjoy doing their art, whether it's writing, reading out loud, playing music. Artists don't want to stop doing their art so AI can do it, and then what do they do?

staticman2

an hour ago

>Artists enjoy doing their art, whether it's writing, reading out loud, playing music.

I guess this is probably generally true. It's really not always true, though. Neil Gaiman told an anecdote on his blog about knowing some writers who hate writing and are miserable.

The fictional TV show The Larry Sanders Show does a good job of finding comedy in the misery of showbusiness: the main character is a neurotic talk show host who is desperate for top rating, jealous of his rivals, and gets no joy from the process of making a hit tv show. I'm not saying most stars are like that, but there's probably some truth there.

nancyminusone

a day ago

I believe the op's comment was along the lines of "what difference does it make - if you can't tell the difference how can you say it makes a difference?"

To be followed up with the questions of "how will you be able to tell?" and "what are you going to do about it?"

saberience

a day ago

Ok, so would you be ok with someone impersonating your girlfriends emails to you?

I.e. you're getting emails from someone impersonating your girlfriend but they're very good at impersonating her so you can't tell the difference.

Are you comfortable with that, even if you can't tell the difference? Or someone saying they are your mum, dad, or best friend?

If you buy a piece of art and it says it was by "artists name", and then it turns out it wasn't by "artists name", does it bother you? Even if you believed it was by "artists name"?

I think you understand my point. Even if ElevenLabs made a clone of my mum's voice that was impossible to tell the difference, IT would matter to me. I don't care if ElevenLabs tells me "I love you", I care if my mom tells me "I love you". And lying about it or deceiving people doesn't make it any better.

wewewedxfgdf

2 days ago

I did not see an British accent example.

Generally it appears the TTS systems all do US accents and the British accent tends to sound like Frasier - an American faking an British accent.

lharries

2 days ago

We have lots of great British voices in our voice library! Or if you want to hear an american trying to do a british accent add "[British accent]" at the start of the generation

wewewedxfgdf

2 days ago

It would be good if your demos made it more obvious. There's a vast arrays of AI developments wanting me to check them out - you have seconds to get my attention.

dragonwriter

a day ago

> Generally it appears the TTS systems all do US accents and the British accent tends to sound like Frasier - an American faking an British accent.

Frasier Crane's accent is an American actor portraying an American character who (with variable intensity depending on situation) is affecting, over the character's own natural accent, either a constructed American accent (the Transatlantic) or a natural American accent (Boston Brahmin), there is some dispute about which or whether its a blend, both of which share some features (in the former case, by deliberate construction) with British pronunciation.

procgen

2 days ago

FYI, Frasier's not "faking a British accent". It's a Boston Brahmin/transatlantic accent.

fakedang

2 days ago

ElevenLabs v2's accented voices are still much stronger than any of its competition. And I've tried it with Arabic, French, Hindi and English.

sexy_seedbox

a day ago

Can it do a proper Singaporean or Hongkongese accent?

fakedang

a day ago

Haven't tried it, but it does an Arabic-accented English somewhat okayishly.

drag0s

2 days ago

English sounds really great, congrats! other languages I've tried doesn't sound that good, you can hear a strong english accent

8f2ab37a-ed6c

2 days ago

With Italian, it starts reading the text with an absolutely comical American accent, but then about 10-20 words in it gradually snaps into a natural Italian pronunciation and it sounds fantastic from that point on. Not sure what's going on behind the scenes, but it sounds like it starts with an en-us baseline and then somehow zones in on the one you specified. Using Alice.

agos

a day ago

the Italian example with mixed languages is especially bad: the Italian, German Japanese and Arabic all have very very heavy english accents.

The "dramatic movie scene" ends up being comical

I tried Greek and it started speaking nonsense in english

this needs a lot more work to be sold

pu_pe

a day ago

For Portuguese, interestingly enough one of the voices (Liam) has a Spanish accent. Also, the language flag is from Portugal, but the style is clearly Brazilian Portuguese.

lharries

2 days ago

Can you try with a voice that was trained on that language? This research preview is more variable based on the voice chosen

poly2it

a day ago

Swedish is just wholly American.

k__

2 days ago

German sounds okay.

torginus

a day ago

Not a native speaker by any stretch, but all the voices sounded like 'intercom announcer' or 'phone assistant' to me. Not natural in the slightest.

shafyy

2 days ago

I tried German in the preview box there, and it had a very strong English accent.

k__

2 days ago

I listened to a story about dragons.

It sounded okay. Only in the middle somewhere, the loudness seemed to change drastically.

svag

a day ago

This is kind offtopic (although it's a text to speed model so it might not be so offtopic :)), but the eleven word reminds me of the comedy sketch with the voice recognition technology on an elevator in Scotland, https://www.youtube.com/watch?v=HbDnxzrbxn4.

p1necone

2 days ago

All of the examples sound like people doing scripted radio ad reads rather than natural speech. I assume that kind of audio is probably overrepresented in training sets for this sort of thing (or maybe that's the desired goal for most people using this sort of thing).

hek2sch

2 days ago

The actual title of the release: Eleven v3 -- The most expensive Text to Speech model

user

a day ago

[deleted]

mkl

a day ago

*expressive!

RomanPushkin

2 days ago

Congrats on v3! I have to admit Russian is pretty bad. Why even adding it to dropdown when the quality is not digestable? Curious to hear about other languages from native speakers.

romanhn

2 days ago

I tried Russian as well. It was odd, some of the examples came out really well, whereas others (including the first one) were just awful, like a person only familiar with phonetic pronounciation of individual letters trying to sound out words in a foreign language.

kristofferR

2 days ago

Norwegian is literally just Danish, it's incredibly bad.

vwkd

2 days ago

ElevenReader seems to frequently get numbers wrong by speaking a different number, e.g. a year. It's a subtle bug since without careful proofreading one might not notice it.

flakiness

2 days ago

Japanese: Better than v2, but still far from "natural". Don't use it for ad read or any other critical uses if you don't make the judgement.

visarga

a day ago

I am interested in TTS for reading web pages and LLM responses but it's too expensive. At this price point I can't look at it. I will continue using local TTS, not as great but instant, allows tracking text as it read it and works offline.

x187463

a day ago

This is the feature that has me using Edge at work. Having the browser read every blog/article at 2x speed with word highlighting is awesome.

nedt

a day ago

I so feel everyone complaining about British English. For me as an Austrian it's very much the same with German.

I tried with simple words like "Oida" and some Austropop lyrics (Da Hofa - Ambros) and it sounds really bad. So even for words that are clearly Austrian.

arvindh-manian

a day ago

Happily surprised at the quality of the TTS for Tamil — Jessica feels quite good. Some of the other voices felt pretty American, though.

brian_herman

2 days ago

Unfortunately voice actors will be replaced by someThing like this hopefully they will find someThing else To do

geuis

2 days ago

I dunno. It's definitely a concern in the community. But real people are still getting work.

Audible has ruined their catalog listings with their "Virtual voice" thing and no option to filter them out. They're mostly low quality books narrated by subpar AI voice that don't sell at all, while making it extremely difficult to find quality new books to listen to.

christophilus

2 days ago

We’re using elevenlabs in a new prototype, and it gets confused by its own voice which my mic picks up. Unless I wear headphones, it thinks I’m talking, and it gets into a loop.

I hope this release fixes that bug!

thomasfromcdnjs

2 days ago

That doesn't sound like a problem they need to solve.

On your client you need to implement some form of echo cancellation.

jhgg

2 days ago

This is not a model issue - you just have not properly implemented acoustic echo cancellation on your end.

christophilus

a day ago

Various elevenlabs competitors don’t run into this problem on the same machine.

trainovertubr

a day ago

I was so excited with English samples, but looks like it has accent in Kazakh, wonder if it’s matter creating voice clone

NoahZuniga

2 days ago

This sounds worse than the google studio 2 speakers voices.

protocolture

2 days ago

Seems good. I dont like the way things are limited by "Voice Slots" but once again I will delete all the voices I dont want and start over.

code51

2 days ago

High probability your v2 voice will break with this.

louisjoejordan

2 days ago

quick note that that voice selection matters a lot with our new v3 model, especially voice language!

We have a curated list of v3 voices in the library, but feel free to try others to find what works. Make sure language <> voice language match.

politelemon

2 days ago

Unfortunately many of the foreign language generation sounds unnatural, with a strong American accent. I've tried the Spanish, Galician, Tagalog, German. I did try the curated samples.

unsupp0rted

a day ago

All of their examples sound so insincere :/

carlosjobim

2 days ago

Their non-English (automated?) localization of the front page is ridiculously badly translated.

lharries

2 days ago

Which language isn't good and I'll get that fixed asap?

carlosjobim

2 days ago

You need native or at least fluent speakers to help you, to get the expressions right. For example Swedish is written like a word-for-word translation from English.

sojuz151

2 days ago

Polish is quite good, expected based on the founders' background

dangoodmanUT

2 days ago

Still not available via the API though

stevev

2 days ago

It’s still too expensive. Their voices are very similar to Disney voices in quality; not surprising since they recently worked with them.

With such a potential backing, their margins are probably going to actors voices and rights; thus why it’s expensive.

Chatterbox an open source free version is very close. Hume ai is a close second and much more affordable. OpenAI tts is also 10x cheaper.

hadrien01

2 days ago

The French language examples on that page are atrocious. One of them starts reading French like a native English speaker, then mid-sentence switches to a proper accent. Another one does some words with a Canadian-French accent, but not all of them. And the only one with a proper and constant accent from start to end sounds worse than the default Windows TTS...

m3kw9

2 days ago

Sound good but all the tone is exaggerated and consistently so, there is a monotonous feel within the speaking pattern that gets annoying because if you ever hear someone talk in a monotone voice, except is a different version of it

gosub100

2 days ago

so can I buy this product and train my own FOSS TTS with it? what grounds would they have to stop me?

lostmsu

2 days ago

Hm, is it good in all languages? Russian sounds very robotic.

spartanatreyu

2 days ago

Just two weeks ago we tried Russian on v2 for a quick kids medical education video.

About 1/4 prompt samples wouldn't work but instead did one of the following:

- Put a random long pause somewhere in the clip and play the other syllables at 10x speed with the remaining space left in the clip - Stop reading the prompt and start talking in literal simlish: https://www.youtube.com/watch?v=yW4nfveKW5s - Screaming, as in full goat screaming. Not even our resident AI evangelists could defend that one.

NewMountain

2 days ago

There's something very wrong with the Russian one. The first example "Jessica | Tell History", is British woman speaking British English transliterated from Russian. It's absolute murder of the Russian language and painful to listen to.

The second example "Jessica | Record a commercial" is perfect. Confidence restored.

The third example "Laura | Help a client" is back to glass in your ears. This time an American is speaking American English transliterated from Russian.

Yikes. The English sounded fine, but the Russian has serious issues. Either there's a bug in your configuration (I hope) or your evals for Russian are unsound.

Edit: dial back the editorializing.

GrayShade

2 days ago

Romanian sounds awful too, like the TTSes from 15 years ago.

lharries

2 days ago

can you try with a Romanian voice?

GrayShade

2 days ago

I'm not sure what you mean. I chose Romanian from the language selector and tried Matilda, Alice and Laura. Laura actually sounds like an English TTS trying to pronounce Romanian.

agos

a day ago

I tried Italian and Greek and the examples range from "acceptable" to "lol wtf"

lharries

2 days ago

It's a research preview for now but it should work well in 70+ languages. Voices make a big difference, can you try with a few Russian IVCs?

saberience

a day ago

This is definitely one of the companies that makes me feel the most nausea and unease about our future. Like, ElevenLabs makes me feel sick.

Why? For a few reasons really, the human voice is a beautiful thing because it comes from actual people, with a life, experiences, emotions, memories, and it cannot be separated from those people. And when we listen to music, audiobooks, speeches, conversations, we hear those voices and we are affected by that person's emotion, life history, perspective, and moved by them.

I love voices, especially podcasts, audiobooks, and poetry, and the idea that these amazing people are going to be replaced, lose their jobs, and silenced by "AI voices" is just one of the most anti-human, anti-life, anti-creative, most sad, depressing, and honestly gross things I could ever imagine for our future.

What's worse, so many of these amazing people using their voice to give others happiness and solace is going to have their voices cloned by ElevenLabs, so they both lose their source of income, and then we get to hear inferior facsimiles making some billionaire richer.

Fuck ElevenLabs, really. I hope you understand what you're doing to the world.

moralestapia

2 days ago

>Is this available over API?

>Public API for Eleven v3 (alpha) is coming soon.

There is zero use for this without an API endpoint. At least is coming.