Benchmark › Speech models › Qwen3 TTS
Alibaba · tested 2026-11-22
Qwen3 TTS
76.3overall · rank 16 of 19 speech models
API model: qwen3-tts
Reached through Replicate
Voice: Serena24 kHz
Profile
Each spoke is one test, 0 at the centre and 100 at the edge.
Qwen3 TTSMedian of all models (dashed)
Test by test
The dot shows where this model sits among all 19: left is last, right is first.
Long text
One document sent at five lengths, a single request each. Longest clean read: 2,000 characters.
| 1,000 characters | 2,000 characters | 4,000 characters | 8,000 characters | 15,000 characters |
|---|---|---|---|---|
| 100 | 99.5 | 62.1 | 29.5 | 1.9 |
Numbers, dates and symbols
49 of 60 sentences read correctly. Hover a square for the sentence.
Text: The meeting is on 03/14/2025.
Heard: The meeting is on 03, short first 2025.
Text: Tickets cost €45 each.
Heard: Tickets cost 45 each.
Text: Flight BA2490 departs from gate C14.
Heard: Flight BA-2 for Dossi departs from gate C-14.
Text: Rent is $2,300 a month.
Heard: Rent is 2,300 a month.
Text: The fee is £18.99.
Heard: The fee is 18.99.
Text: The deadline is Jan. 5, 2026.
Heard: The deadline is Jan 5, 2026.
Plus 5 more; hover the red squares.
Emotion control
5 of 40 directed clips measurably changed. Control used: text instruction.
Angry
2/10
Excited
3/10
Scared
0/10
Whisper
0/10
Other languages
Other misses
Word accuracy
Text: They spent the whole afternoon repairing the roof before the next storm rolled in from the coast.
Heard: They spent a whole afternoon repairing the roof before the next storm rolled in from the coast.
Repeated words
Text: Row, row, row your boat, gently down the stream. Row, row, row your boat, gently down the stream.
Heard: Row, row, row your boat gently down the stream.
Text: Again and again and again and again and again, the waves hit the shore.
Heard: Again and again and again and again, the waves hit the shore.
Text: Knock, knock, knock. Nobody answered. Knock, knock, knock. Still nobody answered.
Heard: Knock knock, nobody answered. Knock knock, still nobody answered.
Audio from the test
Unedited clips exactly as the model returned them.
Plain sentence
TextThe ferry leaves the harbor every morning just after sunrise, and most of the passengers are still half asleep.
Plain sentence (most errors)
TextThey spent the whole afternoon repairing the roof before the next storm rolled in from the coast.
HeardThey spent a whole afternoon repairing the roof before the next storm rolled in from the coast.
Repetition
TextNo, no, no, no, no. I said no.
Repetition (most errors)
TextRow, row, row your boat, gently down the stream. Row, row, row your boat, gently down the stream.
HeardRow, row, row your boat gently down the stream.
Money amount
TextThe total comes to $1,250.50 after tax.
Hard text: date (failed)
TextThe meeting is on 03/14/2025.
HeardThe meeting is on 03, short first 2025.
Hard text: euro (failed)
TextTickets cost €45 each.
HeardTickets cost 45 each.
Hard text: flight (failed)
TextFlight BA2490 departs from gate C14.
HeardFlight BA-2 for Dossi departs from gate C-14.
Hard text: rent (failed)
TextRent is $2,300 a month.
HeardRent is 2,300 a month.
Spanish
Japanese
Neutral reading
Asked for: angry
Asked for: excited
Asked for: sad (not scored yet)
Asked for: whisper
Compare with
Gemini 3.8 Flash-Lite TTS · 99.2AnyToSpeech Standard voices · 98.9Gemini 3.8 Flash TTS · 98.1AnyToSpeech Premium and Characters · 93.6MiniMax Speech 2.8 HD · 90.3MiniMax Speech 2.8 Turbo · 89.2Grok TTS · 88.1Inworld TTS-2 · 84.8Eleven v3 · 82.3GPT-4o mini TTS · 81.6Kokoro 82M · 81.6Eleven Flash v2.5 · 81.3Eleven Multilingual v2 · 79Inworld TTS-1.5 Max · 77.1Gemini 2.5 Pro TTS · 76.8TTS-1 · 76.2TTS-1 HD · 70.9Chatterbox Multilingual · 59.9
Think a score is wrong? Check it.
Every test item, scoring rule and known limit is published, and the audio behind each number is on the page.