Benchmark › Speech models › Chatterbox Multilingual
Resemble AI · open source · tested 2026-11-22
Chatterbox Multilingual
59.9overall · rank 19 of 19 speech models
API model: chatterbox-multilingual
Reached through Replicate
Voice: default24 kHz
Profile
Each spoke is one test, 0 at the centre and 100 at the edge.
Chatterbox MultilingualMedian of all models (dashed)
Test by test
The dot shows where this model sits among all 19: left is last, right is first.
Long text
One document sent at five lengths, a single request each. Longest clean read: none.
| 1,000 characters | 2,000 characters | 4,000 characters | 8,000 characters | 15,000 characters |
|---|---|---|---|---|
| 34.3 | 17.2 | 8.6 | 4.1 | 2.1 |
Numbers, dates and symbols
36 of 60 sentences read correctly. Hover a square for the sentence.
Text: The total comes to $1,250.50 after tax.
Heard: The total comes to $120.50, $50.50 after tax.
Text: The city has 3,482,000 residents.
Heard: The city has three House 492,000 residents.
Text: The meeting is on 03/14/2025.
Heard: The meeting is on 03/04 for 2025.
Text: Call us at 555-0142.
Heard: Call us at 55T-742.
Text: Visit www.example.org/start for details.
Heard: Visit www.tiles.org start for details.
Text: It was -5°C this morning.
Heard: It was five Jack C this morning.
Plus 18 more; hover the red squares.
Emotion control
2 of 40 directed clips measurably changed. Control used: none offered.
Angry
1/10
Excited
1/10
Scared
0/10
Whisper
0/10
Other languages
Other misses
Repeated words
Text: Very, very, very good. Really, really, really, really good.
Heard: Very, very, very good. Really, really, really, really, really good.
Text: Left, right, left, right, left, right, left. Keep marching, keep marching, keep marching.
Heard: Left right left right left right left. Keep marching keep marching keep marching. Hello
Text: Knock, knock, knock. Nobody answered. Knock, knock, knock. Still nobody answered.
Heard: knock knock knock nobody answered knock knock knock knock still nobody answered
Audio from the test
Unedited clips exactly as the model returned them.
Plain sentence
TextThe ferry leaves the harbor every morning just after sunrise, and most of the passengers are still half asleep.
Repetition
TextNo, no, no, no, no. I said no.
Repetition (most errors)
TextVery, very, very good. Really, really, really, really good.
HeardVery, very, very good. Really, really, really, really, really good.
Money amount
TextThe total comes to $1,250.50 after tax.
Hard text: big-number (failed)
TextThe city has 3,482,000 residents.
HeardThe city has three House 492,000 residents.
Hard text: date (failed)
TextThe meeting is on 03/14/2025.
HeardThe meeting is on 03/04 for 2025.
Hard text: phone (failed)
TextCall us at 555-0142.
HeardCall us at 55T-742.
Hard text: url (failed)
TextVisit www.example.org/start for details.
HeardVisit www.tiles.org start for details.
Spanish
Japanese
Neutral reading
Asked for: angry
Asked for: excited
Asked for: sad (not scored yet)
Asked for: whisper
Compare with
Gemini 3.8 Flash-Lite TTS · 99.2AnyToSpeech Standard voices · 98.9Gemini 3.8 Flash TTS · 98.1AnyToSpeech Premium and Characters · 93.6MiniMax Speech 2.8 HD · 90.3MiniMax Speech 2.8 Turbo · 89.2Grok TTS · 88.1Inworld TTS-2 · 84.8Eleven v3 · 82.3GPT-4o mini TTS · 81.6Kokoro 82M · 81.6Eleven Flash v2.5 · 81.3Eleven Multilingual v2 · 79Inworld TTS-1.5 Max · 77.1Gemini 2.5 Pro TTS · 76.8Qwen3 TTS · 76.3TTS-1 · 76.2TTS-1 HD · 70.9
Think a score is wrong? Check it.
Every test item, scoring rule and known limit is published, and the audio behind each number is on the page.