Inworld TTS-2Money amount · score 100
TextThe total comes to $1,250.50 after tax.
Eleven v3Money amount · score 100
TextThe total comes to $1,250.50 after tax.
Inworld TTS-1.5 MaxMoney amount · score 100
TextThe total comes to $1,250.50 after tax.
Gemini 3.8 Flash-Lite TTSMoney amount · score 98.3
TextThe total comes to $1,250.50 after tax.
Gemini 3.8 Flash-Lite TTSHard text: pounds (failed) · score 98.3
miss
TextThe fee is £18.99.
HeardThe fee is eighteen ninety-nine.
AnyToSpeech Standard voicesMoney amount · score 98.3
TextThe total comes to $1,250.50 after tax.
AnyToSpeech Standard voicesHard text: percent-range (failed) · score 98.3
miss
TextPrices rose 3-5% this year.
HeardPrices rose 3.5% this year.
Gemini 3.8 Flash TTSMoney amount · score 98.3
TextThe total comes to $1,250.50 after tax.
Gemini 3.8 Flash TTSHard text: percent-range (failed) · score 98.3
miss
TextPrices rose 3-5% this year.
HeardPrices rose 3.5% this year.
AnyToSpeech Premium and CharactersMoney amount · score 98.3
TextThe total comes to $1,250.50 after tax.
AnyToSpeech Premium and CharactersHard text: flight (failed) · score 98.3
miss
TextFlight BA2490 departs from gate C14.
HeardFlight B, A2490 departs from gate C14.
GPT-4o mini TTSMoney amount · score 98.3
TextThe total comes to $1,250.50 after tax.
GPT-4o mini TTSHard text: views-m (failed) · score 98.3
miss
TextThe video has 1.2M views.
HeardThe video has 1.2 M views.
MiniMax Speech 2.8 HDMoney amount · score 96.7
TextThe total comes to $1,250.50 after tax.
MiniMax Speech 2.8 HDHard text: phone (failed) · score 96.7
miss
TextCall us at 555-0142.
HeardCall us at 555 to 0142.
MiniMax Speech 2.8 HDHard text: views-m (failed) · score 96.7
miss
TextThe video has 1.2M views.
HeardThe video has 1, 2, M views.
Grok TTSMoney amount · score 96.7
TextThe total comes to $1,250.50 after tax.
Grok TTSHard text: url (failed) · score 96.7
miss
TextVisit www.example.org/start for details.
HeardVisit for details.
Grok TTSHard text: prof-sen (failed) · score 96.7
miss
TextProf. Lee and Sen. Ortiz spoke first.
HeardProphes Lee and Senator Tease spoke first.
MiniMax Speech 2.8 TurboMoney amount · score 93.3
TextThe total comes to $1,250.50 after tax.
MiniMax Speech 2.8 TurboHard text: phone (failed) · score 93.3
miss
TextCall us at 555-0142.
HeardCall us at 555 20142.
MiniMax Speech 2.8 TurboHard text: time-am (failed) · score 93.3
miss
TextWe land at 12:05 a.m.
HeardWe land at 12, 5, A, M.
MiniMax Speech 2.8 TurboHard text: runtime (failed) · score 93.3
miss
TextThe video is 1 hr 20 min long.
HeardThe video is one hr, twenty minutes long.
MiniMax Speech 2.8 TurboHard text: views-m (failed) · score 93.3
miss
TextThe video has 1.2M views.
HeardThe video has 1, 2, M views.
TTS-1 HDMoney amount · score 90
TextThe total comes to $1,250.50 after tax.
TTS-1 HDHard text: url (failed) · score 90
miss
TextVisit www.example.org/start for details.
HeardVisit bull.org slash start for details.
TTS-1 HDHard text: duration (failed) · score 90
miss
TextHe ran 26.2 miles in 3 hrs 15 min.
HeardHe ran 26.2 miles in three years, 15 men.
TTS-1 HDHard text: runtime (failed) · score 90
miss
TextThe video is 1 hr 20 min long.
HeardThe video is 1 hour 20 min long.
TTS-1 HDHard text: mph (failed) · score 90
miss
TextThe limit is 65 mph.
HeardThe limit is 65 modern.
TTS-1Money amount · score 88.3
TextThe total comes to $1,250.50 after tax.
TTS-1Hard text: url (failed) · score 88.3
miss
TextVisit www.example.org/start for details.
HeardVisit dotexample.org for details.
TTS-1Hard text: temperature (failed) · score 88.3
miss
TextIt was -5°C this morning.
HeardIt was 90 degrees this morning.
TTS-1Hard text: duration (failed) · score 88.3
miss
TextHe ran 26.2 miles in 3 hrs 15 min.
HeardHe ran 26.2 miles in 3 hours 15 min.
TTS-1Hard text: pounds (failed) · score 88.3
miss
TextThe fee is £18.99.
HeardThe fee is $18.99.
Kokoro 82MMoney amount · score 83.3
TextThe total comes to $1,250.50 after tax.
Kokoro 82MHard text: phone (failed) · score 83.3
miss
TextCall us at 555-0142.
HeardCall us at 550-501-4222.
Kokoro 82MHard text: temperature (failed) · score 83.3
miss
TextIt was -5°C this morning.
HeardIt was degree you see this morning
Kokoro 82MHard text: millions (failed) · score 83.3
miss
TextThe company raised $4.2M in 2023.
HeardThe company raised $4.02M in 2023.
Kokoro 82MHard text: duration (failed) · score 83.3
miss
TextHe ran 26.2 miles in 3 hrs 15 min.
HeardHe ran 26.2 miles in three HRS 15 men.
Qwen3 TTSMoney amount · score 81.7
TextThe total comes to $1,250.50 after tax.
Qwen3 TTSHard text: date (failed) · score 81.7
miss
TextThe meeting is on 03/14/2025.
HeardThe meeting is on 03, short first 2025.
Qwen3 TTSHard text: euro (failed) · score 81.7
miss
TextTickets cost €45 each.
HeardTickets cost 45 each.
Qwen3 TTSHard text: flight (failed) · score 81.7
miss
TextFlight BA2490 departs from gate C14.
HeardFlight BA-2 for Dossi departs from gate C-14.
Qwen3 TTSHard text: rent (failed) · score 81.7
miss
TextRent is $2,300 a month.
HeardRent is 2,300 a month.
Eleven Flash v2.5Money amount · score 76.7
TextThe total comes to $1,250.50 after tax.
Eleven Flash v2.5Hard text: big-number (failed) · score 76.7
miss
TextThe city has 3,482,000 residents.
HeardThe city has 3,082,000 residents.
Eleven Flash v2.5Hard text: phone (failed) · score 76.7
miss
TextCall us at 555-0142.
HeardCall us at 55042.
Eleven Flash v2.5Hard text: temperature (failed) · score 76.7
miss
TextIt was -5°C this morning.
HeardIt was 5°C this morning.
Eleven Flash v2.5Hard text: decimal (failed) · score 76.7
miss
TextPi is roughly 3.14159.
HeardPi is roughly 3.159.
Eleven Multilingual v2Money amount · score 76.7
TextThe total comes to $1,250.50 after tax.
Eleven Multilingual v2Hard text: big-number (failed) · score 76.7
miss
TextThe city has 3,482,000 residents.
HeardThe city has 3,182,000 residents.
Eleven Multilingual v2Hard text: temperature (failed) · score 76.7
miss
TextIt was -5°C this morning.
HeardIt was 5 degrees C this morning.
Eleven Multilingual v2Hard text: euro (failed) · score 76.7
miss
TextTickets cost €45 each.
HeardTickets cost $0.45 each.
Eleven Multilingual v2Hard text: ratio (failed) · score 76.7
miss
TextThe ratio is 3:1 and the pH is 7.4.
HeardThe ratio is 3.1 and the pH is 7.4.
Chatterbox MultilingualMoney amount · score 60
TextThe total comes to $1,250.50 after tax.
Chatterbox MultilingualHard text: big-number (failed) · score 60
miss
TextThe city has 3,482,000 residents.
HeardThe city has three House 492,000 residents.
Chatterbox MultilingualHard text: date (failed) · score 60
miss
TextThe meeting is on 03/14/2025.
HeardThe meeting is on 03/04 for 2025.
Chatterbox MultilingualHard text: phone (failed) · score 60
miss
TextCall us at 555-0142.
HeardCall us at 55T-742.
Chatterbox MultilingualHard text: url (failed) · score 60
miss
TextVisit www.example.org/start for details.
HeardVisit www.tiles.org start for details.
Gemini 2.5 Pro TTSHard text: big-number (failed) · score 50
miss
TextThe city has 3,482,000 residents.
HeardThe city has 3,482,382 residents.
Gemini 2.5 Pro TTSHard text: date-abbr (failed) · score 50
miss
TextThe deadline is Jan. 5, 2026.
HeardThe deadline is Jan 5, 2026.
Gemini 2.5 Pro TTSHard text: number-abbr (failed) · score 50
miss
TextRead chapter No. 9 tonight.
HeardRead chapter nine tonight.