Try AnyToSpeech
Benchmark › Music models › Lyric accuracy
30% of the overall score · updated 2026-11-22

Lyric accuracy

Given lyrics, does the model sing those words?

Lyric accuracyGenreTempoLengthNo vocals when askedClean endingSpeed

Ranking

Score out of 100, higher is better. 12 items per model; the thin line on each bar is the 95% range.

0255075100

When two models' ranges overlap, this test cannot tell them apart.

Song by song

Share of the supplied lyric words that can be heard, per song; darker is better.

ModelScorepoprockfolksoulcountryhiphopreggaediscoballadindiedancelullaby
1MiniMax Music 2.617 extra words (median) 99.6 100100100100100981001009810098100
2Lyria 3.50 extra words (median) 99.2 10098981001001001009810096100100
3Lyria 3 Pro0 extra words (median) 98.3 1001001001009810010081100100100100
4Lyria 3 Clip0 extra words (median) 98 10010077100100100100100100100100100
5Eleven Music0 extra words (median) 97.1 10091981001001001009790989894
6ACE-Step 1.51 extra words (median) 82.8 10093779510098710093668085
50 or lower100

Instrumental-only models (Stable Audio 2.5, MusicGen Large (stereo)) do not sing and are left out.

What we test and how it is scored

Test. 12 short songs across styles from pop and rock to hip hop, reggae and a lullaby, each with a verse and chorus we wrote, about 55 words.

Scoring. The vocal stem is separated from the mix, and both the stem and the full mix are transcribed by two speech recognisers. Score = share of the supplied lyric words that can be heard in order, taken from the best transcript. Repeats and extra words do not lower the score; they are reported separately.

Full item list and rules: methodology.

Listen for yourself

Previews are the first 45 seconds of each track, in ranking order. More tracks are on each model's page.

MiniMax Music 2.6pop song · 184 s long · 176 extra words
100% of lyrics
MiniMax Music 2.6rock song · 70 s long · 0 extra words
100% of lyrics
MiniMax Music 2.6folk song · 218 s long · 216 extra words
100% of lyrics
Lyria 3.5pop song · 64 s long · 15 extra words
100% of lyrics
Lyria 3.5rock song · 66 s long · 0 extra words
98.1% of lyrics
Lyria 3.5folk song · 62 s long · 0 extra words
98% of lyrics
Lyria 3 Propop song · 71 s long · 0 extra words
100% of lyrics
Lyria 3 Prorock song · 79 s long · 0 extra words
100% of lyrics
Lyria 3 Profolk song · 92 s long · 0 extra words
100% of lyrics
Lyria 3 Clippop song · 31 s long · 0 extra words
100% of lyrics
Lyria 3 Cliprock song · 31 s long · 1 extra words
100% of lyrics
Lyria 3 Clipfolk song · 31 s long · 0 extra words
76.5% of lyrics
Eleven Musicpop song · 60 s long · 15 extra words
100% of lyrics
Eleven Musicrock song · 60 s long · 0 extra words
90.7% of lyrics
Eleven Musicfolk song · 60 s long · 0 extra words
98% of lyrics
ACE-Step 1.5pop song · 60 s long · 51 extra words
100% of lyrics
ACE-Step 1.5rock song · 60 s long · 8 extra words
92.6% of lyrics
ACE-Step 1.5folk song · 60 s long · 0 extra words
76.5% of lyrics

Think a score is wrong? Check it.

Every test item, scoring rule and known limit is published, and the audio behind each number is on the page.

Read the methodology