Try AnyToSpeech
Benchmark › Music models › No vocals when asked
10% of the overall score · updated 2026-11-22

No vocals when asked

Ask for an instrumental, get an instrumental?

Lyric accuracyGenreTempoLengthNo vocals when askedClean endingSpeed

Ranking

Score out of 100, higher is better. 24 items per model; the thin line on each bar is the 95% range.

0255075100

When two models' ranges overlap, this test cannot tell them apart.

Track by track

One square per instrumental brief, in the same order for every model. Hover for what was asked and what came back.

as asked not as asked

What we test and how it is scored

Test. The same 24 briefs, all marked instrumental.

Scoring. The vocal stem is separated. A clip fails only when that stem is loud and contains at least 8 recognisable sung words.

Full item list and rules: methodology.

Listen for yourself

Previews are the first 20 seconds of each track, in ranking order. More tracks are on each model's page.

Stable Audio 2.5asked: lo-fi hip hop, 80 BPM · measured 80 BPM, 30 s
genre ✓tempo ✓
Stable Audio 2.5asked: country, 95 BPM · measured 191 BPM, 30 s
genre ✓tempo ✓
Stable Audio 2.5asked: funk, 110 BPM · measured 110 BPM, 30 s
genre ✓tempo ✓
Eleven Musicasked: lo-fi hip hop, 80 BPM · measured 80 BPM, 30 s
genre ✓tempo ✓
Eleven Musicasked: country, 95 BPM · measured 95 BPM, 30 s
genre ✗tempo ✓
Eleven Musicasked: funk, 110 BPM · measured 110 BPM, 30 s
genre ✓tempo ✓
ACE-Step 1.5asked: lo-fi hip hop, 80 BPM · measured 80 BPM, 30 s
genre ✓tempo ✓
ACE-Step 1.5asked: country, 95 BPM · measured 95 BPM, 30 s
genre ✗tempo ✓
ACE-Step 1.5asked: funk, 110 BPM · measured 63 BPM, 30 s
genre ✓tempo ✓
Lyria 3 Clipasked: lo-fi hip hop, 80 BPM · measured 80 BPM, 30.8 s
genre ✓tempo ✓
Lyria 3 Clipasked: country, 95 BPM · measured 95 BPM, 30.8 s
genre ✗tempo ✓
Lyria 3 Clipasked: funk, 110 BPM · measured 110 BPM, 30.8 s
genre ✗tempo ✓
Lyria 3.5asked: lo-fi hip hop, 80 BPM · measured 82 BPM, 61.9 s
genre ✓tempo ✓
Lyria 3.5asked: country, 95 BPM · measured 95 BPM, 65.3 s
genre ✗tempo ✓
Lyria 3.5asked: funk, 110 BPM · measured 110 BPM, 66.5 s
genre ✓tempo ✓
MusicGen Large (stereo)asked: lo-fi hip hop, 80 BPM · measured 80 BPM, 30 s
genre ✓tempo ✓
MusicGen Large (stereo)asked: country, 95 BPM · measured 95 BPM, 30 s
genre ✗tempo ✓
MusicGen Large (stereo)asked: funk, 110 BPM · measured 110 BPM, 30 s
genre ✓tempo ✓
MiniMax Music 2.6asked: lo-fi hip hop, 80 BPM · measured 86 BPM, 133.6 s
genre ✓tempo ✗
MiniMax Music 2.6asked: country, 95 BPM · measured 86 BPM, 129 s
genre ✗tempo ✗
MiniMax Music 2.6asked: funk, 110 BPM · measured 118 BPM, 164.5 s
genre ✓tempo ✗
Lyria 3 Proasked: lo-fi hip hop, 80 BPM · measured 109.5 BPM, 61.6 s
genre ✓tempo ✗
Lyria 3 Proasked: country, 95 BPM · measured 101.5 BPM, 61.1 s
genre ✗tempo ✗
Lyria 3 Proasked: funk, 110 BPM · measured 110 BPM, 63.2 s
genre ✓tempo ✓

Think a score is wrong? Check it.

Every test item, scoring rule and known limit is published, and the audio behind each number is on the page.

Read the methodology