No vocals when asked
Ask for an instrumental, get an instrumental?
Ranking
Score out of 100, higher is better. 24 items per model; the thin line on each bar is the 95% range.
When two models' ranges overlap, this test cannot tell them apart.
Track by track
One square per instrumental brief, in the same order for every model. Hover for what was asked and what came back.
What we test and how it is scored
Test. The same 24 briefs, all marked instrumental.
Scoring. The vocal stem is separated. A clip fails only when that stem is loud and contains at least 8 recognisable sung words.
Full item list and rules: methodology.
Listen for yourself
Previews are the first 20 seconds of each track, in ranking order. More tracks are on each model's page.
Think a score is wrong? Check it.
Every test item, scoring rule and known limit is published, and the audio behind each number is on the page.