Towards AITowards AIToneBench

Claude Opus 5 (max) vs Qwen3.7 Max (default)

Should you write with Claude Opus 5 (max) or Qwen3.7 Max (default)? On this page the only thing that changes is the model. Both wrote their own version of the scripts behind 10 of my What's AI videos, five drafts per script, and three judges from three model families scored every draft blind, with my finished script as the reference. Claude Opus 5 (max) leads overall, 89.4 to 80.9. Heads-up: Claude Opus 5 (max) shares its model line with one of the three judges. The panel spans three model families, so no model here is scored by its own family alone (how the panel works).

Claude Opus 5 (max)
#8 Elo 2354 · 89.4/100
Qwen3.7 Max (default)
#85 Elo 1546 · 80.9/100
Cost / script
$0.293 vs $0.056
Human baseline
90.9 Claude Opus 5 (max) falls below it · Qwen3.7 Max (default) falls below it

The verdict

If you're choosing between these two for scripts, spend the extra money. Claude Opus 5 (max effort) ranks #8 and Qwen3.7 Max (default) ranks #85, 8.5 points apart on the overall score. Qwen trails on all nine metrics, by roughly ten points on both Tone & Voice Match and Continuity & Emotion, the two that score whether a script sounds like someone walking you through something. At $0.056 per script it costs about five times less than Opus 5, and that's the one real argument for it. Both are closed, so open weights don't come into it. I'd only reach for Qwen3.7 Max (default) when someone will rewrite the script from top to bottom anyway.

Pick Claude Opus 5 (max effort) for scripts that should read close to publish-ready.
Pick Qwen3.7 Max (default) for rough, low-cost scripts that a human will rewrite from top to bottom.

How to read these numbers

Overall vs Elo. Overall is the weighted rubric score. Elo compares each model's five-draft average with every other model's, script by script, and counts gaps inside run-to-run noise as draws, so it rewards winning often and can disagree with overall. My own scripts score 90.9 on the same rubric, not a literal 100. Right now 2 of 167 ranked configurations reach it. A model above that line writes at that level on this rubric. That's not the same as beating my script line for line.

Reading the Elo intervals. Each 95% range comes from resampling every model's recorded run scores on each task and re-ranking. Comparing these separate ranges does not test the Elo gap between two models: far apart is strong evidence, and overlap isn't a tie. The tasks stay fixed, so the ranges say nothing about new tasks (the long version).

Metric by metric: where the gap comes from

Blue is Claude Opus 5 (max), orange is Qwen3.7 Max (default), and the solid bar takes the metric. The weight under each name is how much it counts toward the overall. Weighted by how much each metric counts, Tone & Voice Match does the most to put Claude Opus 5 (max) ahead: it leads there by 10.1 points. If you care about one thing, say voice or length, go straight to that row.

Tone & Voice Match19% weight
89.6
79.5
Writing Craft & Clarity13% weight
90.4
80.9
Substance, Accuracy & Value15% weight
88.6
80.0
Continuity & Emotion14% weight
89.3
79.4
YouTube Best Practices12% weight
89.8
80.4
Hook Strength10% weight
90.2
84.2
Length Adherence8% weight
88.2
83.4
Slop Score (EQ-Bench + ours)5% weight
91.7
86.2
Visual Cue Quality4% weight
84.8
78.2

Cost, speed, and consistency

Quality is half the decision. The other half is what each script costs you, how long you wait, and how often you get a bad draft. The lead has a price: Claude Opus 5 (max) costs about 5.2x as much per script as Qwen3.7 Max (default).

Claude Opus 5 (max)Qwen3.7 Max (default)
Overall / 10089.480.9
Writing Elo23541546
Score spread across drafts (± overall std)1.1902.310
Cost per script (USD)0.2930.056
Avg time per script (min)2.21.8
Open weightsNoNo

Green wins the row, and for spread, cost and time, lower wins. Cost is one script at recorded list prices, uncached and without judging, so your real bill will differ. Spread is how much the overall score moves across a model's drafts, and time is the average time to get one accepted script, retries included.

Want the script-by-script detail? Full scorecards: Claude Opus 5 (max) · Qwen3.7 Max (default). The whole scoring pipeline is on the methodology page.

← All comparisons