Lab Comparison
Last updated , from board data generated at 17:52 UTC.
All 8 ranked Alibaba (Qwen) configurations on ToneBench, side by side: Writing Elo, Writing Score, the nine metrics, and cost and time per script. A configuration is one model at one thinking level.
A configuration 200 Elo below the top is expected to score about 24% in its script-by-script comparisons with it, a draw counting as half. The Lowest Cost Within 200 Elo of the Top card names the cheapest configuration that stays that close.
Ranks in these notes are configuration ranks: each setting's place among all 151 configurations. The Highest Writing Elo card above gives the model rank.
Picks and Notes From Louis
I'd pick Qwen3.8 Flash (thinking on). Qwen3.8 Max (thinking on) is 115 Elo ahead, and the ranges don't overlap, so the Max is the better writer. But it costs 12.2 times as much, $0.207 against $0.017, and for that gap I'd keep the money. One catch with both: they're slow. The Flash takes 6.8 minutes per script and the Max takes 11.2.
If you need speed, Qwen3.7 Max (high) comes back in 1.6 minutes, at #107. If you need open weights, the best open Qwen is down at #131, and Qwen3.5 9B (thinking on), the cheapest at $0.0036, is too far behind for me to use on a real script.
Qwen sits in the middle of the board at best. Qwen3.8 Max (thinking on) is the top Qwen configuration at #86, and its smaller sibling, Qwen3.8 Flash (thinking on), follows at #98. Go back one generation and Qwen3.7 Max (high) is already 298 Elo behind, and the open Qwen3 rows sit far down the board. So with Qwen, the generation you pick matters more than the size. Of the 8 configurations here, 5 are open weights, and I wouldn't write a script with any of those.
Every row wrote the same 10 scripts for the same four blind judges, so these Writing Elo ratings sit on the leaderboard's scale. The rank column is the configuration rank, each setting's place among all 151 configurations on the board. Each row is a different model. The ± after each Elo is half the width of its 95% range, and scores run from 0 to 100. Cost is one full script at the API list price of the route used. Each name opens its scorecard, and the head-to-head comparisons cover models from different labs.
With the metric scores shown, the table scrolls sideways.
| Configuration Rank | Configuration | Writing Elo | Writing Score | Cost / Script | Time / Script | Tone & Voice Match | Writing Craft & Clarity | Substance, Accuracy & Value | Hook Strength | YouTube Best Practices | Continuity & Emotion | Slop Score | Length Adherence | Visual Cue Quality |
|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|
| #86 | Qwen3.8 Max (thinking on) | 1531 ±37 | 76.8 | $0.207 | 11.2 min | 70.3 | 70.9 | 82.0 | 79.2 | 74.0 | 74.0 | 80.2 | 97.5 | 74.8 |
| #98 | Qwen3.8 Flash (thinking on) | 1416 ±43 | 75.3 | $0.017 | 6.8 min | 69.8 | 68.6 | 79.7 | 77.2 | 72.9 | 72.7 | 78.4 | 97.1 | 70.4 |
| #107 | Qwen3.7 Max (high) | 1233 ±48 | 72.6 | $0.102 | 1.6 min | 64.1 | 69.5 | 74.7 | 75.1 | 73.4 | 73.2 | 78.7 | 87.0 | 67.0 |
| #131 | Qwen3 235B Thinking (thinking always on) · open weights | 602 ±43 | 62.6 | $0.012 | 1.4 min | 54.4 | 62.5 | 59.0 | 72.2 | 63.8 | 64.3 | 57.1 | 79.8 | 56.0 |
| #132 | Qwen3 235B A22B (no thinking) · open weights | 599 ±34 | 62.4 | $0.0057 | 1.0 min | 58.5 | 57.9 | 66.0 | 71.2 | 58.3 | 63.9 | 55.4 | 76.2 | 48.3 |
| #144 | Qwen3 Next 80B (no thinking) · open weights | 176 ±44 | 52.3 | $0.0048 | 0.2 min | 49.7 | 43.8 | 55.0 | 68.6 | 45.2 | 56.0 | 53.7 | 62.3 | 28.6 |
| #145 | Qwen3.5 9B (thinking on) · open weights | 147 ±75 | 50.2 | $0.0036 | 0.9 min | 46.5 | 42.5 | 51.1 | 62.9 | 48.0 | 47.4 | 69.0 | 56.8 | 36.7 |
| #147 | Qwen3 8B (thinking on) · open weights | 6 ±39 | 47.1 | $0.0067 | 0.9 min | 42.1 | 49.7 | 51.3 | 62.8 | 40.2 | 44.8 | 62.0 | 28.1 | 56.9 |
Each comparison lists every thinking level of both models, with Writing Elo, cost and time side by side. The line under each pair gives the Writing Elo gap between the two best configurations. A pair outside the written match-ups opens in the comparison tool.