Towards AITowards AIToneBench

Qwen3.7 Max (default)

Alibaba (Qwen) · proprietary · writing benchmark

#85 of 167 Elo 1546 Overall 80.9 Proprietary
Rank
#85 of 167
Writing Elo
1546 ±39
Overall
80.9 / 100
Cost / script
$0.056 per script
Family
Alibaba (Qwen) 3rd of 10
Type
Closed 71st of 114
Consistency
± 2.3 typical spread
Avg tokens
20.5k in+out
Time / script
1.8 min avg, retries included
Family check:Qwen3.8 Flash is Alibaba (Qwen)'s best writer here: +2.1 overall against this config for $0.043 less per script.

The short version

Qwen3.7 Max (default) lands in the middle of the pack on ToneBench at #85 of 167, with a writing Elo of 1546 and an overall score of 80.9 out of 100. Those numbers come from it writing its own version of the scripts behind 10 of my What's AI videos, five times each, with every draft scored blind against mine (how the scoring works).

For scale, my own scripts score 90.9 through the same judges and rubric. That's the real bar here, not a literal 100. It sits about 10 points under it.

Its Elo comes from comparing its average on each script with every other model's average on the same script, with gaps inside the run-to-run noise counted as draws. The 95% range is 1506 to 1583. That range overlaps 17 other configurations, ranked #76 to #95, so its exact spot inside that band is too close to call on this board. What the ranges can and can't tell you.

Its biggest edge is Length: 83.4, 67th on the board and about 13 points above the board average. Even its weakest, Craft (80.9), sits above the board average, so there's no real weak spot to plan around.

The format changes the result. Its best score was on the founder announcement / personal origin story (83.6) and its weakest on the personal technical walkthrough / agentic workflow case study (76.6), about 7 points apart. If most of your scripts look like one of those, weigh that score over the average.

It costs about $0.056 per script. GPT-6 Luna (default) scores higher and costs about $0.003 per script, so on value this isn't the pick. Still, a few pricier configs score lower than it does.

If you're on Alibaba (Qwen) anyway, Qwen3.8 Flash writes better for no more per script, so use that one.

Among proprietary models, it's 71st of 114. The best open-weights config, GLM-5.3 at #15, outranks it, so it's worth a look if you'd rather run open weights.

Qwen3.7 Max is also on the board at other effort settings, and none of them beat this one; the closest is Qwen3.7 Max (high), at Elo 1525. The thinking-levels page shows what each setting costs and how long it takes, so you can see how much quality a cheaper or faster one gives up.

Skill profile

Read the shape: the further a corner reaches, the stronger the model is on that metric. The dashed line is the board average and the dotted line is the board's best score on each metric, so a corner outside the dashed line beats the average there. Hover a point for the exact numbers.

50Tone?Craft?Substance?Flow?YouTube?Hook?Length?Slop?Cues?
Qwen3.7 Max (default)Board averageBoard best per metricMax possible (100)

Metric by metric

Nine writing metrics, each scored 0–100 and blended into the overall by the editorial weight shown next to it. Rank is out of all 167 current-ranked models. The thick bar is this model; the thin line above it is the field's best on that metric (darker) and the one below is the field's average (lighter), on the same scale. The small ± is how much the score moves from run to run, and the ? next to each name says what the metric rewards.

Tone ?19% weight · +0.9 vs avg
best · Claude Opus 5.5 (max effort) · 91.079.5± 1.6 · 96thboard avg · 78.6
Craft ?13% weight · +0.3 vs avg
best · Claude Opus 5.5 (max effort) · 91.580.9± 1.3 · 98thboard avg · 80.5
Substance ?15% weight · +0.6 vs avg
best · Claude Opus 5.5 (xhigh) · 90.780.0± 2.2 · 99thboard avg · 79.4
Flow ?14% weight · +2.4 vs avg
best · Claude Opus 5.5 (max effort) · 90.979.4± 1.2 · 86thboard avg · 77.0
YouTube ?12% weight · +3.7 vs avg
best · Claude Opus 5.5 (max effort) · 91.780.4± 2.6 · 86thboard avg · 76.7
Hook ?10% weight · +2.6 vs avg
best · Claude Opus 5.5 (max effort) · 91.284.2± 1.6 · 80thboard avg · 81.6
Length ?8% weight · +12.6 vs avg
best · Claude Opus 5.5 (max effort) · 97.683.4± 5.1 · 67thboard avg · 70.8
Slop ?5% weight · +2.0 vs avg
best · Claude Opus 5.5 (max effort) · 94.986.2± 2.1 · 93rdboard avg · 84.2
Cues ?4% weight · +1.2 vs avg
best · GPT-5.6 Sol (ultra) · 90.178.2± 4.4 · 105thboard avg · 77.0

Script by script

The same 10 real scripts every current-ranked model writes, each scored on its own as the mean of 5 runs. Different formats stress different skills: a model can nail a tight explainer and still stumble on a personal story, so look for the format closest to what you write.

Script 1
opinion / warning explainer
79.6
out of 100
Script 2
news-analysis / skeptical explainer
81.7
out of 100
Script 3
personal roadmap / opinion
81.7
out of 100
Script 4
short explainer
80.5
out of 100
Script 5
news-analysis / opinion explainer
81.8
out of 100
Script 6
founder announcement / personal origin story
83.6
out of 100
Script 7
personal technical walkthrough / agentic workflow case study
76.6
out of 100
Script 8
product release announcement / personal observation
82.6
out of 100
Script 9
career guide / hiring analysis
81.4
out of 100
Script 10
engineering process walkthrough / presentation adaptation
79.6
out of 100

Consistency: how much it moves between runs

A model whose drafts swing from run to run is harder to use than its average suggests. Every score on this page is the mean of 5 runs per script, and the ± is the run-to-run standard deviation. Overall, Qwen3.7 Max (default) moves by ± 2.3 against a board median of ± 2.7, so it's about as repeatable as the typical model on the board.

Its steadiest is Length: ± 5.1 run to run, when the typical model swings ± 8.6.

MetricThis modelBoard medianVerdict
Tone ?79.5 ± 1.6± 1.7typical
Craft ?80.9 ± 1.3± 1.5typical
Substance ?80.0 ± 2.2± 2.0typical
Flow ?79.4 ± 1.2± 1.8typical
YouTube ?80.4 ± 2.6± 2.9typical
Hook ?84.2 ± 1.6± 2.0typical
Length ?83.4 ± 5.1± 8.6steadier than most
Slop ?86.2 ± 2.1± 2.1typical
Cues ?78.2 ± 4.4± 3.2typical

Cost, time and tokens

Logged on every run. None of it touches the writing score, but it's often what decides whether a model fits your pipeline at all. Time is the average time to get one accepted script, retries included, and cost is priced per script at list price.

Time per script
1.8 minslower than the board median of 1.2 min
Prompt tokens in
11.9kstyle guide + brief + research packet
Tokens out
8.6kwell above the board median (a lot of thinking)
Cost per script
$0.056 ± 0.010measured from actual billed tokens
List price used
$1.475 / $4.425 per M tokinput / output

What each judge scored it

One judge can have taste of its own, which is why there are three, from three model families, each scoring the same 50 stored drafts blind with the identical rubric. The overall of 80.9 combines their scores with the parts computed in code (length, and half of the slop score). The highest and lowest judge are 4.9 points apart on its overall. That's a typical amount of judge disagreement for this board. How the panel works.

Claude Opus 5
Anthropic
78.5
GPT-5.6 Sol (medium)
OpenAI
83.4
DeepSeek V4.1 Flash
DeepSeek
80.8

How we ran Qwen3.7 Max (default)

Frequently asked questions

How good is Qwen3.7 Max (default) at writing?

It's #85 of 167 on ToneBench, with a writing Elo of 1546 and an overall score of 80.9/100. It wrote its own version of the scripts behind 10 of my What's AI videos 5 times each, and three judges from three model families scored every draft blind against mine. Length and half of the slop score are computed in code.

Is Qwen3.7 Max (default) the best Alibaba (Qwen) model for writing?

No. It's 3rd of 10 Alibaba (Qwen) configs; Qwen3.8 Flash is about 153 Elo ahead.

Is Qwen3.7 Max (default) good value for the money?

It costs about $0.056 per script. GPT-6 Luna (default) scores higher and costs less, so it isn't the value pick.

What are Qwen3.7 Max (default)'s strengths and weaknesses?

Against the board average, its biggest edge is Length (83.4, +12.6) and even its weakest, Craft (80.9, +0.3), is above average. The nine-metric breakdown on this page shows the board average and board best for each.

How was Qwen3.7 Max (default) evaluated?

Through OpenRouter, using the exact model/route id qwen/qwen3.7-max, first run on 2026-09-03. Each script ran 5 times with provider-default sampling and no fine-tuning. The 'How we ran it' section and the methodology page have the rest.

Is Qwen3.7 Max (default) open source?

No, it's a proprietary (closed-weights) model. Among proprietary models it's 71st of 114 for writing.

← Back to the full ToneBench leaderboard