Towards AITowards AIToneBench

Qwen3.7 Max (high)

Alibaba (Qwen) · proprietary · writing benchmark

#55 of 130 Elo 1674 Overall 81.5 Proprietary
Rank
#55 of 130
Writing Elo
1674 ±50
Overall
81.5 / 100
Cost / task
$0.054 per script
Family
Alibaba (Qwen) 3rd of 10
Type
Closed 47th of 83
Consistency
± 2.6 steadier than most
Avg tokens
19.7k in+out
Latency
157s per call
Family check:Qwen3.8 Max is Alibaba (Qwen)'s best writer here, +1.9 overall vs this config for $0.095 more per script.

The short version

Qwen3.7 Max (high) sits at #55 of 130 on ToneBench, in the middle of the pack, with a writing Elo of 1674 and an overall score of 81.5 out of 100. We measured it by having it write all 9 of our real YouTube scripts, five times each, then scoring every draft blind against our own finished versions. Here is how it shook out.

Within Alibaba (Qwen) it ranks 3rd of 10. Qwen3.8 Max is the family's top writer here, about 192 Elo ahead, so this config trades some quality for whatever it saves you in cost or speed.

Among proprietary models, it comes in 47th of 83. That ranking is against the stronger half of the board: closed models still set the pace on voice fidelity here.

What it does best is Length Discipline: it ranks 36th on that dimension at 83.3, well above the board average. Its softer spot is Visual Cues (78.4, 76th), which is the thing to watch if that metric matters most for your use.

It was uneven across the 9 scripts. Its best run was the founder announcement / personal origin story (83.3) and its weakest was the personal technical walkthrough / agentic workflow case study (76.8), a spread of about 6 points. Worth knowing if your writing skews toward one of those formats.

On cost, it runs about $0.054/task. DeepSeek V4 Flash 0731 scores higher for less money, at $0.005/task, so on pure value this config is not the frontier. Still, it beats 6 models that cost noticeably more.

If you're tuning reasoning effort, we also tested Qwen3.7 Max at other settings. The strongest of those on the board is Qwen3.7 Max (default) (Elo 1699), so it is worth checking whether more or less thinking moves the needle before you lock in this one.

Skill profile

The shape is the story: the further a corner reaches, the stronger that dimension. Biggest edge over the board: Length Discipline (+16.2); smallest edge: Substance & Value (+2.5).

50Tone?Craft?Substance?Flow?YouTube?Hook?Length?Anti-Slop?Cues?
Qwen3.7 Max (high)Board averageBoard best per metricMax possible (100)

Per-metric scores

Nine writing dimensions, each scored 0–100 and blended by the editorial weight shown. Rank is against all 130 current-ranked models. The thick bar is this model; the thin lines above and below are the current field's best model (darker) and average (lighter) on the same scale. The small ± number is its run-to-run variation.

Tone & Voice ?19% weight · +2.6 vs avg
best · Claude Opus 5 (max effort) · 91.280.9± 1.9 · 66thboard avg · 78.3
Writing Craft ?13% weight · +2.5 vs avg
best · Claude Opus 5 (max effort) · 91.181.5± 2.3 · 65thboard avg · 78.9
Substance & Value ?15% weight · +2.5 vs avg
best · Claude Opus 5 (max effort) · 90.681.2± 2.8 · 65thboard avg · 78.7
Flow & Emotion ?14% weight · +4.8 vs avg
best · Claude Opus 5 (max effort) · 90.479.2± 2.0 · 54thboard avg · 74.4
YouTube Structure ?12% weight · +7.4 vs avg
best · Claude Opus 5 (max effort) · 89.680.7± 2.6 · 50thboard avg · 73.3
Hook ?10% weight · +4.8 vs avg
best · Claude Opus 5 (max effort) · 92.085.0± 1.9 · 52ndboard avg · 80.2
Length Discipline ?8% weight · +16.2 vs avg
best · GPT-5.6 Sol (ultra) · 94.383.3± 5.8 · 36thboard avg · 67.2
Anti-Slop ?5% weight · +3.1 vs avg
best · Claude Fable 5 (max effort + 4.8 fallback) · 93.785.9± 2.6 · 61stboard avg · 82.8
Visual Cues ?4% weight · +3.9 vs avg
best · GPT-5.6 Sol (xhigh) · 91.478.4± 7.6 · 76thboard avg · 74.5

Per-article scores

The same 9 real scripts every current-ranked model writes, scored individually. Different formats stress different skills.

Article 1
opinion / warning explainer
81.3
out of 100
Article 2
news-analysis / skeptical explainer
82.8
out of 100
Article 3
personal roadmap / opinion
82.6
out of 100
Article 4
short explainer
81.1
out of 100
Article 5
news-analysis / opinion explainer
81.8
out of 100
Article 6
founder announcement / personal origin story
83.3
out of 100
Article 7
personal technical walkthrough / agentic workflow case study
76.8
out of 100
Article 8
product release announcement / personal observation
83.0
out of 100
Article 9
career guide / hiring analysis
80.8
out of 100

Consistency: run-to-run variability

Every cell on this page is the mean of 5 independent runs per script; the ± numbers are the run-to-run standard deviation. Overall, Qwen3.7 Max (high) varies by ± 2.6 points between runs versus a board median of ± 3.8, so it is noticeably steadier than the typical model here.

Its most volatile dimension is Visual Cues (± 7.6 vs a board median of ± 4.7): two runs of the same brief can land visibly different visual cues scores.

MetricThis modelBoard medianVerdict
Tone & Voice ?80.9 ± 1.9± 2.2typical
Writing Craft ?81.5 ± 2.3± 2.0typical
Substance & Value ?81.2 ± 2.8± 2.6typical
Flow & Emotion ?79.2 ± 2.0± 2.6typical
YouTube Structure ?80.7 ± 2.6± 3.6typical
Hook ?85.0 ± 1.9± 3.0typical
Length Discipline ?83.3 ± 5.8± 8.6typical
Anti-Slop ?85.9 ± 2.6± 2.6typical
Visual Cues ?78.4 ± 7.6± 4.7swingier than most

Measured, not modeled

Numbers we log on every run and rarely talk about. None of these affect the writing scores; cost and latency are informational.

Latency per script
157sslower than the board median of 70s
Prompt tokens in
11.1kstyle guide + brief + research packet
Tokens out
8.6kwell above the board median (thinks a lot)
Cost per script
$0.054 ± 0.008measured from actual billed tokens
List price used
$1.475 / $4.425 per M tokinput / output

What each judge scored it

The published overall of 81.5 is the consensus of three family-disjoint judges scoring the same 45 stored drafts blind with the identical rubric. The highest and lowest judge differ by 6.8 points on its overall. A typical amount of judge disagreement for this board. How the panel works: methodology.

Claude Opus 5
Anthropic
78.0
GPT-5.6 Sol (medium)
OpenAI
84.7
DeepSeek V4 Flash
DeepSeek
81.8

How we ran Qwen3.7 Max (high)

Frequently asked questions

How good is Qwen3.7 Max (high) at writing?

On ToneBench it ranks #55 of 130 with a writing Elo of 1674 and an overall score of 81.5/100. That score comes from writing our 9 real YouTube scripts five times each and scoring every draft blind against our own finished versions across nine writing dimensions.

Is Qwen3.7 Max (high) the best Alibaba (Qwen) model for writing?

Not quite. Within Alibaba (Qwen) it ranks 3rd of 10; Qwen3.8 Max is the family's best writer here.

Is Qwen3.7 Max (high) good value for the money?

It costs about $0.054/task. DeepSeek V4 Flash 0731 scores higher for less, so it is not the value pick.

What are Qwen3.7 Max (high)'s strengths and weaknesses?

Its strongest dimension is Length Discipline (36th on the board, 83.3). Its weakest is Visual Cues (76th on the board, 78.4). The full nine-metric breakdown is on this page.

Does Qwen3.7 Max (high) write some formats better than others?

Yes. Its best of our 9 scripts was the founder announcement / personal origin story (83.3) and its weakest was the personal technical walkthrough / agentic workflow case study (76.8).

How consistent is Qwen3.7 Max (high) between runs?

We run every script 5 times. Qwen3.7 Max (high)'s overall score varies by about ±2.6 points between runs, versus a board median of ±3.8. That makes it one of the steadier models we test. The full per-metric variability table is on this page.

How was Qwen3.7 Max (high) evaluated?

Via OpenRouter using the exact model/route id qwen/qwen3.7-max at reasoning_effort high, run on 2026-07-29. 5 runs per script, provider-default sampling, no fine-tuning; every draft scored blind with a fixed rubric by a three-family judge panel. Full details in the 'How we ran it' section and the methodology.

Is Qwen3.7 Max (high) open source?

No, it is a proprietary (closed-weights) model. Among proprietary models it ranks 47th of 83 for writing.

← Back to the full ToneBench leaderboard