Towards AITowards AIToneBench

Qwen3.8 Max

Alibaba (Qwen) · proprietary · writing benchmark

#38 of 130 Elo 1866 Overall 83.4 Proprietary
Rank
#38 of 130
Writing Elo
1866 ±72
Overall
83.4 / 100
Cost / task
$0.15 per script
Family
Alibaba (Qwen) 1st of 10
Type
Closed 35th of 83
Consistency
± 5.6 swingier than most
Avg tokens
32.4k in+out
Latency
397s per call
Head-to-head:vs Claude Opus 5 (max) · vs Kimi K3 · vs GPT-5.6 Sol (ultra) · vs Grok 4.5 · vs DeepSeek V4 Flash 0731 · vs MiniMax M3 · vs GLM-5

The short version

Qwen3.8 Max sits at #38 of 130 on ToneBench, in the middle of the pack, with a writing Elo of 1866 and an overall score of 83.4 out of 100. We measured it by having it write all 9 of our real YouTube scripts, five times each, then scoring every draft blind against our own finished versions. Here is how it shook out.

Inside Alibaba (Qwen), this is the strongest writer we tested. It edges out the other 9 Alibaba (Qwen) configs on the board, so if you're staying in this family for voice work, this is the one to reach for.

Among proprietary models, it comes in 35th of 83. That ranking is against the stronger half of the board: closed models still set the pace on voice fidelity here.

What it does best is Length Discipline: it ranks 5th on that dimension at 92.9, well above the board average. Its softer spot is Hook (83.5, 69th), which is the thing to watch if that metric matters most for your use.

It was uneven across the 9 scripts. Its best run was the founder announcement / personal origin story (86.6) and its weakest was the personal technical walkthrough / agentic workflow case study (73.7), a spread of about 13 points. Worth knowing if your writing skews toward one of those formats.

On cost, it runs about $0.15/task. DeepSeek V4 Flash 0731 scores higher for less money, at $0.005/task, so on pure value this config is not the frontier.

Skill profile

The shape is the story: the further a corner reaches, the stronger that dimension. Biggest edge over the board: Length Discipline (+25.7); smallest edge: Hook (+3.3).

50Tone?Craft?Substance?Flow?YouTube?Hook?Length?Anti-Slop?Cues?
Qwen3.8 MaxBoard averageBoard best per metricMax possible (100)

Per-metric scores

Nine writing dimensions, each scored 0–100 and blended by the editorial weight shown. Rank is against all 130 current-ranked models. The thick bar is this model; the thin lines above and below are the current field's best model (darker) and average (lighter) on the same scale. The small ± number is its run-to-run variation.

Tone & Voice ?19% weight · +3.6 vs avg
best · Claude Opus 5 (max effort) · 91.281.9± 2.5 · 63rdboard avg · 78.3
Writing Craft ?13% weight · +4.5 vs avg
best · Claude Opus 5 (max effort) · 91.183.4± 2.1 · 55thboard avg · 78.9
Substance & Value ?15% weight · +5.7 vs avg
best · Claude Opus 5 (max effort) · 90.684.4± 3.7 · 49thboard avg · 78.7
Flow & Emotion ?14% weight · +3.7 vs avg
best · Claude Opus 5 (max effort) · 90.478.1± 3.5 · 64thboard avg · 74.4
YouTube Structure ?12% weight · +7.1 vs avg
best · Claude Opus 5 (max effort) · 89.680.4± 4.9 · 51stboard avg · 73.3
Hook ?10% weight · +3.3 vs avg
best · Claude Opus 5 (max effort) · 92.083.5± 2.7 · 69thboard avg · 80.2
Length Discipline ?8% weight · +25.7 vs avg
best · GPT-5.6 Sol (ultra) · 94.392.9± 7.8 · 5thboard avg · 67.2
Anti-Slop ?5% weight · +9.2 vs avg
best · Claude Fable 5 (max effort + 4.8 fallback) · 93.792.0± 1.3 · 27thboard avg · 82.8
Visual Cues ?4% weight · +10.7 vs avg
best · GPT-5.6 Sol (xhigh) · 91.485.2± 4.5 · 46thboard avg · 74.5

Per-article scores

The same 9 real scripts every current-ranked model writes, scored individually. Different formats stress different skills.

Article 1
opinion / warning explainer
84.8
out of 100
Article 2
news-analysis / skeptical explainer
86.2
out of 100
Article 3
personal roadmap / opinion
85.8
out of 100
Article 4
short explainer
84.2
out of 100
Article 5
news-analysis / opinion explainer
83.1
out of 100
Article 6
founder announcement / personal origin story
86.6
out of 100
Article 7
personal technical walkthrough / agentic workflow case study
73.7
out of 100
Article 8
product release announcement / personal observation
85.8
out of 100
Article 9
career guide / hiring analysis
80.9
out of 100

Consistency: run-to-run variability

Every cell on this page is the mean of 5 independent runs per script; the ± numbers are the run-to-run standard deviation. Overall, Qwen3.8 Max varies by ± 5.6 points between runs versus a board median of ± 3.8, so it is swingier than the typical model here, worth knowing if you need repeatable output.

Its steadiest is Anti-Slop (± 1.3 vs ± 2.6 board median), which you can rely on run after run.

MetricThis modelBoard medianVerdict
Tone & Voice ?81.9 ± 2.5± 2.2typical
Writing Craft ?83.4 ± 2.1± 2.0typical
Substance & Value ?84.4 ± 3.7± 2.6typical
Flow & Emotion ?78.1 ± 3.5± 2.6typical
YouTube Structure ?80.4 ± 4.9± 3.6typical
Hook ?83.5 ± 2.7± 3.0typical
Length Discipline ?92.9 ± 7.8± 8.6typical
Anti-Slop ?92.0 ± 1.3± 2.6steadier than most
Visual Cues ?85.2 ± 4.5± 4.7typical

Measured, not modeled

Numbers we log on every run and rarely talk about. None of these affect the writing scores; cost and latency are informational.

Latency per script
397sslower than the board median of 70s
Prompt tokens in
11.2kstyle guide + brief + research packet
Tokens out
21.2kwell above the board median (thinks a lot)
Cost per script
$0.150 ± 0.028measured from actual billed tokens
List price used
$2 / $6 per M tokinput / output

What each judge scored it

The published overall of 83.4 is the consensus of three family-disjoint judges scoring the same 45 stored drafts blind with the identical rubric. The highest and lowest judge differ by 10.5 points on its overall. A typical amount of judge disagreement for this board. How the panel works: methodology.

Claude Opus 5
Anthropic
78.4
GPT-5.6 Sol (medium)
OpenAI
88.8
DeepSeek V4 Flash
DeepSeek
83.1

How we ran Qwen3.8 Max

Frequently asked questions

How good is Qwen3.8 Max at writing?

On ToneBench it ranks #38 of 130 with a writing Elo of 1866 and an overall score of 83.4/100. That score comes from writing our 9 real YouTube scripts five times each and scoring every draft blind against our own finished versions across nine writing dimensions.

Is Qwen3.8 Max the best Alibaba (Qwen) model for writing?

Yes. Among the Alibaba (Qwen) configs we tested, Qwen3.8 Max is the strongest writer on the board.

Is Qwen3.8 Max good value for the money?

It costs about $0.15/task. DeepSeek V4 Flash 0731 scores higher for less, so it is not the value pick.

What are Qwen3.8 Max's strengths and weaknesses?

Its strongest dimension is Length Discipline (5th on the board, 92.9). Its weakest is Hook (69th on the board, 83.5). The full nine-metric breakdown is on this page.

Does Qwen3.8 Max write some formats better than others?

Yes. Its best of our 9 scripts was the founder announcement / personal origin story (86.6) and its weakest was the personal technical walkthrough / agentic workflow case study (73.7).

How consistent is Qwen3.8 Max between runs?

We run every script 5 times. Qwen3.8 Max's overall score varies by about ±5.6 points between runs, versus a board median of ±3.8. That is swingier than typical, so expect more draft-to-draft variation. The full per-metric variability table is on this page.

How was Qwen3.8 Max evaluated?

Via OpenRouter using the exact model/route id qwen/qwen3.8-max, run on 2026-08-05. 5 runs per script, provider-default sampling, no fine-tuning; every draft scored blind with a fixed rubric by a three-family judge panel. Full details in the 'How we ran it' section and the methodology.

Is Qwen3.8 Max open source?

No, it is a proprietary (closed-weights) model. Among proprietary models it ranks 35th of 83 for writing.

← Back to the full ToneBench leaderboard