Towards AITowards AIToneBench

Qwen3.8 Max

Alibaba (Qwen) · proprietary · writing benchmark

#68 of 167 Elo 1682 Overall 83.2 Proprietary
Rank
#68 of 167
Writing Elo
1682 ±51
Overall
83.2 / 100
Cost / script
$0.161 per script
Family
Alibaba (Qwen) 2nd of 10
Type
Closed 58th of 114
Consistency
± 2.0 steadier than most
Avg tokens
34.8k in+out
Time / script
7.2 min avg, retries included
Family check:Qwen3.8 Flash is Alibaba (Qwen)'s best writer here: -0.2 overall against this config for $0.148 less per script.

The short version

Qwen3.8 Max lands in the middle of the pack on ToneBench at #68 of 167, with a writing Elo of 1682 and an overall score of 83.2 out of 100. Those numbers come from it writing its own version of the scripts behind 10 of my What's AI videos, five times each, with every draft scored blind against mine (how the scoring works).

For scale, my own scripts score 90.9 through the same judges and rubric. That's the real bar here, not a literal 100. It sits 7.7 points under it.

Its Elo comes from comparing its average on each script with every other model's average on the same script, with gaps inside the run-to-run noise counted as draws. The 95% range is 1633 to 1735. That range overlaps 16 other configurations, ranked #63 to #79, so its exact spot inside that band is too close to call on this board. What the ranges can and can't tell you.

Its biggest edge is Length: 94.0, 4th on the board and about 23 points above the board average. Even its weakest, Hook (83.0), sits above the board average, so there's no real weak spot to plan around.

The format changes the result. Its best score was on the career guide / hiring analysis (84.5) and its weakest on the personal technical walkthrough / agentic workflow case study (79.9), about 5 points apart. If most of your scripts look like one of those, weigh that score over the average.

It costs about $0.161 per script. MiMo-V2.6-Flash scores far higher and costs about $0.004 per script, so on value this isn't the pick.

If you're on Alibaba (Qwen) anyway, Qwen3.8 Flash writes better for no more per script, so use that one.

Among proprietary models, it's 58th of 114. The best open-weights config, GLM-5.3 at #15, outranks it, so it's worth a look if you'd rather run open weights.

Skill profile

Read the shape: the further a corner reaches, the stronger the model is on that metric. The dashed line is the board average and the dotted line is the board's best score on each metric, so a corner outside the dashed line beats the average there. Hover a point for the exact numbers.

50Tone?Craft?Substance?Flow?YouTube?Hook?Length?Slop?Cues?
Qwen3.8 MaxBoard averageBoard best per metricMax possible (100)

Metric by metric

Nine writing metrics, each scored 0–100 and blended into the overall by the editorial weight shown next to it. Rank is out of all 167 current-ranked models. The thick bar is this model; the thin line above it is the field's best on that metric (darker) and the one below is the field's average (lighter), on the same scale. The small ± is how much the score moves from run to run, and the ? next to each name says what the metric rewards.

Tone ?19% weight · +1.7 vs avg
best · Claude Opus 5.5 (max effort) · 91.080.2± 1.8 · 94thboard avg · 78.6
Craft ?13% weight · +1.4 vs avg
best · Claude Opus 5.5 (max effort) · 91.582.0± 1.5 · 91stboard avg · 80.5
Substance ?15% weight · +5.0 vs avg
best · Claude Opus 5.5 (xhigh) · 90.784.4± 1.7 · 76thboard avg · 79.4
Flow ?14% weight · +1.4 vs avg
best · Claude Opus 5.5 (max effort) · 90.978.4± 2.2 · 94thboard avg · 77.0
YouTube ?12% weight · +5.7 vs avg
best · Claude Opus 5.5 (max effort) · 91.782.5± 1.9 · 73rdboard avg · 76.7
Hook ?10% weight · +1.4 vs avg
best · Claude Opus 5.5 (max effort) · 91.283.0± 2.1 · 97thboard avg · 81.6
Length ?8% weight · +23.2 vs avg
best · Claude Opus 5.5 (max effort) · 97.694.0± 5.1 · 4thboard avg · 70.8
Slop ?5% weight · +6.6 vs avg
best · Claude Opus 5.5 (max effort) · 94.990.7± 2.2 · 55thboard avg · 84.2
Cues ?4% weight · +7.3 vs avg
best · GPT-5.6 Sol (ultra) · 90.184.2± 2.8 · 68thboard avg · 77.0

Script by script

The same 10 real scripts every current-ranked model writes, each scored on its own as the mean of 5 runs. Different formats stress different skills: a model can nail a tight explainer and still stumble on a personal story, so look for the format closest to what you write.

Script 1
opinion / warning explainer
83.5
out of 100
Script 2
news-analysis / skeptical explainer
83.9
out of 100
Script 3
personal roadmap / opinion
83.9
out of 100
Script 4
short explainer
83.7
out of 100
Script 5
news-analysis / opinion explainer
84.3
out of 100
Script 6
founder announcement / personal origin story
84.2
out of 100
Script 7
personal technical walkthrough / agentic workflow case study
79.9
out of 100
Script 8
product release announcement / personal observation
81.9
out of 100
Script 9
career guide / hiring analysis
84.5
out of 100
Script 10
engineering process walkthrough / presentation adaptation
81.7
out of 100

Consistency: how much it moves between runs

A model whose drafts swing from run to run is harder to use than its average suggests. Every score on this page is the mean of 5 runs per script, and the ± is the run-to-run standard deviation. Overall, Qwen3.8 Max moves by ± 2.0 against a board median of ± 2.7, so it's steadier than the typical model here.

Its steadiest is Length: ± 5.1 run to run, when the typical model swings ± 8.6.

MetricThis modelBoard medianVerdict
Tone ?80.2 ± 1.8± 1.7typical
Craft ?82.0 ± 1.5± 1.5typical
Substance ?84.4 ± 1.7± 2.0typical
Flow ?78.4 ± 2.2± 1.8typical
YouTube ?82.5 ± 1.9± 2.9typical
Hook ?83.0 ± 2.1± 2.0typical
Length ?94.0 ± 5.1± 8.6steadier than most
Slop ?90.7 ± 2.2± 2.1typical
Cues ?84.2 ± 2.8± 3.2typical

Cost, time and tokens

Logged on every run. None of it touches the writing score, but it's often what decides whether a model fits your pipeline at all. Time is the average time to get one accepted script, retries included, and cost is priced per script at list price.

Time per script
7.2 minslower than the board median of 1.2 min
Prompt tokens in
11.9kstyle guide + brief + research packet
Tokens out
22.9kwell above the board median (a lot of thinking)
Cost per script
$0.161 ± 0.033measured from actual billed tokens
List price used
$2 / $6 per M tokinput / output

What each judge scored it

One judge can have taste of its own, which is why there are three, from three model families, each scoring the same 50 stored drafts blind with the identical rubric. The overall of 83.2 combines their scores with the parts computed in code (length, and half of the slop score). The highest and lowest judge are 9.4 points apart on its overall. That's a typical amount of judge disagreement for this board. How the panel works.

Claude Opus 5
Anthropic
78.9
GPT-5.6 Sol (medium)
OpenAI
88.4
DeepSeek V4.1 Flash
DeepSeek
82.1

How we ran Qwen3.8 Max

Frequently asked questions

How good is Qwen3.8 Max at writing?

It's #68 of 167 on ToneBench, with a writing Elo of 1682 and an overall score of 83.2/100. It wrote its own version of the scripts behind 10 of my What's AI videos 5 times each, and three judges from three model families scored every draft blind against mine. Length and half of the slop score are computed in code.

Is Qwen3.8 Max the best Alibaba (Qwen) model for writing?

Not quite. It's 2nd of 10 Alibaba (Qwen) configs; Qwen3.8 Flash is about 17 Elo ahead.

Is Qwen3.8 Max good value for the money?

It costs about $0.161 per script. MiMo-V2.6-Flash scores higher and costs less, so it isn't the value pick.

What are Qwen3.8 Max's strengths and weaknesses?

Against the board average, its biggest edge is Length (94.0, +23.2) and even its weakest, Hook (83.0, +1.4), is above average. The nine-metric breakdown on this page shows the board average and board best for each.

How was Qwen3.8 Max evaluated?

Through OpenRouter, using the exact model/route id qwen/qwen3.8-max, first run on 2026-09-03. Each script ran 5 times with provider-default sampling and no fine-tuning. The 'How we ran it' section and the methodology page have the rest.

Is Qwen3.8 Max open source?

No, it's a proprietary (closed-weights) model. Among proprietary models it's 58th of 114 for writing.

← Back to the full ToneBench leaderboard