Towards AITowards AIToneBench

DeepSeek V4.1 Flash (no thinking)

DeepSeek · open weights · writing benchmark

#76 of 181 Elo 1710 Overall 83.5 Open weights
Rank
#76 of 181
Writing Elo
1710 ±52
Overall
83.5 / 100
Cost / script
$0.003 per script
Family
DeepSeek 7th of 15
Type
Open 12th of 56
Consistency
± 2.9 typical spread
Avg tokens
14.2k in+out
Time / script
0.2 min avg, retries included
Family check:DeepSeek V4.1 Flash (max) is DeepSeek's best writer here: +4.2 overall against this config for $0.009 more per script.

The short version

DeepSeek V4.1 Flash (no thinking) lands in the middle of the pack on ToneBench at #76 of 181, with a writing Elo of 1710 and an overall score of 83.5 out of 100. Those numbers come from it writing its own version of the scripts behind 10 of my What's AI videos, five times each, with every draft scored blind against mine (how the scoring works).

Its Elo comes from comparing its average on each script with every other model's average on the same script, with gaps inside the run-to-run noise counted as draws. The 95% range is 1658 to 1763. That range overlaps 11 other configurations, ranked #74 to #85, so its exact spot inside that band is too close to call on this board. What the ranges can and can't tell you.

Its biggest edge is Length: 78.8, 88th on the board and 6.8 points above the board average. Its weakest, Cues (77.6), sits about level with the board average, so there's no real weak spot to plan around.

The format changes the result. Its best score was on the career guide / hiring analysis (87.4) and its weakest on the engineering process walkthrough / presentation adaptation (79.2), about 8 points apart. If most of your scripts look like one of those, weigh that score over the average.

It costs about $0.003 per script. Nothing that's at least 15% cheaper scores higher, so it sits on the value frontier for its quality. The strongest cheaper option is GPT-6 Luna (high) at #85, about 92 Elo behind, and it costs about $0.003 per script. It also scores higher than plenty of pricier configs.

If you're on DeepSeek anyway, DeepSeek V4.1 Flash (max) is worth paying under a cent more per script.

Among open-weights models, it's 12th of 56. The best open-weights config is GLM-5.3 at #12, and everything above it is closed, so open weights still trail the frontier on this kind of writing.

Skill profile

Read the shape: the further a corner reaches, the stronger the model is on that metric. The dashed line is the board average and the dotted line is the board's best score on each metric, so a corner outside the dashed line beats the average there. Hover a point for the exact numbers.

50Tone?Craft?Substance?Flow?YouTube?Hook?Length?Slop?Cues?
DeepSeek V4.1 Flash (no thinking)Board averageBoard best per metricMax possible (100)

Metric by metric

Nine writing metrics, each scored 0–100 and blended into the overall by the editorial weight shown next to it. Rank is out of all 181 current-ranked models. The thick bar is this model; the thin line above it is the field's best on that metric (darker) and the one below is the field's average (lighter), on the same scale. The small ± is how much the score moves from run to run, and the ? next to each name says what the metric rewards.

Tone ?19% weight · +5.2 vs avg
best · Claude Opus 5.5 (max effort) · 90.484.3± 1.7 · 72ndboard avg · 79.1
Craft ?13% weight · +5.2 vs avg
best · Claude Opus 5.5 (max effort) · 90.986.3± 1.7 · 64thboard avg · 81.1
Substance ?15% weight · +4.4 vs avg
best · Claude Opus 5.5 (max effort) · 89.484.3± 1.6 · 86thboard avg · 80.0
Flow ?14% weight · +5.3 vs avg
best · Claude Opus 5.5 (max effort) · 89.583.0± 2.0 · 74thboard avg · 77.7
YouTube ?12% weight · +3.1 vs avg
best · Claude Opus 5.5 (max effort) · 90.180.6± 3.0 · 98thboard avg · 77.5
Hook ?10% weight · +3.8 vs avg
best · Claude Opus 5.5 (max effort) · 90.485.8± 2.2 · 53rdboard avg · 82.0
Length ?8% weight · +6.8 vs avg
best · Claude Sonnet 5.5 (max effort) · 98.278.8± 11.2 · 88thboard avg · 72.0
Slop ?5% weight · +2.6 vs avg
best · GPT-6 Astra (max) · 94.887.3± 1.9 · 95thboard avg · 84.8
Cues ?4% weight · -0.1 vs avg
best · GPT-5.6 Sol (ultra) · 89.577.6± 4.2 · 125thboard avg · 77.6

Script by script

The same 10 real scripts every current-ranked model writes, each scored on its own as the mean of 5 runs. Different formats stress different skills: a model can nail a tight explainer and still stumble on a personal story, so look for the format closest to what you write.

Script 1
opinion / warning explainer
82.1
out of 100
Script 2
news-analysis / skeptical explainer
85.0
out of 100
Script 3
personal roadmap / opinion
82.6
out of 100
Script 4
short explainer
83.9
out of 100
Script 5
news-analysis / opinion explainer
81.7
out of 100
Script 6
founder announcement / personal origin story
84.2
out of 100
Script 7
personal technical walkthrough / agentic workflow case study
86.5
out of 100
Script 8
product release announcement / personal observation
82.6
out of 100
Script 9
career guide / hiring analysis
87.4
out of 100
Script 10
engineering process walkthrough / presentation adaptation
79.2
out of 100

Consistency: how much it moves between runs

A model whose drafts swing from run to run is harder to use than its average suggests. Every score on this page is the mean of 5 runs per script, and the ± is the run-to-run standard deviation. Overall, DeepSeek V4.1 Flash (no thinking) moves by ± 2.9 against a board median of ± 2.5, so it's about as repeatable as the typical model on the board.

Its most volatile metric is Cues: ± 4.2 between runs, when the typical model moves ± 2.8, so two drafts of the same script can score quite differently there.

MetricThis modelBoard medianVerdict
Tone ?84.3 ± 1.7± 1.5typical
Craft ?86.3 ± 1.7± 1.4typical
Substance ?84.3 ± 1.6± 1.7typical
Flow ?83.0 ± 2.0± 1.6typical
YouTube ?80.6 ± 3.0± 2.5typical
Hook ?85.8 ± 2.2± 1.9typical
Length ?78.8 ± 11.2± 8.2typical
Slop ?87.3 ± 1.9± 1.9typical
Cues ?77.6 ± 4.2± 2.8swingier than most

Cost, time and tokens

Logged on every run. None of it touches the writing score, but it's often what decides whether a model fits your pipeline at all. Time is the average time to get one accepted script, retries included, and cost is priced per script at list price.

Time per script
0.2 minfaster than the board median of 1.2 min
Prompt tokens in
11.6kstyle guide + brief + research packet
Tokens out
2.6kscript + any reasoning tokens
Cost per script
$0.003 ± 0.001measured from actual billed tokens
List price used
$0.15 / $0.6 per M tokinput / output

What each judge scored it

One judge can have taste of its own, which is why there are four: three LLM judges from three model families, plus Jev, a typed judge from TypeSafe, each scoring the same 50 stored drafts blind against the same rubric. The overall of 83.5 combines their scores with the parts computed in code (length, and half of the slop score). The highest and lowest judge are 4.8 points apart on its overall. That's a typical amount of judge disagreement for this board. How the panel works.

Claude Opus 5
Anthropic
81.5
GPT-5.6 Sol (medium)
OpenAI
86.2
DeepSeek V4.1 Flash
DeepSeek
83.3
Jev 1.13
TypeSafe
83.2

How we ran DeepSeek V4.1 Flash (no thinking)

Frequently asked questions

How good is DeepSeek V4.1 Flash (no thinking) at writing?

It's #76 of 181 on ToneBench, with a writing Elo of 1710 and an overall score of 83.5/100. It wrote its own version of the scripts behind 10 of my What's AI videos 5 times each, and four judges scored every draft blind against mine: three LLM judges from three model families, plus Jev, a typed judge from TypeSafe. Length and half of the slop score are computed in code.

Is DeepSeek V4.1 Flash (no thinking) the best DeepSeek model for writing?

No. It's 7th of 15 DeepSeek configs; DeepSeek V4.1 Flash (max) is about 455 Elo ahead.

Is DeepSeek V4.1 Flash (no thinking) good value for the money?

It costs about $0.003 per script. Nothing that's at least 15% cheaper scores higher, so it's on the value frontier for its quality.

What are DeepSeek V4.1 Flash (no thinking)'s strengths and weaknesses?

Against the board average, its biggest edge is Length (78.8, +6.8) and it's furthest behind on Cues (77.6, -0.1). The nine-metric breakdown on this page shows the board average and board best for each.

How was DeepSeek V4.1 Flash (no thinking) evaluated?

Through OpenRouter, using the exact model/route id deepseek/deepseek-v4.1-flash at reasoning_effort none, first run on 2026-09-29. Each script ran 5 times with provider-default sampling and no fine-tuning. The 'How we ran it' section and the methodology page have the rest.

Is DeepSeek V4.1 Flash (no thinking) open source?

Yes, it's an open-weights model. Among open-weights models it's 12th of 56 for writing.

← Back to the full ToneBench leaderboard