DeepSeek · open weights · writing benchmark
DeepSeek V4 Flash (native chat alias) lands in the middle of the pack on ToneBench at #90 of 167, with a writing Elo of 1518 and an overall score of 80.4 out of 100. Those numbers come from it writing its own version of the scripts behind 10 of my What's AI videos, five times each, with every draft scored blind against mine (how the scoring works).
For scale, my own scripts score 90.9 through the same judges and rubric. That's the real bar here, not a literal 100. It sits about 10 points under it.
Its Elo comes from comparing its average on each script with every other model's average on the same script, with gaps inside the run-to-run noise counted as draws. The 95% range is 1458 to 1574. That range overlaps 20 other configurations, ranked #77 to #97, so its exact spot inside that band is too close to call on this board. What the ranges can and can't tell you.
Its biggest edge is Length: 83.5, 66th on the board and about 13 points above the board average. Where it slips is YouTube (73.7, 3.0 points under the board average): the CTAs, open loops and re-engagement beats usually need adding by hand.
The format changes the result. Its best score was on the news-analysis / skeptical explainer (83.5) and its weakest on the short explainer (74.3), about 9 points apart. If most of your scripts look like one of those, weigh that score over the average.
It costs about $0.002 per script. Nothing that's at least 15% cheaper scores higher, so it sits on the value frontier for its quality. The strongest cheaper option is gpt-oss 120B at #150, about 882 Elo behind, and it costs about $0.001 per script. It also scores higher than plenty of pricier configs.
If you're on DeepSeek anyway, DeepSeek V4.1 Flash (max) is worth paying about 1 cents more per script.
Among open-weights models, it's 15th of 53. The best open-weights config is GLM-5.3 at #15, and everything above it is closed, so open weights still trail the frontier on this kind of writing.
Read the shape: the further a corner reaches, the stronger the model is on that metric. The dashed line is the board average and the dotted line is the board's best score on each metric, so a corner outside the dashed line beats the average there. Hover a point for the exact numbers.
Nine writing metrics, each scored 0–100 and blended into the overall by the editorial weight shown next to it. Rank is out of all 167 current-ranked models. The thick bar is this model; the thin line above it is the field's best on that metric (darker) and the one below is the field's average (lighter), on the same scale. The small ± is how much the score moves from run to run, and the ? next to each name says what the metric rewards.
The same 10 real scripts every current-ranked model writes, each scored on its own as the mean of 5 runs. Different formats stress different skills: a model can nail a tight explainer and still stumble on a personal story, so look for the format closest to what you write.
A model whose drafts swing from run to run is harder to use than its average suggests. Every score on this page is the mean of 5 runs per script, and the ± is the run-to-run standard deviation. Overall, DeepSeek V4 Flash (native chat alias) moves by ± 4.0 against a board median of ± 2.7, so it's swingier than the typical model here, which matters if you need repeatable output.
Its most volatile metric is Hook: ± 3.9 between runs, when the typical model moves ± 2.0, so two drafts of the same script can score quite differently there.
| Metric | This model | Board median | Verdict |
|---|---|---|---|
| Tone ? | 80.6 ± 2.1 | ± 1.7 | typical |
| Craft ? | 82.8 ± 1.5 | ± 1.5 | typical |
| Substance ? | 81.5 ± 2.8 | ± 2.0 | typical |
| Flow ? | 78.1 ± 2.8 | ± 1.8 | swingier than most |
| YouTube ? | 73.7 ± 5.4 | ± 2.9 | swingier than most |
| Hook ? | 82.8 ± 3.9 | ± 2.0 | swingier than most |
| Length ? | 83.5 ± 10.7 | ± 8.6 | typical |
| Slop ? | 84.5 ± 1.9 | ± 2.1 | typical |
| Cues ? | 77.4 ± 5.4 | ± 3.2 | swingier than most |
Logged on every run. None of it touches the writing score, but it's often what decides whether a model fits your pipeline at all. Time is the average time to get one accepted script, retries included, and cost is priced per script at list price.
One judge can have taste of its own, which is why there are three, from three model families, each scoring the same 50 stored drafts blind with the identical rubric. The overall of 80.4 combines their scores with the parts computed in code (length, and half of the slop score). The highest and lowest judge are 5.8 points apart on its overall. That's a typical amount of judge disagreement for this board. How the panel works.
deepseek-chat (provider default reasoning)It's #90 of 167 on ToneBench, with a writing Elo of 1518 and an overall score of 80.4/100. It wrote its own version of the scripts behind 10 of my What's AI videos 5 times each, and three judges from three model families scored every draft blind against mine. Length and half of the slop score are computed in code.
No. It's 5th of 12 DeepSeek configs; DeepSeek V4.1 Flash (max) is about 665 Elo ahead.
It costs about $0.002 per script. Nothing that's at least 15% cheaper scores higher, so it's on the value frontier for its quality.
Against the board average, its biggest edge is Length (83.5, +12.7) and it's furthest behind on YouTube (73.7, -3.0). The nine-metric breakdown on this page shows the board average and board best for each.
Through DeepSeek API, using the exact model/route id deepseek-chat, first run on 2026-09-03. Effective identity: DeepSeek V4 Flash. Formerly mislabeled DeepSeek V3; native alias served V4 Flash for every cached benchmark run. Each script ran 5 times with provider-default sampling and no fine-tuning. The 'How we ran it' section and the methodology page have the rest.
Yes, it's an open-weights model. Among open-weights models it's 15th of 53 for writing.