Model Scorecard
DeepSeek V4.1 Flash 1017 (high)
DeepSeek · open weights
DeepSeek V4.1 Flash 1017 ranks #13 of 81 models on the October 2026 ToneBench board through its best configuration, DeepSeek V4.1 Flash 1017 (max). This setting, DeepSeek V4.1 Flash 1017 (high), is #27 of 134 configurations, with a Writing Score of 81.1/100 and a Writing Elo of 2050. One script costs $0.0095 at API list price.
Last updated , from board data generated at 16:59 UTC.
Rank, scores, the nine metrics, the 10 reference scripts, cost and setup for one configuration (a model at one reasoning setting). Key Results sums it up; the section links below it jump to the detail.
Key Results
- StandingDeepSeek V4.1 Flash 1017 ranks #13 of 81 models through its best configuration, DeepSeek V4.1 Flash 1017 (max). This setting is #27 of 134 configurations by Writing Elo (2050), in the upper third of the board. Its 95% range (2001 to 2092) overlaps 17 other configurations, ranked #22 to #39, so its exact place among them is not settled.
- MetricsBest-ranked: Writing Craft & Clarity (79.5, 15th of 134 configurations, +5.4 against the board median). Lowest-ranked: Visual Cue Quality (73.4, 75th of 134 configurations, -0.8 against the board median).
- ScriptsFrom 79.1 on Script 10 (engineering process walkthrough) to 83.0 on Script 9 (career guide): a 3.9-point spread across the 10 reference scripts.
- ConsistencyIts Writing Score moves ± 1.8 between drafts of the same script, against ± 2.8 for the median configuration: steadier than most.
- ValueNo configuration at least 15% cheaper ranks higher. It costs $0.0095 per script. The strongest option at least 15% cheaper is MiMo-V2.6-Flash (thinking on), configuration #38, 77 Elo behind, at $0.0057 per script; their Elo ranges overlap.
Louis's PickI'd stay with this one: DeepSeek V4.1 Flash 1017 (max) is the strongest DeepSeek V4.1 Flash 1017 setting, but the board can't separate the two, and it costs under a cent more per script.
More Context Behind These Results
Writing Elo comes from comparing its average on each script with every other configuration's average on that same script; a gap smaller than the draft-to-draft variation counts as a draw (what the ranges can and cannot show).
On Writing Craft & Clarity, its best-ranked metric, its sentences need less smoothing than the typical configuration's. Visual Cue Quality ranks in the bottom half (75th of 134 configurations), so expect to add most of the visual cues by hand.
The script format moves its score. If most of your scripts look like its best or weakest format, that result is a better guide than the average.
Its drafts vary little, so the first draft is usually close to the next one.
It outranks 75 configurations that cost at least 50% more.
Among open-weight models, DeepSeek V4.1 Flash 1017 is 4th of 34. This setting is 5th of 43 open-weight configurations. That is one of the strongest open-weight results on this board.
All Settings of DeepSeek V4.1 Flash 1017
DeepSeek V4.1 Flash 1017 is also on the board at other effort settings, and DeepSeek V4.1 Flash 1017 (max) ranks higher, though their Elo ranges overlap. The thinking-level page for DeepSeek V4.1 Flash 1017 charts how quality, cost and time change with the setting.
| Setting | Configuration Rank | Writing Score | Writing Elo | Cost / Script | Time / Script |
|---|---|---|---|---|---|
| max | #24 | 81.6 | 2087 | $0.014 | 1.3 min |
| high this page | #27 | 81.1 | 2050 | $0.0095 | 0.9 min |
Skill Profile Across the Nine Metrics
Each corner is one metric on a 0 to 100 scale; the further out, the higher the score. A corner outside the dashed line beats the board median. Hover or tap a point for its exact score, and a metric name for what it rewards.
Scores by Metric
Nine metrics, each scored 0 to 100 and weighted into the Writing Score; the weight sits under each name. Rank is out of all 134 ranked configurations.
Scores by Reference Script
Every ranked configuration writes five drafts for each of the same 10 briefs, and each score is the mean of those drafts. The rank and board median compare it with every configuration on that script, which separates a weak result from a hard script. The result on the format closest to your own work is the most relevant.
Consistency Between Drafts
Every score on this page is the mean of 5 drafts per script. The ± is the standard deviation between those drafts: the larger it is, the more two drafts of the same script can differ.
Compared with the typical model, it varies most on Visual Cue Quality: ± 4.8 between drafts against ± 3.0, so two drafts of the same script can score quite differently there.
Consistency by Metric
| Metric | This model | Board median | Verdict |
|---|---|---|---|
| Tone & Voice Match ? | 79.6 ± 1.3 | ± 2.0 | typical |
| Writing Craft & Clarity ? | 79.5 ± 1.1 | ± 1.6 | typical |
| Substance, Accuracy & Value ? | 82.2 ± 2.4 | ± 2.3 | typical |
| Continuity & Emotion ? | 80.9 ± 1.1 | ± 1.5 | typical |
| YouTube Best Practices ? | 80.0 ± 2.2 | ± 2.5 | typical |
| Hook Strength ? | 81.2 ± 2.4 | ± 2.8 | typical |
| Length Adherence ? | 88.8 ± 6.9 | ± 7.0 | typical |
| Slop Score ? | 84.2 ± 1.4 | ± 1.6 | typical |
| Visual Cue Quality ? | 73.4 ± 4.8 | ± 3.0 | more variable than most |
Cost, Time and Tokens per Script
Logged on every run; none of these figures affects the Writing Score. Time is the average time to one accepted script, retries included. Cost is one script at the API list price.
Scores by Judge
Four judges score the same 50 stored drafts blind against the same rubric: three LLM judges from three labs, plus Jev, a typed judge from TypeSafe that rates each metric on five described quality levels. No single judge's taste decides the result. The Writing Score of 81.1 combines their scores with the parts computed in code (Length Adherence and half of the Slop Score). The highest and lowest judge are 11.9 points apart on its Writing Score. That is close to the board median of 13.7. Each judge also has its own scale, so every card shows that judge's score against its average across the board. How the panel works.
Evaluation Setup
How this exact configuration was run and judged: route, model ID, dates, sampling and prompt.
- Accessed viaOpenRouter · model page ↗.
- Exact model / route id
deepseek/deepseek-v4.1-flash-1017atreasoning level: high. - Generations5 independent runs × 10 scripts = 50 drafts, stored after generation and never edited.
- Run dates2026-10-17.
- JudgesClaude Opus 5.5 at medium effort through the Claude Code subscription, GPT-6.1 Sol at medium reasoning through the Codex CLI, GLM 5.3 Flash through OpenRouter, and Jev 1.13 from TypeSafe. One call per judge per draft. All four score every draft on their own, blind to which model wrote it. The three LLM judges use the identical rubric and have to quote evidence before they score a metric. Jev answers the same rubric as one question per metric, choosing among five described quality levels, and writes no text. Seven metrics are the plain average of the four judges. Length is computed from the spoken word count, and Slop is half computed (lexical scans minus the spoken-dash penalty) and half judged. The Writing Elo is cross-checked with a Bradley-Terry fit of the same pairwise results (methodology).
- Sampling and promptThe provider's default sampling, with no fine-tuning and no system-prompt changes. Every current-ranked model gets the same prompt, about 13,000 tokens (the count shifts a bit with each model's tokenizer): a style guide built from Louis's voice and storytelling guides, the target length, and the brief with its research packet. Generation is closed-book on every route: the prompt is the only source, with no web search, browsing, code execution, file access or other tool (generation).
- What stays privateThe exact rubric and any non-public reference material. Each script is normally benchmarked before its video is published, which lowers the odds that a model has seen the reference, though it does not rule it out (why).
Frequently Asked Questions
How Good Is DeepSeek V4.1 Flash 1017 (high) at Writing?
DeepSeek V4.1 Flash 1017 ranks #13 of 81 models on ToneBench through its best configuration, DeepSeek V4.1 Flash 1017 (max). This configuration is #27 of 134 configurations, in the upper third of the board, with a Writing Elo of 2050 and a Writing Score of 81.1/100. The ranks come from full YouTube scripts written in the voice of Louis-François Bouchard and judged blind, with the channel's finished script as the reference. The benchmark measures long-form scripted writing, so the result does not carry over to every kind of text.
Is DeepSeek V4.1 Flash 1017 (high) the Best DeepSeek Model for Writing?
DeepSeek V4.1 Flash 1017 is the top DeepSeek model, #13 of 81 models, through DeepSeek V4.1 Flash 1017 (max). This setting is 2nd of 11 DeepSeek configurations, about 37 Elo behind it, inside the overlap of their Elo ranges.
Is DeepSeek V4.1 Flash 1017 (high) Good Value for the Money?
It costs about $0.0095 per script. That is good value: no configuration at least 15% cheaper ranks higher.
What Are the Strengths and Weaknesses of DeepSeek V4.1 Flash 1017 (high)?
Its best-ranked metric is Writing Craft & Clarity (79.5, 15th of 134 configurations, +5.4 against the board median), and its lowest-ranked is Visual Cue Quality (73.4, 75th of 134, -0.8). The Scores by Metric section shows the board median and the board's best for each one.
How Was DeepSeek V4.1 Flash 1017 (high) Evaluated?
It was run through OpenRouter, with the exact model/route ID deepseek/deepseek-v4.1-flash-1017 at reasoning effort high, first run on 2026-10-17. It wrote each script 5 times with the provider's default sampling and no fine-tuning. The Evaluation Setup section and the methodology page have the details.
Does DeepSeek V4.1 Flash 1017 (high) Have Open Weights?
Yes. Its weights are public, so it can be downloaded and run on your own hardware. Check the license if you need open source in the strict sense. Among open-weight configurations it is 5th of 43 for writing.