Towards AITowards AIToneBench

Claude Fable 5 (max) vs DeepSeek V4 Pro (xhigh)

Should you write with Claude Fable 5 (max) or DeepSeek V4 Pro (xhigh)? On this page the only thing that changes is the model. Both wrote their own version of the scripts behind 10 of my What's AI videos, five drafts per script, and three judges from three model families scored every draft blind, with my finished script as the reference. Claude Fable 5 (max) leads overall, 89.7 to 78.9.

Claude Fable 5 (max)
#5 Elo 2392 · 89.7/100
DeepSeek V4 Pro (xhigh)
#97 Elo 1417 · 78.9/100
Cost / script
$2.522 vs $0.013
Human baseline
90.9 Claude Fable 5 (max) falls below it · DeepSeek V4 Pro (xhigh) falls below it

The verdict

This one is lopsided: almost a thousand Elo points between Claude Fable 5 (max effort + 4.8 fallback) at #5 and DeepSeek V4 Pro (xhigh) at #97. The gaps that hurt most are the script-specific ones. DeepSeek is about fifteen points behind on YouTube Best Practices, the structure that keeps people watching, and about as far behind on Visual Cue Quality. A hole that size means rebuilding the script rather than editing it. DeepSeek V4 Pro (xhigh) is open-weights and costs about a cent per script against two and a half dollars, and that's its whole case. I'd keep it for throwaway experiments.

Pick Claude Fable 5 (max effort + 4.8 fallback) for any script you actually plan to publish.
Pick DeepSeek V4 Pro (xhigh) only for cheap open-weights experiments where writing quality is secondary.

How to read these numbers

Overall vs Elo. Overall is the weighted rubric score. Elo compares each model's five-draft average with every other model's, script by script, and counts gaps inside run-to-run noise as draws, so it rewards winning often and can disagree with overall. My own scripts score 90.9 on the same rubric, not a literal 100. Right now 2 of 167 ranked configurations reach it. A model above that line writes at that level on this rubric. That's not the same as beating my script line for line.

Reading the Elo intervals. Each 95% range comes from resampling every model's recorded run scores on each task and re-ranking. Comparing these separate ranges does not test the Elo gap between two models: far apart is strong evidence, and overlap isn't a tie. The tasks stay fixed, so the ranges say nothing about new tasks (the long version).

Metric by metric: where the gap comes from

Blue is Claude Fable 5 (max), orange is DeepSeek V4 Pro (xhigh), and the solid bar takes the metric. The weight under each name is how much it counts toward the overall. Weighted by how much each metric counts, Tone & Voice Match does the most to put Claude Fable 5 (max) ahead: it leads there by 9.8 points. If you care about one thing, say voice or length, go straight to that row.

Tone & Voice Match19% weight
89.7
79.9
Writing Craft & Clarity13% weight
89.6
80.9
Substance, Accuracy & Value15% weight
88.6
79.4
Continuity & Emotion14% weight
89.1
77.3
YouTube Best Practices12% weight
90.5
75.5
Hook Strength10% weight
88.6
82.6
Length Adherence8% weight
93.2
78.5
Slop Score (EQ-Bench + ours)5% weight
93.4
80.7
Visual Cue Quality4% weight
85.4
70.3

Cost, speed, and consistency

Quality is half the decision. The other half is what each script costs you, how long you wait, and how often you get a bad draft. The lead has a price: Claude Fable 5 (max) costs about 194x as much per script as DeepSeek V4 Pro (xhigh).

Claude Fable 5 (max)DeepSeek V4 Pro (xhigh)
Overall / 10089.778.9
Writing Elo23921417
Score spread across drafts (± overall std)1.3603.840
Cost per script (USD)2.5220.013
Avg time per script (min)9.11.8
Open weightsNoYes

Green wins the row, and for spread, cost and time, lower wins. Cost is one script at recorded list prices, uncached and without judging, so your real bill will differ. Spread is how much the overall score moves across a model's drafts, and time is the average time to get one accepted script, retries included.

Want the script-by-script detail? Full scorecards: Claude Fable 5 (max) · DeepSeek V4 Pro (xhigh). The whole scoring pipeline is on the methodology page.

← All comparisons