Towards AITowards AIToneBench

Claude Fable 5.1 (max) vs Kimi K3

Head-to-head on the Towards AI writing benchmark: same 10 real YouTube scripts, five runs each, scored blind by a three-family judge panel. Claude Fable 5.1 (max) leads overall, 89.7 to 88.2.

Claude Fable 5.1 (max)
#1 Elo 2290 · 89.7/100
Kimi K3
#13 Elo 2148 · 88.2/100
Cost / script
$3.153 vs $0.260
Human baseline
90.2 Claude Fable 5.1 (max) falls below it · Kimi K3 falls below it

The verdict

Claude Fable 5.1 (max effort) has the stronger current result: #1 at 2289.7 Elo and 89.71 overall, compared with Kimi K3 at #13, 2148.0 Elo, and 88.19 overall. Their 95% Elo confidence intervals do not overlap, which supports the directional ordering (2229.00–2346.50 and 2113.10–2181.30). Claude Fable 5.1 (max effort) has its clearest metric edges in Length Adherence (94.83 versus 90.07) and Slop Score (EQ-Bench + ours) (93.99 versus 90.86). Kimi K3 does not lead an individual published metric in this pairing. At the measured run mix, Claude Fable 5.1 (max effort) costs $3.153 per article versus $0.260 for Kimi K3; Kimi K3 is the cheaper route. Kimi K3 is the open-weights option; Claude Fable 5.1 (max effort) is closed. On the current automated evidence, Claude Fable 5.1 (max effort) is the stronger default; Kimi K3 remains a defensible choice when its specific strengths, price, or deployment profile matter more than the headline rank.

Pick Claude Fable 5.1 (max effort) when you prioritize the stronger current board result, length adherence, and slop score (eq-bench + ours).
Pick Kimi K3 when you prioritize open weights, and lower measured cost.

Metric by metric

Blue bars: Claude Fable 5.1 (max). Orange bars: Kimi K3. Same 0–100 scale; the bold bar wins that metric.

Tone & Voice Match19% weight
89.3
88.3
Writing Craft & Clarity13% weight
89.2
88.5
Substance, Accuracy & Value15% weight
88.9
87.6
Continuity & Emotion14% weight
88.5
86.8
YouTube Best Practices12% weight
89.0
87.3
Hook Strength10% weight
90.2
90.2
Length Adherence8% weight
94.8
90.1
Slop Score (EQ-Bench + ours)5% weight
94.0
90.9
Visual Cue Quality4% weight
85.5
84.6

Everything else that differs

Claude Fable 5.1 (max)Kimi K3
Overall / 10089.788.2
Writing Elo22902148
Run-to-run spread (± overall std)3.8701.680
Cost per script (USD)3.1530.260
Avg latency (s)622.5234.3
Open weightsNoYes

Full scorecards: Claude Fable 5.1 (max) · Kimi K3. How scoring works: methodology.

← All comparisons