Towards AITowards AIToneBench

Comparisons

Head-to-Head Model Comparisons

Last updated , from board data generated at 20:08 UTC.

Compare two models on writing quality and cost, to see whether the quality gap is worth the difference in price. Written pages cover every pair among the top 25 models, the models with a configuration in the top 50 of the 132 configurations: 300 pages in total, each with every thinking level of both models, cost, the nine metric scores, a written verdict and a pick for each model. Any other pair opens in the comparison tool.

All models wrote the same 10 real scripts and were scored by the same four judges. A configuration is one model at one thinking level. The Writing Score is the 0 to 100 consensus of the judges and code, and the Writing Elo is a rating from pairwise comparisons of those scores; where the 95% ranges of two ratings overlap, the board cannot order the two configurations. The highest-ranked model outside the written match-ups is Claude Opus 4.7, #26 of 80 models; its best configuration is #52 of 132 configurations.

Compare Any Two Models

A pair with a written match-up opens that page, and any other pair opens in the comparison tool. The configurations of a single model are compared on its thinking-levels page.

Key Match-Ups

Three written match-ups picked by rule from the current board. Picks name the configuration Louis recommends for each model.

Smallest Elo Gap Among the Top 10 Models
Claude Fable 5.1 vs Claude Sonnet 5.51 Elo apart, 95% ranges overlapPicks: Claude Fable 5.1 (max effort) · Claude Sonnet 5.5 (xhigh)
Largest Price Gap Between Models the Board Cannot Separate
Claude Opus 4.8 vs MiMo-V2.6-Flash95% ranges overlap; Claude Opus 4.8 (max effort) costs about 216 times as much per scriptPicks: Claude Opus 4.8 (max effort) · MiMo-V2.6-Flash (thinking on)
Highest-Rated Pair From One Lab
Claude Opus 5.5 vs Claude Fable 5.1Anthropic: 235 Elo apart, 95% ranges do not overlapPicks: Claude Opus 5.5 (xhigh) · Claude Fable 5.1 (max effort)

Lab Pages: Every Configuration From One Lab

Each card names a lab's best configuration with its Writing Elo and its model's rank. The lab page ranks all of the lab's configurations and picks out the highest Writing Elo, the lowest cost within 200 Elo of the top, and the lowest cost.

Anthropic
Claude Opus 5.5 (xhigh)Elo 2785 · #1 of 80 models · 29 configurations
OpenAI
GPT-6 Sol (max)Elo 2365 · #4 of 80 models · 27 configurations
Zhipu (GLM)
GLM-5.3 (max)Elo 2209 · #7 of 80 models · 7 configurations
Moonshot (Kimi)
Kimi K3 (max)Elo 2189 · #10 of 80 models · 3 configurations
DeepSeek
DeepSeek V4.1 Flash (max)Elo 2024 · #14 of 80 models · 9 configurations
Meta
Muse Wonder (max)Elo 2005 · #16 of 80 models · 7 configurations
Xiaomi
MiMo-V2.6-Pro UltraSpeed (thinking on)Elo 1990 · #18 of 80 models · 3 configurations
xAI
Grok 4.6 (high)Elo 1949 · #20 of 80 models · 8 configurations
Mistral
Mistral Large 4 (high)Elo 1661 · #30 of 80 models · 4 configurations
Google
Gemini 4 Argon (high thinking)Elo 1639 · #32 of 80 models · 17 configurations
Alibaba (Qwen)
Qwen3.8 Max (thinking on)Elo 1613 · #34 of 80 models · 8 configurations
MiniMax
MiniMax M3 (thinking on)Elo 1473 · #40 of 80 models · 3 configurations
NVIDIA
Nemotron 3 Ultra 550B (high)Elo 943 · #56 of 80 models · 3 configurations
Cohere
Cohere Command A+ (05-2026) (thinking on)Elo 449 · #71 of 80 models · 3 configurations

Match-Ups With a Verdict (300)

How to Use This List

Each group is one model and lists every lower-rated model it meets. The figure after each name is how far ahead the group's model is, in Writing Elo between the two best configurations, and Close marks a pair whose 95% ranges overlap. The filter takes model or lab names, and two names show that pair. Select a model's name to open or fold its list.

300 match-ups

Claude Opus 5.5

24 match-ups

Claude Fable 5.1

23 match-ups

Claude Sonnet 5.5

22 match-ups

GPT-6 Sol

21 match-ups

Claude Opus 5

20 match-ups

Claude Fable 5

19 match-ups

GLM-5.3

18 match-ups

GPT-6.1 Sol

17 match-ups

GPT-5.6 Sol

16 match-ups

Kimi K3

15 match-ups

GPT-6 Astra

14 match-ups

GLM-5.3 Flash

13 match-ups

GPT-5.6 Terra

12 match-ups

DeepSeek V4.1 Flash

11 match-ups

Claude Opus 4.8

10 match-ups

Muse Wonder

9 match-ups

Claude Haiku 5.5

8 match-ups

MiMo-V2.6-Pro UltraSpeed

7 match-ups

MiMo-V2.6-Flash

6 match-ups

Grok 4.6

5 match-ups

DeepSeek V4 Pro 0813

4 match-ups

MiMo-V2.6-Pro

3 match-ups

Grok 4.7

2 match-ups

Claude Sonnet 5

1 match-up
← Back to the leaderboard