Towards AITowards AIToneBench

Comparisons

Head-to-Head Model Comparisons

Last updated , from board data generated at 20:15 UTC.

Compare two models on writing quality and cost, to see whether the quality gap is worth the difference in price. Written pages cover every pair among the top 25 models, the models with a configuration in the top 50 of the 141 configurations: 300 pages in total, each with every thinking level of both models, cost, the nine metric scores, a written verdict and a pick for each model. Any other pair opens in the comparison tool.

All models wrote the same 10 real scripts and were scored by the same four judges. A configuration is one model at one thinking level. The Writing Score is the 0 to 100 consensus of the judges and code, and the Writing Elo is a rating from pairwise comparisons of those scores. The 95% ranges describe individual configurations; overlap alone establishes neither a tie nor an order for a pair. The highest-ranked model outside the written match-ups is Grok 4.7, #26 of 84 models; its best configuration is #51 of 141 configurations.

Compare Any Two Models

A pair with a written match-up opens that page, and any other pair opens in the comparison tool. The configurations of a single model are compared on its thinking-levels page.

Key Match-Ups

Three written match-ups picked by rule from the current board. Picks name the configuration Louis recommends for each model.

Smallest Elo Gap Among the Top 10 Models
GPT-5.6 Sol vs GLM-5.31 Elo apart, 95% ranges overlapPicks: GPT-5.6 Sol (low) · GLM-5.3 (max)
Largest Price Gap Between Models With Overlapping Ranges
Claude Opus 4.8 vs MiMo-V2.6-Flash95% ranges overlap; Claude Opus 4.8 (max effort) costs about 216 times as much per scriptPicks: Claude Opus 4.8 (max effort) · MiMo-V2.6-Flash (thinking on)
Highest-Rated Pair From One Lab
Claude Opus 5.5 vs Claude Sonnet 5.5Anthropic: 234 Elo apart, 95% ranges do not overlapPicks: Claude Opus 5.5 (xhigh) · Claude Sonnet 5.5 (high)

Lab Pages: Every Configuration From One Lab

Each card names a lab's best configuration with its Writing Elo and its model's rank. The lab page ranks all of the lab's configurations and picks out the highest Writing Elo, the lowest cost within 200 Elo of the top, and the lowest cost.

Anthropic
Claude Opus 5.5 (max effort)Elo 2763 · #1 of 84 models · 29 configurations
OpenAI
GPT-6 Sol (max)Elo 2335 · #4 of 84 models · 32 configurations
Moonshot (Kimi)
Kimi K3.1 Pro (max)Elo 2191 · #8 of 84 models · 4 configurations
Zhipu (GLM)
GLM-5.3 (max)Elo 2178 · #10 of 84 models · 7 configurations
DeepSeek
DeepSeek V4.1 Flash 1017 (max)Elo 2072 · #14 of 84 models · 11 configurations
Meta
Muse Wonder (max)Elo 1974 · #17 of 84 models · 7 configurations
Xiaomi
MiMo-V2.6-Pro UltraSpeed (thinking on)Elo 1965 · #20 of 84 models · 3 configurations
xAI
Grok 4.6 (high)Elo 1937 · #22 of 84 models · 8 configurations
MiniMax
MiniMax M3.1 Flash (max)Elo 1679 · #31 of 84 models · 4 configurations
Mistral
Mistral Large 4 (high)Elo 1639 · #34 of 84 models · 4 configurations
Google
Gemini 4 Argon (high thinking)Elo 1627 · #35 of 84 models · 17 configurations
Alibaba (Qwen)
Qwen3.8 Max (thinking on)Elo 1575 · #37 of 84 models · 8 configurations
NVIDIA
Nemotron 3 Ultra 550B (high)Elo 903 · #60 of 84 models · 3 configurations
Cohere
Cohere Command A+ (05-2026) (thinking on)Elo 412 · #75 of 84 models · 3 configurations

Match-Ups With a Verdict (300)

How to Use This List

Each group is one model and lists every lower-rated model it meets. The figure after each name is how far ahead the group's model is, in Writing Elo between the two best configurations, and Close marks a pair whose 95% ranges overlap. The filter takes model or lab names, and two names show that pair. Select a model's name to open or fold its list.

300 match-ups

Claude Opus 5.5

24 match-ups

Claude Sonnet 5.5

23 match-ups

Claude Fable 5.1

22 match-ups

GPT-6 Sol

21 match-ups

Claude Opus 5

20 match-ups

Claude Fable 5

19 match-ups

GPT-6.1 Sol

18 match-ups

Kimi K3.1 Pro

17 match-ups

GPT-5.6 Sol

16 match-ups

GLM-5.3

15 match-ups

Kimi K3

14 match-ups

GPT-6 Astra

13 match-ups

GLM-5.3 Flash

12 match-ups

DeepSeek V4.1 Flash 1017

11 match-ups

GPT-5.6 Terra

10 match-ups

DeepSeek V4.1 Flash

9 match-ups

Muse Wonder

8 match-ups

Claude Opus 4.8

7 match-ups

Claude Haiku 5.5

6 match-ups

MiMo-V2.6-Pro UltraSpeed

5 match-ups

MiMo-V2.6-Flash

4 match-ups

Grok 4.6

3 match-ups

GPT-6.1 Terra

2 match-ups

MiMo-V2.6-Pro

1 match-up
← Back to the leaderboard