Towards AITowards AIToneBench

Thinking Levels · Anthropic

Claude Sonnet 5: Writing Quality by Reasoning Effort

Last updated , from board data generated at 17:52 UTC.

This page compares Claude Sonnet 5 at 2 reasoning-effort settings, each tested on the same 10 scripts: the Writing Score (the 0 to 100 consensus of the judges and code), the Writing Elo (a rating from pairwise comparisons of those scores), and the cost and time of each setting. As a model, Claude Sonnet 5 ranks #29 of 87 models through its best setting. The other ranks on this page are configuration ranks: one setting's place among all 151 configurations.

What More Effort Changes for Claude Sonnet 5

On Claude Sonnet 5, max effort is a clear gain over no flag, and you wait for it. Max lands 218 Elo above the run with no effort flag (high), going from #83 to #61, and the ranges don't overlap. Each script then costs 5.8 times as much and takes about 12.0 minutes instead of 1.9.

Recommended Setting

On Claude Sonnet 5, max is the better setting. I just wouldn't run either one today. Claude Sonnet 5.5 (high) ranks well above both at #35, for $0.092 a script, less than this model with no flag, and it comes back in about 1.0 minutes. Moving to the newer Sonnet does more for your scripts than any effort setting on this one.

Every Setting on the Chart

Each point is one effort setting of Claude Sonnet 5, joined from the lowest setting to the highest. Higher and further left is better: a higher score for less money or less time.

How to Use the Chart
  • A hollow marker is the provider default: the level the provider applies when the request sets no effort level.
  • The tabs choose the score on the vertical axis, X axis switches between cost and time, and Table lists the same numbers as rows.
  • Select a point for its numbers and a link to its scorecard.
Score on the vertical axis
View
X axis

On a small screen, Table lists the same numbers as rows.

Both Effort Settings Compared

Score colors:82 and up65 to 81.9under 65
SettingWriting EloStepWriting ScoreCost / ScriptTime / ScriptConfiguration Rank
high (provider default)1561 ±55-76.6$0.1211.9 min#83
max1779 ±48+21879.2$0.69612.0 min#61

Other Anthropic Models by Effort

Writing Elo comes from comparing every pair of models on every script, which puts these settings on the same scale as the leaderboard. Step is the Writing Elo change from the provider default. Cost is one full script at API list prices, and time is the average for one accepted script, retries included. The thinking-levels page covers the other models, and the Anthropic family page lists every Anthropic model side by side.