Towards AITowards AIToneBench

Thinking Levels · OpenAI

GPT-6 Sol: Writing Quality by Reasoning Effort

Last updated , from board data generated at 17:52 UTC.

This page compares GPT-6 Sol at 2 reasoning-effort settings, each tested on the same 10 scripts: the Writing Score (the 0 to 100 consensus of the judges and code), the Writing Elo (a rating from pairwise comparisons of those scores), and the cost and time of each setting. As a model, GPT-6 Sol ranks #5 of 87 models through its best setting. The other ranks on this page are configuration ranks: one setting's place among all 151 configurations.

What More Effort Changes for GPT-6 Sol

Max effort gives GPT-6 Sol a real gain, and the scripts stay cheap. Max lands 155 Elo above the run with no effort flag (medium), from #21 to #13, and the two ranges don't overlap. It costs 2.2 times as much, but that still comes to $0.126 a script, with about 2.5 minutes of waiting instead of 0.8.

Recommended Setting

I'd run GPT-6 Sol at max. At #13, nothing ranked above it costs less per script. The run with no flag is my pick for bulk drafts: #21 for $0.056, back in about 0.8 minutes.

The newer GPT-6.1 Sol (max) doesn't beat it. It ranks below this model at max, with ranges that don't touch, and it costs more and takes longer. For scripts, the newer version number buys you nothing here.

Every Setting on the Chart

Each point is one effort setting of GPT-6 Sol, joined from the lowest setting to the highest. Higher and further left is better: a higher score for less money or less time.

How to Use the Chart
  • A hollow marker is the provider default: the level the provider applies when the request sets no effort level.
  • The tabs choose the score on the vertical axis, X axis switches between cost and time, and Table lists the same numbers as rows.
  • Select a point for its numbers and a link to its scorecard.
Score on the vertical axis
View
X axis

On a small screen, Table lists the same numbers as rows.

Both Effort Settings Compared

Score colors:82 and up65 to 81.9under 65
SettingWriting EloStepWriting ScoreCost / ScriptTime / ScriptConfiguration Rank
medium (provider default)2146 ±42-82.5$0.0560.8 min#21
max2301 ±40+15583.5$0.1262.5 min#13

Other OpenAI Models by Effort

Writing Elo comes from comparing every pair of models on every script, which puts these settings on the same scale as the leaderboard. Step is the Writing Elo change from the provider default. Cost is one full script at API list prices, and time is the average for one accepted script, retries included. The thinking-levels page covers the other models, and the OpenAI family page lists every OpenAI model side by side.