Towards AITowards AIToneBench

Thinking Levels · OpenAI

GPT-5.6 Sol: Writing Quality by Reasoning Effort

Last updated , from board data generated at 17:52 UTC.

This page compares GPT-5.6 Sol at 2 reasoning-effort settings, each tested on the same 10 scripts: the Writing Score (the 0 to 100 consensus of the judges and code), the Writing Elo (a rating from pairwise comparisons of those scores), and the cost and time of each setting. As a model, GPT-5.6 Sol ranks #11 of 87 models through its best setting. The other ranks on this page are configuration ranks: one setting's place among all 151 configurations.

What More Effort Changes for GPT-5.6 Sol

Ultra effort barely moves GPT-5.6 Sol's Writing Elo rating. The run with no effort flag (low) and the ultra run end up 2 Elo apart, with ranges that overlap almost completely. Ultra still charges you for trying: 3.3 times the price per script, and about 4.1 minutes of waiting instead of 0.9.

Recommended Setting

Leave the flag off. Ultra barely moves Writing Elo, and the run with no flag costs less and comes back much sooner. If you're picking a model today, though, I'd move to GPT-6 Sol. GPT-6 Sol (max) costs about what this model costs with no flag, $0.126 against $0.113, and ranks well above both settings here, with a clear gap between the ranges.

Every Setting on the Chart

Each point is one effort setting of GPT-5.6 Sol, joined from the lowest setting to the highest. Higher and further left is better: a higher score for less money or less time.

How to Use the Chart
  • A hollow marker is the provider default: the level the provider applies when the request sets no effort level.
  • The tabs choose the score on the vertical axis, X axis switches between cost and time, and Table lists the same numbers as rows.
  • Select a point for its numbers and a link to its scorecard.
Score on the vertical axis
View
X axis

On a small screen, Table lists the same numbers as rows.

Both Effort Settings Compared

Score colors:82 and up65 to 81.9under 65
SettingWriting EloStepWriting ScoreCost / ScriptTime / ScriptConfiguration Rank
low (provider default)2132 ±35-82.3$0.1130.9 min#25
ultra2134 ±52+282.3$0.3674.1 min#24

The 95% Writing Elo ranges overlap: GPT-5.6 Sol (low) runs from 2095 to 2165, and GPT-5.6 Sol (ultra) from 2082 to 2185.

Other OpenAI Models by Effort

Writing Elo comes from comparing every pair of models on every script, which puts these settings on the same scale as the leaderboard. Step is the Writing Elo change from the provider default. Cost is one full script at API list prices, and time is the average for one accepted script, retries included. The thinking-levels page covers the other models, and the OpenAI family page lists every OpenAI model side by side.