Towards AITowards AIToneBench

Lab Comparison

xAI Models Compared

Last updated , from board data generated at 17:52 UTC.

All 8 ranked xAI configurations on ToneBench, side by side: Writing Elo, Writing Score, the nine metrics, and cost and time per script. A configuration is one model at one thinking level.

Highest Writing Elo
Elo 1883Grok 4.6 (high)#24 of 87 models · $0.156 per script
Lowest Cost Within 200 Elo of the Top
$0.064 per scriptGrok 4.7 (low)Configuration #64 · Elo 1757
Lowest Cost
$0.021 per scriptGrok 4.3 (low)Configuration #130 · Elo 616

A configuration 200 Elo below the top is expected to score about 24% in its script-by-script comparisons with it, a draw counting as half. The Lowest Cost Within 200 Elo of the Top card names the cheapest configuration that stays that close.

Recommended Configurations

Ranks in these notes are configuration ranks: each setting's place among all 151 configurations. The Highest Writing Elo card above gives the model rank.

Picks and Notes From Louis

If you want the best script Grok can write, that's Grok 4.6 (high), at $0.156 and 5.2 minutes per script. The higher version number doesn't beat it. Grok 4.7 (high) costs 1.9 times as much, takes 9.6 minutes, and lands at #58. Their ranges overlap, and overlap alone doesn't settle their order, but nothing here says the extra money buys you a better script.

For volume, Grok 4.7 (low) is the cheapest configuration within 200 Elo of the top, at $0.064 and 1.7 minutes per script, and it sits 126 Elo behind. Length is its weakest score by far, so if you use it, check the word count before you publish.

I'd skip the older Groks entirely. Grok 4.5 (high) costs about what Grok 4.7 (low) does and sits 132 Elo lower, and Grok 4.3 (low) at $0.021 is down at #130. In this family, the cheap old models aren't a bargain.

With xAI, which Grok you pick matters way more than how you set it. The 8 configurations here run from Grok 4.6 (high) at #47 on the full board all the way down to Grok 4.3 (low) at #130, 1267 Elo apart. The Grok 4.6 and Grok 4.7 settings take the top of the family, from #47 to #64, then there's a cliff, and the next model down, Grok 4.5 (high), falls to #73.

All 8 xAI Configurations, Grouped by Model

Every row wrote the same 10 scripts for the same four blind judges, so these Writing Elo ratings sit on the leaderboard's scale. The rank column is the configuration rank, each setting's place among all 151 configurations on the board. Rows are grouped by model: a highlighted row is a model's best configuration, and the rows under it are the same model at other thinking levels. The ± after each Elo is half the width of its 95% range, and scores run from 0 to 100. Cost is one full script at the API list price of the route used. Each name opens its scorecard, and the head-to-head comparisons cover models from different labs.

Score colors:82 and up65 to 81.9under 65

With the metric scores shown, the table scrolls sideways.

Configuration RankConfigurationWriting EloWriting ScoreCost / ScriptTime / ScriptTone & Voice MatchWriting Craft & ClaritySubstance, Accuracy & ValueHook StrengthYouTube Best PracticesContinuity & EmotionSlop ScoreLength AdherenceVisual Cue Quality
#47Grok 4.6 (high)1883 ±4780.3$0.1565.2 min78.874.085.079.379.979.080.990.777.1
#57Grok 4.7 (medium)1840 ±5179.6$0.2156.2 min78.471.986.281.080.580.080.578.778.8
#58Grok 4.7 (high)1809 ±4679.6$0.3059.6 min78.471.486.079.780.280.980.579.180.4
#64Grok 4.7 (low)1757 ±5179.0$0.0641.7 min78.774.085.481.880.080.080.468.876.7
#73Grok 4.5 (high)1625 ±3577.8$0.0440.9 min75.573.683.081.976.577.680.677.175.7
#115Grok 4.20 (thinking always on)1041 ±4270.0$0.0250.6 min66.871.673.272.365.871.977.375.248.8
#125Grok 4.3 (high)789 ±5365.8$0.0351.2 min55.967.671.874.065.167.981.361.148.8
#130Grok 4.3 (low)616 ±3862.5$0.0210.3 min55.869.567.975.960.267.882.137.530.4

Effort Ladders for xAI Models

Each of these models ran at more than one thinking level. Each page shows how the score, cost and time change from one level to the next.

Grok 4.6 Against Other xAI Models

Each comparison lists every thinking level of both models, with Writing Elo, cost and time side by side. The line under each pair gives the Writing Elo gap between the two best configurations. A pair outside the written match-ups opens in the comparison tool.

← All comparisons