Lab Comparison
Last updated , from board data generated at 17:52 UTC.
All 4 ranked Moonshot (Kimi) configurations on ToneBench, side by side: Writing Elo, Writing Score, the nine metrics, and cost and time per script. A configuration is one model at one thinking level.
Ranks in these notes are configuration ranks: each setting's place among all 151 configurations. The Highest Writing Elo card above gives the model rank.
Picks and Notes From Louis
For scripts you'll publish, I'd use Kimi K3.1 Pro (max). It's 34 Elo ahead of Kimi K3 (max), and their ranges overlap. Overlap alone doesn't say whether one writes better. The metrics split: it gains on substance and visual cues and gives back a little on tone, flow and YouTube best practices. It does win on cost and speed: $0.251 and 5.5 minutes per script, against $0.362 and 9.9 minutes. I'd stay on Kimi K3 (max) only if you need open weights.
If you write a lot, Kimi K3 (high) is the practical one. It drops to #45, but it costs $0.128 a script and comes back in 2.8 minutes. I'd skip Kimi K2.6 (high). At $0.103 it's only a little cheaper than Kimi K3 (high), takes longer, and sits at #103.
The best Kimi on the board is now Kimi K3.1 Pro (max), at #19 overall. Moonshot calls it open-weight, but the weights aren't published yet, so the board marks it closed for now. That's annoying if you came to Kimi to run it yourself. There are only 4 Kimi configurations here, and they're far apart: 809 Elo from top to bottom.
Every row wrote the same 10 scripts for the same four blind judges, so these Writing Elo ratings sit on the leaderboard's scale. The rank column is the configuration rank, each setting's place among all 151 configurations on the board. Rows are grouped by model: a highlighted row is a model's best configuration, and the rows under it are the same model at other thinking levels. The ± after each Elo is half the width of its 95% range, and scores run from 0 to 100. Cost is one full script at the API list price of the route used. Each name opens its scorecard, and the head-to-head comparisons cover models from different labs.
With the metric scores shown, the table scrolls sideways.
| Configuration Rank | Configuration | Writing Elo | Writing Score | Cost / Script | Time / Script | Tone & Voice Match | Writing Craft & Clarity | Substance, Accuracy & Value | Hook Strength | YouTube Best Practices | Continuity & Emotion | Slop Score | Length Adherence | Visual Cue Quality |
|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|
| #19 | Kimi K3.1 Pro (max) | 2150 ±42 | 82.5 | $0.251 | 5.5 min | 77.0 | 77.8 | 88.2 | 83.4 | 79.7 | 80.8 | 85.0 | 95.4 | 84.9 |
| #26 | Kimi K3 (max) · open weights | 2116 ±38 | 82.2 | $0.362 | 9.9 min | 78.7 | 78.8 | 83.5 | 83.1 | 81.2 | 82.3 | 83.4 | 94.2 | 80.0 |
| #45 | Kimi K3 (high) · open weights | 1891 ±50 | 80.3 | $0.128 | 2.8 min | 77.4 | 77.9 | 82.4 | 83.2 | 79.9 | 81.1 | 82.0 | 84.5 | 76.0 |
| #103 | Kimi K2.6 (high) · open weights | 1341 ±46 | 74.4 | $0.103 | 4.1 min | 69.7 | 70.3 | 75.9 | 79.4 | 73.3 | 74.0 | 76.8 | 87.9 | 65.6 |
Only Kimi K3 ran at more than one thinking level here. Its page shows how the score, cost and time change from one level to the next.
Each comparison lists every thinking level of both models, with Writing Elo, cost and time side by side. The line under each pair gives the Writing Elo gap between the two best configurations. A pair outside the written match-ups opens in the comparison tool.