Towards AITowards AIToneBench

Model Scorecard

Kimi K3.1 Pro (max)

Moonshot (Kimi) · proprietary

Kimi K3.1 Pro ranks #7 of 83 models on the October 2026 ToneBench board, and Kimi K3.1 Pro (max) is its only configuration, #14 of 136 configurations, with a Writing Score of 82.5/100 and a Writing Elo of 2205. One script costs $0.251 at API list price.

Last updated , from board data generated at 22:06 UTC.

Rank, scores, the nine metrics, the 10 reference scripts, cost and setup for one configuration (a model at one reasoning setting). Key Results sums it up; the section links below it jump to the detail.

Model Rank ?
#7 of 83 modelsits only configuration is #14 of 136 configurations
Writing Score ?
82.5 out of 100
Writing Elo ?
2205 95% range 2166 to 2246
Cost per Script
$0.251 at API list price

Key Results

Louis's PickI'd pick Claude Opus 5.5 (low) over this one: it ranks clearly higher for no more per script.

More Context Behind These Results

Writing Elo comes from comparing its average on each script with every other configuration's average on that same script; a gap smaller than the draft-to-draft variation counts as a draw (what the ranges can and cannot show).

On Visual Cue Quality, its best-ranked metric, its visual cues are more usable than the typical configuration's. Even its lowest-ranked metric, Tone & Voice Match, ranks in the top half of the board, so no metric stands out as a weak spot.

The script format moves its score. If most of your scripts look like its best or weakest format, that result is a better guide than the average.

Its drafts vary little, so the first draft is usually close to the next one.

It outranks 7 configurations that cost at least 50% more.

It ranks highest of the 4 Moonshot (Kimi) configurations on the board, though its Elo range overlaps that of Kimi K3 (max).

Among proprietary models, Kimi K3.1 Pro is 7th of 49. As a configuration, it is 14th of 93 proprietary configurations. It also sits above every open-weight configuration; the best of them, GLM-5.3 (max), is configuration #17.

Lab
Moonshot (Kimi) 1st of 3 modelsthis setting 1st of 4 configurations
Weights
Proprietary 7th of 49 modelsthis setting 14th of 93 configurations
Consistency
± 1.6 steadier than most
Average Tokens
35.8k input + output
Time per Script
5.5 min average, retries included

Skill Profile Across the Nine Metrics

Each corner is one metric on a 0 to 100 scale; the further out, the higher the score. A corner outside the dashed line beats the board median. Hover or tap a point for its exact score, and a metric name for what it rewards.

50Tone?Craft?Substance?Flow?YouTube?Hook?Length?Slop?Cues?
Kimi K3.1 Pro (max)Board medianBoard best per metricMax possible (100)

Scores by Metric

Nine metrics, each scored 0 to 100 and weighted into the Writing Score; the weight sits under each name. Rank is out of all 136 ranked configurations.

Score colors:Strong: 82 and upMiddle: 65 to 81.9Weak: under 65
This modelBoard best (upper line)Board median (lower line)±: spread between drafts?: what the metric rewards
Tone & Voice Match ?19% weight · +3.5 vs median
board best 82.8 · Claude Opus 5.5 (max effort)77.0± 1.6 · 47thboard median 73.5
Writing Craft & Clarity ?13% weight · +3.8 vs median
board best 83.2 · Claude Opus 5.5 (xhigh)77.8± 1.2 · 39thboard median 74.0
Substance, Accuracy & Value ?15% weight · +7.3 vs median
board best 88.4 · Claude Opus 5.5 (xhigh)88.2± 0.8 · 2ndboard median 80.9
Continuity & Emotion ?14% weight · +3.6 vs median
board best 85.7 · Claude Opus 5.5 (max effort)80.8± 1.1 · 29thboard median 77.2
YouTube Best Practices ?12% weight · +4.4 vs median
board best 84.4 · Claude Opus 5.5 (xhigh)79.7± 2.1 · 31stboard median 75.3
Hook Strength ?10% weight · +4.0 vs median
board best 83.7 · Claude Opus 5.5 (max effort)83.4± 1.6 · 5thboard median 79.3
Length Adherence ?8% weight · +12.0 vs median
board best 98.8 · Claude Sonnet 5.5 (max effort)95.4± 3.0 · 17thboard median 83.4
Slop Score ?5% weight · +4.2 vs median
board best 89.0 · GPT-6 Sol (medium)85.0± 1.3 · 28thboard median 80.8
Visual Cue Quality ?4% weight · +10.6 vs median
board best 85.9 · Claude Opus 5.5 (max effort)84.9± 1.6 · 2ndboard median 74.3

Scores by Reference Script

Every ranked configuration writes five drafts for each of the same 10 briefs, and each score is the mean of those drafts. The rank and board median compare it with every configuration on that script, which separates a weak result from a hard script. The result on the format closest to your own work is the most relevant.

Script 1
opinion / warning explainer
81.3
out of 100
24th of 136 configurations on this script · board median 76.4
Script 2
news-analysis / skeptical explainer
83.2
out of 100
13th of 136 configurations on this script · board median 77.7
Script 3
personal roadmap / opinion
81.9
out of 100
24th of 136 configurations on this script · board median 76.3
Script 4
short explainer
82.0
out of 100
16th of 136 configurations on this script · board median 74.6
Script 5
news-analysis / opinion explainer
84.2
out of 100
8th of 136 configurations on this script · board median 77.1
Script 6
founder announcement / personal origin story
83.0
out of 100
17th of 136 configurations on this script · board median 78.9
Script 7
personal technical walkthrough / agentic workflow case study
80.4
out of 100
42nd of 136 configurations on this script · board median 77.0
Script 8
product release announcement / personal observation
82.1
out of 100
20th of 136 configurations on this script · board median 78.4
Script 9
career guide / hiring analysis
85.5
out of 100
9th of 136 configurations on this script · board median 78.5
Script 10
engineering process walkthrough / presentation adaptation
81.3
out of 100
15th of 136 configurations on this script · board median 73.8

Consistency Between Drafts

Every score on this page is the mean of 5 drafts per script. The ± is the standard deviation between those drafts: the larger it is, the more two drafts of the same script can differ.

Compared with the typical model, it's steadiest on Substance, Accuracy & Value: ± 0.8 between drafts against ± 2.3.

Consistency by Metric
MetricThis modelBoard medianVerdict
Tone & Voice Match ?77.0 ± 1.6± 2.0typical
Writing Craft & Clarity ?77.8 ± 1.2± 1.6typical
Substance, Accuracy & Value ?88.2 ± 0.8± 2.3steadier than most
Continuity & Emotion ?80.8 ± 1.1± 1.5typical
YouTube Best Practices ?79.7 ± 2.1± 2.5typical
Hook Strength ?83.4 ± 1.6± 2.8steadier than most
Length Adherence ?95.4 ± 3.0± 7.0steadier than most
Slop Score ?85.0 ± 1.3± 1.6typical
Visual Cue Quality ?84.9 ± 1.6± 3.0steadier than most

Cost, Time and Tokens per Script

Logged on every run; none of these figures affects the Writing Score. Time is the average time to one accepted script, retries included. Cost is one script at the API list price.

Time per Script
5.5 minabout 4x the board median of 1.5 min
Prompt tokens in
13.3kstyle guide + brief + research packet
Tokens Out
22.5kwell above the board median, so a lot of thinking
Cost per Script
$0.251measured from actual billed tokens; varies ± 0.046 between drafts
List Price Used
$2 / $10input / output, per million tokens

Scores by Judge

Four judges score the same 50 stored drafts blind against the same rubric: three LLM judges from three labs, plus Jev, a typed judge from TypeSafe that rates each metric on five described quality levels. No single judge's taste decides the result. The Writing Score of 82.5 combines their scores with the parts computed in code (Length Adherence and half of the Slop Score). The highest and lowest judge are 11.8 points apart on its Writing Score. That is close to the board median of 13.7. Each judge also has its own scale, so every card shows that judge's score against its average across the board. How the panel works.

Claude Opus 5.5 (medium)
Anthropic
77.7
+10.0 against its board average of 67.7
GLM 5.3 Flash
Z.ai
89.5
+7.3 against its board average of 82.2
GPT-6.1 Sol (medium)
OpenAI
83.3
+12.3 against its board average of 70.9
Jev 1.13
TypeSafe
79.5
+5.9 against its board average of 73.5

Evaluation Setup

How this exact configuration was run and judged: route, model ID, dates, sampling and prompt.

Frequently Asked Questions

How Good Is Kimi K3.1 Pro (max) at Writing?

Kimi K3.1 Pro ranks #7 of 83 models on ToneBench, and this is its only configuration on the board. This configuration is #14 of 136 configurations, in the top 20, with a Writing Elo of 2205 and a Writing Score of 82.5/100. The ranks come from full YouTube scripts written in the voice of Louis-François Bouchard and judged blind, with the channel's finished script as the reference. The benchmark measures long-form scripted writing, so the result does not carry over to every kind of text.

Is Kimi K3.1 Pro (max) the Best Moonshot (Kimi) Model for Writing?

Yes. Of the 4 Moonshot (Kimi) configurations on the board, Kimi K3.1 Pro (max) ranks highest by Writing Elo, which makes Kimi K3.1 Pro the top Moonshot (Kimi) model, #7 of 83 models. Its Elo range overlaps that of Kimi K3 (max), so the order between those two is not settled.

Is Kimi K3.1 Pro (max) Good Value for the Money?

It costs about $0.251 per script. GPT-6 Sol (max) ranks higher and costs less.

What Are the Strengths and Weaknesses of Kimi K3.1 Pro (max)?

Its best-ranked metric is Visual Cue Quality (84.9, 2nd of 136 configurations, +10.6 against the board median), and its lowest-ranked is Tone & Voice Match (77.0, 47th of 136, +3.5). Even that one ranks in the top half of the board. The Scores by Metric section shows the board median and the board's best for each one.

How Was Kimi K3.1 Pro (max) Evaluated?

It was run through OpenRouter, with the exact model/route ID moonshotai/kimi-k3.1-pro at reasoning effort max, first run on 2026-10-23. It wrote each script 5 times with the provider's default sampling and no fine-tuning. The Evaluation Setup section and the methodology page have the details.

Does Kimi K3.1 Pro (max) Have Open Weights?

No. It is a proprietary model: its weights are not public. Among proprietary configurations it is 14th of 93 for writing.

← All models   ← Leaderboard