Towards AITowards AIToneBench

Kimi K2 (0905)

Moonshot (Kimi) · open weights · writing benchmark

#102 of 167 Elo 1351 Overall 77.8 Open weights
Rank
#102 of 167
Writing Elo
1351 ±42
Overall
77.8 / 100
Cost / script
$0.012 per script
Family
Moonshot (Kimi) 5th of 6
Type
Open 20th of 53
Consistency
± 4.3 swingier than most
Avg tokens
13.4k in+out
Time / script
0.8 min avg, retries included
Family check:Kimi K3 is Moonshot (Kimi)'s best writer here: +10.7 overall against this config for $0.248 more per script.

The short version

Kimi K2 (0905) lands in the middle of the pack on ToneBench at #102 of 167, with a writing Elo of 1351 and an overall score of 77.8 out of 100. Those numbers come from it writing its own version of the scripts behind 10 of my What's AI videos, five times each, with every draft scored blind against mine (how the scoring works).

For scale, my own scripts score 90.9 through the same judges and rubric. That's the real bar here, not a literal 100. It sits about 13 points under it.

Its Elo comes from comparing its average on each script with every other model's average on the same script, with gaps inside the run-to-run noise counted as draws. The 95% range is 1307 to 1392. That range overlaps 17 other configurations, ranked #97 to #114, so its exact spot inside that band is too close to call on this board. What the ranges can and can't tell you.

Its biggest edge is Hook: 83.2, 90th on the board and 1.6 points above the board average. Where it slips is YouTube (72.3, 4.4 points under the board average): the CTAs, open loops and re-engagement beats usually need adding by hand.

The format changes the result. Its best score was on the news-analysis / skeptical explainer (83.5) and its weakest on the personal technical walkthrough / agentic workflow case study (70.9), about 13 points apart. If most of your scripts look like one of those, weigh that score over the average.

It's also swingy: its overall moves ± 4.3 between runs of the same script, against ± 2.7 for the typical model, so the same prompt can give you a usable draft one time and one you'd rewrite the next. If you use it, generate a few drafts and keep the best.

It costs about $0.012 per script. DeepSeek V4 Flash (native chat alias) scores higher and costs about $0.002 per script, so on value this isn't the pick. Still, plenty of pricier configs score lower than it does.

If you're on Moonshot (Kimi) anyway, Kimi K3 is worth paying about 25 cents more per script.

Among open-weights models, it's 20th of 53. The best open-weights config is GLM-5.3 at #15, and everything above it is closed, so open weights still trail the frontier on this kind of writing.

Skill profile

Read the shape: the further a corner reaches, the stronger the model is on that metric. The dashed line is the board average and the dotted line is the board's best score on each metric, so a corner outside the dashed line beats the average there. Hover a point for the exact numbers.

50Tone?Craft?Substance?Flow?YouTube?Hook?Length?Slop?Cues?
Kimi K2 (0905)Board averageBoard best per metricMax possible (100)

Metric by metric

Nine writing metrics, each scored 0–100 and blended into the overall by the editorial weight shown next to it. Rank is out of all 167 current-ranked models. The thick bar is this model; the thin line above it is the field's best on that metric (darker) and the one below is the field's average (lighter), on the same scale. The small ± is how much the score moves from run to run, and the ? next to each name says what the metric rewards.

Tone ?19% weight · +0.4 vs avg
best · Claude Opus 5.5 (max effort) · 91.079.0± 2.0 · 99thboard avg · 78.6
Craft ?13% weight · +1.1 vs avg
best · Claude Opus 5.5 (max effort) · 91.581.6± 1.7 · 92ndboard avg · 80.5
Substance ?15% weight · -0.7 vs avg
best · Claude Opus 5.5 (xhigh) · 90.778.7± 2.5 · 105thboard avg · 79.4
Flow ?14% weight · -0.8 vs avg
best · Claude Opus 5.5 (max effort) · 90.976.2± 2.8 · 108thboard avg · 77.0
YouTube ?12% weight · -4.4 vs avg
best · Claude Opus 5.5 (max effort) · 91.772.3± 3.8 · 124thboard avg · 76.7
Hook ?10% weight · +1.6 vs avg
best · Claude Opus 5.5 (max effort) · 91.283.2± 2.4 · 90thboard avg · 81.6
Length ?8% weight · -1.1 vs avg
best · Claude Opus 5.5 (max effort) · 97.669.7± 8.6 · 99thboard avg · 70.8
Slop ?5% weight · -1.5 vs avg
best · Claude Opus 5.5 (max effort) · 94.982.6± 2.7 · 108thboard avg · 84.2
Cues ?4% weight · -2.4 vs avg
best · GPT-5.6 Sol (ultra) · 90.174.5± 6.9 · 117thboard avg · 77.0

Script by script

The same 10 real scripts every current-ranked model writes, each scored on its own as the mean of 5 runs. Different formats stress different skills: a model can nail a tight explainer and still stumble on a personal story, so look for the format closest to what you write.

Script 1
opinion / warning explainer
77.2
out of 100
Script 2
news-analysis / skeptical explainer
83.5
out of 100
Script 3
personal roadmap / opinion
75.2
out of 100
Script 4
short explainer
77.7
out of 100
Script 5
news-analysis / opinion explainer
79.2
out of 100
Script 6
founder announcement / personal origin story
83.0
out of 100
Script 7
personal technical walkthrough / agentic workflow case study
70.9
out of 100
Script 8
product release announcement / personal observation
81.4
out of 100
Script 9
career guide / hiring analysis
75.4
out of 100
Script 10
engineering process walkthrough / presentation adaptation
74.1
out of 100

Consistency: how much it moves between runs

A model whose drafts swing from run to run is harder to use than its average suggests. Every score on this page is the mean of 5 runs per script, and the ± is the run-to-run standard deviation.

Its most volatile metric is Cues: ± 6.9 between runs, when the typical model moves ± 3.2, so two drafts of the same script can score quite differently there.

MetricThis modelBoard medianVerdict
Tone ?79.0 ± 2.0± 1.7typical
Craft ?81.6 ± 1.7± 1.5typical
Substance ?78.7 ± 2.5± 2.0typical
Flow ?76.2 ± 2.8± 1.8swingier than most
YouTube ?72.3 ± 3.8± 2.9typical
Hook ?83.2 ± 2.4± 2.0typical
Length ?69.7 ± 8.6± 8.6typical
Slop ?82.6 ± 2.7± 2.1typical
Cues ?74.5 ± 6.9± 3.2swingier than most

Cost, time and tokens

Logged on every run. None of it touches the writing score, but it's often what decides whether a model fits your pipeline at all. Time is the average time to get one accepted script, retries included, and cost is priced per script at list price.

Time per script
0.8 minfaster than the board median of 1.2 min
Prompt tokens in
11.4kstyle guide + brief + research packet
Tokens out
2.1kscript + any reasoning tokens
Cost per script
$0.012 ± 0.003measured from actual billed tokens
List price used
$0.6 / $2.5 per M tokinput / output

What each judge scored it

One judge can have taste of its own, which is why there are three, from three model families, each scoring the same 50 stored drafts blind with the identical rubric. The overall of 77.8 combines their scores with the parts computed in code (length, and half of the slop score). The highest and lowest judge are 6.1 points apart on its overall. That's a typical amount of judge disagreement for this board. How the panel works.

Claude Opus 5
Anthropic
74.6
GPT-5.6 Sol (medium)
OpenAI
80.7
DeepSeek V4.1 Flash
DeepSeek
78.0

How we ran Kimi K2 (0905)

Frequently asked questions

How good is Kimi K2 (0905) at writing?

It's #102 of 167 on ToneBench, with a writing Elo of 1351 and an overall score of 77.8/100. It wrote its own version of the scripts behind 10 of my What's AI videos 5 times each, and three judges from three model families scored every draft blind against mine. Length and half of the slop score are computed in code.

Is Kimi K2 (0905) the best Moonshot (Kimi) model for writing?

No. It's 5th of 6 Moonshot (Kimi) configs; Kimi K3 is about 866 Elo ahead.

Is Kimi K2 (0905) good value for the money?

It costs about $0.012 per script. DeepSeek V4 Flash (native chat alias) scores higher and costs less, so it isn't the value pick.

What are Kimi K2 (0905)'s strengths and weaknesses?

Against the board average, its biggest edge is Hook (83.2, +1.6) and it's furthest behind on YouTube (72.3, -4.4). The nine-metric breakdown on this page shows the board average and board best for each.

How was Kimi K2 (0905) evaluated?

Through OpenRouter, using the exact model/route id moonshotai/kimi-k2-0905, first run on 2026-09-03. Each script ran 5 times with provider-default sampling and no fine-tuning. The 'How we ran it' section and the methodology page have the rest.

Is Kimi K2 (0905) open source?

Yes, it's an open-weights model. Among open-weights models it's 20th of 53 for writing.

← Back to the full ToneBench leaderboard