Should you write with Kimi K3 or Gemini 3.1 Pro (default)? On this page the only thing that changes is the model. Both wrote their own version of the scripts behind 10 of my What's AI videos, five drafts per script, and three judges from three model families scored every draft blind, with my finished script as the reference. Kimi K3 leads overall, 88.5 to 80.1.
For a script in a real voice, Kimi K3 is far ahead of Gemini 3.1 Pro (default). It's #21, Gemini is #94, and Kimi wins all nine metrics. The biggest leads are tone and continuity, around nine or ten points each, exactly the metrics that score whether a script sounds like me or like a summary. To be fair to Gemini, it's quicker, around a minute and a quarter per script against about four, and cheaper at about $0.143 against $0.260. Kimi is the open-weights option, though, and that saving buys you a lot of rewriting. Gemini only makes sense when you're already on Google's API and need a rough starting draft.
Pick Kimi K3 for scripts that need to sound like a person talking, with open weights on top.
Pick Gemini 3.1 Pro (default) only when you're already built on Google's API and the script is a rough starting point.
Overall vs Elo. Overall is the weighted rubric score. Elo compares each model's five-draft average with every other model's, script by script, and counts gaps inside run-to-run noise as draws, so it rewards winning often and can disagree with overall. My own scripts score 90.9 on the same rubric, not a literal 100. Right now 2 of 167 ranked configurations reach it. A model above that line writes at that level on this rubric. That's not the same as beating my script line for line.
Reading the Elo intervals. Each 95% range comes from resampling every model's recorded run scores on each task and re-ranking. Comparing these separate ranges does not test the Elo gap between two models: far apart is strong evidence, and overlap isn't a tie. The tasks stay fixed, so the ranges say nothing about new tasks (the long version).
Blue is Kimi K3, orange is Gemini 3.1 Pro (default), and the solid bar takes the metric. The weight under each name is how much it counts toward the overall. Weighted by how much each metric counts, Tone & Voice Match does the most to put Kimi K3 ahead: it leads there by 9.8 points. If you care about one thing, say voice or length, go straight to that row.
Quality is half the decision. The other half is what each script costs you, how long you wait, and how often you get a bad draft. The lead has a price: Kimi K3 costs about 1.8x as much per script as Gemini 3.1 Pro (default).
| Kimi K3 | Gemini 3.1 Pro (default) | |
|---|---|---|
| Overall / 100 | 88.5 | 80.1 |
| Writing Elo | 2217 | 1465 |
| Score spread across drafts (± overall std) | 1.260 | 2.580 |
| Cost per script (USD) | 0.260 | 0.143 |
| Avg time per script (min) | 3.9 | 1.3 |
| Open weights | Yes | No |
Green wins the row, and for spread, cost and time, lower wins. Cost is one script at recorded list prices, uncached and without judging, so your real bill will differ. Spread is how much the overall score moves across a model's drafts, and time is the average time to get one accepted script, retries included.
Want the script-by-script detail? Full scorecards: Kimi K3 · Gemini 3.1 Pro (default). The whole scoring pipeline is on the methodology page.
← All comparisons