Towards AITowards AIToneBench

Every Zhipu (GLM) model, side by side

Zhipu's GLM line is open weights top to bottom, and its best model is a serious writer: GLM-5.3 ranks #12 on the whole board. At the other end, GLM-4.5 Air lands at #163, 1598 Elo lower. That spread is basically a history lesson. The GLM-5 generation sits far above the GLM-4 one, so the version number tells you more than the brand does.

Best writer
GLM-5.3#12 · Elo 2253 · $0.114 per script
Best value (within 200 Elo of the best)
GLM-5.3 Flash#18 · Elo 2222 · $0.015 per script
Cheapest
GLM-4.5 Air#163 · Elo 656 · $0.0061 per script

All 7 configurations

Every configuration here wrote the same 10 scripts for the same four blind judges, so the writing Elo and ranks compare across the whole board, not just inside this family. A highlighted row is a model's best configuration, and the rows under it are the same model at other effort or thinking settings. Scores run 0 to 100, and cost is one full script at the API list price of the route we ran.

Board rankConfigurationEloOverallToneCraftSubstanceHookYouTubeFlowSlopLengthCuesCost / scriptTime / script
#12GLM-5.3 · open2253 ±3588.589.389.287.388.788.387.390.790.483.5$0.1145.2 min
#18GLM-5.3 Flash · open2222 ±4488.288.389.086.588.687.987.291.491.383.7$0.0156.6 min
#80GLM-5 · open1649 ±4282.783.383.883.185.382.480.187.178.580.3$0.0613.1 min
#96GLM-5.2 · open1529 ±4681.483.283.883.384.679.679.886.068.082.0$0.0411.1 min
#125GLM-4.7 · open1215 ±3477.076.379.376.882.272.176.681.374.076.3$0.0163.5 min
#138GLM-4.6 · open1111 ±4974.775.178.275.681.271.874.077.063.273.4$0.0141.2 min
#163GLM-4.5 Air · open656 ±4367.167.370.669.075.964.865.270.449.570.0$0.00611.4 min

Which one should you use?

If you only care about the score, GLM-5.3 is the one. But the pick I'd actually make is GLM-5.3 Flash. It's only 31 Elo behind, their ranges overlap, and GLM-5.3 costs 7.7 times as much. The catch is time, and oddly the Flash is the slower one here: GLM-5.3 Flash takes 6.6 minutes per script against 5.2 minutes for GLM-5.3.

GLM-4.5 Air is the cheapest GLM at $0.0061, but it sits at #163, so I wouldn't write with it. Going one rung up doesn't help much either: GLM-4.7 costs about what GLM-5.3 Flash costs and lands 1007 Elo lower, so I wouldn't drop to the GLM-4 generation for writing at all.

Every row links to its full scorecard, and the cross-lab match-ups live in the head-to-head comparisons.

← All comparisons