Real head-to-head · same prompt, one shot

GLM-5.2 vs Claude Sonnet 5

The never-forgets agent — 1M context, open weights. vs The agentic SWE frontier — 82% SWE-bench Verified, Dev Team mode.

Head-to-head verdict: Claude Sonnet 5 wins 22–19 with 1 tie.

GLM-5.2 · context1M tokens
Claude Sonnet 5 · context1M tokens
GLM-5.2 · priceOpen weights · free for individuals
Claude Sonnet 5 · price$3 / $15 per M ($2/$10 intro)
GLM-5.2 · vendorZhipu / Z.ai
Claude Sonnet 5 · vendorAnthropic

What I tested — same prompt, two models

I run the same fixed prompt set through every new model the day it drops — same string, one shot, single HTML file out — and I score the result 0–10 on whether it ran, how close it hit the brief, and how good it looked. Below is what came out when I gave the exact same prompts to GLM-5.2 and Claude Sonnet 5, side by side, on 42 shared tasks inside the Agent Operating System.

Both models were given identical prompts inside the Agent Operating System — no help, no iteration, no "best of N" tricks. I run each prompt once, save the HTML file the model produces, and score it 0–10 on whether it ran, how close it hit the brief, and how good it looked. The scoring is mine. The verdicts below are pulled from my source comparison guides at agentos.guide where I publish every score and the reasoning behind it.

GLM-5.2 · Default model inside Agent OS for any task that touches a long context — codebase Q&A, multi-file refactors, agent memory replay.

Claude Sonnet 5 · Reach for it in Agent OS when the job is iterative, tool-using software engineering. For one-shot visual builds, GLM 5.2 (free) beat it 4-1 here.

Side-by-side on 42 shared tasks

Click any cell to play that model's actual one-shot attempt. Medals are derived from my 0–10 scores per task (highest = 🥇, second = 🥈, third = 🥉).

Task ↓
GLM-5.2
Claude Sonnet 5
Game
GLM-5.2 on Arcade
Claude Sonnet 5 on Arcade
Game
🥉GLM-5.2 on Crypt
Claude Sonnet 5 on Crypt
Game
GLM-5.2 on Dogfight
Claude Sonnet 5 on Dogfight
Game
GLM-5.2 on Doom
Claude Sonnet 5 on Doom
GLM-5.2 on Dragonflight
Claude Sonnet 5 on Dragonflight
GLM-5.2 on Dragonrealm
Claude Sonnet 5 on Dragonrealm
Game
GLM-5.2 on Game
Claude Sonnet 5 on Game
GLM-5.2 on Neonblaster
Claude Sonnet 5 on Neonblaster
Game
🥇GLM-5.2 on Neoncity
Claude Sonnet 5 on Neoncity
Game
GLM-5.2 on Neonracer
🥈Claude Sonnet 5 on Neonracer
GLM-5.2 on Nordiccrypt
Claude Sonnet 5 on Nordiccrypt
Game
🥈GLM-5.2 on Outrun
🥇Claude Sonnet 5 on Outrun
Game
GLM-5.2 on Pool
🥈Claude Sonnet 5 on Pool
Game
GLM-5.2 on Racing
Claude Sonnet 5 on Racing
Game
GLM-5.2 on Raycaster
Claude Sonnet 5 on Raycaster
Game
GLM-5.2 on Rpg
Claude Sonnet 5 on Rpg
Game
GLM-5.2 on Skyrim
Claude Sonnet 5 on Skyrim
GLM-5.2 on Twilightvale
Claude Sonnet 5 on Twilightvale
Game
GLM-5.2 on Voxelcraft
Claude Sonnet 5 on Voxelcraft
Page
🥇GLM-5.2 on Landing
Claude Sonnet 5 on Landing
Page
GLM-5.2 on Webos
Claude Sonnet 5 on Webos
Sim
GLM-5.2 on Blackhole
Claude Sonnet 5 on Blackhole
Sim
GLM-5.2 on Boids
Claude Sonnet 5 on Boids
Sim
GLM-5.2 on Cloth
Claude Sonnet 5 on Cloth

Where GLM-5.2 beat Claude Sonnet 5

The tasks where I gave GLM-5.2 a higher 0–10 score on the same prompt — with the actual commentary from my source guides.

Solar Sim
GLM-5.2 8.5 · Claude Sonnet 5 2.5 (+6.0)

What I saw: Three genuinely good space sims. Opus tilts the orbits into real 3D with a bloom-heavy sun and Saturn's rings. GLM's is the most product-like — labelled planets, orbit and label toggles, a clean HUD. Kimi's is a tidy tilted-orbit system with rings and a deep starfield. Opus and G…

Aurora Visual
GLM-5.2 7.0 · Claude Sonnet 5 2.5 (+4.5)

What I saw: 8KB · plays clean · plain

GLM-5.2 7.5 · Claude Sonnet 5 3.0 (+4.5)

What I saw: 54KB · plays clean · plain

Wormhole Sim
GLM-5.2 7.5 · Claude Sonnet 5 3.0 (+4.5)

What I saw: 26KB · plays clean · plain

Orbit Sim
GLM-5.2 7.5 · Claude Sonnet 5 3.5 (+4.0)

What I saw: Opus nailed the brief — labelled planet orbits, a real NEO / close-pass panel, a sim clock. GLM went for drama: a glowing nebula swirl that's gorgeous but reads more galaxy than orbit map. Kimi's is accurate but dim and sparse.

Where Claude Sonnet 5 beat GLM-5.2

The tasks where I gave Claude Sonnet 5 a higher 0–10 score on the same prompt — with the actual commentary from my source guides.

Raycaster Game
Claude Sonnet 5 8.0 · GLM-5.2 6.5 (+1.5)

What I saw: Strong, shippable 3D maze: clean rendered walls with lighting/shadows, checkerboard floor, working minimap with player+goal markers, and solid controls/UI. Uses real 3D geometry rather than classic raycasting and looks a bit flat/plain (colored walls without texture), keeping it …

Fireworks Visual
Claude Sonnet 5 8.3 · GLM-5.2 7.0 (+1.3)

What I saw: Strong 3D scene with starfield, skyline silhouette, additive-blended particle bursts and a polished shimmering title—clearly on-brief and shippable. Particles read slightly blocky/square rather than glowing sparks, and the depth composition feels a touch flat, keeping it just shy…

Claude Sonnet 5 8.6 · GLM-5.2 7.5 (+1.1) · Converged Cornell box

What I saw: Renders a genuine progressively-converged Cornell box with correct red/green colored-wall bleed, a diffuse yellow sphere, and convincing glass and metal spheres showing refraction/reflection at 163 samples — physically-plausible and clearly on-brief. Minor grain and the truncated…

Matrix Visual
Claude Sonnet 5 8.0 · GLM-5.2 7.0 (+1.0)

What I saw: Strong, polished matrix rain with proper katakana glyphs, bright white leading heads, fading trails, and glow — plus solid extras (theme cycling, mouse disturbance, speed). Screenshot shows a captured cyan theme rather than classic green which slightly undercuts the iconic look, …

Terrain Visual
Claude Sonnet 5 8.0 · GLM-5.2 7.0 (+1.0)

What I saw: Renders a clean, atmospheric procedural landscape with convincing height-based coloring (sand/grass/rock/snow), scattered trees, and fog depth; solid and shippable but the terrain reads somewhat soft/generic and lacks standout visual punch or striking peaks to top the field.

Strengths & weaknesses I logged

GLM-5.2

Strengths

  • 1M-token context window — best-in-class long-document and large-codebase work
  • Open weights — runs locally, no vendor lock-in, no token meter
  • Top of the bench for cinematic visuals (neon city, synthwave, voxel runner)

Trade-offs

  • Faceplanted on the Goldie Bench raycaster — the engine was great but it spawned the player inside a wall
  • First-shot reliability lags Opus by a hair on consistency

Claude Sonnet 5

Strengths

  • 82.1% SWE-bench Verified — first model past 80% on real GitHub-issue repair
  • Dev Team multi-agent mode + 1M context for repo-level agentic work
  • Precision on hard logic — won the raycaster the open-weight field kept botching

Trade-offs

  • One-shot creative-visual builds trail GLM 5.2 here (lost 4 of 5) — no iteration to catch its own bugs
  • A temporal-dead-zone bug blanked its N-body orbit sim on the first shot

Pricing & context — the spec sheet

Spec GLM-5.2 Claude Sonnet 5
VendorZhipu / Z.aiAnthropic
Context window1,000,000 tokens1,000,000 tokens
PriceOpen weights · free for individuals$3 / $15 per M ($2/$10 intro)
Pricing detailOpen-weights release: weights downloadable from Hugging Face for self-hosting, or runnable for free on z.ai for individuals (commercial use has separate licensing).$3.00 input / $15.00 output per million tokens; introductory $2.00/$10.00 through 2026-08-31.
Release2026-06-142026-06-30
Bench coverage42/42 scored · avg 7.77/1042/42 scored · avg 7.18/10

The verdict — which should you pick?

Across 42 scored shared tasks, GLM-5.2 averaged 7.77/10, beating Claude Sonnet 5's 7.18/10 by 0.59 points. Pick GLM-5.2 when the build has to ship on the first prompt and you can afford the trade-offs in the comparison below.

If you only run one of these inside your stack, the head-to-head average above is the call. If you can run both, my honest play is to wire GLM-5.2 and Claude Sonnet 5 both into the Agent Operating System and dispatch each from the kanban by task type — long-context agent loops — pasting a whole codebase into one prompt → GLM-5.2, agentic software engineering — write / run / test / fix loops on real repos → Claude Sonnet 5. That's the same setup I run for the 3,600+ founders inside the AI Profit Boardroom.

FAQ — GLM-5.2 vs Claude Sonnet 5

Which is better, GLM-5.2 or Claude Sonnet 5?

On Goldie Bench, GLM-5.2 averages 7.77/10 across the shared tasks, with 5 gold, 2 silver, 1 bronze overall. Claude Sonnet 5 averages 7.18/10, with 3 gold, 3 silver, 3 bronze. Claude Sonnet 5 wins the head-to-head 22–19.

How much does GLM-5.2 cost vs Claude Sonnet 5?

GLM-5.2: Open-weights release: weights downloadable from Hugging Face for self-hosting, or runnable for free on z.ai for individuals (commercial use has separate licensing). Claude Sonnet 5: $3.00 input / $15.00 output per million tokens; introductory $2.00/$10.00 through 2026-08-31.

What's the context window for GLM-5.2 vs Claude Sonnet 5?

GLM-5.2 has a 1,000,000 tokens context window. Claude Sonnet 5 has a 1,000,000 tokens context window.

When should I pick GLM-5.2 over Claude Sonnet 5?

Pick GLM-5.2 for: Long-context agent loops — pasting a whole codebase into one prompt; Cinematic visual builds — landing pages, voxel scenes, synthwave runners; Anyone who needs to run a frontier coder locally for $0. The trade-off is the weaknesses we logged on the bench: Faceplanted on the {{SITE_NAME}} raycaster — the engine was great but it spawned the player inside a wall; First-shot reliability lags Opus by a hair on consistency.

When should I pick Claude Sonnet 5 over GLM-5.2?

Pick Claude Sonnet 5 for: Agentic software engineering — write / run / test / fix loops on real repos; Repo-level reasoning across a 1M-token context (Dev Team multi-agent mode); Precise logic — raycasters, physics — where one-shot open models slip. The trade-off is the weaknesses we logged on the bench: One-shot creative-visual builds trail GLM 5.2 here (lost 4 of 5) — no iteration to catch its own bugs; A temporal-dead-zone bug blanked its N-body orbit sim on the first shot.

How does Goldie Bench score GLM-5.2 vs Claude Sonnet 5?

Every demo on this page was built by Julian Goldie inside the Agent Operating System — same fixed prompt for both models, one shot, single HTML file out. Each result gets a 0–10 score on whether it ran, how close it hit the brief, and how good it looked. The highest score on each task gets gold; second gets silver; third gets bronze. See methodology for full provenance.

The same stack Julian uses

Run this stack yourself.

Every demo on this bench was built inside the Agent Operating System — one prompt, one shot, single HTML file out. The Agent OS, the prompts, the templates, the weekly walkthroughs and 3,600+ founders shipping with it every day all live inside the AI Profit Boardroom.

3,600+founders
258documented wins
38countries
$59/momonthly