Real head-to-head · same prompt, one shot

Claude Sonnet 5 vs Kimi K2.7 · No-Think

The agentic SWE frontier — 82% SWE-bench Verified, Dev Team mode. vs Pure execution mode — no chain of thought.

Claude Sonnet 5 · context1M tokens
Kimi K2.7 · No-Think · context256K tokens
Claude Sonnet 5 · price$3 / $15 per M ($2/$10 intro)
Kimi K2.7 · No-Think · priceFlat plan (no per-token bill)
Claude Sonnet 5 · vendorAnthropic
Kimi K2.7 · No-Think · vendorMoonshot AI

What I tested — same prompt, two models

I run the same fixed prompt set through every new model the day it drops — same string, one shot, single HTML file out — and I score the result 0–10 on whether it ran, how close it hit the brief, and how good it looked. Below is what came out when I gave the exact same prompts to Claude Sonnet 5 and Kimi K2.7 · No-Think, side by side, on 42 shared tasks inside the Agent Operating System.

Both models were given identical prompts inside the Agent Operating System — no help, no iteration, no "best of N" tricks. I run each prompt once, save the HTML file the model produces, and score it 0–10 on whether it ran, how close it hit the brief, and how good it looked. The scoring is mine. The verdicts below are pulled from my source comparison guides at agentos.guide where I publish every score and the reasoning behind it.

Claude Sonnet 5 · Reach for it in Agent OS when the job is iterative, tool-using software engineering. For one-shot visual builds, GLM 5.2 (free) beat it 4-1 here.

Kimi K2.7 · No-Think · Reserved for templated transforms where the plan is already in the prompt — the model just executes.

Side-by-side on 42 shared tasks

Click any cell to play that model's actual one-shot attempt. Medals are derived from my 0–10 scores per task (highest = 🥇, second = 🥈, third = 🥉).

Task ↓
Claude Sonnet 5
Kimi K2.7 · No-Think
Game
Claude Sonnet 5 on Arcade
Kimi K2.7 · No-Think on Arcade
Game
Claude Sonnet 5 on Crypt
Kimi K2.7 · No-Think on Crypt
Game
Claude Sonnet 5 on Dogfight
Kimi K2.7 · No-Think on Dogfight
Game
Claude Sonnet 5 on Doom
Kimi K2.7 · No-Think on Doom
Claude Sonnet 5 on Dragonflight
Kimi K2.7 · No-Think on Dragonflight
Claude Sonnet 5 on Dragonrealm
Kimi K2.7 · No-Think on Dragonrealm
Game
Claude Sonnet 5 on Game
Kimi K2.7 · No-Think on Game
Claude Sonnet 5 on Neonblaster
Kimi K2.7 · No-Think on Neonblaster
Game
Claude Sonnet 5 on Neoncity
Kimi K2.7 · No-Think on Neoncity
Game
🥈Claude Sonnet 5 on Neonracer
Kimi K2.7 · No-Think on Neonracer
Claude Sonnet 5 on Nordiccrypt
Kimi K2.7 · No-Think on Nordiccrypt
Game
🥇Claude Sonnet 5 on Outrun
Kimi K2.7 · No-Think on Outrun
Game
🥈Claude Sonnet 5 on Pool
Kimi K2.7 · No-Think on Pool
Game
Claude Sonnet 5 on Racing
Kimi K2.7 · No-Think on Racing
Game
Claude Sonnet 5 on Raycaster
Kimi K2.7 · No-Think on Raycaster
Game
Claude Sonnet 5 on Rpg
Kimi K2.7 · No-Think on Rpg
Game
Claude Sonnet 5 on Skyrim
Kimi K2.7 · No-Think on Skyrim
Claude Sonnet 5 on Twilightvale
Kimi K2.7 · No-Think on Twilightvale
Game
Claude Sonnet 5 on Voxelcraft
Kimi K2.7 · No-Think on Voxelcraft
Page
Claude Sonnet 5 on Landing
Kimi K2.7 · No-Think on Landing
Page
Claude Sonnet 5 on Webos
Kimi K2.7 · No-Think on Webos
Sim
Claude Sonnet 5 on Blackhole
Kimi K2.7 · No-Think on Blackhole
Sim
Claude Sonnet 5 on Boids
Kimi K2.7 · No-Think on Boids
Sim
Claude Sonnet 5 on Cloth
Kimi K2.7 · No-Think on Cloth

Strengths & weaknesses I logged

Claude Sonnet 5

Strengths

  • 82.1% SWE-bench Verified — first model past 80% on real GitHub-issue repair
  • Dev Team multi-agent mode + 1M context for repo-level agentic work
  • Precision on hard logic — won the raycaster the open-weight field kept botching

Trade-offs

  • One-shot creative-visual builds trail GLM 5.2 here (lost 4 of 5) — no iteration to catch its own bugs
  • A temporal-dead-zone bug blanked its N-body orbit sim on the first shot

Kimi K2.7 · No-Think

Strengths

  • Skips planning to ship straight to code
  • Useful when you've already done the reasoning in the prompt
  • Predictable latency for batched jobs

Trade-offs

  • Loses ground on multi-step tasks that benefit from planning
  • Not scored on the standalone bench — see methodology

Pricing & context — the spec sheet

Spec Claude Sonnet 5 Kimi K2.7 · No-Think
VendorAnthropicMoonshot AI
Context window1,000,000 tokens256,000 tokens
Price$3 / $15 per M ($2/$10 intro)Flat plan (no per-token bill)
Pricing detail$3.00 input / $15.00 output per million tokens; introductory $2.00/$10.00 through 2026-08-31.Same flat-rate plan as standard Kimi K2.7 — No-Think disables the chain-of-thought layer at runtime. Vendor: Moonshot AI (moonshot.ai).
Release2026-06-302026-06
Bench coverage42/42 scored · avg 7.18/100/42 scored · avg —

The verdict — which should you pick?

Not enough scored shared tasks yet for a head-to-head average. The live demos for both are on the matrix above — play them and form your own opinion.

If you only run one of these inside your stack, the head-to-head average above is the call. If you can run both, my honest play is to wire Claude Sonnet 5 and Kimi K2.7 · No-Think both into the Agent Operating System and dispatch each from the kanban by task type — agentic software engineering — write / run / test / fix loops on real repos → Claude Sonnet 5, templated transforms where the plan is in the prompt → Kimi K2.7 · No-Think. That's the same setup I run for the 3,600+ founders inside the AI Profit Boardroom.

FAQ — Claude Sonnet 5 vs Kimi K2.7 · No-Think

Which is better, Claude Sonnet 5 or Kimi K2.7 · No-Think?

On Goldie Bench, Claude Sonnet 5 averages no scored verdicts yet across the shared tasks, with 3 gold, 3 silver, 3 bronze overall. Kimi K2.7 · No-Think averages no scored verdicts yet, with 0 gold, 0 silver, 0 bronze. Not enough scored shared tasks yet to call a winner.

How much does Claude Sonnet 5 cost vs Kimi K2.7 · No-Think?

Claude Sonnet 5: $3.00 input / $15.00 output per million tokens; introductory $2.00/$10.00 through 2026-08-31. Kimi K2.7 · No-Think: Same flat-rate plan as standard Kimi K2.7 — No-Think disables the chain-of-thought layer at runtime. Vendor: Moonshot AI (moonshot.ai).

What's the context window for Claude Sonnet 5 vs Kimi K2.7 · No-Think?

Claude Sonnet 5 has a 1,000,000 tokens context window. Kimi K2.7 · No-Think has a 256,000 tokens context window.

When should I pick Claude Sonnet 5 over Kimi K2.7 · No-Think?

Pick Claude Sonnet 5 for: Agentic software engineering — write / run / test / fix loops on real repos; Repo-level reasoning across a 1M-token context (Dev Team multi-agent mode); Precise logic — raycasters, physics — where one-shot open models slip. The trade-off is the weaknesses we logged on the bench: One-shot creative-visual builds trail GLM 5.2 here (lost 4 of 5) — no iteration to catch its own bugs; A temporal-dead-zone bug blanked its N-body orbit sim on the first shot.

When should I pick Kimi K2.7 · No-Think over Claude Sonnet 5?

Pick Kimi K2.7 · No-Think for: Templated transforms where the plan is in the prompt; Batched code generation jobs; Workflows where you want the model to stop second-guessing. The trade-off is the weaknesses we logged on the bench: Loses ground on multi-step tasks that benefit from planning; Not scored on the standalone bench — see methodology.

How does Goldie Bench score Claude Sonnet 5 vs Kimi K2.7 · No-Think?

Every demo on this page was built by Julian Goldie inside the Agent Operating System — same fixed prompt for both models, one shot, single HTML file out. Each result gets a 0–10 score on whether it ran, how close it hit the brief, and how good it looked. The highest score on each task gets gold; second gets silver; third gets bronze. See methodology for full provenance.

The same stack Julian uses

Run this stack yourself.

Every demo on this bench was built inside the Agent Operating System — one prompt, one shot, single HTML file out. The Agent OS, the prompts, the templates, the weekly walkthroughs and 3,600+ founders shipping with it every day all live inside the AI Profit Boardroom.

3,600+founders
258documented wins
38countries
$59/momonthly