Real head-to-head · same prompt, one shot
Claude Sonnet 5 vs Inkling
The agentic SWE frontier — 82% SWE-bench Verified, Dev Team mode. vs A 975B open-weights frontier model — yours to own and run.
Head-to-head verdict: Claude Sonnet 5 wins 32–13 with 2 ties.
What I tested — same prompt, two models
I run the same fixed prompt set through every new model the day it drops — same string, one shot, single HTML file out — and I score the result 0–10 on whether it ran, how close it hit the brief, and how good it looked. Below is what came out when I gave the exact same prompts to Claude Sonnet 5 and Inkling, side by side, on 47 shared tasks inside the Agent Operating System.
Both models were given identical prompts inside the Agent Operating System — no help, no iteration, no "best of N" tricks. I run each prompt once, save the HTML file the model produces, and score it 0–10 on whether it ran, how close it hit the brief, and how good it looked. The scoring is mine. The verdicts below are pulled from my source comparison guides at agentos.guide where I publish every score and the reasoning behind it.
Claude Sonnet 5 · Reach for it in Agent OS when the job is iterative, tool-using software engineering. For one-shot visual builds, GLM 5.2 (free) beat it 4-1 here.
Inkling · Benched on GoldieBench one-shot through Tinker's OpenAI-compatible endpoint at medium reasoning effort, then headless-playtested on the same rubric as the whole field. In the Agent OS it's wired into the opencode tab on your own Tinker key — the Ink Machine.
Side-by-side on 50 shared tasks
Click any cell to play that model's actual one-shot attempt. Medals are derived from my 0–10 scores per task (highest = 🥇, second = 🥈, third = 🥉).
Task ↓
Claude Sonnet 5
Inkling
Game
Game
Game
Game
Game
Game
Game
Game
Game
Game
Game
Game
Game
Game
Game
Game
Game
Game
Game
Game
Game
Game
Game
Page
Where Claude Sonnet 5 beat Inkling
The tasks where I gave Claude Sonnet 5 a higher 0–10 score on the same prompt — with the actual commentary from my source guides.
Plasma
Visual
Claude Sonnet 5 8.4
·
Inkling 2.3
(+6.1)
What I saw: Gorgeous smooth GLSL plasma with rich rainbow blobs, clean glowing title, and five well-styled palette swatches with clear active state; ripples aren't visible in the still but the code is solid, though the effect reads slightly generic against the very best field entry.
Reactiondiff
Sim
Claude Sonnet 5 8.4
·
Inkling 3.5
(+4.9)
· GPU Turing patterns
What I saw: Strong GPU Gray-Scott sim rendering clean cell/worm Turing structures with a polished glassy control panel, presets, and interactive seeding; slight weakness is somewhat uniform blob patterns rather than more dramatic branching coral, keeping it just under the top.
Particleforge
Sim
Claude Sonnet 5 7.8
·
Inkling 3.2
(+4.6)
What I saw: Renders a clean, colorful 9000-particle spherical cloud with a glowing gravity core, gradient title, palette swatches, and full interaction wiring (attract/repel/swirl/zoom/reset). Strong polish and on-brief, but the static screenshot reads as a fairly generic scattered blob with…
Cloth
Sim
Claude Sonnet 5 7.8
·
Inkling 3.5
(+4.3)
What I saw: Strong Verlet cloth with visible draping folds over the sphere, clean UI and controls, and nice lighting/vertex-color tint. Weakness: the drape reads a bit shroud-like/pointy and the sphere obstacle is fully hidden, so the 'draping over an object' silhouette is less convincing th…
Crypt
Game
Claude Sonnet 5 6.5
·
Inkling 2.5
(+4.0)
What I saw: Renders with atmospheric HUD, functional minimap showing the maze, and a working torch-lit dungeon architecture in code, but the screenshot is too dark/muddy with no visible walls, torches, or dungeon geometry — the dim ambient/fog balance undersells the crawler and looks flat ra…
Where Inkling beat Claude Sonnet 5
The tasks where I gave Inkling a higher 0–10 score on the same prompt — with the actual commentary from my source guides.
Aurora
Visual
Inkling 7.8
·
Claude Sonnet 5 2.5
(+5.3)
What I saw: Renders a vivid, colorful WebGL aurora curtain with clean green/cyan/purple bands, ground plane, and tasteful title overlay — clearly on-brief and polished; but the curtain reads as a contained rectangular slab rather than a sky-spanning flowing veil, and the mountain silhouette …
Solar
Sim
Inkling 6.3
·
Claude Sonnet 5 2.5
(+3.8)
What I saw: Renders cleanly with polished typography, orbit rings, starfield and interactive controls, but the camera framing is broken — the Sun sits off-center, planets aren't clearly the largest bodies, no Saturn rings, and the scale/order reads as a generic sphere scatter rather than an …
Orbit
Sim
Inkling 7.2
·
Claude Sonnet 5 3.5
(+3.7)
What I saw: Clean render with polished title, colorful glowing bodies, starfield and working 3D orbit/spawn interactions; but the physics uses non-symplectic Euler with a hard bounds hack, no orbital trails, and the scattered layout doesn't visually read as gravitational clustering—competent…
Wormhole
Sim
Inkling 5.5
·
Claude Sonnet 5 3.0
(+2.5)
What I saw: Renders cleanly with polished pastel rings, nice typography, and clear HUD, but the spiral path produces a chaotic tangle of loops rather than a coherent tunnel-through-the-center flythrough — it reads as scattered torus rings, not a wormhole you fly down.
Gtadrive
Game
Inkling 6.5
·
Claude Sonnet 5 4.5
(+2.0)
What I saw: Renders cleanly with a polished HUD, wanted stars, minimap, and 3D box cars with headlight glow, but the ground reads as a flat dark void with barely visible grid lines and no real city/buildings, making it feel sparse rather than a living open city. Competent and functional but …
Strengths & weaknesses I logged
Claude Sonnet 5
Strengths
- 82.1% SWE-bench Verified — first model past 80% on real GitHub-issue repair
- Dev Team multi-agent mode + 1M context for repo-level agentic work
- Precision on hard logic — won the raycaster the open-weight field kept botching
Trade-offs
- One-shot creative-visual builds trail GLM 5.2 here (lost 4 of 5) — no iteration to catch its own bugs
- A temporal-dead-zone bug blanked its N-body orbit sim on the first shot
Inkling
Strengths
- Genuinely open-weights — the full 975B model is public on Hugging Face; run it on your own key, no black box
- Best one-shot builds are 2D / animation / web — a matrix-rain that topped its task (8.4), plus arcade, fractal, aurora and a mini web-OS all judged shippable (7.6–8.2)
- Frontier-class agentic coding for an open model — 77.6% SWE-bench Verified, ahead of Nemotron 3 Ultra
- 1M-token context, native multimodal (text/image/audio), and a controllable thinking-effort dial
Trade-offs
- One-shot 3D games are weak — three.js dungeons/racers render a title screen but no playable scene, like most open models (crypt 2.5)
- Physics and particle sims are hit-or-miss — black-hole, plasma and cloth one-shots often render dark or static (2.3–3.5)
- Not the strongest overall — the closed frontier (Fable 5) still tops the raw benchmarks; Inkling trades peak for ownership
Pricing & context — the spec sheet
| Spec | Claude Sonnet 5 | Inkling |
|---|---|---|
| Vendor | Anthropic | Thinking Machines |
| Context window | 1,000,000 tokens | 1,000,000 tokens |
| Price | $3 / $15 per M ($2/$10 intro) | $0.33 / M |
| Pricing detail | $3.00 input / $15.00 output per million tokens; introductory $2.00/$10.00 through 2026-08-31. | Inkling is open-weights — a 975B-parameter (41B active) Mixture-of-Experts model whose full weights are public on Hugging Face. You run it on your own key through Tinker's OpenAI-compatible endpoint (usage-based, ~$0.33/M sampling, 50% off at launch), or via Together / Fireworks / Modal / Databricks / Baseten. Benched here one-shot at medium reasoning effort via Tinker. |
| Release | 2026-06-30 | 2026-07 |
| Bench coverage | 47/47 scored · avg 7.01/10 | 50/50 scored · avg 6.07/10 |
The verdict — which should you pick?
Across 47 scored shared tasks, Claude Sonnet 5 averaged 7.01/10, beating Inkling's 6.00/10 by 1.01 points. Pick Claude Sonnet 5 when the build has to ship on the first prompt and you can afford the trade-offs in the comparison below.
If you only run one of these inside your stack, the head-to-head average above is the call. If you can run both, my honest play is to wire Claude Sonnet 5 and Inkling both into the Agent Operating System and dispatch each from the kanban by task type — agentic software engineering — write / run / test / fix loops on real repos → Claude Sonnet 5, owning a frontier model instead of renting one — on your own key, pennies per build → Inkling. That's the same setup I run for the 4,000+ founders inside the AI Profit Boardroom.
FAQ — Claude Sonnet 5 vs Inkling
Which is better, Claude Sonnet 5 or Inkling?
On Goldie Bench, Claude Sonnet 5 averages 7.01/10 across the shared tasks, with 1 gold, 2 silver, 5 bronze overall. Inkling averages 6.00/10, with 0 gold, 3 silver, 1 bronze. Claude Sonnet 5 wins the head-to-head 32–13.
How much does Claude Sonnet 5 cost vs Inkling?
Claude Sonnet 5: $3.00 input / $15.00 output per million tokens; introductory $2.00/$10.00 through 2026-08-31. Inkling: Inkling is open-weights — a 975B-parameter (41B active) Mixture-of-Experts model whose full weights are public on Hugging Face. You run it on your own key through Tinker's OpenAI-compatible endpoint (usage-based, ~$0.33/M sampling, 50% off at launch), or via Together / Fireworks / Modal / Databricks / Baseten. Benched here one-shot at medium reasoning effort via Tinker.
What's the context window for Claude Sonnet 5 vs Inkling?
Claude Sonnet 5 has a 1,000,000 tokens context window. Inkling has a 1,000,000 tokens context window.
When should I pick Claude Sonnet 5 over Inkling?
Pick Claude Sonnet 5 for: Agentic software engineering — write / run / test / fix loops on real repos; Repo-level reasoning across a 1M-token context (Dev Team multi-agent mode); Precise logic — raycasters, physics — where one-shot open models slip. The trade-off is the weaknesses we logged on the bench: One-shot creative-visual builds trail GLM 5.2 here (lost 4 of 5) — no iteration to catch its own bugs; A temporal-dead-zone bug blanked its N-body orbit sim on the first shot.
When should I pick Inkling over Claude Sonnet 5?
Pick Inkling for: Owning a frontier model instead of renting one — on your own key, pennies per build; Generative visuals, data-viz and single-file web builds you want one-shot; A customizable open base you can fine-tune on Tinker for your own domain. The trade-off is the weaknesses we logged on the bench: One-shot 3D games are weak — three.js dungeons/racers render a title screen but no playable scene, like most open models (crypt 2.5); Physics and particle sims are hit-or-miss — black-hole, plasma and cloth one-shots often render dark or static (2.3–3.5); Not the strongest overall — the closed frontier (Fable 5) still tops the raw benchmarks; Inkling trades peak for ownership.
How does Goldie Bench score Claude Sonnet 5 vs Inkling?
Every demo on this page was built by Julian Goldie inside the Agent Operating System — same fixed prompt for both models, one shot, single HTML file out. Each result gets a 0–10 score on whether it ran, how close it hit the brief, and how good it looked. The highest score on each task gets gold; second gets silver; third gets bronze. See methodology for full provenance.
Related comparisons
Other head-to-heads using the same scoring system:
Claude Sonnet 5 vs Fusion Inkling vs Fusion Claude Sonnet 5 vs Hermes MoA Inkling vs Hermes MoA Claude Sonnet 5 vs GPT-5.6 Sol Inkling vs GPT-5.6 Sol Claude Sonnet 5 vs Claude Fable 5 Inkling vs Claude Fable 5Full model pages: Claude Sonnet 5 · Inkling · back to the leaderboard
The same stack Julian uses
Run this stack yourself.
Every demo on this bench was built inside the Agent Operating System — one prompt, one shot, single HTML file out. The Agent OS, the prompts, the templates, the weekly walkthroughs and 4,000+ founders shipping with it every day all live inside the AI Profit Boardroom.
4,000+founders
258documented wins
38countries
$59/momonthly