Get the Agent OS + join 4,000+ founders inside the AI Profit Boardroom → Join AIPB ($59/mo)

GoldieBench deep dive

Kilo Code's full benchmark breakdown.

Fable 5-class intelligence at ~59% less. The split-the-cost play. Every number below is either one of my own judged one-shot builds - playable on this site - or an outside result with its source linked. Nothing display-only, nothing vibes.

Data refreshed
2026-07-17
Scored tasks
0
Reading time
4 min
External sources
2

01 · The headline numbers

No scored tasks yet - this model is on the bench but unranked.

02 · Every benchmark, bar by bar

All 0 scored tasks, best first. Hover for the judge's comment; click through for every model's build on that task. Or overlay other models in the interactive graphs.

03 · Where it wins - with the judge's own words

04 · Where it struggles - quoted, not hidden

Boards that hide the weak rows are brochures. These are Kilo Code's lowest scored builds, verdicts unedited:

Nothing under 8.0 on the board right now - Kilo Code's floor is unusually high.

05 · Category breakdown vs the whole field

Games (0 tasks)

field avg7.1

Others (0 tasks)

field avg7.4

Pages (0 tasks)

field avg7.5

Sims (0 tasks)

field avg6.7

Visuals (0 tasks)

field avg6.7

06 · Outside signals - every row sourced

My bench measures one thing: judged one-shot builds. These outside rows measure other things - kept separate, never blended into the GoldieBench average, every value linked to where it comes from.

From the source guides

MeasureResultSource guide
Cheaper-plan quality (GPT-5.5 cohort)8.3/10/kilo-split
Cost reduction vs solo Fable 5~59% less/kilo-split

07 · Head-to-head records

Not enough shared scored tasks yet.

08 · Methodology + honest limits

Every GoldieBench score is a one-shot, single-file build from an identical prompt - no retries, no hand-fixing - rendered for real, screenshotted, and scored 0-10 by one judge model on one rubric across the whole field. Failures score as failures. What this bench does NOT measure: multi-turn agent work, long-context recall, or API latency - that is what the sourced outside rows are for. Full method: /methodology.

Frequently asked questions

01How much does Kilo Code cost?

Kilo Code is a routing layer that splits planning (heavy model) from execution (cheaper model) so you get Fable-5-class plans driving GPT-5.5-class builds. Total spend lands at ~59% less than running Fable 5 end-to-end.

Source ledger

  1. 01Official vendor site: kilocode.aikilocode.ai
  2. 02Cheaper-plan quality (GPT-5.5 cohort)agentos.guide

Every model's breakdown

The same stack Julian uses

Run this stack yourself.

Every demo on this bench was built inside the Agent Operating System — one prompt, one shot, single HTML file out. The Agent OS, the prompts, the templates, the weekly walkthroughs and 4,000+ founders shipping with it every day all live inside the AI Profit Boardroom.

4,000+founders
258documented wins
38countries
$59/momonthly