⭐ Get the Agent OS + join 3,400+ founders inside the AI Profit Boardroom → Join AIPB

GoldieBench Blog · 7 min read

Grok Bot vs Claude Code: Which AI Models Each One Runs, With Real GoldieBench Scores

Claude Code hands you the model switch; Grok Bot keeps it. Here's what the GoldieBench numbers can and can't tell you on each side.

Illustrated dark navy leaderboard with gold bars, a model selector switch on one side and a sealed routing box on the other

Grok bot vs claude code looks very different through a model lens: Claude Code lets you choose which Claude model runs each session, while Grok Bot routes every task itself and doesn't tell you which model it used.

That decides how useful a benchmark score is to you.

For Claude Code, a GoldieBench score feeds straight into a /model choice you control.

For Grok Bot, a Grok score describes xAI's chat model, which may or may not sit behind your Bots.

Every score below is quoted from the GoldieBench page I read it on, on 5 November 2026, and the tool facts come from xAI's and Anthropic's own docs.

Want help picking models for your own stack? Book a free SEO strategy session.

Which models each tool lets you run

Claude Code: you choose

Claude Code's model configuration page lists aliases you switch with /model or --model.

On the Anthropic API, opus resolves to Opus 5.5, sonnet to Sonnet 5.5 and haiku to Haiku 5.5.

The fable alias resolves to Fable 5.1, which Anthropic describes as suited to tasks larger than a single sitting.

Neither Fable model is the default on any plan, so you select one explicitly.

Aliases can resolve to older versions on Bedrock, Google Cloud and Foundry, so check your provider's row.

Anthropic's models overview suggests starting most work on Opus 5.5 and moving to Fable 5.1 for demanding, long-horizon agentic work; it lists Opus 5 and Fable 5 as legacy models still available.

Grok Bot: it chooses

The Grok Bot FAQ says there's no model picker and Grok Bot picks the model for each task.

The settings page repeats it: Grok Bot manages model selection.

xAI doesn't say which model handles which request, so no benchmark can tell you what a Bot is running.

The GoldieBench scores that matter for this matchup

ModelGoldieBench resultTasksPage read
Claude Opus 5.57.57/10 average; 0 gold, 0 silver, 1 bronze50/models/opus55
Claude Opus 58.27/10 average; 13 gold, 7 silver, 5 bronze50/models/opus5
Claude Fable 58.10/10 average; 4 gold, 2 silver, 1 bronze47/models/fable-5
Claude Sonnet 57.01/10 average; 0 gold, 0 silver, 4 bronze47/models/sonnet5
Grok8.09/10 average; 5 gold, 1 silver, 1 bronze47 demos, 43 scored/models/grok
Grok 4.77.15/10 average; 0 gold, 2 silver, 3 bronze20/models/grok47

GoldieBench has no page yet for Sonnet 5.5, Haiku 5.5 or Fable 5.1, so the newest Claude Code aliases other than opus have no score here.

What these numbers measure, and what they don't

The methodology page explains the test: the same fixed prompt for every model, one shot, one self-contained HTML file, scored 0 to 10.

The tasks are games, simulations, visuals and pages.

That makes the scores a fair signal for one-shot front-end builds, the kind of job you might hand Claude Code for a landing page or a small web tool.

They say nothing about inbox triage, spreadsheet updates or browser chores, which is most of what Grok Bot does.

One more caveat: the methodology page lists Grok as unranked with zero scored tasks, while the Grok model page shows 8.09 over 43 scored tasks, so treat the Grok row with care.

Reading the Grok vs Opus 5.5 head-to-head

On the Grok vs Claude Opus 5.5 page, the headline verdict is Grok wins 24–17 with 2 ties.

Opus 5.5 is what Claude Code's opus alias points to on the Anthropic API, so that's the most direct Claude Code comparison on the site.

It still isn't a Grok Bot comparison, because Grok Bot doesn't promise to run the Grok chat model.

If one-shot build quality is the job, the table points to pinning the older Opus 5 or Fable 5 in Claude Code by full model ID where your provider serves them, since both outscore Opus 5.5 here.

Picking a Claude Code model per job

  • One-shot pages and small web tools: start with Opus 5 or Fable 5 by model ID, the two Claude rows with the most gold medals here.
  • Everyday repo work: the opus alias, following Anthropic's own advice to start on Opus 5.5.
  • Long, multi-hour sessions: fable, which Anthropic positions for long autonomous work; GoldieBench hasn't scored Fable 5.1 yet.
  • Light, repetitive jobs: haiku, which the docs describe as fast and efficient for simple tasks.
  • Planning then building: opusplan, which uses Opus in plan mode and Sonnet for execution.

Why a Grok score can't tune Grok Bot

With Grok Bot you can't pin a model, so the lever you actually control is the brief.

Write narrow instructions, save working tasks as skills, and keep approvals on anything external.

The skills and routines page says to make a task reliable first, save it as a skill, then automate it with a routine.

Watch the Grok Bot changelog for behavior changes, since model routing can shift without a setting changing on your side.

Where each one runs, and why it matters for models

Grok Bot runs on one cloud computer that all your Bots share, each with its own screen, per the computer and apps page.

Claude Code runs on your machine by default; its cloud sessions use an isolated VM each.

Claude Code shares configuration, project memory and MCP servers across its local surfaces, so a model setting you save in your settings file carries from the terminal to the IDE.

Cloud scheduled tasks run in auto permission mode by default, so pick the model and the guardrails together before you schedule anything.

The guardrails matter more than the model

A stronger model doesn't replace an approval step, on either side.

Grok Bot's Auto Review checks each action and stops for a card on risky ones, and Ask first rules always stop.

Claude Code's permission modes range from Manual, which asks before most edits and commands, to plan mode, which blocks edits until you approve a plan.

Deny rules in Claude Code hold in every mode, whichever model is running.

Set those first, then experiment with models on safe tasks.

Verdict by job type

Pick Claude Code when the job is code and you want to choose the model: build pages on the higher-scoring Claude rows, run daily repo work on opus.

Pick Grok Bot when the job is business work across apps and websites, and you're happy to let xAI choose the model.

Use both when a codebase sits next to a busy back office.

Small-business examples

  1. A café with a website: the owner's developer asks Claude Code, set to Fable 5 by model ID, for a one-page seasonal menu in plain HTML, reviews it in Manual mode and opens a pull request.
  2. An accountant's office: a Grok Bot routine checks the client tracker sheet each Monday and lists missing documents; nobody needs to think about models.
  3. A marketing agency: a shared Bot turns Slack change requests into briefs, and the developer runs each brief through Claude Code on the opus alias, then a Bot routine watches the PR.

If you're weighing Grok Bot against OpenAI's coding agent, read Grok Bot vs Codex.

On plans, by name: The X Subscription includes Grok Bot from Premium upwards, through Super and Ultra, while Anthropic sells Claude Code access with Pro, Max, Ultra, Team and Enterprise, or through a Console account.

Our live routing notes sit inside the AI Profit Boardroom.

Also On Our Network

Pick a Claude Code model from the table, let Grok Bot route its own, and book a free strategy session or join the AI Profit Boardroom for help with grok bot vs claude code.

FAQ

Which model does Claude Code use?

You choose. On the Anthropic API the opus alias is Opus 5.5, sonnet is Sonnet 5.5, haiku is Haiku 5.5 and fable is Fable 5.1, and you can pin a version by its full model ID.

Which model does Grok Bot use?

xAI doesn't say. Grok Bot has no model picker and chooses a model for each task itself.

Does the Grok score on GoldieBench apply to Grok Bot?

Not directly. It scores the Grok chat model on one-shot HTML builds, and Grok Bot doesn't state which model it runs.

Which Claude model scored best on GoldieBench?

Among the Claude rows read for this page, Opus 5 has the highest average at 8.27/10 over 50 tasks, ahead of Fable 5 at 8.10 and Opus 5.5 at 7.57.

The same stack Julian uses

Run this stack yourself.

Every demo on this bench was built inside the Agent Operating System — one prompt, one shot, single HTML file out. The Agent OS, the prompts, the templates, the weekly walkthroughs and 3,400+ founders shipping with it every day all live inside the AI Profit Boardroom.

3,400+founders
258documented wins
38countries
4coaching calls a week