GoldieBench Blog · 7 min read
Grok Bot vs Claude Code: Which AI Models Each One Runs, With Real GoldieBench Scores
Claude Code hands you the model switch; Grok Bot keeps it. Here's what the GoldieBench numbers can and can't tell you on each side.

Grok bot vs claude code looks very different through a model lens: Claude Code lets you choose which Claude model runs each session, while Grok Bot routes every task itself and doesn't tell you which model it used.
That decides how useful a benchmark score is to you.
For Claude Code, a GoldieBench score feeds straight into a /model choice you control.
For Grok Bot, a Grok score describes xAI's chat model, which may or may not sit behind your Bots.
Every score below is quoted from the GoldieBench page I read it on, on 5 November 2026, and the tool facts come from xAI's and Anthropic's own docs.
Want help picking models for your own stack? Book a free SEO strategy session.
Which models each tool lets you run
Claude Code: you choose
Claude Code's model configuration page lists aliases you switch with /model or --model.
On the Anthropic API, opus resolves to Opus 5.5, sonnet to Sonnet 5.5 and haiku to Haiku 5.5.
The fable alias resolves to Fable 5.1, which Anthropic describes as suited to tasks larger than a single sitting.
Neither Fable model is the default on any plan, so you select one explicitly.
Aliases can resolve to older versions on Bedrock, Google Cloud and Foundry, so check your provider's row.
Anthropic's models overview suggests starting most work on Opus 5.5 and moving to Fable 5.1 for demanding, long-horizon agentic work; it lists Opus 5 and Fable 5 as legacy models still available.
Grok Bot: it chooses
The Grok Bot FAQ says there's no model picker and Grok Bot picks the model for each task.
The settings page repeats it: Grok Bot manages model selection.
xAI doesn't say which model handles which request, so no benchmark can tell you what a Bot is running.
The GoldieBench scores that matter for this matchup
| Model | GoldieBench result | Tasks | Page read |
|---|---|---|---|
| Claude Opus 5.5 | 7.57/10 average; 0 gold, 0 silver, 1 bronze | 50 | /models/opus55 |
| Claude Opus 5 | 8.27/10 average; 13 gold, 7 silver, 5 bronze | 50 | /models/opus5 |
| Claude Fable 5 | 8.10/10 average; 4 gold, 2 silver, 1 bronze | 47 | /models/fable-5 |
| Claude Sonnet 5 | 7.01/10 average; 0 gold, 0 silver, 4 bronze | 47 | /models/sonnet5 |
| Grok | 8.09/10 average; 5 gold, 1 silver, 1 bronze | 47 demos, 43 scored | /models/grok |
| Grok 4.7 | 7.15/10 average; 0 gold, 2 silver, 3 bronze | 20 | /models/grok47 |
GoldieBench has no page yet for Sonnet 5.5, Haiku 5.5 or Fable 5.1, so the newest Claude Code aliases other than opus have no score here.
What these numbers measure, and what they don't
The methodology page explains the test: the same fixed prompt for every model, one shot, one self-contained HTML file, scored 0 to 10.
The tasks are games, simulations, visuals and pages.
That makes the scores a fair signal for one-shot front-end builds, the kind of job you might hand Claude Code for a landing page or a small web tool.
They say nothing about inbox triage, spreadsheet updates or browser chores, which is most of what Grok Bot does.
One more caveat: the methodology page lists Grok as unranked with zero scored tasks, while the Grok model page shows 8.09 over 43 scored tasks, so treat the Grok row with care.
Reading the Grok vs Opus 5.5 head-to-head
On the Grok vs Claude Opus 5.5 page, the headline verdict is Grok wins 24–17 with 2 ties.
Opus 5.5 is what Claude Code's opus alias points to on the Anthropic API, so that's the most direct Claude Code comparison on the site.
It still isn't a Grok Bot comparison, because Grok Bot doesn't promise to run the Grok chat model.
If one-shot build quality is the job, the table points to pinning the older Opus 5 or Fable 5 in Claude Code by full model ID where your provider serves them, since both outscore Opus 5.5 here.
Picking a Claude Code model per job
- One-shot pages and small web tools: start with Opus 5 or Fable 5 by model ID, the two Claude rows with the most gold medals here.
- Everyday repo work: the
opusalias, following Anthropic's own advice to start on Opus 5.5. - Long, multi-hour sessions:
fable, which Anthropic positions for long autonomous work; GoldieBench hasn't scored Fable 5.1 yet. - Light, repetitive jobs:
haiku, which the docs describe as fast and efficient for simple tasks. - Planning then building:
opusplan, which uses Opus in plan mode and Sonnet for execution.
Why a Grok score can't tune Grok Bot
With Grok Bot you can't pin a model, so the lever you actually control is the brief.
Write narrow instructions, save working tasks as skills, and keep approvals on anything external.
The skills and routines page says to make a task reliable first, save it as a skill, then automate it with a routine.
Watch the Grok Bot changelog for behavior changes, since model routing can shift without a setting changing on your side.
Where each one runs, and why it matters for models
Grok Bot runs on one cloud computer that all your Bots share, each with its own screen, per the computer and apps page.
Claude Code runs on your machine by default; its cloud sessions use an isolated VM each.
Claude Code shares configuration, project memory and MCP servers across its local surfaces, so a model setting you save in your settings file carries from the terminal to the IDE.
Cloud scheduled tasks run in auto permission mode by default, so pick the model and the guardrails together before you schedule anything.
The guardrails matter more than the model
A stronger model doesn't replace an approval step, on either side.
Grok Bot's Auto Review checks each action and stops for a card on risky ones, and Ask first rules always stop.
Claude Code's permission modes range from Manual, which asks before most edits and commands, to plan mode, which blocks edits until you approve a plan.
Deny rules in Claude Code hold in every mode, whichever model is running.
Set those first, then experiment with models on safe tasks.
Verdict by job type
Pick Claude Code when the job is code and you want to choose the model: build pages on the higher-scoring Claude rows, run daily repo work on opus.
Pick Grok Bot when the job is business work across apps and websites, and you're happy to let xAI choose the model.
Use both when a codebase sits next to a busy back office.
Small-business examples
- A café with a website: the owner's developer asks Claude Code, set to Fable 5 by model ID, for a one-page seasonal menu in plain HTML, reviews it in Manual mode and opens a pull request.
- An accountant's office: a Grok Bot routine checks the client tracker sheet each Monday and lists missing documents; nobody needs to think about models.
- A marketing agency: a shared Bot turns Slack change requests into briefs, and the developer runs each brief through Claude Code on the
opusalias, then a Bot routine watches the PR.
If you're weighing Grok Bot against OpenAI's coding agent, read Grok Bot vs Codex.
On plans, by name: The X Subscription includes Grok Bot from Premium upwards, through Super and Ultra, while Anthropic sells Claude Code access with Pro, Max, Ultra, Team and Enterprise, or through a Console account.
Our live routing notes sit inside the AI Profit Boardroom.
Also On Our Network
- Agent Operatorsthe seven-step setup order for a general agent and a coding agent
- AI Income Deskwhich one a small business should hire first, with three use cases
- AI Tool Verdicta ten-criterion scorecard that rates both agents from the official docs
- agentos.guidefive copy-paste prompts that split work between a general agent and a coding agent
- aiprofitboardroom.comthe complete Grok Bot vs Claude Code guide on the AI Profit Boardroom blog
Pick a Claude Code model from the table, let Grok Bot route its own, and book a free strategy session or join the AI Profit Boardroom for help with grok bot vs claude code.
FAQ
Which model does Claude Code use?
You choose. On the Anthropic API the opus alias is Opus 5.5, sonnet is Sonnet 5.5, haiku is Haiku 5.5 and fable is Fable 5.1, and you can pin a version by its full model ID.
Which model does Grok Bot use?
xAI doesn't say. Grok Bot has no model picker and chooses a model for each task itself.
Does the Grok score on GoldieBench apply to Grok Bot?
Not directly. It scores the Grok chat model on one-shot HTML builds, and Grok Bot doesn't state which model it runs.
Which Claude model scored best on GoldieBench?
Among the Claude rows read for this page, Opus 5 has the highest average at 8.27/10 over 50 tasks, ahead of Fable 5 at 8.10 and Opus 5.5 at 7.57.


