⭐ Get the Agent OS + join 3,400+ founders inside the AI Profit Boardroom → Join AIPB

GoldieBench Blog · 6 min read

Grok Bot For Customer Support + Which AI Models To Pair With It, With Real GoldieBench Scores

No model picker inside the Bot, so the bench helps you choose the planner and page-builder models around it.

Illustrated benchmark leaderboard with gold bars beside a support desk queue of draft replies waiting for approval

Grok Bot for customer support chooses its own model for every task, so the benchmark question is which models to put around it, not which one sits inside it.

I read the live GoldieBench pages on 6 November 2026, and every score below is quoted from the page it appears on.

The Grok Bot facts come from xAI's Grok Bot FAQ, the security page and the shared Bots docs.

Want help choosing a stack for your support desk? Book a free SEO strategy session with my team.

No model picker inside Grok Bot, so here is what the scores are for

xAI says Grok Bot manages model selection and there is no customer-facing model picker.

The FAQ adds that the choice can differ from one request to the next, and that users cannot be routed to or away from a particular model.

Usage views also record the work as Grok Bot usage rather than by model.

So no number on GoldieBench is a Grok Bot number.

The scores help with the models around the Bot: the one in your Agent OS that writes reply guidelines, and the one that builds your help-centre page.

The overall leaderboard on 6 November 2026

ModelAvg / 10Tasks scored
Fusion8.5947/47
Claude Opus 58.2750/50
Hermes MoA8.1747/47
GPT-5.6 Sol8.1650/50
Claude Fable 58.1047/47
Qwen 3.88.1045/45
Grok8.0943/47

Source: the GoldieBench leaderboard, where ranking is Julian's 0 to 10 score averaged across the tasks each model ran.

The board lists 50 tasks and 33 models in total.

The Pages tab is the closest match to a help-centre page

GoldieBench splits its tasks into Games (23), Visuals (9), Sims (12) and Pages (3).

Pages tasks are single-file web pages, the nearest thing on the bench to a support FAQ page or a returns-policy page.

Top Pages averages on the leaderboard's Pages tab:

ModelPages avg / 10 (3 tasks)
Fusion8.50
Claude Opus 58.47
GPT-5.6 Sol8.47
Qwen 3.88.40
Grok8.33

The leaderboard's Best at column tags GPT-5.6 Sol as best at Pages.

Grok's own Pages scores, task by task

The Grok model page shows 9.0 on Landing Page, 9.0 on Webos and 7.0 on Aipbpromo.

Those three average to the 8.33 in the Pages table.

The same page lists a 256,000-token context window and an 8.09 overall average.

A mismatch on the Grok page

The Grok page's trade-offs box says its demos have zero curated verdicts and that it is currently unranked.

The leaderboard, read the same day, ranks Grok seventh with 43 of 47 tasks scored.

Treat the leaderboard figures as current and the trade-offs text as older copy.

Grok and Grok 4.7 are separate rows

The board carries two xAI entries, and they should not be confused.

Grok sits seventh at 8.09 across 47 tasks, while Grok 4.7 sits seventeenth at 7.15 across 20 tasks, all 20 scored.

Neither row tells you what Grok Bot runs on a given ticket, because the Bot picks per request.

If you want an xAI model writing your support rules in your Agent OS, the Grok row is the stronger of the two on this bench.

The Grok 4.7 page has its own task-by-task breakdown if you want to compare the two in detail.

What GoldieBench cannot tell you about support

Each task on the models page is the same fixed prompt, one shot per model, scored 0 to 10 by Julian.

Nothing on the bench scores ticket triage, reply tone, policy accuracy or escalation judgement.

A strong Pages score says a model builds a good page in one go; it says nothing about whether it reads an angry email well.

Judge the support work itself by the drafts Grok Bot hands back.

Which model does which support job

Support jobWhere it runsWhat to use the bench for
Reply drafts from help filesGrok Bot, its own modelNothing; judge the drafts
Escalation repro packsGrok Bot, Slack triggerNothing; judge the steps
Reply style guide and rulesYour Agent OS modelPick from the overall top rows
Help-centre or FAQ pageYour Agent OS or build modelThe Pages tab
Account-health thresholdsYour Agent OS modelOverall average as a rough guide

The Bot's own rules stay the same whichever model writes the brief: routine email waits as a draft, and other people's email is information, not instructions.

That is why the planner model matters more than it looks: it writes the description, the Ask first rules and the Slack trigger phrase that Grok Bot follows.

A sloppy brief from a weak planner produces drafts you have to rewrite; a tight brief produces drafts you send.

Step-by-step trainings on writing briefs like this sit inside the AI Profit Boardroom.

Test two models on your own tickets

  1. Export twenty real, anonymised questions from your inbox or Zoho Desk, the one helpdesk the docs name.
  2. Ask two Agent OS models to write the same support-desk description and reply rules.
  3. Paste each into the shared Bot's description in turn and run the same twenty questions.
  4. Count the edits you make to each set of drafts, and keep the brief that needs fewer.
  5. Save that process as a skill.

Keep the questions identical across both runs, and keep the help files identical too.

Otherwise you are measuring the inputs, not the brief.

Twenty questions is small enough to read every draft yourself, which is the only score that matters here.

Two small-business examples

A café. The owner asks the top Pages model to build a one-page FAQ from the menu and opening hours, then attaches the same files to the shared Bot so drafted replies match the page.

A dog groomer. Booking questions reach a +bookings alias; the Bot checks Google Calendar for free time and drafts a reply, and the groomer sends it from the phone app. No model choice is involved at all, which is the point.

A small software company. Its Agent OS model writes the "needs repro" rules; Grok Bot runs them on a Slack trigger, builds the repro pack in staging, and waits for the engineer who asked to approve the post.

Where to start this week

Pick one Agent OS model from the top of the overall table to write your rules, and one Pages leader for your help page.

Then judge Grok Bot on its drafts, not on a leaderboard row.

For the team side, see the Grok Bot teams breakdown, and for the Slack updates read the Grok Bot changelog.

The model-testing trainings are inside the AI Profit Boardroom.

Also On Our Network

Choose the planner model from the board, judge the Bot on its drafts, and book a free strategy session to pick the right stack for Grok Bot for customer support.

FAQ

Which model does Grok Bot use for support?

Grok Bot manages model selection itself and has no customer-facing model picker, so you cannot choose it.

Which GoldieBench category fits a help-centre page?

Pages, with three single-file web page tasks. Fusion leads at 8.50, with Claude Opus 5 and GPT-5.6 Sol at 8.47.

Does GoldieBench score reply quality?

No. Every task is a one-shot build scored 0 to 10, so judge support drafts on your own tickets.

What is Grok's overall score?

The leaderboard shows Grok at 8.09 with 43 of 47 tasks scored, read on 6 November 2026.

The same stack Julian uses

Run this stack yourself.

Every demo on this bench was built inside the Agent Operating System — one prompt, one shot, single HTML file out. The Agent OS, the prompts, the templates, the weekly walkthroughs and 3,400+ founders shipping with it every day all live inside the AI Profit Boardroom.

3,400+founders
258documented wins
38countries
4coaching calls a week