⭐ Get the Agent OS + join 3,400+ founders inside the AI Profit Boardroom → Join AIPB

GoldieBench Blog · 6 min read

Grok Bot Android: Which AI Models To Pair With It, And What The GoldieBench Scores Mean When The Bot Picks Its Own

Your phone only approves the work, so the scores that count belong to Grok, the Pages leaders and the planner and checker you run beside it.

A dark navy benchmark leaderboard of glowing gold bars beside a smartphone, with gold lines linking the phone to a floating cloud computer

Grok Bot Android never asks you to pick a model, so the GoldieBench scores that matter are the ones for the models Grok Bot might route to and the models you run beside it to plan and check the work you approve on your phone.

The Grok Bot FAQ is blunt: there is no model picker, and the backend model can differ from one request to the next.

The Android app (Android 9 or later, from Google Play) is a client for Bots that work on a cloud computer, per the mobile docs.

So your phone's chip changes nothing about output quality.

Every score below was read on live goldiebench.com pages on 2 November 2026, with the page named beside it.

If you want my team to choose where agents fit your SEO, book a free SEO strategy session.

Why your Android phone isn't the benchmark

The phone handles messages, approvals, take-overs and routine controls.

The thinking happens on Grok Bot's side, on a model Grok Bot chooses.

A budget Android 9 handset and a new flagship get the same answers.

What the phone changes is how fast you approve, not how good the work is.

What a GoldieBench score measures

The methodology page describes one fixed prompt per task, one shot, and a single self-contained HTML file out.

Scores are Julian's own 0 to 10 marks.

That makes the bench a good proxy for "can this model ship a finished page in one pass", which is exactly what you review in a Bot's Library on your phone.

It doesn't test screen control, phone apps or approvals.

The leaderboard models worth knowing

These are the overall averages from the home leaderboard and the model pages.

ModelAverageTasksRank / medalsPage read
Fusion8.59/1047#1 · 21 goldLeaderboard
Claude Opus 58.27/1050#2 · 13 goldLeaderboard
Hermes MoA8.17/1047#3 · 3 goldLeaderboard
GPT-5.6 Sol8.16/1050#4 · best at PagesGPT-5.6 Sol page
Grok8.09/1047 (43 scored)#7 · 5 gold, 1 silver, 1 bronzeGrok page
Grok 4.77.15/10202 silver, 3 bronzeGrok 4.7 page
Gemini 3.6 Flash7.08/10501 gold, 2 silverAll models

The bench lists 1310 live demos, 50 tasks and 33 models on its home page.

The Grok scores, read straight

The Grok model page shows an 8.09/10 average across 47 tasks, 43 of them scored, with a 256,000-token context.

Its best results are Twilightvale at 9.5 and four tasks at 9.0, including Landing and Webos.

Its lowest scored tasks sit at 7.0: Aipbpromo, Aurora and Matrix.

The Grok 4.7 page shows 7.15/10 across 20 tasks with a 500,000-token context.

That page also lists outside numbers sourced to x.ai: CursorBench 4.0 at 46.3%, DeepSWE v1.1 (high effort) at 71.0% and Terminal-Bench 4.0 at 38.0%.

None of these tells you which model Grok Bot used on your last task.

Pages are what you review on Android, so check the Pages scores

A Bot's results often arrive as pages you open from a chat card or the Bot's Library.

The Landing task page is the closest bench match: a modern marketing landing page in one shot.

It shows 26 models tested, 21 scored, and an 8.11/10 average.

ModelLanding scoreNote on the task page
Grok9.0/10 (gold)Premium keynote-style page from one sentence
Fusion9.0/10 (gold)Apple-keynote style mesh gradient
Fugu Ultra9.0/10 (gold)Listed as the task winner
GPT-5.6 Sol8.7/10Scored on the same prompt
Gemini 3.6 Flash8.6/10Interactive 3D hero
Claude Fable 57.2/103D object overlapped card text

Grok sharing the top Landing score with Fusion and Fugu Ultra is a good sign for page-style Bot output.

The AI Profit Boardroom trainings walk through this planner-and-checker setup; see what's inside.

GPT-5.6 Sol is the leaderboard's "best at Pages" model, which makes it the checker I'd point at a page before approving it.

The pairing I'd run around the phone

Planner: Claude Opus 5 or Fusion

Brief writing rewards the strongest all-rounder, and the top two averages are Fusion at 8.59 and Claude Opus 5 at 8.27.

Draft the brief with one of them, then dictate or paste it into the Bot from your phone.

Checker: GPT-5.6 Sol

Before you tap Allow once on a publish card, have a second model review the page.

Sol's 8.16 average and its Pages lead make it the natural reviewer.

Fast lane: Gemini 3.6 Flash

For quick rewrites on the move, the leaderboard calls Gemini 3.6 Flash faster and cheaper, with a 7.08 average and 8.6 on Landing.

Read the Grok 4.7 terminal number carefully

Terminal-Bench 4.0 at 38.0% is the weakest of the outside figures on the Grok 4.7 page.

Command-line work is the kind of thing a Bot does on its cloud computer while you watch from the phone.

It's a reason to keep the desktop rule for running commands on your own machine at Ask every time, which is the default.

It isn't proof that Grok Bot uses Grok 4.7, because the FAQ says the backend model varies.

A check you can run from your phone

Ask the Bot for a one-page landing draft, open it from the chat card, and share the link to your checker model.

Compare what the checker flags against what the Landing task notes call out, like overlapping visuals and unreadable text.

If the checker catches problems, deny the publish card and send the fixes back in chat.

That turns the bench's lessons into a habit rather than a table you read once.

What about local models on the phone?

The local models page is a Mac story: every model there runs on-device via Ollama or MLX.

Its leader, Qwable 5 27B Coder, scores 7.14/10 across 41 tasks at 15.0GB.

The smallest listed, Qwythos 9B at 5.6GB, scores 2.98/10.

Nothing on that page is benched on an Android phone, so don't read it as a phone ranking.

How approvals connect the bench to your phone

Scores tell you which model to trust for a draft; approvals decide what actually ships.

On Android, Auto Review and Custom Rules live in the Bot group of Settings, per the approvals page.

Set Ask first for publishing and sending, so every page a Bot makes gets your look, and your checker's, first.

Routine cards expire after 30 minutes, so keep notifications on for Bots that publish.

If you work from a laptop too, our Grok Bot Mac model guide covers the desktop side of the same pairing.

What the bench can't tell you about Grok Bot Android

It can't tell you notification timing, phone app behaviour or Google Play billing.

Those live in the docs: the share sheet on Android accepts text only, and phone apps are limited to Calendar, Contacts, Location and Alarms.

On The X Subscription, the Grok Bot plan page lists Premium, Super and Ultra as the tiers that come with it, and leaves Plus out.

For the trainings behind this model stack, join the AI Profit Boardroom.

Also On Our Network

Pick one planner and one checker from the tables, put Ask first on publishing, and approve from your phone; for help choosing, book a strategy session with my team and get more out of grok bot android.

FAQ

Does a faster Android phone make Grok Bot smarter?

No. Bots work on a cloud computer and Grok Bot picks the model per task, so the phone only affects how quickly you read and approve.

How does Grok score on GoldieBench?

The Grok model page shows 8.09/10 across 47 tasks, 43 scored, with 5 gold, 1 silver and 1 bronze medal, read on 2 November 2026.

Which model should check Bot pages before I approve them?

GPT-5.6 Sol is listed as best at Pages on the leaderboard, with an 8.16 average, so it makes a sensible reviewer.

Can I run a GoldieBench local model on my Android phone?

The local models page benches on-device models on a Mac via Ollama or MLX. None of them is benched on Android.

The same stack Julian uses

Run this stack yourself.

Every demo on this bench was built inside the Agent Operating System — one prompt, one shot, single HTML file out. The Agent OS, the prompts, the templates, the weekly walkthroughs and 3,400+ founders shipping with it every day all live inside the AI Profit Boardroom.

3,400+founders
258documented wins
38countries
4coaching calls a week