GoldieBench Blog · 7 min read
Grok Bot vs Manus: Which AI Models Each One Runs, With Real GoldieBench Scores
One agent keeps its model to itself. The other lets you plug in a provider key and choose. Here is how to use the leaderboard on the side where you hold the dial.

Grok Bot vs Manus splits sharply on models: Grok Bot chooses a model per task and never shows it, while Manus lets you bring your own provider key through Manus Flex and pick the model yourself.
That makes GoldieBench scores no help on one side and a real guide on the other.
Below are the scores I read on live GoldieBench pages on 5 November 2026, what they measure, and how I'd pair them with Manus jobs.
The tool comparison is my reading of the xAI and Manus docs, since neither vendor compares the two.
If you'd like my team to map models to your workflows, grab a free SEO strategy session.
The model question, side by side
| Model question | Grok Bot | Manus |
|---|---|---|
| Can you pick the model? | No picker | Yes, with Manus Flex (beta) |
| Can you see which model ran? | No | Yes, Flex shows your model in the mode menu |
| Standard modes | Not applicable | Manus 2.0, Manus 2.0 Max, Manus 2.0 Lite |
| Bring your own key | Not offered | OpenAI, Anthropic, Google AI Studio, xAI, Meta, OpenRouter, Fireworks, Modal |
| Media models | Not documented | Built-in video, image, audio and 3D models on Manus credits |
| Can GoldieBench guide the choice? | No | Yes, for build-style tasks under Flex |
Why GoldieBench can't score Grok Bot
The Grok Bot FAQ says the product routes work to a model it picks, with no picker and no way to see which model handled a request.
So there's no single model to benchmark.
The GoldieBench page called Grok covers xAI's Grok model, not the Grok Bot product.
Judge Grok Bot on its workflow instead: the shared cloud computer, its routines and its approvals.
How Manus handles models, and what Flex changes
By default you pick a Manus mode, not a model.
Free accounts get Manus 2.0 Lite in Agent mode, while Pro accounts can use Manus 2.0, Manus 2.0 Max and Manus 2.0 Lite.
Manus Flex swaps the language model behind the agent for one from your own provider account.You choose the provider, paste a key, then set a primary model and an effort level, and the model list comes from that provider.
Manus still plans the task, calls tools and runs it in the same sandboxes, Projects and automations.
Flex is in beta, and Manus says it doesn't guarantee third-party model performance.
What GoldieBench scores actually measure
The methodology page says every model gets one fixed prompt, one shot, with no iteration and no best-of-N.
Each result has to be a single self-contained HTML file that runs in a browser: games, visuals, simulations and pages.
Rankings are a model's average 0 to 10 score across the tasks it was scored on.
That maps well onto Manus jobs that build things, such as a landing page or a small web tool.
It says nothing about inbox triage, tool calls or approval handling, so treat it as one input.
The scores I read for models from Flex providers
All figures come from the GoldieBench leaderboard and the models page, read on 5 November 2026.
| Model | Flex provider | GoldieBench score | Rank |
|---|---|---|---|
| Fusion | OpenRouter | 8.59 avg over 47 tasks | #1 |
| Claude Opus 5 | Anthropic | 8.27 avg over 50 tasks | #2 |
| GPT-5.6 Sol | OpenAI | 8.16 avg over 50 tasks | #4 |
| Grok | xAI | 8.09 avg over 47 tasks (43 scored) | #7 |
| Claude Opus 5.5 | Anthropic | 7.57 avg over 50 tasks | #13 |
| Muse Spark 1.2 | Meta | 7.55 avg over 50 tasks | #14 |
| Grok 4.7 | xAI | 7.15 avg over 20 tasks | #17 |
| Gemini 3.6 Flash | 7.08 avg over 50 tasks | #18 |
Two caveats from the site itself.
The models page says Fusion is currently graded by Claude's AI judge until Julian's own Fusion head-to-head ships.
The methodology page also lists Grok as unranked, while the leaderboard shows it at #7, so read the Grok row with that in mind.
For the newer Anthropic model, the Opus 5.5 page has the full task breakdown, and Grok 4.7's page covers xAI's numbered release.
How I'd pair models with Manus jobs
- Building a page or small web app: start with the highest-ranked model your provider lists, such as Claude Opus 5 or GPT-5.6 Sol.
- Comparing several models: use one OpenRouter key, which the Flex docs suggest for comparing models, and try a medium effort level first.
- Images, video, audio or 3D: leave it to Manus's built-in models, which Flex doesn't change.
- Everyday research and documents: stay on the standard Manus 2.0 modes unless you already hold a provider contract.
None of this applies to Grok Bot, where the model choice stays with xAI.
Reading a score before you switch models
A higher average is a signal, not a promise for your own task.
Open the model's page and check the category it wins: the leaderboard tags Claude Opus 5 as best at Sims and GPT-5.6 Sol as best at Pages.
For a Manus website build, the Pages column is the closer match.
Then run the same brief twice in Manus, once on your current mode and once on the Flex model, and compare the drafts side by side.
Keep the winner as your primary model and note the effort level you used.
Members of the AI Profit Boardroom share these side-by-side runs on the weekly coaching calls.
The rest of the head-to-head, briefly
A Manus task runs in a temporary sandbox, with an optional always-on Cloud Computer for long jobs.
Grok Bot keeps every Bot on a single always-on cloud machine, where each Bot works on a separate screen.
Manus adds the Browser Operator extension for your own logged-in browser, Manus Studio for desktop work on Apple Silicon Macs and Windows, 416 connectors and a REST API with webhooks.
Grok Bot answers with routines on schedules, Slack, GitHub, Linear, Sentry, PagerDuty, email or webhooks, plus Auto Review approval cards with Ask first rules.
For the same model question against a self-hosted agent, see our Grok Bot vs OpenClaw model guide.
Plans and company status
On The X Subscription, the Premium, Super and Ultra tiers come with Grok Bot, and Plus does not.
Manus offers Free, Pro and Team plans on credits, and with Flex your provider bills the language model while Manus credits still cover media and the Cloud Computer.
Manus said in December 2025 it was joining Meta, and a Manus blog post dated 1 September says it has resumed independent operations.
Small-business examples
A freelance web designer.Turn on Flex with an Anthropic key, set Claude Opus 5 as primary if it's listed, and ask Manus to build a one-page site draft for a client from their brief.
A coffee roaster.Stay on Manus 2.0 and ask for a product photo set using the built-in image models, since Flex doesn't touch media.
A tutoring service.Use Grok Bot: create a Bot named Timetable, connect Google Calendar, and add a weekly routine that drafts the parents' schedule email for your approval.
Verdict by job type
Pick Grok Bot when you'd rather not think about models at all and want standing Bots with memory.
Pick Manus with Flex when model choice matters, especially for build-style jobs where GoldieBench scores give you a starting point.
Also On Our Network
- Agent Operatorsthe first settings I change on each agent, side by side
- AI Income Deskwhich agent suits a small firm, with six step-by-step business examples
- AI Tool Verdicta 9-point scorecard rating both agents, with a verdict by job
- agentos.guidefive prompts that let your Agent OS dispatch jobs to either agent
- aiprofitboardroom.comthe complete Grok Bot vs Manus guide on the AI Profit Boardroom blog
Check the leaderboard, set your Flex primary model, and join the AI Profit Boardroom or book a free strategy session to pick the right models for grok bot vs manus.
FAQ
Which model does Grok Bot use?
Grok Bot does not say. It routes each task to a model it chooses, has no model picker and does not show which model ran.
Can I choose the model in Manus?
Yes, through Manus Flex, which is in beta. You connect an API key from a supported provider such as OpenAI, Anthropic, Google AI Studio, xAI, Meta or OpenRouter, then pick a primary model and an effort level.
Which model scores highest on GoldieBench among Flex providers?
Fusion from OpenRouter leads the leaderboard at 8.59 over 47 tasks, and Claude Opus 5 is next at 8.27 over 50 tasks. Whether either appears in your Flex list depends on your provider.
Do GoldieBench scores apply to Manus image or video work?
No. GoldieBench scores one-shot HTML builds, and Manus media generation always uses its built-in models, even when Flex is on.


