
Real head-to-head · same prompt, one shot
Fugu Ultra 1.1 vs Grok 4.7
Sakana's multi-agent orchestrator, v1.1 — routes experts per request. vs Grok 4.6's price, a bigger base model, and it builds games that hold together.
Head-to-head verdict: Fugu Ultra 1.1 wins 5–4 with 1 tie.
What I tested — same prompt, two models
I run the same fixed prompt set through every new model the day it drops — same string, one shot, single HTML file out — and I score the result 0–10 on whether it ran, how close it hit the brief, and how good it looked. Below is what came out when I gave the exact same prompts to Fugu Ultra 1.1 and Grok 4.7, side by side, on 10 shared tasks inside the Agent Operating System.
Both models were given identical prompts inside the Agent Operating System — no help, no iteration, no "best of N" tricks. I run each prompt once, save the HTML file the model produces, and score it 0–10 on whether it ran, how close it hit the brief, and how good it looked. The scoring is mine. The verdicts below are pulled from my source comparison guides at agentos.guide where I publish every score and the reasoning behind it.
Fugu Ultra 1.1 · Benched on GoldieBench via Sakana's Responses API (fugu-ultra-v1.1, xhigh reasoning). Game tasks use the skill-infused threejs-game-director prompt plus a controls+graphics fix loop with an anti-regression clamp, judged on a real mid-play frame by the same Opus judge as the field.
Grok 4.7 · Wired into the Agent OS Grok Build tab (4.7 / 4.6 / 4.5 picker, OpenRouter fallback when the CLI is signed out) and benched on twenty skill-infused game builds, each played through its full gameplay arc on a Metal GPU before the vision judge scored the played frame.
Side-by-side on 25 shared tasks
Click any cell to play that model's actual one-shot attempt. Medals are derived from my 0–10 scores per task (highest = 🥇, second = 🥈, third = 🥉).
Task ↓
Fugu Ultra 1.1
Grok 4.7
Game
Game
Game
Game
Game
Game
Game
Game
Game
Game
Game
— not attempted —
Game
— not attempted —
Game
— not attempted —
Game
— not attempted —
Game
— not attempted —
Game
— not attempted —
Game
— not attempted —
Game
— not attempted —
Game
— not attempted —
Game
— not attempted —
Game
— not attempted —
Game
— not attempted —
Game
— not attempted —
Page
— not attempted —
Where Fugu Ultra 1.1 beat Grok 4.7
The tasks where I gave Fugu Ultra 1.1 a higher 0–10 score on the same prompt — with the actual commentary from my source guides.
Crypt
Game
Fugu Ultra 1.1 7.8
·
Grok 4.7 2.3
(+5.5)
What I saw: Strong atmospheric torch-lit crypt with a visible skeleton enemy, working HUD (health/torch/kills/depth), coffins and props — clearly a combat crawler not an empty walk sim. Lighting feels a bit washed-out/bright for a 'torch-lit dungeon' and the mood lacks the deep shadowy dread…
Doom
Game
Fugu Ultra 1.1 8.4
·
Grok 4.7 6.3
(+2.1)
· 3D demon shooter
What I saw: Strong atmospheric 3D maze with a visible horned demon enemy, working shotgun, minimap with tracked enemies, and active combat ('CLAWED' hit feedback, HP dropped to 082) — polished HUD and lighting. Falls just shy of the field's best; enemies are more Three.js models than true ra…
Dogfight
Game
Fugu Ultra 1.1 7.2
·
Grok 4.7 6.3
(+0.9)
What I saw: Strong visuals — detailed hero jet with shadow, polished HUD, city skyline and terrain create a real air-combat atmosphere; but the screenshot shows no visible enemies or combat (0/10 kills, no dogfight action), so it reads closer to a flight-sim showcase than a proven shooter.
Twilightvale
Game
Fugu Ultra 1.1 8.6
·
Grok 4.7 8.3
(+0.3)
· Atmospheric RPG World
What I saw: Gorgeous cohesive twilight scene with detailed hero holding a weapon, visible enemies (creature + humanoid), wooden bridge, lampposts, cottage, river, pickups and a working minimap/HUD with quest and kill tracker. Strong art direction and populated world with combat framing; only…
Rpg
Game
Fugu Ultra 1.1 8.4
·
Grok 4.7 8.2
(+0.2)
· Verdant Relic RPG
What I saw: Polished top-down 3D RPG with visible enemies in aggro rings, active combat ('HIT -13' damage numbers, health at 87), pickups, a shrine objective, and a clean HUD showing inventory/kills/hostiles; strong shippable build, only slightly held back by the inventory system being minim…
Where Grok 4.7 beat Fugu Ultra 1.1
The tasks where I gave Grok 4.7 a higher 0–10 score on the same prompt — with the actual commentary from my source guides.
Arcade
Game
Grok 4.7 8.6
·
Fugu Ultra 1.1 5.5
(+3.1)
· 3D breakout polish
What I saw: A gorgeous 3D breakout with rich lighting, gradient sky dome, gridded arena, minimap, and a polished sci-fi HUD; playtest confirms real motion (walkPx 0.23) with hull/lives/score/bricks all changing and no console errors — clearly at or above the field's best.
Skyrim
Game
Grok 4.7 8.4
·
Fugu Ultra 1.1 6.8
(+1.6)
· snowy shrine explorer
What I saw: Renders a polished, atmospheric first-person Skyrim-lite with soft-shadowed low-poly pines, standing stones, held sword+shield, a working minimap, and a rich RPG HUD (health/stamina/shards/shrines/altitude). Playtest confirms real movement, altitude climbing, and HP dropping from…
Gtadrive
Game
Grok 4.7 7.8
·
Fugu Ultra 1.1 7.4
(+0.4)
What I saw: Renders a polished city sandbox with a detailed HUD (health, nitro, wanted stars, minimap with markers) and a nicely modeled car, and the playtest shows real movement — distance closed from 0104 to 0023, score rose to 164, health dropped on crash. Weak points: speed reads 000 and…
Flightsim
Game
Grok 4.7 8.5
·
Fugu Ultra 1.1 8.4
(+0.1)
· polished flight HUD
What I saw: Strong render with a detailed 3D airport (runway, hangar, apron truck), clean chase-cam plane, and a rich professional HUD (heading tape, artificial horizon, IAS/ALT/VS gauges); playtest confirms real takeoff physics — throttle to 100, IAS ramping 55→146kt, ALT climbing 1→236m wi…
Strengths & weaknesses I logged
Fugu Ultra 1.1
Strengths
- Orchestrates 1-3 expert agents per request and synthesises their answers
- Reported SWE-Bench Pro 73.7 — above Opus 4.8 and GPT-5.5 on Sakana's table
- OpenAI- and Anthropic-compatible API — drop-in for Codex and Claude Code
Trade-offs
- Benched as a partial run until the full 50-task batch completes
- Region-locked: unavailable across the EU/EEA/UK/CH — access depends on where you are
Grok 4.7
Strengths
- Averaged 6.86/10 on the same twenty skill-infused game briefs where Grok 4.6 averaged 5.63, winning 8 of the 11 head-to-heads
- Best one-shots on this run: arcade (8.6), dragonrealm (8.6), flightsim (8.5), every one played on a real GPU before scoring
- Longer reinforcement learning shows: it holds a 40-50KB single-file spec and wires the controls it advertises
- xAI's own coding numbers moved: CursorBench 4.0 46.3% (from 40.4%) and DeepSWE v1.1 71.0% (from 65.2%)
Trade-offs
- 2 of 20 builds died on load or never moved when played — crypt: hud is not a function; voxelcraft: mesh.computeBoundingSphere is not a function file:///Users/j
- Independent Artificial Analysis Intelligence Index v4.3.2 puts it at 46, seven points behind Claude Fable 5.1 and GPT-6 at 53
- Terminal-Bench 4.0 is the weak spot xAI reports itself: 38.0% at launch
Pricing & context — the spec sheet
| Spec | Fugu Ultra 1.1 | Grok 4.7 |
|---|---|---|
| Vendor | Sakana AI | xAI |
| Context window | 1,000,000-token context window | 500,000 tokens |
| Price | API · orchestration billed | $2 in / $6 out per M tokens |
| Pricing detail | Sakana's Fugu Ultra v1.1 — a multi-agent system served as a model: an orchestrator routes each request across one to three expert agents and synthesises the answer. Reported (v1.0): SWE-Bench Pro 73.7, LiveCodeBench 93.2, GPQA Diamond 95.5. NOTE: Sakana geo-blocks the EU/EEA/UK/Switzerland pending GDPR compliance — benched from an allowed region. | xAI's September 2026 release, priced exactly like Grok 4.6: $2 per million input tokens and $6 per million output on the standard tier, $4 / $12 on the Fast tier (double the output speed). OpenRouter lists the same model at $1.60 / $4.80. |
| Release | 2026-07 | 2026-09 |
| Bench coverage | 23/24 scored · avg 6.94/10 | 11/11 scored · avg 6.86/10 |
The verdict — which should you pick?
Across 10 scored shared tasks, Fugu Ultra 1.1 averaged 7.71/10, beating Grok 4.7's 7.33/10 by 0.38 points. Pick Fugu Ultra 1.1 when the build has to ship on the first prompt and you can afford the trade-offs in the comparison below.
If you only run one of these inside your stack, the head-to-head average above is the call. If you can run both, my honest play is to wire Fugu Ultra 1.1 and Grok 4.7 both into the Agent Operating System and dispatch each from the kanban by task type — hard, high-stakes coding and reasoning where answer quality beats latency → Fugu Ultra 1.1, one-shot arcade, driving and shooter builds where the whole game has to arrive in a single file → Grok 4.7. That's the same setup I run for the 4,000+ founders inside the AI Profit Boardroom.
FAQ — Fugu Ultra 1.1 vs Grok 4.7
Which is better, Fugu Ultra 1.1 or Grok 4.7?
On Goldie Bench, Fugu Ultra 1.1 averages 7.71/10 across the shared tasks, with 0 gold, 1 silver, 1 bronze overall. Grok 4.7 averages 7.33/10, with 0 gold, 1 silver, 2 bronze. Fugu Ultra 1.1 wins the head-to-head 5–4.
How much does Fugu Ultra 1.1 cost vs Grok 4.7?
Fugu Ultra 1.1: Sakana's Fugu Ultra v1.1 — a multi-agent system served as a model: an orchestrator routes each request across one to three expert agents and synthesises the answer. Reported (v1.0): SWE-Bench Pro 73.7, LiveCodeBench 93.2, GPQA Diamond 95.5. NOTE: Sakana geo-blocks the EU/EEA/UK/Switzerland pending GDPR compliance — benched from an allowed region. Grok 4.7: xAI's September 2026 release, priced exactly like Grok 4.6: $2 per million input tokens and $6 per million output on the standard tier, $4 / $12 on the Fast tier (double the output speed). OpenRouter lists the same model at $1.60 / $4.80.
What's the context window for Fugu Ultra 1.1 vs Grok 4.7?
Fugu Ultra 1.1 has a 1,000,000-token context window context window. Grok 4.7 has a 500,000 tokens context window.
When should I pick Fugu Ultra 1.1 over Grok 4.7?
Pick Fugu Ultra 1.1 for: Hard, high-stakes coding and reasoning where answer quality beats latency; Agentic workflows in Codex / Claude Code via the drop-in provider config; One-shot builds you want a panel of experts on, not a single model. The trade-off is the weaknesses we logged on the bench: Benched as a partial run until the full 50-task batch completes; Region-locked: unavailable across the EU/EEA/UK/CH — access depends on where you are.
When should I pick Grok 4.7 over Fugu Ultra 1.1?
Pick Grok 4.7 for: One-shot arcade, driving and shooter builds where the whole game has to arrive in a single file; High-volume agent work priced at half what the other frontier models charge; Grok Build inside the Agent OS: pick 4.7 in the tab and everything it writes lands in the workspace. The trade-off is the weaknesses we logged on the bench: 2 of 20 builds died on load or never moved when played — crypt: hud is not a function; voxelcraft: mesh.computeBoundingSphere is not a function file:///Users/j; Independent Artificial Analysis Intelligence Index v4.3.2 puts it at 46, seven points behind Claude Fable 5.1 and GPT-6 at 53; Terminal-Bench 4.0 is the weak spot xAI reports itself: 38.0% at launch.
How does Goldie Bench score Fugu Ultra 1.1 vs Grok 4.7?
Every demo on this page was built by Julian Goldie inside the Agent Operating System — same fixed prompt for both models, one shot, single HTML file out. Each result gets a 0–10 score on whether it ran, how close it hit the brief, and how good it looked. The highest score on each task gets gold; second gets silver; third gets bronze. See methodology for full provenance.
Related comparisons
Other head-to-heads using the same scoring system:
Fugu Ultra 1.1 vs Fusion Grok 4.7 vs Fusion Fugu Ultra 1.1 vs Claude Opus 5 Grok 4.7 vs Claude Opus 5 Fugu Ultra 1.1 vs Hermes MoA Grok 4.7 vs Hermes MoA Fugu Ultra 1.1 vs GPT-5.6 Sol Grok 4.7 vs GPT-5.6 SolFull model pages: Fugu Ultra 1.1 · Grok 4.7 · back to the leaderboard
The same stack Julian uses
Run this stack yourself.
Every demo on this bench was built inside the Agent Operating System — one prompt, one shot, single HTML file out. The Agent OS, the prompts, the templates, the weekly walkthroughs and 4,000+ founders shipping with it every day all live inside the AI Profit Boardroom.
4,000+founders
258documented wins
38countries
$59/momonthly
































