
Real head-to-head · same prompt, one shot
Qwen 3.7 vs Fugu Ultra 1.1
Multilingual open-weights — strong on Chinese reasoning. vs Sakana's multi-agent orchestrator, v1.1 — routes experts per request.
Head-to-head verdict: Fugu Ultra 1.1 wins 12–11.
What I tested — same prompt, two models
I run the same fixed prompt set through every new model the day it drops — same string, one shot, single HTML file out — and I score the result 0–10 on whether it ran, how close it hit the brief, and how good it looked. Below is what came out when I gave the exact same prompts to Qwen 3.7 and Fugu Ultra 1.1, side by side, on 24 shared tasks inside the Agent Operating System.
Both models were given identical prompts inside the Agent Operating System — no help, no iteration, no "best of N" tricks. I run each prompt once, save the HTML file the model produces, and score it 0–10 on whether it ran, how close it hit the brief, and how good it looked. The scoring is mine. The verdicts below are pulled from my source comparison guides at agentos.guide where I publish every score and the reasoning behind it.
Qwen 3.7 · Wired alongside GLM-5.2 in Agent OS for open-weights agent loops where you want vendor diversity.
Fugu Ultra 1.1 · Benched on GoldieBench via Sakana's Responses API (fugu-ultra-v1.1, xhigh reasoning). Game tasks use the skill-infused threejs-game-director prompt plus a controls+graphics fix loop with an anti-regression clamp, judged on a real mid-play frame by the same Opus judge as the field.
Side-by-side on 47 shared tasks
Click any cell to play that model's actual one-shot attempt. Medals are derived from my 0–10 scores per task (highest = 🥇, second = 🥈, third = 🥉).
Task ↓
Qwen 3.7
Fugu Ultra 1.1
Game
Game
Game
Game
Game
Game
Game
Game
Game
Game
Game
Game
Game
Game
Game
Game
Game
Game
Game
Game
Game
Game
Page
Visual
Where Qwen 3.7 beat Fugu Ultra 1.1
The tasks where I gave Qwen 3.7 a higher 0–10 score on the same prompt — with the actual commentary from my source guides.
Neoncity
Game
Qwen 3.7 7.5
·
Fugu Ultra 1.1 2.3
(+5.2)
What I saw: 8KB · plays clean · webgl, rAF
Arcade
Game
Qwen 3.7 8.0
·
Fugu Ultra 1.1 5.5
(+2.5)
What I saw: The closest test. All three shipped a real, juicy game. Opus's breakout had the most game-feel (particle bursts + live combo). Qwen's neon breakout is clean and vibrant. GLM went its own way with fullscreen asteroids. Genuinely hard to separate.
Aurora
Visual
Qwen 3.7 7.5
·
Fugu Ultra 1.1 5.5
(+2.0)
What I saw: 6KB · plays clean · webgl, rAF
Raycaster
Game
Qwen 3.7 4.0
·
Fugu Ultra 1.1 2.0
(+2.0)
What I saw: 0KB · no animation detected on load · TIMEOUT
Nordiccrypt
Game
Qwen 3.7 7.0
·
Fugu Ultra 1.1 5.2
(+1.8)
What I saw: 16KB · plays clean · webgl
Where Fugu Ultra 1.1 beat Qwen 3.7
The tasks where I gave Fugu Ultra 1.1 a higher 0–10 score on the same prompt — with the actual commentary from my source guides.
Outrun
Game
Fugu Ultra 1.1 8.6
·
Qwen 3.7 5.5
(+3.1)
· neon combat runner
What I saw: Gorgeous synthwave city with pseudo-3D road, glowing hero craft on a contact disc, and a visible enemy vehicle ahead with combat HUD (KILLS, THREAT HIGH, crosshair) — clearly a combat runner not an empty walking sim. Polished vignette, meters, and banner elevate it above the fiel…
Dragonrealm
Game
Fugu Ultra 1.1 8.6
·
Qwen 3.7 6.0
(+2.6)
· Frozen combat realm
What I saw: Strong Skyrim-vibe frozen open world with layered snowy mountains, a player with visible sword, multiple approaching enemies with health orbs, runes, an event banner ('DRAGON SWOOP · FIRE BREATH') and polished HUD/compass — clearly beats the empty-walking-sim trap. Enemy models a…
Rpg
Game
Fugu Ultra 1.1 8.4
·
Qwen 3.7 6.0
(+2.4)
· Verdant Relic RPG
What I saw: Polished top-down 3D RPG with visible enemies in aggro rings, active combat ('HIT -13' damage numbers, health at 87), pickups, a shrine objective, and a clean HUD showing inventory/kills/hostiles; strong shippable build, only slightly held back by the inventory system being minim…
Racing
Game
Fugu Ultra 1.1 8.6
·
Qwen 3.7 7.0
(+1.6)
· Neon combat racer
What I saw: Gorgeous polished third-person racer with a clear track, guardrails, trees/rocks/buildings, obstacle cones, a slick craft with ground shadow, and combat layered in (crosshair, KILLS 0/12, visible enemies/targets ahead) plus rich HUD with minimap — strong shippable build; only min…
Doom
Game
Fugu Ultra 1.1 8.4
·
Qwen 3.7 7.0
(+1.4)
· 3D demon shooter
What I saw: Strong atmospheric 3D maze with a visible horned demon enemy, working shotgun, minimap with tracked enemies, and active combat ('CLAWED' hit feedback, HP dropped to 082) — polished HUD and lighting. Falls just shy of the field's best; enemies are more Three.js models than true ra…
Strengths & weaknesses I logged
Qwen 3.7
Strengths
- Open weights, free for individuals — same model class as GLM-5.2
- Best-of-three on fluid simulation in the Goldie Bench bench
- Multilingual depth — Chinese reasoning especially strong
Trade-offs
- Only 5 tasks scored on the bench so far — small sample size
- Trails GLM-5.2 on cinematic visual builds at similar pricing
Fugu Ultra 1.1
Strengths
- Orchestrates 1-3 expert agents per request and synthesises their answers
- Reported SWE-Bench Pro 73.7 — above Opus 4.8 and GPT-5.5 on Sakana's table
- OpenAI- and Anthropic-compatible API — drop-in for Codex and Claude Code
Trade-offs
- Benched as a partial run until the full 50-task batch completes
- Region-locked: unavailable across the EU/EEA/UK/CH — access depends on where you are
Pricing & context — the spec sheet
| Spec | Qwen 3.7 | Fugu Ultra 1.1 |
|---|---|---|
| Vendor | Alibaba | Sakana AI |
| Context window | 256,000 tokens | 1,000,000-token context window |
| Price | Open weights · free for individuals | API · orchestration billed |
| Pricing detail | Alibaba's open-weights release — downloadable from Hugging Face, runnable locally or via Alibaba Cloud's free tier for individuals. | Sakana's Fugu Ultra v1.1 — a multi-agent system served as a model: an orchestrator routes each request across one to three expert agents and synthesises the answer. Reported (v1.0): SWE-Bench Pro 73.7, LiveCodeBench 93.2, GPQA Diamond 95.5. NOTE: Sakana geo-blocks the EU/EEA/UK/Switzerland pending GDPR compliance — benched from an allowed region. |
| Release | 2026-06 | 2026-07 |
| Bench coverage | 47/47 scored · avg 7.00/10 | 23/24 scored · avg 6.94/10 |
The verdict — which should you pick?
Across 23 scored shared tasks, the averages are essentially tied — Qwen 3.7 7.07 vs Fugu Ultra 1.1 6.94. This isn't the comparison where one wins; it's the comparison where you pick based on context, pricing, and what you're actually trying to ship.
If you only run one of these inside your stack, the head-to-head average above is the call. If you can run both, my honest play is to wire Qwen 3.7 and Fugu Ultra 1.1 both into the Agent Operating System and dispatch each from the kanban by task type — open-weights alternative to glm-5.2 when you want a different model family → Qwen 3.7, hard, high-stakes coding and reasoning where answer quality beats latency → Fugu Ultra 1.1. That's the same setup I run for the 4,000+ founders inside the AI Profit Boardroom.
FAQ — Qwen 3.7 vs Fugu Ultra 1.1
Which is better, Qwen 3.7 or Fugu Ultra 1.1?
On Goldie Bench, Qwen 3.7 averages 7.07/10 across the shared tasks, with 0 gold, 0 silver, 0 bronze overall. Fugu Ultra 1.1 averages 6.94/10, with 0 gold, 1 silver, 2 bronze. Fugu Ultra 1.1 wins the head-to-head 12–11.
How much does Qwen 3.7 cost vs Fugu Ultra 1.1?
Qwen 3.7: Alibaba's open-weights release — downloadable from Hugging Face, runnable locally or via Alibaba Cloud's free tier for individuals. Fugu Ultra 1.1: Sakana's Fugu Ultra v1.1 — a multi-agent system served as a model: an orchestrator routes each request across one to three expert agents and synthesises the answer. Reported (v1.0): SWE-Bench Pro 73.7, LiveCodeBench 93.2, GPQA Diamond 95.5. NOTE: Sakana geo-blocks the EU/EEA/UK/Switzerland pending GDPR compliance — benched from an allowed region.
What's the context window for Qwen 3.7 vs Fugu Ultra 1.1?
Qwen 3.7 has a 256,000 tokens context window. Fugu Ultra 1.1 has a 1,000,000-token context window context window.
When should I pick Qwen 3.7 over Fugu Ultra 1.1?
Pick Qwen 3.7 for: Open-weights alternative to GLM-5.2 when you want a different model family; Multilingual workloads (Chinese, multi-script content); Fluid and particle simulations. The trade-off is the weaknesses we logged on the bench: Only 5 tasks scored on the bench so far — small sample size; Trails GLM-5.2 on cinematic visual builds at similar pricing.
When should I pick Fugu Ultra 1.1 over Qwen 3.7?
Pick Fugu Ultra 1.1 for: Hard, high-stakes coding and reasoning where answer quality beats latency; Agentic workflows in Codex / Claude Code via the drop-in provider config; One-shot builds you want a panel of experts on, not a single model. The trade-off is the weaknesses we logged on the bench: Benched as a partial run until the full 50-task batch completes; Region-locked: unavailable across the EU/EEA/UK/CH — access depends on where you are.
How does Goldie Bench score Qwen 3.7 vs Fugu Ultra 1.1?
Every demo on this page was built by Julian Goldie inside the Agent Operating System — same fixed prompt for both models, one shot, single HTML file out. Each result gets a 0–10 score on whether it ran, how close it hit the brief, and how good it looked. The highest score on each task gets gold; second gets silver; third gets bronze. See methodology for full provenance.
Related comparisons
Other head-to-heads using the same scoring system:
Qwen 3.7 vs Fusion Fugu Ultra 1.1 vs Fusion Qwen 3.7 vs Claude Opus 5 Fugu Ultra 1.1 vs Claude Opus 5 Qwen 3.7 vs Hermes MoA Fugu Ultra 1.1 vs Hermes MoA Qwen 3.7 vs GPT-5.6 Sol Fugu Ultra 1.1 vs GPT-5.6 SolFull model pages: Qwen 3.7 · Fugu Ultra 1.1 · back to the leaderboard
The same stack Julian uses
Run this stack yourself.
Every demo on this bench was built inside the Agent Operating System — one prompt, one shot, single HTML file out. The Agent OS, the prompts, the templates, the weekly walkthroughs and 4,000+ founders shipping with it every day all live inside the AI Profit Boardroom.
4,000+founders
258documented wins
38countries
$59/momonthly














































