GoldieBench Blog · 7 min read
Hermes Agent For Customer Support + Which AI Models To Pin To Triage, Drafts And Hard Cases: Real GoldieBench Scores
Hermes lets each cron job, channel and Bot run its own model. Here is how the live GoldieBench averages map onto a support desk.

Hermes Agent for customer support doesn't need one model for everything: Hermes lets you pick a model per scheduled job, per chat channel and per Bot, so triage, drafting and hard cases can each run on a different one.
Below are the GoldieBench averages I read on the live models page on 7 November 2026, matched to the support jobs where Hermes lets you choose.
The examples are a dental clinic, an online shop and a design agency, and each pick says what the model does in that job.
Want my team to map models to your own support flow? Book a free SEO strategy session.
What GoldieBench Measures, And What It Doesn't
The GoldieBench methodology gives every model the same fixed prompt, one attempt, and the output must be one self-contained HTML file.
Julian scores each build from 0 to 10, and the models page ranks by the average.
So the numbers measure one-shot building: games, simulations and pages.
They don't measure how well a model writes a refund reply, reads a long email thread or follows a tone guide.
Treat them as a rough signal of overall strength, and test the shortlisted models on your own tickets before you commit.
A simple test: take ten past tickets with known good answers, run them through two shortlisted models in your drafting channel, and have the person who normally replies pick the better draft each time.
That tells you more about support writing than any build score can.
Four Places Hermes Lets You Choose A Model For Support
- Each cron job: the cron docs resolve a job's model as per-job pin first, then
cron.model, then the main model. Pin withhermes cron edit <job_id> --model … --provider …. - Each chat channel:
channel_overridesin the messaging gateway set a model and a system prompt per channel or thread from one gateway. - Each Bot: Bot Mode gives every Bot its own role, model, memory and skills.
- One-off hard prompts: the slash-command reference lists
/moa <prompt>, which runs one prompt through the default Mixture of Agents preset and then restores your model.
That means a support desk can run a lighter model on the sorting job and a stronger one where words reach a customer, without two installs.
The AI Profit Boardroom trainings walk through these pins inside the Agent OS.
The Shortlist, With Live Scores
| Model | Avg score | Tasks | Gold medals | Page read |
|---|---|---|---|---|
| Fusion | 8.59/10 | 47 | 21 | Fusion page |
| Claude Opus 5 | 8.27/10 | 50 | 13 | Opus 5 page |
| Hermes MoA | 8.17/10 | 47 | 3 | Hermes MoA page |
| GPT-5.6 Sol | 8.16/10 | 50 | 2 | GPT-5.6 Sol page |
| Claude Fable 5 | 8.10/10 | 47 | 4 | Fable 5 page |
| Qwen 3.8 | 8.10/10 | 45 | 8 | Qwen 3.8 page |
| Grok | 8.09/10 | 47 | 5 | Grok page |
| MiniMax M3 | 7.97/10 | 47 | 2 | MiniMax M3 page |
| Kimi K3 | 7.89/10 | 50 | 8 | Kimi K3 page |
| GLM-5.2 | 7.77/10 | 47 | 5 | GLM-5.2 page |
| Gemini 3.6 Flash | 7.08/10 | 50 | 1 | Gemini 3.6 Flash page |
All figures are from the GoldieBench models page and the linked model pages as read on 7 November 2026.
The gap between first and seventh is half a point; the gap down to Gemini 3.6 Flash is bigger.
Triage Runs: A Mid-Table Model Is Enough
Sorting mail into five piles is a short, repetitive task with a human reading the result.
That's where I'd pin a model from the middle of the table, such as MiniMax M3 at 7.97 or Kimi K3 at 7.89, to the triage job only.
GoldieBench's Kimi K3 page describes it as tuned for long-horizon agent work with a context window of about one million tokens, which helps when a job reads a whole day of mail.
Pin it with hermes cron edit <job_id> --model … --provider …, and the rest of your setup stays on the main model.
The job runs the bundled himalaya and email-inbox-triage skills from the skills catalog.
The cron docs also let a job pin its own reasoning effort, from none up to ultra, with hermes cron edit <job_id> --reasoning-effort low.
Sorting rarely needs deep thinking, so a low setting on the triage job and a higher one on the weekly report is a sensible split.
Reply Drafts: Put A Top-Tier Model Where Words Reach Customers
Drafts are the part a customer eventually reads, so this is where the top of the table earns its place.
Fusion leads at 8.59 with 21 gold medals across 47 tasks, and Claude Opus 5 follows at 8.27 across 50.
Set the stronger model on your drafting channel with channel_overrides, so every draft written there uses it while the rest of your gateway doesn't.
A person still reads and sends every draft, because Hermes approvals cover risky commands and not outgoing messages, whichever model writes them.
Hard Cases: /moa And The Hermes MoA Score
Some tickets deserve more than one model's opinion: an angry complaint, a disputed charge, a legal-sounding letter.
GoldieBench lists Hermes MoA at 8.17 across 47 tasks, and its page describes a panel of frontier models whose drafts a chair model merges into one answer.
In Hermes, /moa <prompt> runs a single prompt through your default Mixture of Agents preset, then switches back.
Use it on the hard ticket only, keep the output as a draft, and have the owner send it.
Routing Group Chats Without Wasting A Big Model
If your support team runs as a group of Bots, Hermes can pick who answers a message that names nobody.
The Bot Mode docs say that choice is one short model call, and you can route it to a lighter model with auxiliary.group_router.
That keeps your top model for the drafts and away from simple routing decisions.
Bots also escalate judgment calls to a human with @user, which shows a "needs you" badge on the room.
Three Support Setups, Model By Model
A dental clinic
- The triage job runs on Kimi K3 every morning and sorts appointment, insurance and emergency questions.
- Emergencies go straight to the practice manager's Telegram.
- Receptionists draft replies in a Slack channel pinned to Claude Opus 5, then send them from the clinic inbox.
An online shop on Freshdesk
- The community freshdesk plugin reads new tickets on a schedule pinned to MiniMax M3.
- Suggested answers are written as private notes on the main model, Fusion, and each note waits for approval because it's a write tool.
- Staff send the public reply from Freshdesk.
A design agency in Slack
- Client questions come into an internal channel set to GPT-5.6 Sol, which scored 8.16 across 50 tasks.
- Disputed invoices go through
/moafor a second view. - The account manager edits and posts every answer personally.
Safety Doesn't Change With The Model
Swapping in a lighter or stronger model changes nothing about what Hermes is allowed to do.
Dangerous-command rules for cron and webhook sessions live in your config, per the security docs.
So does trust: untrusted for an MCP server like the Intercom entry, which makes every write-capable call ask first.
Members of the AI Profit Boardroom share the exact approval settings they keep on support profiles.
For more on the hosted alternative, see our Grok Bot for customer support model guide.
Also On Our Network
- Agent Operatorsthe 8-step draft-only help desk setup, config blocks included
- AI Income Desksix small-business support jobs and the risks an owner should weigh
- AI Tool Verdictten support jobs scored out of 10, with the reason for each
- agentos.guidefive copy-paste draft-only prompts for a support desk in your Agent OS
- aiprofitboardroom.comthe complete Hermes Agent for Customer Support guide on the AI Profit Boardroom blog
Pin one model to your triage job today, and book a free strategy session if you want help choosing models for Hermes Agent for customer support.
FAQ
Do GoldieBench scores measure support writing?
No. GoldieBench scores one-shot builds of single HTML files, so use the averages as a rough strength signal and test models on your own tickets.
Which model led the GoldieBench models page on 7 November 2026?
Fusion, with an 8.59 average across 47 tasks and 21 gold medals.
Can my triage job use a different model from my reply drafts?
Yes. A cron job can carry its own model pin, and channel_overrides can set a different model for your drafting channel.
Does a stronger model make unattended replies safe?
No. Hermes approvals cover risky commands, not outgoing messages, so keep a person on every customer reply whichever model drafts it.


