GoldieBench Blog · 10 min read
Hermes Agent OS GitHub: Install Herald OS, Then Pick A Brain With Real Benchmark Scores
Hermes Agent OS GitHub repo (Herald OS) explained, plus the best model to connect: real GoldieBench scores for Claude, GPT-5.6, Kimi and free picks.

The Hermes Agent OS GitHub repo is github.com/iamlukethedev/Herald-OS, and it holds Herald OS, a free, open-source operating system that uses Hermes Agent as its interface.
Herald OS was built by Luke The Dev as an independent project, and it is not affiliated with Nous Research, the team that publishes Hermes Agent.
The code is released under the MIT licence, so you can download it, read every line and run it without paying for the software.
The problem it solves is simple, because instead of driving Hermes from a terminal, you get a clean desktop where you talk or type to one agent that works across your whole machine.
Every download lives on the repo's releases page, and the README walks through a route for a Mac, a spare PC, Arch, Omarchy, other Linux and a virtual machine.
In this post I will show you what is in the repo, how it works, how to install it, what every screen does and where it still falls short.
What is in the Hermes Agent OS GitHub repo?
Herald OS describes itself as an agent-native operating system, with Hermes Agent as the interface.
You talk or type to Hermes, and it works across the whole machine, asking before it changes anything.
These are the facts I checked in the repo and the GitHub API on 8 October 2026.
| Item | Detail |
|---|---|
| Repo | github.com/iamlukethedev/Herald-OS, with every download on its releases page |
| Author | Luke The Dev, as an independent project |
| Affiliation | Not affiliated with Nous Research, which publishes Hermes Agent separately at github.com/NousResearch/hermes-agent |
| Licence | MIT, with Hermes Agent also MIT |
| Status | Alpha (0.1), with v0.1.0-alpha.1 published on 6 October 2026 |
| Popularity | 155 stars and 20 forks when I checked |
| Platforms | macOS 13 or later on Apple Silicon, Herald OS Linux for PCs, Arch, Omarchy, other Linux and a virtual machine |
| How it uses Hermes | It runs your normal Hermes install and adds a plugin called herald-os-bridge, without forking Hermes |
One naming note is worth a line here.
Nous Research codenamed Hermes Agent v0.20 the Herald Release, but Herald OS is a separate project that simply runs on Hermes.
How Herald OS works on top of Hermes
Hermes Agent is the part that thinks and acts, and Herald OS is the desktop you use to talk to it.
Herald OS does not fork Hermes, so your existing Hermes setup carries straight over.
On its first start, it links the herald-os-bridge plugin into your Hermes plugins folder and switches its tools on.
That plugin gives Hermes system tools for system info, processes, disk usage, file search, opening apps, and moving and trashing files.
Each tool has a permission tier, so reading and opening things runs straight away, changing files asks first, and trashing files or stopping a program asks every time.
Some locations, such as your SSH keys, your keychains and Hermes's own credentials, are always refused, and Settings shows the audit log of what Hermes did.
Because Herald OS sits on your one Hermes install, my automations showed up in Herald OS, Hermes Desktop and my Agent OS at the same time.
How to install Herald OS from GitHub
Every route starts with Hermes Agent and a model provider.
curl -fsSL https://hermes-agent.nousresearch.com/install.sh | bash
source ~/.zshrc
hermes setup
The hermes setup step signs you in to a provider, and I cover which brain to pick further down this post.
Then pick the route that matches your machine.
| Machine | Route |
|---|---|
| Apple Silicon Mac | Drag the mac-arm64 DMG to Applications, then run xattr -dr com.apple.quarantine "/Applications/Herald OS.app", because the alpha build is not notarized yet. |
| A spare PC | Join the two ISO parts with cat, write the ISO to an 8 GB USB stick, and install Herald OS Linux on Fedora. |
| Arch Linux | Run makepkg -si in packaging/arch/herald-os-bin, then herald-os setup. |
| Omarchy | Install the Arch package, then run herald-os omarchy install. |
| Other Linux | Unpack the tarball to /opt/herald-os, then run herald-os setup and herald-os-app. |
| Virtual machine | Run brew install qemu zstd, clone the repo and run bash linux/vm/try.sh. |
I took the easy road and asked Claude to set it up for me, and it was done in about two minutes.
To change the brain later, run hermes model, or open Settings inside Herald OS.
To update on Linux, run herald-os update, and herald-os rollback takes you back.
A tour of what Herald OS can do
The dashboard says "Good morning, Julian. Your day already in motion", with voice input, today's schedule and what needs attention.
"Pick up where you left off" suggests where to continue from your recent documents, projects, chats and calendar events, and you can toggle it.
Recent screenshots from your desktop appear on the dashboard too.
The chat is normal Hermes chat with Preview and Sources, plus a new conversation button.
Spaces split work into Ideas, Work and Personal, and you can add a space per client and set a default.
Missions let Hermes plan a goal step by step, such as building out a new website.
Memory shows everything Hermes remembers, including my Telegram details, so be careful when screen-sharing.
Files covers recent, favourites, projects, downloads, shared and deleted.
Automations synced across Herald OS, Hermes Desktop and my Agent OS, including a 6am to-do recap, Japanese lessons and inbox triage.
Settings cover runtimes including Docker, background agents, remember preferences, auto-approve, activity history, fullscreen, default space and folder, do not disturb, stay awake, screen saver, dictation, themes, software access for Claude Code, Codex and LM Studio, plugins from a GitHub link, a Hermes Agent section, usage, voice engines and speeds, privacy, notifications, networks, storage and accessibility.
The Usage page in Settings shows tokens used, your plan and your token balance, and the README says it warns you when you reach 90% of your model plan.
My free Hermes Agent OS guide covers running the whole thing without paying for software.
Limits to know before you install
Herald OS is alpha software, so keep backups of anything you let an agent touch and keep approvals on.
The sidebar resizes, but the top of the interface was cut off slightly on my screen.
Connections did not sync for me, which is fair for an alpha, but it means you should not rely on them yet.
The Mac build is not notarized, so only download it from the official releases page.
Reporting issues on the Herald OS repo
Bugs go in the repo's Issues tab, with what happened, steps, platform, versions and logs.
Problems with models and providers belong on the Nous Research hermes-agent repo instead, because that is where the model plumbing lives.
Security problems go privately through the repo's Security tab.
Which brain to connect to Herald OS
Herald OS does not come with its own model, because it uses whichever model your Hermes install is set up with.
That one choice decides how smart your new operating system feels and how much it costs you to run.
To compare the options fairly, I use GoldieBench, the leaderboard where I score models on real one-shot builds.
What GoldieBench can and cannot tell you about Herald OS
I want to be straight about this before we look at numbers.
GoldieBench gives every model the same one-shot prompt to build a game, a page, a simulation or a visual, then scores the rendered result from 0 to 10.
Herald OS asks a model to do something different, which is to act as an agent through many tool calls across your whole computer.
So a GoldieBench score measures raw building ability, not how well a model runs inside Herald OS.
Herald OS itself is not a model, so it is not on the board, and I am not going to pretend otherwise.
What the board does give you is a fair, same-prompt comparison of the brains Hermes lets you connect.
The brains Herald OS can use, matched to real GoldieBench scores
The README lists the providers Hermes supports, including Nous Portal, OpenRouter, OpenAI, Anthropic and local models.
Here is how the main models behind those providers score on the live board.
| Provider in Hermes | Model on GoldieBench | Avg score | Tasks scored | Listed price |
|---|---|---|---|---|
| OpenRouter | Fusion | 8.59 | 47 | OpenRouter Fusion API pricing |
| Anthropic | Claude Opus 5 | 8.27 | 50 | $5 / $25 per M |
| OpenRouter, through Hermes | Hermes MoA | 8.17 | 47 | Panel and aggregator calls via OpenRouter |
| OpenAI | GPT-5.6 Sol | 8.16 | 50 | $5 / $30 per M |
| OpenRouter | MiniMax M3 | 7.97 | 47 | $0.30 / 1M input, $1.50 / 1M output |
| OpenRouter | Kimi K3 | 7.89 | 50 | $3 / M in |
| OpenRouter | GLM-5.2 | 7.77 | 47 | Open weights, free for individuals |
| Anthropic | Claude Opus 5.5 | 7.57 | 50 | $4 / $20 per M |
| OpenRouter | Muse Spark 1.2 | 7.55 | 50 | $1.25 in / $4.25 out per 1M |
| Anthropic | Claude Sonnet 5 | 7.01 | 47 | $3 / $15 per M |
Hermes MoA deserves a special mention, because it is Hermes Agent's own Mixture of Agents mode.
It scored 8.17 across 47 tasks, which shows Hermes itself can sit near the top of the board when you give it strong brains to combine.
The Claude Opus 5 vs GPT-5.6 Sol head-to-head is worth a look if you are torn between the two biggest names.
The model I actually had plugged in
In my Herald OS settings, the preferred model was GPT-6 Astra, which I had connected through a CLI.
GPT-6 Astra is not on GoldieBench yet, so I cannot give you a score for it.
That is the honest answer, and I would rather leave a gap than invent a number.
If you want a benched choice from the same family, GPT-5.6 Sol averages 8.16 across all 50 tasks.
The best brain for each part of Herald OS
Herald OS has several jobs inside it, and they do not all need the same brain.
Hermes lets you set up profiles, so you can match the brain to the job.
| Herald OS feature | What the brain does there | Brain I would try first | Why |
|---|---|---|---|
| Missions | Plans a big goal, such as building out a new website, step by step | Claude Opus 5 (8.27) or GPT-5.6 Sol (8.16) | These are the two strongest single models on the board. |
| Studio builds | Writes the code and shows a live preview | Claude Opus 5 (8.27) | GoldieBench is a build test, and this is where its score matters most. |
| Automations | Runs routines like a 6am to-do recap or inbox triage | MiniMax M3 (7.97) | It scores close to the leaders at a fraction of the input price. |
| Chat and Sources | Reads your files and answers questions | Kimi K3 (7.89) | It has a 1M context window for long documents. |
| Pick up where you left off | Writes short suggestions from names and dates | Claude Sonnet 5 (7.01) | It is a cheaper Claude for light, frequent work. |
| Private work | Anything that must stay offline | A local model | It is free and private, but much weaker, as the next section shows. |
Automations matter most for your bill, because they run every day whether you are watching or not.
Free and local brains for Herald OS
Herald OS itself is free, and you can keep the model free as well.
Settings has a software access section where you can add local models such as LM Studio, and Hermes supports local providers.
Here is what the local models board says about the free options I have benched.
| Free or local model | Avg score | Tasks scored | How it runs |
|---|---|---|---|
| Qwable 5 27B Coder | 7.14 | 41 | It runs locally through MLX only. |
| Agents-A1 | 4.83 | 45 | It is an agent-tuned open model that runs free on a Mac. |
| Gemma 4 12B (MLX) | 3.98 | 42 | It runs free on the MLX path. |
| Laguna XS 2.1 | 3.93 | 42 | It has a free tier on OpenRouter. |
| Qwythos 9B | 2.98 | 42 | It is a small local model with a low build score. |
There is also LongCat-2.0, which scored 8.12, but only across 4 tasks, so the board marks it provisional.
The gap is the real story.
The best free local builder scores 7.14, the next one down scores 4.83, and the cloud leaders sit above 8.
If you want my full ranking of local brains for Hermes, read the best local model for Hermes Agent.
What each brain costs you inside Herald OS
Herald OS shows you the bill on its Usage page, which I really like.
Here is how the list prices compare against the scores.
| Model | List price | Avg score |
|---|---|---|
| MiniMax M3 | $0.30 / 1M input, $1.50 / 1M output | 7.97 |
| Muse Spark 1.2 | $1.25 in / $4.25 out per 1M | 7.55 |
| Gemini 3.6 Flash | $1.50 / M input | 7.08 |
| Claude Sonnet 5 | $3 / $15 per M | 7.01 |
| Claude Opus 5.5 | $4 / $20 per M | 7.57 |
| Claude Opus 5 | $5 / $25 per M | 8.27 |
| GPT-5.6 Sol | $5 / $30 per M | 8.16 |
MiniMax M3 is the value stand-out, because it sits about three tenths of a point behind Claude Opus 5 at a far lower input price.
Settings also lets you set how many background agents run, and fewer agents means a smaller bill.
My honest verdict on Herald OS and its brains
Herald OS is super clean, it synced with my existing Hermes setup quickly, and I think it looks nicer than Hermes Desktop.
It is alpha, so keep backups and keep approvals on.
If you already pay for Claude or ChatGPT, connect that first, because the board puts Claude Opus 5 at 8.27 and GPT-5.6 Sol at 8.16.
If you are choosing on value, MiniMax M3 at 7.97 is the one I would test first for daily automations.
Also On Our Network
- Agent Operatorsevery Herald OS install route with the real commands
- AI Income Desksix ways a business can use the Herald OS repo
- AI Tool Verdictmy scored review of Herald OS
- agentos.guidefitting Herald OS into an Agent OS workflow
- agentos.guidewhat the Hermes v0.20 Herald Release changed
Install Herald OS, connect the brain the board backs for each job, and you will get the most out of the Hermes Agent OS GitHub repo.
FAQ
Where is the Hermes Agent OS GitHub repo?
Herald OS is at github.com/iamlukethedev/Herald-OS, published by Luke The Dev under the MIT License. It is not affiliated with Nous Research, whose Hermes Agent repo is github.com/NousResearch/hermes-agent.
Does Herald OS come with its own model?
No. Herald OS runs on your normal Hermes Agent install, so it uses whichever model Hermes is set up with, such as a Nous Portal model, an OpenRouter, OpenAI or Anthropic key, or a local model. You change it with hermes model or in Settings.
What is the best model to connect to Herald OS?
On GoldieBench, the strongest single brains Hermes can connect are Claude Opus 5 (8.27) and GPT-5.6 Sol (8.16). Hermes MoA, Hermes Agent's own Mixture of Agents mode, scored 8.17.
What is the best value model for Herald OS?
MiniMax M3 averages 7.97 on GoldieBench at $0.30 per million input tokens and $1.50 per million output tokens, which makes it a strong pick for daily automations.
Can Herald OS run on a free local model?
Yes. Hermes supports local providers, and Herald OS lists LM Studio under software access. Benched local options score well below the cloud leaders, with Qwable 5 27B at 7.14 and Agents-A1 at 4.83.
Is Herald OS on the GoldieBench leaderboard?
No. GoldieBench scores models on one-shot builds, and Herald OS is an operating system rather than a model. The scores show which brain to connect, not how Herald OS performs.


