Hermes Agent Prompt Caching (2026): Cut Costs With cache_ttl auto

Julian Goldie — founder, AI Profit Boardroom
By Julian Goldie · 8 min read
Get The AI Profit Stack Join AIPB →
🎯 1,000+ done-for-you AI agent workflows 📅 4 live coaching calls every week 🛡️ 7-day refund + 30-day ROI guarantee 👥 3,400+ AI operators inside

Hermes Agent prompt caching just got smarter. In the 19 November 2026 canary and the v0.23.3 release on 20 November, Hermes moved to one prompt-cache controller that keeps the cache warm through long tool runs, trims idle chats before the 1-hour cache runs out, and sets the prompt_caching.cache_ttl setting to auto by default. In plain words: long agent jobs re-read less of your conversation at full price, so they cost less and start replies faster. This guide explains how it works and how to get the most from it.

📺 Watch: Hermes Agent Just Got 10X Faster!

🔥 Get the Agent OS as a free bonus: AI Profit Boardroom members get the full Agent OS zip, prompt libraries, daily tutorials and weekly live coaching calls. → Get inside

What Prompt Caching Is (in Plain English)

Every time Hermes sends a message to an AI model, it sends the whole conversation again: the system prompt, the tool list, every past message and every tool result. On a long task that can be a lot of text, and you pay for all of it each turn.

Prompt caching lets the AI provider remember the start of that conversation for a while. When the next request begins with the same text, the provider reads it from the cache instead of processing it fresh. Cached reads are much cheaper and quicker.

The Hermes docs say prompt caching cuts input token costs by about 75% on multi-turn conversations with Anthropic models. That's the docs' figure for Claude models. Your own savings depend on the model, the provider and how you work.

Want a Hermes setup that is already tuned for cost? Inside the AI Profit Boardroom we share our Agent OS configs and walk through them on weekly live calls.

What Changed in the Hermes Agent Prompt Caching Update

The v0.23.3 release notes list these changes as part of the new prompt-cache lifecycle controller:

The 19 November canary notes add some detail: the cache-expiry compaction summarizes using the conversation's warm prefix, and the warm summary "runs only when cheaper". Large chats also need to grow again before they are re-compacted.

📺 Watch: Hermes Agent OS Can Automate EVERYTHING?! 🤯

How the Cache Setting Works

You control it in config.yaml:

prompt_caching:
  cache_ttl: "auto"

There are three options, according to the docs:

The docs list the machine-paced sources that get 5 minutes under auto: subagents, cron jobs, one-shot runs, webhooks, kanban, API and API server calls, tools, batch jobs and the curator. Side agents such as /background, /btw and /refine also get 5 minutes.

Why does this matter? A 1-hour cache costs more to write than a 5-minute one, but it survives your coffee break. A cron job that fires and finishes fast doesn't need an hour. Auto picks for you, so most people should leave it alone.

How Hermes Keeps the Cache Warm

The developer docs explain the warming logic. Here's the short version:

The goal is simple: only spend money on warming when it saves more than it costs.

We test which models give the best results for the money on Goldie Bench, and our free Agent OS guide shows how we run long Hermes jobs day to day.

📺 Watch: Stop Finding Leads Manually! Use Hermes Agent

Which Models Use It

The docs say prompt caching turns on automatically when the model is an Anthropic Claude model and the provider supports cache markers, such as the native Anthropic API or OpenRouter. Hermes uses a "system_and_3" strategy: one cache marker on the system prompt and a rolling window on the last three messages, inside Anthropic's limit of four markers per request.

The docs also describe how Hermes tracks caches for other providers that cache automatically (it treats those as a 30-minute cache by default), and how Nous Portal can pick which models get cache markers from its model catalog.

Speed and Cost: What You Actually Get

Here's what this means for a normal business user running Hermes:

Want help setting up cron jobs and subagents that use this well? The AI Profit Boardroom has step-by-step tutorials and prompt libraries.

5 Habits That Keep Your Cache Hits High

  1. Don't switch models mid-chat. The docs are clear: caches are tied to the model and account. A /model switch, a fallback to another model or a credential rotation means the next request gets zero cache hits and re-reads the whole chat at full price.
  2. Keep your system prompt stable. Changing it mid-conversation breaks the cache for everything after it.
  3. Use /new for a new topic. A fresh chat is cheaper than dragging a huge old one along.
  4. Leave cache_ttl on auto unless you have a clear reason to pin it.
  5. Update Hermes. These cache changes landed on 19 and 20 November 2026, so older versions won't have them.

How to Check It's Working

The docs mention that when warming is switched off for a route, the /context view shows it as warming_off. Use /context during a long session to see what's going on. If you see warming off a lot, check whether something keeps changing your model or provider mid-chat.

For more on keeping long sessions lean, see our guides on Hermes memory management and the Hermes Agent fallback model. A fallback switch can cost you your cache, so set it up with care.

FAQ

Is Hermes Agent prompt caching on by default?

Yes, for Claude models on providers that support cache markers, such as the Anthropic API and OpenRouter. The cache_ttl setting defaults to auto.

What does cache_ttl auto do?

It picks a 1-hour cache for human-paced chats and a 5-minute cache for machine-paced work such as cron jobs, subagents and webhooks.

How much does prompt caching save?

The Hermes docs say it cuts input token costs by about 75% on multi-turn conversations with Anthropic models. Real savings vary by model and workflow.

Why did my cache stop working?

The most common cause is a model change mid-chat, from a /model switch, a fallback or a credential rotation. Each one starts the cache from zero.

Which version added the new cache controller?

It appeared in the 19 November 2026 canary and is listed in the v0.23.3 release notes from 20 November 2026.

What members say about the AI Profit Boardroom

Read all 114 reviews on Skool →

★ 4.9 out of 5 from 114 member reviews on Skool

Yosuke Sato, AI Profit Boardroom member review (5 stars, paying member for 17 months): The best Skool course you get for AI! I have attended a few Skool courses before, but AI Profit Boardroom is the most active community and has great support from the management team, including Julian! You can get the most up-to-date information and practical implementations in this community. I highly recommend this!Mazzie T, AI Profit Boardroom member review (5 stars, paying member for 10 months): My mind is blown everyday with all the content and the incredible information. So much support and I love the personalised attention and quick responses. The community is great and people are very responsive and helpful.Rene Clayton, AI Profit Boardroom member review (5 stars, paying member for 9 months): The AI Profit Boardroom is a GAME CHANGER people. I could not be more thrilled that I joined!! So much support, more information than you can even consume, a huge value for what the small fee was. I have grown my business, my knowledge and my FUN!. SUCH a fantastic leader and group of humans. I am incredibly honored to be a part of this fantastic group of intelligent humans :-) THANK YOU!Arpiet Malpani, AI Profit Boardroom member review (5 stars, paying member for 8 months): Incredible learning from Julian and team. I started out in march and was able to build end to end SAAS with the help and learning from this group. I am incredibly thankful to Julian for crazy support and prompt response.James Grimm, AI Profit Boardroom member review (5 stars, paying member for 7 months): I asked Julian for help finding local business websites with little to no traffic. Julian was gracious in providing me my personal "how-to" video instruction. Wow, this is the pinnacle of customer service! I am just one of 3,400 subscribers and Julian took the time to help me personally. Thank you Julian for your assistance and outstanding custoemr support and care. James (Jim) GrimmNick Good, AI Profit Boardroom member review (5 stars, paying member for 4 months): I’m part of many AI groups and hands down, what Julian Goldie, has built here…the classroom trainings are amazing, but the community he has created is second to none (the community is worth the cost of joining!). If you’re looking to become the AI expert and build/create something meaningful, then AI Profit Boardroom is for YOU!Steven Gray, AI Profit Boardroom member review (5 stars, paying member for 4 months): Been in awhile. I’m a dad on a factory shift, not a tech bloke. Julian’s lot showed me how to use AI without drowning in tools. Avatar, voice, the workflow thinking — that’s what I needed. If you’re stuck on “where do I start,” this group’s worth it. I always read them.Steve Erickson, AI Profit Boardroom member review (5 stars, paying member for 4 months): I asked Julian a simple question, and he ended up creating a 10-minute video and a guide breaking down in extreme detail what I had asked. Amazing response!Rod Martin, AI Profit Boardroom member review (5 stars, paying member for 3 months): Julian is brilliant, and more prolific than I can keep up with (which is a great thing). His AgentOS is remarkable, and he is THE go-to guy for what you can really do (and not do) with the ever-increasing deluge of new AI upgrades and tools. HIGHLY recommend.Daniel Shulman, AI Profit Boardroom member review (5 stars, paying member for 4 months): Julian is very helpful. He doesn't try sell stuff you dont need and will give you a straight answer to your questions.Rj Herzog, AI Profit Boardroom member review (5 stars, paying member for 5 months): Top notch. If you are searching & searching thinking there is always something better out there.... You just found it. No need to look any further. Goldie covers it all & is super helpful. Can't beat the group either. Really can't recommend this group enough.Jermey Matthews, AI Profit Boardroom member review (5 stars, paying member for 6 months): While he has the capacity to do it, Julian is definitely doing the unscalable things to support his community.

Ready To Join The #1 AI Community?

Join 3,400+ entrepreneurs inside the AI Profit Boardroom. Get the Agent OS, 1,000+ plug-and-play AI agent workflows, daily Q&A with Julian and 4 live coaching calls every week.

Join The AI Profit Boardroom →

7-Day No-Questions Refund • 30-Day ROI Guarantee

← Back to all posts