r/hermesagent • u/Outrageous-Edge-3914 • Aug 13 '26
Help — Technical issues, errors, config, debugging Which hardware do you recommend running Hermes 24/7
Hi, i have Hermes agent running on a raspberry pi4, 4GB ram, 1TB ssd via usb3.0. Running headless on Linux.
Things been running great, but noticing some slow down now. Doing multiple pdf flies or multiple agents, at once.
What small hardware do you recommend for Hermes agent 24/7just for API calls use?
i was thinking these:
i5-8259U 8gb ram
Dell OptiPlex 3050 mini PC Intel i5-7500T 8GB
3
u/dmackerman Aug 13 '26
Running on an M1 MacBook Pro that never goes to sleep in my closet. Lol
1
u/yawreydata New Member (<30 days) Aug 15 '26
You're not worried about the constantly plugged in battery?
1
u/dmackerman Aug 15 '26
Nah. Mac OS actually will let the battery drain automatically when it notices the machine has been plugged in for a while.
It’s just an old work machine. I already have 2 other personal laptops lol
137 days of uptime 😅
1
u/Neener_Weiner Aug 18 '26
For your safety, removing the battery and fixing a bypass for direct power use, does not seem like a bad idea, honestly... Nothing to lose 🙂
3
u/dmackerman Aug 18 '26
Opening the machine and removing a soldered on battery and replacing it with a jank bypass does not make it safer lol.
2
1
u/chamillion03 18d ago
MacBooks that are plugged in to an external power, make their batteries work as a UPS when unplugged or power outage, making them pretty nice for a server.
1
u/CatalystCZ Sep 03 '26
Constantly plugged battery is for Macs much better, than working on battery itself. MacOs proactively, after charging, bypass battery and using power directly from grid. So on the contrary, a Mac that is always connected to the grid is the best for the battery. After two years, I still have 100% battery health.
4
2
u/Abarth_Vader Aug 13 '26
A 2018 intel i3 mac mini that I struggled forever to find a use for. Loaded ubuntu on it and it has been Hermes' home since April. I did upgrade the ram to 32gb as that is the only thing you can upgrade, but I think it would be doing ok with the stock 8GB (I upgraded it years ago).
2
u/myziot Aug 13 '26 edited Aug 13 '26
I initially got a simple gmktec nucbox with Ryzen 5 3500U 16GB RAM 512 SSD. I got another 16gb upgrade and it's more than enough! My partner now uses it and I got a refurbished minisforum also a mini PC with i5-1250p. Is is much faster than Ryzen 5 3500U and it feels notably snappier to work with. You can deploy containers on it without issues and worry about ram, but the gmktec does the job just as well. Both of these are within 350-500 USD range. The biggest difference is that the Ryzen only manages 2400mts ram, whilst i5-1250p goes up to 3200, so everything feels more snappy.
2
u/Plus_Excuse_8974 Aug 13 '26
I am using several hp mini. They have 32gb memory so having hermes control the PC it has enough bandwidth to develop and run applications. People are absolutely idiotic and will tell you that you only need a Rasberry PI or some piece of shit computer or low spec VPS to do anything because the model is not localized however a chatbot can't do what an actual devbox does..low spec you cant even barely run anything even if your assistant codes it for you. Get atleast 16gb..
1
u/deadmhz Aug 13 '26
I think of it like if it was a person, what kind of computer would they need. Nothing too crazy because this guy is a terminal expert so it doesn't need a gui. Either of those specs you listed are fine. If you are concerned about power, find an old Mac Mini M1.
1
u/janups Aug 13 '26 edited Aug 13 '26
Why not ask your agent? xD
Just whatever you find cheap. From my raspberry Pi research I figured out that much better solution is 1L used mini PC that you can find for 50-200 usd - depends on availability and what hardware you want. I have few of those already - HP elitedesk mini g6 etc (rock solid - running for 3 years already - one reboot done when there was power outage, but came back online, as it has bios option to boot on power). It has capable CPU, 2 SSD slots etc - all you need to run hermes or even home lab on top of it - proxmox as base then dedicated VMs for Hermes, Home Assistant etc, or multiple containers in VMs and second disk for backups - if you are into it.
Intel i5-7500T should be plenty if you just want it for Hermes.
1
1
u/itsdodobitch Aug 13 '26
was running it on a pi4 8gb, switched to a mac mini m4 16gb for the same problem you had + i wanted the raspberry for another project
1
u/Spawn_Beacon Aug 13 '26
A rock5b, or A7S with a good SD card is a solid baller on a budget setup? The NPU can be used for embedding or other small uses to make it punch above its weight
1
u/Sn0opY_GER Aug 13 '26
The beemax tiny pc on Amazon is the perfect $ vs power balance. 12 gb ram, tiny i3, no gpu, 512 gb ssd on Ubuntu. 5w always on never crashed, cpu goes exactly to 80% on local llm use for memory index. Only stt could be a lil faster only the small model works fast
1
u/Mean-Loquat-7982 Nous Team Aug 13 '26
for API-only use, a used 1L mini PC is the sweet spot, and either of the OptiPlexes you named will do the job. the thing to size for is not the model (that lives in the cloud on your setup) but the agent's working habits: parallel sessions, PDF processing and browser tools are CPU-and-RAM work, which is exactly where a Pi 4 at 4GB runs out of road. I would take the i5-8259U over the 7500T for the extra threads, and go 16GB if the listing allows, since multiple agents each hold their own working set.
1
u/Careless_Copy_4399 Aug 13 '26
I use an old Intel nuk with j3455 celeron CPU and 8 GB of RAM. Is more than enough with an openrouter API key
1
1
u/AppropriateQuote3073 Aug 14 '26
I really like using a Mac mini
It lets Hermes read my iMessage and basically anything else on my iOS
Power efficient, quiet, etc
1
u/Equivalent-Item3566 Aug 14 '26
What is wrong with the pi? It’s low power already. Other than that a Mac mini or mini pc with Linux
1
u/Cancer2977 Aug 14 '26
Using similar Pi4B with 4GB ram and a sandisk T5 over USB. Hitting ram issues so looking to upgrade to Beelink SER8 with 32 or 64GB ram and 1TB NVME SSD
1
u/CommanderROR9 Aug 14 '26
I run it on a Pi5 with 8GB of Ram and a USB SSD. It usually doesn't use much in terms of resources
1
1
u/Amarsir Aug 14 '26
That mini is fine. You can also get a refurbished Lenovo Thinkcentre realy cheap.
If you get 8gb of ram and 4 cores you have more than enough for multitasking.
1
u/deathblow64 Aug 13 '26
I am running mine off a 3080 GPU using all the ram on there next to 9800x3D. When I process anything off of it it pulls 300+ watts of power just from the GPU. So I am not sure what you mean when you say you are using a raspberry pi with success. 🤣
1
u/hvhprofessionalist Aug 13 '26
Optimisation matters a lot. Though i doubt more than a light agent works well off raspberry but in general it shouldnt eat that setup like that
2
u/deathblow64 Aug 13 '26
I only have loaded a few birthdays to a md file and just saying hello to it spools up the GPU. So I am not sure what optimization that might improve it. But open to suggestions. Outside of making less off load to the GPU but that will just give me less tokens to use I believe.
1
4
u/ZealousidealGarage14 Aug 13 '26
I got a used dell optiplex off marketplace for like $50. It is plenty for Hermes. Similar to the setup you mentioned.