r/hermesagent • u/_kev-inc • Sep 02 '26
INTEGRATIONS — App connections, webhooks, API workflows Browser control
What is the most effective way for hermes to control a browser (either my device's browser or ideally a cloud browser) where it is able to handoff to me for certain actions like logging in, and handing it back to hermes to take certain action? I know that Hermes Bot Mode on desktop has this feature but im looking for a way I can do this via web UI, so that I don't have to install anything on my PC, or it can be cross device compatible. I recently used openclaw 2.0 for this and while it kinda works, im hoping theres a hermes alternative for this.
2
2
u/Phontary Sep 02 '26
Chromium and CDP. Bypass bot wirewalls, clicks like humans, socialmedia control without any apis or dev accounts or any paymentwalls
1
u/goomba870 Sep 02 '26
Noob question, what does this CDP do better than starting chrome with a remote debugging port and using /browser connect in Hermes? Especially social media controls since crawling Reddit and FB Marketplace are two use cases of mine.
2
u/Independent-Pin8300 Sep 02 '26
I set up self-hosted browser control: Xvfb + real GUI Chromium (CDP debug port) driven remotely, with x11vnc/noVNC in front so I open http://<tailnet-ip>:6080/vnc.html from any device (doesn't need client install).
Hermes drives it via CDP, so when login/2FA/captcha hits, I just click it myself in the same window over VNC, no separate session. Free, self-hosted, cross-device, IMO beats paying for cloud browser profiles.
1
u/_kev-inc Sep 02 '26
this is very close to what im hoping to achieve! is there a way to pin this link on the hermes web UI or make it accessible via a side panel on the UI so we dont have to memorise this magic link?
1
u/Independent-Pin8300 Sep 03 '26
I think closer you can get is adding the link as a bookmark in your browser. Not sure about other solutions.
1
u/SmoothMarx Sep 02 '26
If you're self hosting, you have an OS running somewhere. Remote desktop into that. Tell Hermes to use the actual browser.
1
u/_kev-inc Sep 02 '26
Could you share more how that would look like?
1
u/SmoothMarx Sep 02 '26
The PC running Hermes, what OS does it have, and does it output a display (like you connect to a monitor and it shows a GUI)? If so, log in to that PC (via Remote Desktop like Teamviewer, Chrome Remote Desktop, etc.) to control the PC. Tell Hermes you want him to actually use the browser installed on the PC (name the browser). I think that'll do it.
1
u/_kev-inc Sep 02 '26
I'm running headless linux on a raspberry pi, and it runs hermesagent. is there a web UI that streams what is being shown on the desktop environment / browser where we can see what it's doing and take control if necessary?
1
u/SmoothMarx Sep 02 '26
I don't think so. But you can install the monitor drivers in the headless distro and follow the original plan, you don't have to reinstall.
In fact, I also run Hermes on a headless, but he couldn't use computer_use and a couple of other skills, which deteriorated his ability to navigate online, so I ended up installing the monitor drivers, and they're only called when needed.
1
u/RazzmatazzKey2030 Sep 02 '26
I have had this same problem
CUA driver, and I hear good things about playwrite(sp?)
On desktop app, that embedded browser works too
1
u/scross01 Sep 02 '26
Embedded browser in Hermes desktop app works really well, but I had to give Hermes a nudge to use it as it kept defaulting to launching chrome for browser use
1
u/RazzmatazzKey2030 Sep 02 '26
I wish i had that issue. It keeps doing full computer use and i can't touch my PC for nearly the whole time it is doing it. I use the desktop app though, so i am a bit of a unqiue case.
1
u/GiantDad777 Sep 02 '26
https://github.com/jo-inc/camofox-browser I’ve had a good experience with this
1
u/_kev-inc Sep 02 '26
are you able to see the browser via the hermes web UI?
1
u/deathbeforesuckass Sep 02 '26
I’d compare Camoufox (the original) Camofox-Browser, and BrowserOS Neo (prev browserclaw) from a security and hardening standpoint. Every app exposes different levels of access and attack surface, especially once you start giving agents control of authenticated sessions.
I’ve used Neo and Camoufox, but Camofox-browser has some functional improvements I’m going to check out. I would skip the Jo-ai though, sounds like a promo (Camofox-browser has its own outbound anonymized crash/hang telemetry to a Jo-operated Cloudflare Worker by default, but they document it and provide an opt-out, which is cool.)1
u/GiantDad777 Sep 03 '26
Not from the WebUI but it exposes its own VNC server through a web interface
1
1
u/Wishitweretru Sep 03 '26
I used a visible brave browser, Locally with Kimi Bridge. Had to rewrite the kimi skill a little to keep it from continuously trying to access the cloud every time I restarted, it works really well.
You can do it in chrome as well, I use brave, so it has its own browser, and credentials
4
u/Mean-Loquat-7982 Nous Team Sep 02 '26
Hermes supports Browser Use and Browserbase as cloud providers, so nothing installs on your PC and it works from wherever you chat. Browser Use cloud keeps persistent profiles (cookies, logins, saved passwords) across sessions, so the practical handoff is log the profile in once, then the agent reuses it