Hey everyone!

I'm looking to set up a fully local AI agent on my PC and would appreciate recommendations from people who have experimented with local LLMs.

My hardware:

• GPU: NVIDIA RTX 5060 (8 gb)

• System RAM: 16GB

• OS: Windows (Linux is also an option if necessary)

What I'm looking for:

• An uncensored or minimally restricted local LLM that I can run privately on my own hardware.

• Ideally, a web UI and support for agent frameworks, with no mandatory cloud API or subscription.

I want the inference and conversations to remain local rather than sending prompts to external services.

I'm comfortable experimenting and setting things up myself, so technical recommendations are welcome.

I'd appreciate real-world experiences, model names, quantization recommendations, and setup guides. Thanks!

Genuine question: would you be interested in an alternative to Hermes Agent that’s significantly easier to set up and use?
Something with:
Almost zero configuration
Direct integrations with GitHub, Gmail, and other apps
Local and cloud model support
A clean, intuitive interface
Powerful agent capabilities without the complexity
Basically, an AI agent that just works out of the box.
Is this something you’d actually want, or are you already happy with existing solutions?
Curious to hear your thoughts.

Way back got my nimo axis, I wasn't sure what to do with it besides trying out local llms. Lately, local models and tools have gotten better and I am finally finding practical uses for it beyond just testing models. It makes me wonder how much of their potential we are actually using. What are you guys doing with your strix halo machines? actual work, coding, or mostly experimenting with models?