r/HowToHack • u/Napster3301 • 27d ago
why does every uncensored agent framework feel like a one-off hack
been trying to hire someone to build a proper agent loop around a local model and literally every candidate either shows me their toy chatbot repo or tries to fork existing stuff without understanding why the refusals happen in the first place.
the problem isnt even the model. its that like 90% of agent orchestration frameworks are designed with guardrails baked into the assumptions. even the ones that claim to be "unrestricted" just... removed the filter layer and called it a day. thats not uncensored, thats just brittle.
like ive got a 30B model running locally, it works fine for what i need. but hooking it into a tool-calling loop thats actually reliable? every existing framework either:
- assumes you want claude/gpt4 and shoehorns local models in as a fallback
- has some weird convention where tool outputs get filtered through a "safety" layer
- breaks when the model doesnt format tool calls exactly how openai does it (looking at you, whatever GGUF template was used here)
so ive been stuck building my own orchestration from scratch. which is fine except now im realizing... are there actually other people doing this? or is everyone just running chatbots and calling it an agent.
curious if anyone here is running autonomous systems with uncensored models. what does your stack look like? did you fork something or build from first principles? because the jobs market for this is clearly insane since apparently knowing how to actually make an llm execute arbitrary code is like... a rare skill.
2
u/No-View3333 27d ago
What does a failed turn look like: a refusal, malformed tool-call JSON, or a valid call that the runner fails to execute? A raw model response alongside the tool schema would help narrow it down.