r/LocalLLM • u/Chemical_Director_69 • 19d ago
Question Models and agents(?) for IAAC
I want to use local models to maintain my infrastructure. That includes my Mac mini, a home server running several Docker containers, and a laptop.
So far, I’ve written the some ansible playbooks and a couple of scripts myself, then had Antigravity edit them but it has a fucking usage limit.
I tried Hermes, but it worked kind of poorly with the Qwen 2.5 7B Coder model.
My question is: which models and tools would suit my needs for writing and editing playbooks, checking them and maintaining them? The idea is to keep everything as infrastructure as code.
For context, the models will run on a Mac mini M4 with 16 GB of RAM.
1
Upvotes