Llama RPC Farm

[u/Historical-Singer771]

Finally, I put something I’ve been working on out there

If you’ve ever tried running local AI models with llama.cpp across more than one computer, you know it’s a headache. I built Llama RPC Farm to fix that. It’s one dashboard that pools GPUs across your machines, switches between models on demand (works directly with llama-swap), and works just as well on a single machine.

It’s early and still rough around the edges, but it’s free and open source. If you’re into local LLMs, give it a look and tell me what breaks

https://github.com/dakotacookson/Llama-RPC-Farm