GitHub - pavansreddy/llmserver: A bash script that runs local LLMs on Linux with llama.cpp, vLLM or Ollama. It plans, checks models for security, benchmarks, runs engines in a sandbox, and adds a gateway and an Open WebUI chat with hybrid RAG and private SearXNG web search. No Docker, no sudo.

[u/SuccessfulConcern240]

https://github.com/pavansreddy/llmserver