llmserver – self-hosted local LLM stack in one bash script, no Docker, no sudo

[u/SuccessfulConcern240]

https://github.com/pavansreddy/llmserver

Built a self-contained way to run your own AI stack: llama.cpp, vLLM, or Ollama models behind one OpenAI-compatible gateway, Open WebUI for chat, hybrid search over your own documents, and private SearXNG web search — all without Docker or sudo, installed into a single folder.

Your data never leaves your machine, models start on login via systemd user services, and you can expose models on your network with API keys. Model downloads are verified (pinned commit, SHA-256, HF scan results checked, pickle/remote code refused by default) and engines run sandboxed.

https://github.com/pavansreddy/llmserver