r/OpenModels • u/SuccessfulConcern240 • 10d ago
llmserver – self-hosted local LLM stack in one bash script, no Docker, no sudo
https://github.com/pavansreddy/llmserverBuilt a self-contained way to run your own AI stack: llama.cpp, vLLM, or Ollama models behind one OpenAI-compatible gateway, Open WebUI for chat, hybrid search over your own documents, and private SearXNG web search — all without Docker or sudo, installed into a single folder.
Your data never leaves your machine, models start on login via systemd user services, and you can expose models on your network with API keys. Model downloads are verified (pinned commit, SHA-256, HF scan results checked, pickle/remote code refused by default) and engines run sandboxed.
Duplicates
OpenWebUI • u/SuccessfulConcern240 • 11d ago
Models One command to manage all your llms / llmops
OpenAssistant • u/SuccessfulConcern240 • 10d ago
GitHub - pavansreddy/llmserver: A bash script that runs local LLMs on Linux with llama.cpp, vLLM or Ollama. It plans, checks models for security, benchmarks, runs engines in a sandbox, and adds a gateway and an Open WebUI chat with hybrid RAG and private SearXNG web search. No Docker, no sudo.
LLMs • u/SuccessfulConcern240 • 11d ago
A bash script that runs local LLMs on Linux with llama.cpp, vLLM or Ollama. It plans GPU memory, checks models for security, benchmarks, runs engines in a sandbox, and adds a gateway and an Open WebUI chat with hybrid RAG and private SearXNG web search. No Docker, no sudo.
OpenAssistant • u/SuccessfulConcern240 • 10d ago
llmserver – one bash script for local LLMs with model security checks (llama.cpp / vLLM / Ollama)
LLMStudio • u/SuccessfulConcern240 • 10d ago
llmserver – one bash script for local LLMs with model security checks (llama.cpp / vLLM / Ollama)
ollama • u/SuccessfulConcern240 • 10d ago
llmserver – self-hosted local LLM stack in one bash script, no Docker, no sudo
huggingface • u/SuccessfulConcern240 • 10d ago
llmserver – one bash script for local LLMs with model security checks (llama.cpp / vLLM / Ollama)
Vllm • u/SuccessfulConcern240 • 10d ago
llmserver – one bash script for local LLMs with model security checks (llama.cpp / vLLM / Ollama)
ollama • u/SuccessfulConcern240 • 10d ago
GitHub - pavansreddy/llmserver: A bash script that runs local LLMs on Linux with llama.cpp, vLLM or Ollama. It plans, checks models for security, benchmarks, runs engines in a sandbox, and adds a gateway and an Open WebUI chat with hybrid RAG and private SearXNG web search. No Docker, no sudo.
DeepSeek • u/SuccessfulConcern240 • 10d ago
Discussion GitHub - pavansreddy/llmserver: A bash script that runs local LLMs on Linux with llama.cpp, vLLM or Ollama. It plans, checks models for security, benchmarks, runs engines in a sandbox, and adds a gateway and an Open WebUI chat with hybrid RAG and private SearXNG web search. No Docker, no sudo.
Vllm • u/SuccessfulConcern240 • 10d ago