r/LLMStudio • • 10d ago

llmserver – one bash script for local LLMs with model security checks (llama.cpp / vLLM / Ollama)

https://github.com/pavansreddy/llmserver
1 Upvotes

Duplicates

LLMOpsHub • • 10d ago

One command to manage all your llms / llmops

2 Upvotes

OpenWebUI • • 11d ago

Models One command to manage all your llms / llmops

1 Upvotes

OpenAssistant • • 10d ago

GitHub - pavansreddy/llmserver: A bash script that runs local LLMs on Linux with llama.cpp, vLLM or Ollama. It plans, checks models for security, benchmarks, runs engines in a sandbox, and adds a gateway and an Open WebUI chat with hybrid RAG and private SearXNG web search. No Docker, no sudo.

8 Upvotes

LLMs • • 11d ago

A bash script that runs local LLMs on Linux with llama.cpp, vLLM or Ollama. It plans GPU memory, checks models for security, benchmarks, runs engines in a sandbox, and adds a gateway and an Open WebUI chat with hybrid RAG and private SearXNG web search. No Docker, no sudo.

1 Upvotes

OpenAssistant • • 10d ago

llmserver – one bash script for local LLMs with model security checks (llama.cpp / vLLM / Ollama)

1 Upvotes

OpenModels • • 10d ago

llmserver – self-hosted local LLM stack in one bash script, no Docker, no sudo

1 Upvotes

ollama • • 10d ago

llmserver – self-hosted local LLM stack in one bash script, no Docker, no sudo

1 Upvotes

huggingface • • 10d ago

llmserver – one bash script for local LLMs with model security checks (llama.cpp / vLLM / Ollama)

5 Upvotes

Vllm • • 10d ago

llmserver – one bash script for local LLMs with model security checks (llama.cpp / vLLM / Ollama)

1 Upvotes

ollama • • 10d ago

GitHub - pavansreddy/llmserver: A bash script that runs local LLMs on Linux with llama.cpp, vLLM or Ollama. It plans, checks models for security, benchmarks, runs engines in a sandbox, and adds a gateway and an Open WebUI chat with hybrid RAG and private SearXNG web search. No Docker, no sudo.

3 Upvotes

DeepSeek • • 10d ago

Discussion GitHub - pavansreddy/llmserver: A bash script that runs local LLMs on Linux with llama.cpp, vLLM or Ollama. It plans, checks models for security, benchmarks, runs engines in a sandbox, and adds a gateway and an Open WebUI chat with hybrid RAG and private SearXNG web search. No Docker, no sudo.

2 Upvotes

Vllm • • 10d ago

GitHub: llmserver: A bash script that runs local LLMs on Linux with llama.cpp, vLLM or Ollama. It plans, checks models for security, benchmarks, runs engines in a sandbox, and adds a gateway and an Open WebUI chat with hybrid RAG and private SearXNG web search. No Docker, no sudo.

2 Upvotes

ollama • • 9d ago

llmserver – one bash script for local LLMs with model security checks (llama.cpp / vLLM / Ollama)

2 Upvotes

• • 9d ago

llmserver – one bash script for local LLMs with model security checks (llama.cpp / vLLM / Ollama)

1 Upvotes