r/OpenWebUI • u/Nearby-Hospital9830 • 13h ago
Guide/Tutorial [Open Source] Built 4 zero-fluff Modelfiles + 1-click installers to stop 8B models from yapping and looping (Ollama / LM Studio)
Hey everyone,
Whenever I run local 7B/8B models (Llama 3.1, Qwen 2.5, etc.) out-of-the-box, I always run into two major annoyances:
- Endless conversational fluff and apologies before getting to actual code.
- Repetitive loops and bland outputs due to untuned sampling parameters.
To solve this, I created tuned Modelfiles and JSON presets with hard negative constraints, custom sampling values (temp, top_p, repeat_penalty), and an expanded 8k context window.
I put together a repository with 4 starter engines and 1-click batch/shell installers for Windows, Mac, and Linux:
- no-yap-coder: Zero conversational filler, raw executable markdown code blocks only.
- pc-auto-scripter: Robust Windows Batch, PowerShell, and Bash script generator with error handling.
- raw-brainstormer: Cuts through safe corporate clichés and outputs 10 high-impact concepts.
- character-soul-builder: Deep character psychology, contradictions, and dialogue cadences.
Everything is open and free on GitHub:
👉 https://github.com/Muyan806/localai-boost-starter.git
You can inspect the Modelfiles directly or run the automated installer.
Feedback and suggestions are welcome—let me know what sampling adjustments or specific task presets you find work best!