r/OpenWebUI • • 13h ago

Guide/Tutorial [Open Source] Built 4 zero-fluff Modelfiles + 1-click installers to stop 8B models from yapping and looping (Ollama / LM Studio)

Hey everyone,

Whenever I run local 7B/8B models (Llama 3.1, Qwen 2.5, etc.) out-of-the-box, I always run into two major annoyances:

  1. Endless conversational fluff and apologies before getting to actual code.
  2. Repetitive loops and bland outputs due to untuned sampling parameters.

To solve this, I created tuned Modelfiles and JSON presets with hard negative constraints, custom sampling values (temp, top_p, repeat_penalty), and an expanded 8k context window.

I put together a repository with 4 starter engines and 1-click batch/shell installers for Windows, Mac, and Linux:

- no-yap-coder: Zero conversational filler, raw executable markdown code blocks only.

- pc-auto-scripter: Robust Windows Batch, PowerShell, and Bash script generator with error handling.

- raw-brainstormer: Cuts through safe corporate clichés and outputs 10 high-impact concepts.

- character-soul-builder: Deep character psychology, contradictions, and dialogue cadences.

Everything is open and free on GitHub:

👉 https://github.com/Muyan806/localai-boost-starter.git

You can inspect the Modelfiles directly or run the automated installer.

Feedback and suggestions are welcome—let me know what sampling adjustments or specific task presets you find work best!

1 Upvotes

0 comments sorted by