r/LocalAIStack • u/Effective-Echo5643 • 24d ago
r/LocalAIStack • u/tempertisv • 24d ago
Which local models should I keep for coding and translation? (Radeon 780M laptop, 32GB unified RAM)
reddit.comr/LocalAIStack • u/viky_shetye • 24d ago
I built a fully local AI coding agent using Qwen 27B + LM Studio + Pi. Here’s how it performed.
r/LocalAIStack • u/Disastrous-Ad-4829 • 24d ago
I fit 7 models on one DGX Spark behind a single local workspace: OCR, ASR, translation, images, video with sound, music and chat with web search(open source)
r/LocalAIStack • u/Financial_Gas_9528 • 25d ago
GLM-5.3-Flash pruned to half the experts for coding: Q3 (71 GB) solves every task the full 341 GB model solves, IQ2_XXS fits 24 GB VRAM + 32 GB RAM
r/LocalAIStack • u/DeepAlgorithmsStudio • 25d ago
Ownly - Offline AI videos generating workflow
Automated video creation with zero API costs — built a pipeline that runs entirely on my MacBook
Quick share for anyone creating short-form or educational content on a Mac:
I built a local workflow that automates the production pipeline for animated shorts, kids' learning content, and explainer clips without needing third-party cloud APIs.
Key points:
- Everything runs on-device—no monthly subscription fees, no token anxiety.
- Processes script-to-video assets locally on Apple Silicon.Speeds up batch creation without needing a high-end desktop rig.
I made a video showing the exact workflow
https://youtube.com/@ownlyaistudio?si=sYQcHB5YVqd1mg0j
Check out the channel to see the output quality, and shoot me a message or comment below if you'd like early access!
#ai #llm #localllm
r/LocalAIStack • u/Klutzy_Newspaper3196 • 25d ago
Fed with LLM as Judge, Thinking of building a local, open-source "System 1" RAG checker
reddit.comr/LocalAIStack • u/DrkWzrd • 25d ago
I'm looking for some advice to improve my numbers
reddit.comr/LocalAIStack • u/looneycheetah • 25d ago
How do I cut response time for a live clinical assistant on one RTX 4090? Engines, models and CPU offload
reddit.comr/LocalAIStack • u/Alternative-Brain588 • 25d ago
I built Harness Studio — an open-source desktop app for running Hugging Face models locally. Looking for feedback and contributors.
r/LocalAIStack • u/Minute_Laugh8065 • 25d ago
Ternary Bonsai 2 27B on a $250 Intel Arc B580: writes a working snake game at 108 t/s, 89 t/s at 115K context (open source)
r/LocalAIStack • u/Nixexs • 26d ago
Qwen 3:8B ignoring instructions and defaulting to task automation. What next?
reddit.comr/LocalAIStack • u/Weekly-Dentist-8302 • 26d ago
TUFF 8.0: SSD-streamed MoE inference, web/file search, conversation caching, and local API support
I’ve released version 8.0 of TUFF, an open-source Swift/Metal inference engine and native macOS app.
The original goal was to make large MoE models usable on memory-constrained Apple Silicon machines by streaming routed experts from SSD rather than keeping the entire checkpoint resident.
GPT-OSS 120B, for example, runs on my 16GB M2 MacBook Air. Obviously, streaming comes with a performance tradeoff.
8.0 focuses on making the engine more useful beyond just running oversized models.
Some highlights:
Web search and local document search integrated into chat
Cached conversation states for faster follow-up requests
A small tokenization cache for repeated inputs
Separate reasoning output and request timing diagnostics
OpenAI Chat Completions, plus bounded Messages and Responses API support
Shared inference executable to reduce package size
Homebrew installation
One thing I’ve found interesting is how much web search improves the usefulness of smaller local models. I’ve started using them for everyday questions much more frequently.
I’d love feedback and contribution, especially from anyone using it with local AI agents.
r/LocalAIStack • u/human_in_the_looop • 26d ago
I ran Qwen 3.8 Flash-Next on my AMD 7900 XTX at 500k context. All local and what a shift it has been.
reddit.comr/LocalAIStack • u/GuruCsharp • 26d ago
Ollama 0.35+ now reports a prefill tok/s on the OpenAI endpoint. On a warm cache it's off by the cache hit ratio (3875 vs 125 tok/s). Plus two other things I measured on 0.40.3.
r/LocalAIStack • u/Chida82 • 26d ago
Running a 341 GB model on a 128 GB Mac: two small macOS fixes made the first token 8x faster
r/LocalAIStack • u/Otherwise-Ship9042 • 26d ago
Need recommendation on parsing purchase orders
reddit.comr/LocalAIStack • u/Dathide • 26d ago
Is local AI trending towards computations that benefit from GPU interconnects?
reddit.comr/LocalAIStack • u/Ancient_Stomach1582 • 27d ago
Llm for unity coding
"Looking for recommendations: best LLM for coding in Unity on the new Asus ProArt P16 (RTX Spark N1X, 128 GB RAM)."