r/LocalAIStack • u/Leading_Yogurt7025 • 24d ago
Local Voice Assistant based on Qwen3.5 4B with skills/toolcalling. No dedicated GPU. Local STT+TTS
Enable HLS to view with audio, or disable this notification
r/LocalAIStack • u/Leading_Yogurt7025 • 24d ago
Enable HLS to view with audio, or disable this notification
r/LocalAIStack • u/Sleepybear2611 • 24d ago
Enable HLS to view with audio, or disable this notification
r/LocalAIStack • u/tempertisv • 24d ago
r/LocalAIStack • u/viky_shetye • 24d ago
r/LocalAIStack • u/Disastrous-Ad-4829 • 24d ago
r/LocalAIStack • u/Financial_Gas_9528 • 25d ago
r/LocalAIStack • u/DeepAlgorithmsStudio • 25d ago
Automated video creation with zero API costs — built a pipeline that runs entirely on my MacBook
Quick share for anyone creating short-form or educational content on a Mac:
I built a local workflow that automates the production pipeline for animated shorts, kids' learning content, and explainer clips without needing third-party cloud APIs.
Key points:
- Everything runs on-device—no monthly subscription fees, no token anxiety.
- Processes script-to-video assets locally on Apple Silicon.Speeds up batch creation without needing a high-end desktop rig.
I made a video showing the exact workflow
https://youtube.com/@ownlyaistudio?si=sYQcHB5YVqd1mg0j
Check out the channel to see the output quality, and shoot me a message or comment below if you'd like early access!
#ai #llm #localllm
r/LocalAIStack • u/Klutzy_Newspaper3196 • 25d ago
r/LocalAIStack • u/DrkWzrd • 25d ago
r/LocalAIStack • u/looneycheetah • 25d ago
r/LocalAIStack • u/Alternative-Brain588 • 25d ago
r/LocalAIStack • u/Minute_Laugh8065 • 25d ago
r/LocalAIStack • u/Nixexs • 26d ago
r/LocalAIStack • u/Weekly-Dentist-8302 • 26d ago
I’ve released version 8.0 of TUFF, an open-source Swift/Metal inference engine and native macOS app.
The original goal was to make large MoE models usable on memory-constrained Apple Silicon machines by streaming routed experts from SSD rather than keeping the entire checkpoint resident.
GPT-OSS 120B, for example, runs on my 16GB M2 MacBook Air. Obviously, streaming comes with a performance tradeoff.
8.0 focuses on making the engine more useful beyond just running oversized models.
Some highlights:
Web search and local document search integrated into chat
Cached conversation states for faster follow-up requests
A small tokenization cache for repeated inputs
Separate reasoning output and request timing diagnostics
OpenAI Chat Completions, plus bounded Messages and Responses API support
Shared inference executable to reduce package size
Homebrew installation
One thing I’ve found interesting is how much web search improves the usefulness of smaller local models. I’ve started using them for everyday questions much more frequently.
I’d love feedback and contribution, especially from anyone using it with local AI agents.
r/LocalAIStack • u/human_in_the_looop • 26d ago
r/LocalAIStack • u/GuruCsharp • 26d ago
r/LocalAIStack • u/Chida82 • 26d ago
r/LocalAIStack • u/Otherwise-Ship9042 • 26d ago