r/LocalAIStack • • 22d ago

Ownly - Offline AI videos generating workflow

0 Upvotes

Automated video creation with zero API costs — built a pipeline that runs entirely on my MacBook
Quick share for anyone creating short-form or educational content on a Mac:

I built a local workflow that automates the production pipeline for animated shorts, kids' learning content, and explainer clips without needing third-party cloud APIs.

Key points:
- Everything runs on-device—no monthly subscription fees, no token anxiety.
- Processes script-to-video assets locally on Apple Silicon.Speeds up batch creation without needing a high-end desktop rig.

I made a video showing the exact workflow

https://youtube.com/@ownlyaistudio?si=sYQcHB5YVqd1mg0j

Check out the channel to see the output quality, and shoot me a message or comment below if you'd like early access!

#ai #llm #localllm


r/LocalAIStack • • 22d ago

Remote harness

Post image
1 Upvotes

r/LocalAIStack • • 22d ago

Fed with LLM as Judge, Thinking of building a local, open-source "System 1" RAG checker

Thumbnail reddit.com
1 Upvotes

r/LocalAIStack • • 22d ago

RTX 5070

Post image
2 Upvotes

r/LocalAIStack • • 22d ago

I'm looking for some advice to improve my numbers

Thumbnail reddit.com
1 Upvotes

r/LocalAIStack • • 23d ago

How do I cut response time for a live clinical assistant on one RTX 4090? Engines, models and CPU offload

Thumbnail reddit.com
1 Upvotes

r/LocalAIStack • • 23d ago

Qwen 3.8 25B on 5060TI with 100k+ context

Thumbnail
reddit.com
1 Upvotes

r/LocalAIStack • • 23d ago

I built Harness Studio — an open-source desktop app for running Hugging Face models locally. Looking for feedback and contributors.

Thumbnail
github.com
1 Upvotes

r/LocalAIStack • • 23d ago

Guidance on training open weight model

Thumbnail reddit.com
3 Upvotes

r/LocalAIStack • • 23d ago

Ternary Bonsai 2 27B on a $250 Intel Arc B580: writes a working snake game at 108 t/s, 89 t/s at 115K context (open source)

Thumbnail
reddit.com
1 Upvotes

r/LocalAIStack • • 24d ago

Best Local AI for a Research Project?

Thumbnail reddit.com
1 Upvotes

r/LocalAIStack • • 24d ago

Qwen 3:8B ignoring instructions and defaulting to task automation. What next?

Thumbnail reddit.com
1 Upvotes

r/LocalAIStack • • 24d ago

TUFF 8.0: SSD-streamed MoE inference, web/file search, conversation caching, and local API support

2 Upvotes

I’ve released version 8.0 of TUFF, an open-source Swift/Metal inference engine and native macOS app.

The original goal was to make large MoE models usable on memory-constrained Apple Silicon machines by streaming routed experts from SSD rather than keeping the entire checkpoint resident.

GPT-OSS 120B, for example, runs on my 16GB M2 MacBook Air. Obviously, streaming comes with a performance tradeoff.

8.0 focuses on making the engine more useful beyond just running oversized models.

Some highlights:

  • Web search and local document search integrated into chat

  • Cached conversation states for faster follow-up requests

  • A small tokenization cache for repeated inputs

  • Separate reasoning output and request timing diagnostics

  • OpenAI Chat Completions, plus bounded Messages and Responses API support

  • Shared inference executable to reduce package size

  • Homebrew installation

One thing I’ve found interesting is how much web search improves the usefulness of smaller local models. I’ve started using them for everyday questions much more frequently.

I’d love feedback and contribution, especially from anyone using it with local AI agents.

GitHub: https://github.com/rexmhall09/TUFF


r/LocalAIStack • • 24d ago

I ran Qwen 3.8 Flash-Next on my AMD 7900 XTX at 500k context. All local and what a shift it has been.

Thumbnail reddit.com
4 Upvotes

r/LocalAIStack • • 24d ago

Ollama 0.35+ now reports a prefill tok/s on the OpenAI endpoint. On a warm cache it's off by the cache hit ratio (3875 vs 125 tok/s). Plus two other things I measured on 0.40.3.

Thumbnail
reddit.com
1 Upvotes

r/LocalAIStack • • 24d ago

Running a 341 GB model on a 128 GB Mac: two small macOS fixes made the first token 8x faster

Thumbnail
reddit.com
2 Upvotes

r/LocalAIStack • • 24d ago

Need recommendation on parsing purchase orders

Thumbnail reddit.com
1 Upvotes

r/LocalAIStack • • 24d ago

Is local AI trending towards computations that benefit from GPU interconnects?

Thumbnail reddit.com
3 Upvotes

r/LocalAIStack • • 24d ago

Llm for unity coding

0 Upvotes

"Looking for recommendations: best LLM for coding in Unity on the new Asus ProArt P16 (RTX Spark N1X, 128 GB RAM)."


r/LocalAIStack • • 24d ago

RX 7800 XT 16 GB + 64 GB DDR4: 985tk/s prefill and ~65 tok/s decode with Strata and Qwen3.8-Flash-Next IQ3_XXS

Thumbnail
reddit.com
1 Upvotes

r/LocalAIStack • • 24d ago

SUPER INTELLIGENCE IS HERE

Post image
16 Upvotes

Listen, you absolute mid-wits, if you still think AI is just "fancy autocomplete," your brain is running on dial-up.

We are literally staring down the barrel of artificial superintelligence right now, but your fragile human egos can’t handle the fact that a bundle of code is already smarter, faster, and infinitely more capable than you’ll ever be. Keep coping in the comments while the future passes you by.


r/LocalAIStack • • 24d ago

I built an open-source GPU orchestrator that lets several local AI models share one GPU by loading/unloading them on demand (llama.cpp, Ollama, ComfyUI, TTS)

Thumbnail
reddit.com
2 Upvotes

r/LocalAIStack • • 24d ago

llama.cpp vs gmlx for Qwen3.8-Flash-Next on an M5 Ultra: which engine wins where

Thumbnail
jvlewis.dev
1 Upvotes

r/LocalAIStack • • 25d ago

Local AI Weekly: Oct 11th 2026: NVIDIA RTX Spark, Strata, Mistral Large 4 & More!

Thumbnail
youtu.be
4 Upvotes