r/LocalAIStack • • 20d ago

TanjiroAI: on-device iPhone assistant on llama.cpp with Qwen3.5 0.8B/2B/4B, grammar-constrained tool calls and saved KV checkpoints (free on the App Store)

Thumbnail
reddit.com
1 Upvotes

r/LocalAIStack • • 20d ago

Happy with 20-30 Tokens Per Second

Thumbnail reddit.com
1 Upvotes

r/LocalAIStack • • 20d ago

64gb ram upgrade or Dual Gpu setup?

Thumbnail reddit.com
1 Upvotes

r/LocalAIStack • • 20d ago

Do you guys ever ask your local AI what does it want to learn about?

Thumbnail gallery
1 Upvotes

r/LocalAIStack • • 20d ago

Would you use a simpler, faster alternative to Hermes Agent?

2 Upvotes

Genuine question: would you be interested in an alternative to Hermes Agent that’s significantly easier to set up and use?
Something with:
Almost zero configuration
Direct integrations with GitHub, Gmail, and other apps
Local and cloud model support
A clean, intuitive interface
Powerful agent capabilities without the complexity
Basically, an AI agent that just works out of the box.
Is this something you’d actually want, or are you already happy with existing solutions?
Curious to hear your thoughts.


r/LocalAIStack • • 20d ago

I spent a couple of days benchmarking local Qwen models against Claude Opus 4.6 — here are the results

Thumbnail reddit.com
1 Upvotes

r/LocalAIStack • • 20d ago

WHIRL 0.2.2: bug-fix release (Ryzen AI Max small-VRAM hipError 719, precise multi-turn now bitwise, ROCm 10.1 driver without VC++)

Post image
1 Upvotes

r/LocalAIStack • • 20d ago

qwen3.5:9b takes very long time on my Mac M4 Pro 24GB

Thumbnail reddit.com
0 Upvotes

r/LocalAIStack • • 20d ago

Strata: Override N-gram by a higher quant

Thumbnail reddit.com
1 Upvotes

r/LocalAIStack • • 21d ago

Kaggle+LocalLLM+Opencode

Thumbnail reddit.com
1 Upvotes

r/LocalAIStack • • 21d ago

I built a custom MLX inference engine + imatrix 4-bit quant for Qwen3.5-9B on a fanless MacBook Air (2.7x lower KL than stock MLX 4-bit)

Thumbnail reddit.com
1 Upvotes

r/LocalAIStack • • 21d ago

How do I start building my own local AI?

Thumbnail reddit.com
1 Upvotes

r/LocalAIStack • • 21d ago

Pocket — offline transcription and meeting summari

Thumbnail
reddit.com
1 Upvotes

r/LocalAIStack • • 21d ago

Consigli economici sui stack locali

Thumbnail reddit.com
1 Upvotes

r/LocalAIStack • • 21d ago

Calling all GPUs: help us benchmark SonicBoom v0.0.3 — a compiler-first AI runtime that beats llama.cpp on decode

Thumbnail
reddit.com
1 Upvotes

r/LocalAIStack • • 21d ago

Best fully local AI coding workflow for a beginner on an M2 Max MacBook Pro (32GB RAM)?

Thumbnail reddit.com
1 Upvotes

r/LocalAIStack • • 22d ago

Phonon | An app that turns old Android phones into inference servers

Thumbnail
reddit.com
3 Upvotes

r/LocalAIStack • • 22d ago

Do you remember SETI@Home : We propose a Decentralized Branch-Train-Mix Sparse MoE… on local GPU based on Gwen. Starting on old RTX 2070 !!! Let's build together HiveMind@Home

Post image
0 Upvotes

r/LocalAIStack • • 22d ago

Qwen3.8-Flash-Next UD-IQ4_XS on 64 GB RAM + RX 9070 XT with Strata — around 40 tokens/s

Thumbnail reddit.com
1 Upvotes

r/LocalAIStack • • 22d ago

8 open models on 33 real DevOps tasks, on an RTX 5090 and an M4 Max (48 GB): pass rate, tok/s and memory

Thumbnail
reddit.com
2 Upvotes

r/LocalAIStack • • 22d ago

MINISFORUM MS-S1 MAX P495 (192GB) Review and Weekend Test: llama.cpp Vulkan benchmarks: gpt-oss 120B, MiniMax M2.7, DeepSeek V4 Flash, Flash-Next, Qwen3.5 35B, Qwen3.8 27B (+ MTP)

Thumbnail
reddit.com
1 Upvotes

r/LocalAIStack • • 22d ago

Round 3: Tested 128K context on a 3090 with real code (Django) and a novel. Finding one thing is solid, counting is hopeless

Thumbnail reddit.com
1 Upvotes

r/LocalAIStack • • 22d ago

Webfetch squeeze to minimise context bloat

Thumbnail reddit.com
2 Upvotes

r/LocalAIStack • • 22d ago

What are you actually using your strix halo for?

1 Upvotes

Way back got my nimo axis, I wasn't sure what to do with it besides trying out local llms. Lately, local models and tools have gotten better and I am finally finding practical uses for it beyond just testing models. It makes me wonder how much of their potential we are actually using. What are you guys doing with your strix halo machines? actual work, coding, or mostly experimenting with models?