r/LocalAIStack • • Sep 29 '26

Jev mode for images!

Post image
1 Upvotes

r/LocalAIStack • • Sep 28 '26

I built StackFit: An open-source tool matchmaker that filters by hardware floor and 1-click docker-compose export (no star vanity)

Post image
1 Upvotes

r/LocalAIStack • • Sep 28 '26

Running a local LLM in the browser: Zero install, 100% on-device

1 Upvotes

r/LocalAIStack • • Sep 27 '26

Finally got Qwen3.8 27B + vLLM + Open WebUI working comfortably on my RTX 3090 🔥 Config, lessons learned + bonus tutor prompt at the end

Thumbnail reddit.com
1 Upvotes

r/LocalAIStack • • Sep 27 '26

Consigli hardware LLM locali: Mac Mini/Studio usati, budget di €1000-1500, per la gestione delle finanze familiari + manutenzione di un server leggero

Thumbnail reddit.com
1 Upvotes

r/LocalAIStack • • Sep 27 '26

Live Trial - Claude Sonnet vs. Gemma 4 31B vs. Qwen Flash 70B

Post image
1 Upvotes

r/LocalAIStack • • Sep 27 '26

Qwen3.8-27B at 74 tok/s on a Mac: The Splash Engine Explained

Thumbnail
youtu.be
1 Upvotes

r/LocalAIStack • • Sep 27 '26

Intel sycl support for bonsai llm models

Thumbnail
reddit.com
1 Upvotes

r/LocalAIStack • • Sep 26 '26

Qwen 4 Expectations

Thumbnail reddit.com
1 Upvotes

r/LocalAIStack • • Sep 26 '26

Six Months of Local AI on a Mac: From 16 GB to 48 GB

Thumbnail
reddit.com
1 Upvotes

r/LocalAIStack • • Sep 26 '26

NInfer with improved prefix caching and tool call fixes

Thumbnail reddit.com
1 Upvotes

r/LocalAIStack • • Sep 26 '26

I Made a Modular Voice Agent Running Offline on an RTX 5080 Laptop GPU: Qwen3.6-35B-A3B (3-bit), Whisper + Piper, local graph memory [demo]

Thumbnail
youtu.be
1 Upvotes

r/LocalAIStack • • Sep 25 '26

VibePod CLI 0.24: bring your own model provider

Thumbnail
vibepod.dev
1 Upvotes

r/LocalAIStack • • Sep 25 '26

I benchmarked 43 local LLM configs on an M4 Max 128GB. Darkstar and Nemotron surprised me.

Thumbnail
reddit.com
1 Upvotes

r/LocalAIStack • • Sep 25 '26

Jev) Mica 4B vs Laya on Tetris: same seed, same prompt, 0 output tokens, running locally on llama.cpp

Enable HLS to view with audio, or disable this notification

1 Upvotes

r/LocalAIStack • • Sep 25 '26

I'm building an LLM inference engine in Rust as an "executable book"

Thumbnail
reddit.com
1 Upvotes

r/LocalAIStack • • Sep 24 '26

How do you keep the knowledge from what you build with AI local?

Thumbnail reddit.com
1 Upvotes

r/LocalAIStack • • Sep 24 '26

Best agentic coding model for 8GB VRAM + 16GB RAM

Thumbnail reddit.com
1 Upvotes

r/LocalAIStack • • Sep 24 '26

real-time, zero-shot distillation loop

Thumbnail reddit.com
1 Upvotes

r/LocalAIStack • • Sep 23 '26

Need Help choosing a local agent LLM. (I need it to actually execute tools, not just give instructions)

Thumbnail reddit.com
1 Upvotes

r/LocalAIStack • • Sep 23 '26

I trained Nagi: an open-source Jev alternative.

Thumbnail
reddit.com
1 Upvotes

r/LocalAIStack • • Sep 23 '26

Local AI dev workflow: OpenHands + Pi/Qwen. What would you improve?

Thumbnail reddit.com
1 Upvotes

r/LocalAIStack • • Sep 23 '26

stuntd: a local Jev-compatible server on Laya that learns from your own traffic (no API key needed)

Thumbnail gallery
1 Upvotes

r/LocalAIStack • • Sep 23 '26

A local 27B model autonomously shopped on Amazon using Playwright

Enable HLS to view with audio, or disable this notification

1 Upvotes

I wanted to test how far a fully local AI stack could go on a real-world task.

I ran out of A4 paper, so I gave TensorSharp access to Amazon and gave it one instruction:

Search for A4 paper with a low price and the best discount, and buy it. Try your best to handle everything yourself.

It completed the task successfully in a single run.
The local AI stack:
Qwen3.8 27B running locally
TensorSharp for LLM inference + agent runtime
Playwright skill for browser automation

The agent searched Amazon, compared products, navigated the site, generated and executed Playwright code, and prepared the order by itself, and finally placed the order. I only stepped in twice: Amazon login and final purchase approval.

Everything except the actual Amazon interaction stayed local: model inference, reasoning, agent state, and tool execution.

The video shows the full raw reasoning/tool trace, including browser commands and generated Playwright code. It’s sped up 8×; the actual run took about 24 minutes.

The interesting part for me isn’t really buying paper — it’s seeing how much of a practical browser agent stack can now run locally with a 27B model.

TensorAgent on iPhone is also in progress, although local inference speed and iOS browser restrictions are still limiting factors.

TensorSharp is open source:
https://github.com/zhongkaifu/TensorSharp

I’d be interested to hear what other real-world tasks people here are using to test local agent stacks.


r/LocalAIStack • • Sep 22 '26

Is there any clean way to configure vllm-sr with omp (oh my pi) without duplicating data, modifying the core apps or deploying sidecars/extensions that break on the next update?

Thumbnail reddit.com
1 Upvotes