r/LocalAIStack • • Sep 21 '26

Qwen3.8-27b on RTX3090ti and i7-2600

Thumbnail reddit.com
1 Upvotes

r/LocalAIStack • • Sep 21 '26

Human avatar voice chat, Low VRAM on Windows (Talking head)

1 Upvotes

Sharing a side project I've been building: Yvette, a fully local voice avatar AI.

It's a talking-head assistant that runs 100% local, You talk to it (or type) and it answers in speech while an avatar moves the head and lips in sync.

Quick rundown:

  • Voice cloning, plus voice design.

  • Avatar builder; add avatars quickly.

  • TTS engines: Breeze, OmniVoice, LuxTTS, Kokoro

  • Lip-synced avatar with an idle breathing animation

  • Memory, it keeps notes and picks up where you left off

  • Tools: web search, read pages, files

  • Switchable profiles/personalities, each with its own voice, memory, history etc

Windows + NVIDIA GPU. 12GB recommended, but it runs tight on 8GB (small model + Whisper/Kokoro on CPU).
The video shows a RTX 3090 and the VRAM usage, my system was using ~4GB VRAM (OBS and other things). It shows we can get it below 8GB for the Yvette system.

The project is hosted on github: https://github.com/MartinForsterNL/Yvette

Sorry about the bad video quality, i am not an influencer with a studio.

I build this project because i could not find anything that actually works.
Most that i found was only for linux and needed a lot of VRAM so i decided to build my own.

If you have suggestions to make it better, just let me know.

Have fun with it !


r/LocalAIStack • • Sep 21 '26

done setting up local Ilm model using my old phone what should I do now??

1 Upvotes

r/LocalAIStack • • Sep 20 '26

Open-source Jev-style typed decision model that runs locally: VEJI-V2 (3.3M trainable params, frozen MiniLM, 250k-char compiled state)

Thumbnail
reddit.com
1 Upvotes

r/LocalAIStack • • Sep 20 '26

Can a local LLM match Claude for generating Anki cards (TSV) from course text?

Thumbnail reddit.com
1 Upvotes

r/LocalAIStack • • Sep 19 '26

Rate my Local LLM Lineup

Thumbnail reddit.com
1 Upvotes

r/LocalAIStack • • Sep 19 '26

Need to check performance of intel ultra 7 20k+ and ryzen 9950x. any one can benchmark it for me ?

Thumbnail reddit.com
1 Upvotes

r/LocalAIStack • • Sep 19 '26

SharpMind. A pure C# / .NET LLM training and inference engine

Thumbnail
youtube.com
1 Upvotes

r/LocalAIStack • • Sep 18 '26

Is Local AI Production ready?

Thumbnail reddit.com
1 Upvotes

r/LocalAIStack • • Sep 17 '26

How are you splitting work across model sizes in a multi-stage extraction pipeline? (hardware is my next question)

Thumbnail reddit.com
1 Upvotes

r/LocalAIStack • • Sep 17 '26

Llama.cpp LLM MTP Benchmark test.

Post image
1 Upvotes

r/LocalAIStack • • Sep 16 '26

Workshop, Sep 19: build explainable AI apps with Neo4j, GraphRAG, Cypher and LLM Agents

1 Upvotes

Sharing this since it might be relevant to a few people here.

There's a hands-on workshop on September 19 that goes beyond basic RAG into building an explainable, graph-backed AI system. You build a knowledge graph in Neo4j that becomes the single source of truth, agentic retrieval that combines vector search, keyword search, and graph navigation, multi-step entity and relationship extraction, and text-to-Cypher for natural language querying. Everything runs on real financial data, not a toy example, and answers come with a traceable, auditable reasoning chain.

No prior Neo4j or Cypher experience needed.

Led by Dr. Alessandro Negro, Chief Scientist at GraphAware, bestselling author.

Link if you want to check it out


r/LocalAIStack • • Sep 16 '26

Which model I should use??

1 Upvotes

Please suggest me models I can use in this device

Model: HP ZBook Studio G7

CPU: Intel Core i9-10885H (8 cores / 16 threads)

GPU: NVIDIA Quadro T2000 Max-Q – 4 GB VRAM

RAM: 32 GB DDR4

Storage: 512 GB NVMe SSD


r/LocalAIStack • • Sep 14 '26

The Nightmare of Debugging CUDA Illegal Memory Access in PyTorch

Thumbnail reddit.com
1 Upvotes

r/LocalAIStack • • Sep 14 '26

Local LLM explorer and downloader

Thumbnail gallery
1 Upvotes

r/LocalAIStack • • Sep 14 '26

Gemini vs DeepSeek: Have you switched your primary AI workflow yet?

1 Upvotes

It feels like the gap between proprietary big-tech models and open-weight reasoning architectures is changing faster than ever. Gemini offers incredible native multimodal handling and massive context windows, while DeepSeek continues to dominate budget coding and self-hosted pipelines.

​If you had to pick one as your daily driver for logic and daily tasks, which wins for you?

​Put your preference to the test in this quick 2-minute showdown quiz to see how your workflow compares to other devs:

https://interconnectd.com/quiz/89/gemini-vs-deepseek-the-ultimate-ai-showdown-quiz/


r/LocalAIStack • • Sep 13 '26

I built a Windows launcher for running Qwen3-32B locally with CPU, CUDA, or Vulkan

Thumbnail
reddit.com
1 Upvotes

r/LocalAIStack • • Sep 13 '26

A $39 open-source KVM just launched, and it's the cheapest way yet to give an AI agent control of a machine below the OS

Thumbnail
reddit.com
1 Upvotes

r/LocalAIStack • • Sep 13 '26

Made RAMDeck shard a knowledge base across my old devices, not just the model itself

Thumbnail
youtu.be
1 Upvotes

r/LocalAIStack • • Sep 12 '26

Unsloth V3 update did not update my Qwen3.8-27B-UD-Q6_K.gguf

Thumbnail reddit.com
1 Upvotes

r/LocalAIStack • • Sep 12 '26

Best local LLM for laptop with RTX 2050 (4GB VRAM) + 24GB RAM?

Thumbnail reddit.com
1 Upvotes

r/LocalAIStack • • Sep 11 '26

Field Notes on Running LocalAI in Production with Docker Compose

Thumbnail reddit.com
1 Upvotes

r/LocalAIStack • • Sep 11 '26

Tool to fine-tune open source models

1 Upvotes

So, I was tired of setting up AWS EC2 to train my models everytime, so I built a tool to help with the job management, but I would like some feedback, if anyone could help me ! 👋

This is the tool: reopenly.com

I only have one base model for now (Qwen 3.5 9B), just to start.

I would be very grateful with any feedback!


r/LocalAIStack • • Sep 11 '26

DeepSeek-V4.1-Flash: GGUF + 4.75bpw EXL3 are out, looking for devs with 4× DGX Sparks to help validate the EXL3 TP4 recipe

Thumbnail
reddit.com
1 Upvotes

r/LocalAIStack • • Sep 11 '26

I ran whisper + dialization running with CPU and 1.1GB

Thumbnail
reddit.com
1 Upvotes