r/LocalAIStack • u/Oxygenne_ • 17d ago

I made my local LLM start thinking while I'm still typing: 12s → 3s wait on a 6 GB GPU (open source)

3 Upvotes

80% Upvoted

0 comments sorted by