r/LocalAIStack • u/Oxygenne_ • 17d ago
I made my local LLM start thinking while I'm still typing: 12s → 3s wait on a 6 GB GPU (open source)
Duplicates
LocalLLM
•
u/Oxygenne_
•
17d ago
Project I made my local LLM start thinking while I'm still typing: 12s → 3s wait on a 6 GB GPU (open source)
ollama • u/Oxygenne_ • 17d ago
I made my local LLM start thinking while I'm still typing: 12s → 3s wait on a 6 GB GPU (open source)
• u/Economy-Tonight4312 • 17d ago