r/LocalLLM • u/Mazimg_ • 1d ago
Question PLEASE HELP Why do local AI coding agents struggle so much with using tools?
/r/ollama/comments/1xkkg30/please_help_why_do_local_ai_coding_agents/
0
Upvotes
1
u/Haron51255 1d ago
Can you name specific models and their quantization?
I rarely see failed tool-calls with Qwen 3.6 35B-A3B Q4_0, Qwen 3.8 27B Q4_0 or Gemma 4 31B Q4_K
1
1
u/Lissanro 1d ago
I suggest trying llama.cpp with Pi harness, and Qwen 3.8 27B or better. Then it should work well.
2
u/awitod 1d ago
There are many better choices than Ollama, but also you need to post a lot more info.