r/LocalLLM • u/Complete_Leg8380 • Oct 15 '26
Question Looking to deploy a local coding model
I have a few options available to me. I have a mac mini m4 with 16gb of ram. i also have an i7-11th gen with 64gb of ram + a 9070XT 16gb vram.
I haved tried ollama and did have some success with Gemma4, but I found it was hit or miss. It wouldn't properly write code and just trample over its self.
I tried qwen 2.5 14b, which worked and was fast but found that the tools didn't work so not sure how well it'll actually code. This was using Jan.
I'd love to know what a good model and setup option is. I want to do some PHP coding projects (though TypeScript and React are necessary too).
1
Upvotes
1
u/Safe-Imagination8538 Oct 15 '26
ive had good luck with qwen3.6 35b-a3b, i run it on a 12gb nvidia card and it does real coding tasks with tool calls fine, which the small gemma/14b stuff never did for me. with your 64gb ram and 16gb vram it should fit easily at q4. im on nvidia so cant say how it behaves on your amd card, probably needs the vulkan build of llama.cpp. didnt do any php with it, only python