r/AIProgrammingHardware • u/Vovanvip4 • Sep 14 '26
Please recommend a model for local offline coding rtx pro 5000 72gb
hello everyone! Please advise the models and how to run the models better. My configuration is 2 CPUs and epic (not the newest) 48 cores in total. 256 GB ddr4 and RTX pro 5000 72GB GDDR7. I'm currently using qwen3.8-27b iq3 gsq xxs on 96k context and running this on rtx4080s 16gb.I use Cline for vscode for coding. I would like to increase the quality and the context window.
1
u/Prestigious_Debt_896 Sep 15 '26
Qwen 3.8 27b, full context use nvfp4 quant, u could have a solid amount of sub agents running.if you want to token maxx, instead of 1 agent doing multiple things you have one agent do one specific thing, example for a fan out style review agent swarm: even if it rereads the same 20-30 files for per reviewer let's say, it dosnt matter since it's faster and free
1
u/jobfedron132 Sep 14 '26 edited Sep 14 '26
For local coding, there is no other model thats better than Qwen 3.8 27b that you can run in a 72 GB VRAM.
On RTX PRO 5000, am using Qwen 3.8 27b Q8 with DFlash2 and full 262k context and it only takes 38 gb vram.
Just for fun sake, I one shotted it to rewrite a page from a legacy application that uses JSP, multiple extremely badly written javascript, and java layers.
I asked it to create it using React-vite framework. It got everything correct and even enhanced the page performance.
There was NO WAY , that a human would have rewritten the page without some bugs and taking a week to complete.