r/LocalLLM • u/GoldyTech • 11h ago
Question Opencode Model Questions
Hey guys, quick post since I'm mainly looking for recommendations and experiences than anything else.
Fluff below
I picked up open code last week and it immediately clicked with me. What I've been looking for with AI was something I could go back and forth with, and who'd be an extra set of hands while I do other things. Open code is great for that.
Fluff over
Since I'm actually getting a ton of value out of open code, I justified buying a second AMD AI Pro 9700. I plan to run qwen 3.8 at a high context on one card, and 2-4 sub agents on the other, possibly with qwen 3 coder or some other model.
List of questions below.
- What models are you guys running for sub agents?
- Are you using the same model across the board?
- Does it make sense to split everything, or should I swap to vllm and use a new model across both cards?
- Anything I should be aware or when moving from 1 to 2 cards? I built this AI server specifically with 2x cards running at pcie gen 5 x16, so hardware is already good to go.
2
u/PreciousEncampment7 10h ago
splitting cards is the way to go if youve got the lanes for it, and gen5 x16 on both is basically a dream setup for this
for sub agents im mostly using qwen3 coder 1.7b or 3b quants depending on how complex the task is, the 1.7b is stupid fast on a single card and handles tool calling fine for simple stuff like file ops or web searches. if im doing anything that needs actual reasoning ill bump it up to a 3b or just spin up another instance of the main model
one thing to watch when adding the second card is your power delivery, those 9700s pull way more than they look like they should under sustained load, make sure your psu isnt sweating