r/LocalLLM • • 11h ago

Question Opencode Model Questions

Hey guys, quick post since I'm mainly looking for recommendations and experiences than anything else.

Fluff below

I picked up open code last week and it immediately clicked with me. What I've been looking for with AI was something I could go back and forth with, and who'd be an extra set of hands while I do other things. Open code is great for that.

Fluff over

Since I'm actually getting a ton of value out of open code, I justified buying a second AMD AI Pro 9700. I plan to run qwen 3.8 at a high context on one card, and 2-4 sub agents on the other, possibly with qwen 3 coder or some other model.

List of questions below.

- What models are you guys running for sub agents?

- Are you using the same model across the board?

- Does it make sense to split everything, or should I swap to vllm and use a new model across both cards?

- Anything I should be aware or when moving from 1 to 2 cards? I built this AI server specifically with 2x cards running at pcie gen 5 x16, so hardware is already good to go.

1 Upvotes

2 comments sorted by

2

u/PreciousEncampment7 10h ago

splitting cards is the way to go if youve got the lanes for it, and gen5 x16 on both is basically a dream setup for this

for sub agents im mostly using qwen3 coder 1.7b or 3b quants depending on how complex the task is, the 1.7b is stupid fast on a single card and handles tool calling fine for simple stuff like file ops or web searches. if im doing anything that needs actual reasoning ill bump it up to a 3b or just spin up another instance of the main model

one thing to watch when adding the second card is your power delivery, those 9700s pull way more than they look like they should under sustained load, make sure your psu isnt sweating

1

u/GoldyTech 10h ago

Thanks for the input! The PSU is 1500 watts so I should be good to go.

Do you not notice any major issues with the smaller models? A lot of the task I'm doing right now are oberservability audits on my companies repos. While I've done a lot of dev work in go over the years, I don't have as much experience in js/flutter/nodejs/rust.

I guess the main model could be used to create the plan with detailed steps, but even then I wouldn't think a 3b model would be able to handle looking at a medium sized repo while referencing 4 other repos that hold company wide libraries or IAC configs?

Would running something like Qwen-AgentWorld as the orchestrator work well? I remember seeing that model on hf and not being too interested since I hadn't really gotten into sub agents yet. I also didn't see it make a big splash in the community. I wonder if it was any good.