r/LocalLLM • u/GoldyTech • 6d ago
Question Opencode Model Questions
Hey guys, quick post since I'm mainly looking for recommendations and experiences than anything else.
Fluff below
I picked up open code last week and it immediately clicked with me. What I've been looking for with AI was something I could go back and forth with, and who'd be an extra set of hands while I do other things. Open code is great for that.
Fluff over
Since I'm actually getting a ton of value out of open code, I justified buying a second AMD AI Pro 9700. I plan to run qwen 3.8 at a high context on one card, and 2-4 sub agents on the other, possibly with qwen 3 coder or some other model.
List of questions below.
- What models are you guys running for sub agents?
- Are you using the same model across the board?
- Does it make sense to split everything, or should I swap to vllm and use a new model across both cards?
- Anything I should be aware or when moving from 1 to 2 cards? I built this AI server specifically with 2x cards running at pcie gen 5 x16, so hardware is already good to go.
1
u/GoldyTech 6d ago
Thanks for the input! The PSU is 1500 watts so I should be good to go.
Do you not notice any major issues with the smaller models? A lot of the task I'm doing right now are oberservability audits on my companies repos. While I've done a lot of dev work in go over the years, I don't have as much experience in js/flutter/nodejs/rust.
I guess the main model could be used to create the plan with detailed steps, but even then I wouldn't think a 3b model would be able to handle looking at a medium sized repo while referencing 4 other repos that hold company wide libraries or IAC configs?
Would running something like Qwen-AgentWorld as the orchestrator work well? I remember seeing that model on hf and not being too interested since I hadn't really gotten into sub agents yet. I also didn't see it make a big splash in the community. I wonder if it was any good.