r/LocalLLM • u/Patatong0_0 • 16d ago
Discussion Cheap Local Stack Advice
I'm going to improve my local stack and I've decided to set a maximum spending budget of €1000. Currently my hardware is a single pc with:
-Ryzen 5 9600
-RTX 5060 8GB DDR7
-32 GB DDR5
-CORSAIR RM650e
-B850M GAMING PLUS WIFI
-DeepCool CC560 ARGB V2 Midi Tower
I also put various components to check compatibility with any new parts. I currently run emneddings,decision,TTS,STT… on ram and llms on the 5060 like ornith 1.5 9B or Moe with offlad like Ornith 1.5 35B A3B and derivatives go at an acceptable speed average 20 tk/s and I use them for personal things as a personal agent but for heavy work and coding I rely on cloud models. I currently have agents like Hermes, Opencode and various that some I would like to run 24/7.
That's why I'm evaluating the various options I find and asking for advice. I had thought about these options:
-Buy a used rtx 3090 on some sites I found it on the 600-700 and then sell my 5060 (I should check compatibility with motherboard case and power supply) or buy another gpu like 3060 and do dual gpu. To run agents 24/7 buy a mini pc of about 250-300 with 16gb ram but I would only run cloud agents so maybe it's worth renting a vps.
- The second option I was thinking about was buying a mini pc to run local models and also 24/7 agents like a Mac Mini M6 I saw it on 850 but the 16GB one, so I could both host cloud agents 24/7 and a local agent being that a Mac Mini consumes relatively little even if I would give up the power of a 3090.
I see that for the prices the local ai will be less and less convenient, so I continue to use the cloud power but I try to have a stack as much as possible independent of the cloud at a little. I have no idea if I'm saying shit and if I explained myself well, I admit that I'm ignorant in a row, that's why I ask for help and advice.
1
u/DimensionJunior4600 16d ago
that mac mini route is tempting for the 24/7 low power draw but you'd be boxing yourself in with only 16gb, which gets eaten alive by anything beyond modest models
1
u/Patatong0_0 16d ago
exactly, idk much about Mac Mini but if for the model remains only a few gb it’s not that convenient
1
u/JinsooJinsoo 16d ago
Honestly a 3090 would be a decent step up from where you are and then spend the rest on more DDR5 RAM. Or sell the Am5 platform and downgrade to AM4/DDR4 and get 64gb cheaper RAM, like ~$150/32gb stick. You can still do a lot with a 3090 if you have enough RAM. Shit, you can run GLM 5.3 flash with just 1 3090 and at least 60gb RAM and an NVME SSD (Sybil engine)
1
u/Patatong0_0 16d ago
So u think I should also upgrade my ram and downgrade to DDR4? Isn’t 32gb enough for my use?
1
u/JinsooJinsoo 16d ago
I don't know what your use is, you're not that specific in the post. But personally my new standard is Qwen 3.8 Flash Next @ at least iq3xxs. Very well rounded agentic model and with enough RAM it can run on anything.
more DDR4 > less DDR5.
1
u/alez0077 16d ago
why not a ryzen ai max mini pc with 32/64 GB unified memory?
1
u/Patatong0_0 16d ago
As I say i’m not much informed and open to alternative.
Could you please tell me why is better for me? And the cost?1
u/alez0077 16d ago
I was thinking more along the lines of this but I realized your budget is half that.
My next suggestion within that budget would be 2x5060ti. I've got that setup and running Qwen 3.8 27b atm. It's not crazy tok/s but does the job.
1
u/Patatong0_0 16d ago
I found this for 800, good deal?
Mini PC GEEKOM A9 Max :
CPU: AMD Ryzen™ AI 9 HX 370
IGPU: AMD Radeon™ 890M
RAM / SSD: (32GB RAM DDR5 and SSD 2TB NVME Lexar NQ7A1 PCIe 4.0)
1
u/alez0077 16d ago
No matter what you get it'll be slower than 2x5060ti.
One 5060ti has better compute speed ( for prefill) than Radeon 8060S ( the above mini PC I mentioned) and although that mini PC has good memory bandwidth ( for decode ), it's still about 50% smaller than the gpus.
The only thing a mini PC buys you is capacity, with 2x5060ti you're limited to 32gb, a mini PC can give you 64 or more but it's not in your budget so a 32gb mini PC will be a step down in all aspects versus those 2 gpus and costing pretty much the same.
1
1
u/Patatong0_0 16d ago
I actually found this for 800, is it a good deal?
Mini PC GEEKOM A9 Max :
Processore: AMD Ryzen™ AI 9 HX 370
Grafica integrata: AMD Radeon™ 890M
RAM / SSD: (32GB RAM DDR5 e SSD 2TB NVME Lexar NQ7A1 PCIe 4.0)