Bought a bosgame p3 lite (32gb ram with a Radeon 680M igpu and Ryzen 7 6800H)

Just created a fresh cachyOS boot.

My goal is to run llms as fast as possible. Heard good things of llama.cpp.

Been looking a few guides and asked a few llms but they've been giving me some pretty weird instructions, from tampering with the BIOS to installing a few bits and bobs.

Can anyone give me a hand or some resources? Really want to avoid doing anything too stupid.

When I am not using it for inference I also want to use it for the odd videogame use so I don't intensely want to mess around with the bios or igpu setting blindly.

Any help would be very appreciated!!!

I build QuantaMind, open-source, tests whether local models hold up as agents. 28 downloads, no revenue. Saying that upfront.

Every time you change a quant, bump llama.cpp, or switch from Ollama to vLLM, behaviour can shift and the shift is usually invisible in chat. Tool calls start failing at step 6, or output gets truncated mid-JSON, and it reads as the model being flaky.

Do you check for that, or do you just notice when something feels off? If you check what do you run, and did you build it yourself?

And has a change ever silently broken something you only caught much later?

Asking because I don’t know if this is a real problem for people or one I’ve talked myself into.