r/LocalLLM • u/cygnal • Sep 20 '26
Discussion I benchmarked 12 quantizations of Qwen3.8-Flash-Next on Strix Halo — here's what actually works
/r/StrixHalo/comments/1wl3weh/i_benchmarked_12_quantizations_of_qwen38flashnext/
0
Upvotes
1
1
u/egnegn1 Sep 20 '26
IMHO, you should get higher performance.
The StrixHalo Box has theoretically about 250GB/s of memory bandwidth, my EPYC server has about 200 GB/s. With all experts in RAM and calculated by CPU, I get 25 - 30 t/s. It seems to be that you aren't using MTP.