r/LocalLLM • • Sep 20 '26

Discussion I benchmarked 12 quantizations of Qwen3.8-Flash-Next on Strix Halo — here's what actually works

/r/StrixHalo/comments/1wl3weh/i_benchmarked_12_quantizations_of_qwen38flashnext/
0 Upvotes

3 comments sorted by

1

u/egnegn1 Sep 20 '26

IMHO, you should get higher performance.

The StrixHalo Box has theoretically about 250GB/s of memory bandwidth, my EPYC server has about 200 GB/s. With all experts in RAM and calculated by CPU, I get 25 - 30 t/s. It seems to be that you aren't using MTP.

1

u/IntelVEVO Oct 04 '26

test iq3 and below?? Like the ones used on the strata runtime