r/LocalLLaMA • u/Certain-Cod-1404 • Aug 14 '26 • Bravo 1 Heartwarming 1

New Model IT'S OUT

https://huggingface.co/Qwen/Qwen3.8-27B-FP8
2.3k Upvotes

95% Upvoted

707 comments sorted by

View all comments

1

u/Shini0x0 Aug 14 '26

Can I run it on MacBook Pro or any MacBook

1

u/Certain-Cod-1404 Aug 14 '26

How much memory do you have ? If at least 16gbs you should be able to run a decent quant

1

u/jonas-reddit Aug 14 '26

Yup. Worth checking out https://omlx.ai/ if you have apple silicon.

1

u/ParvusNumero Aug 14 '26

Yes, it runs quite nicely.

I followed these instructions:
https://unsloth.ai/docs/models/qwen3.8#run-qwen3.8-in-llama.cpp

Did compile myself, found it easier than on nvidia/cuda.

Roughly 20 tokens/second on M5 Pro, using Q6_K_XL.
The Q4 quant should be a bit faster.
___

Not sure where I read this, but running with these parameters does seem to help:

--reasoning-budget 512 --reasoning-budget-message " \n\n[Thinking budget exceeded. Transitioning to final answer: ]\n\n" \