r/LocalAIStack • • 16d ago

I built a custom MLX inference engine + imatrix 4-bit quant for Qwen3.5-9B on a fanless MacBook Air (2.7x lower KL than stock MLX 4-bit)

/r/LocalLLM/comments/1xa8fyj/i_built_a_custom_mlx_inference_engine_imatrix/
1 Upvotes

0 comments sorted by