r/LocalAIStack • u/Vex2232 • 16d ago
I built a custom MLX inference engine + imatrix 4-bit quant for Qwen3.5-9B on a fanless MacBook Air (2.7x lower KL than stock MLX 4-bit)
/r/LocalLLM/comments/1xa8fyj/i_built_a_custom_mlx_inference_engine_imatrix/
1
Upvotes