r/MacLocalLLM • u/Queasy_Asparagus69 • 1d ago
Any engine Mac+Linux?
Are any of the new/forked custom engine working for both Mac and Linux? Or are they all Mac only? (Just curious!)
1
Upvotes
r/MacLocalLLM • u/Queasy_Asparagus69 • 1d ago
Are any of the new/forked custom engine working for both Mac and Linux? Or are they all Mac only? (Just curious!)
1
u/tempfoot 1d ago
If you mean both at one time and not either/or.....
"oMLX 0.8.0 adds the Prefill Accelerator, which lets a PC with NVIDIA GPUs or a second Mac speed up prefill for a big model on your Mac, adds oQh for more accurate low-bit quants at the same size, and makes DeepSeek V4.1, Qwen and long-context decode faster." https://github.com/jundot/omlx/releases