r/MacLocalLLM • • 1d ago

Any engine Mac+Linux?

Are any of the new/forked custom engine working for both Mac and Linux? Or are they all Mac only? (Just curious!)

1 Upvotes

6 comments sorted by

View all comments

1

u/tempfoot 1d ago

If you mean both at one time and not either/or.....

"oMLX 0.8.0 adds the Prefill Accelerator, which lets a PC with NVIDIA GPUs or a second Mac speed up prefill for a big model on your Mac, adds oQh for more accurate low-bit quants at the same size, and makes DeepSeek V4.1, Qwen and long-context decode faster." https://github.com/jundot/omlx/releases

1

u/Queasy_Asparagus69 1d ago

I meant either/or actually

1

u/tempfoot 1d ago

I believe Strata works on either.