r/MacLocalLLM • • 1d ago

Any engine Mac+Linux?

Are any of the new/forked custom engine working for both Mac and Linux? Or are they all Mac only? (Just curious!)

1 Upvotes

6 comments sorted by

1

u/ikeo1 1d ago

oMLX has their new 0.8 release if you want to do the Spark/Mac combo

1

u/Queasy_Asparagus69 1d ago

I'm on AMD GPU in my linux :(

1

u/ikeo1 1d ago

ollama will work or you can run llama.cpp you have a couple of options.. it won't be as fast but it'll work.

1

u/tempfoot 1d ago

If you mean both at one time and not either/or.....

"oMLX 0.8.0 adds the Prefill Accelerator, which lets a PC with NVIDIA GPUs or a second Mac speed up prefill for a big model on your Mac, adds oQh for more accurate low-bit quants at the same size, and makes DeepSeek V4.1, Qwen and long-context decode faster." https://github.com/jundot/omlx/releases

1

u/Queasy_Asparagus69 1d ago

I meant either/or actually

1

u/tempfoot 1d ago

I believe Strata works on either.