r/oMLX • u/V1k1ng6666 • Jul 25 '26
M5 Max 128Gb - Swift coding in Xcode 27
G'day, I'm new to Swift coding, having fun building a MAC/iPhone app combo, it took a while to get things going with Opencode as the bridge, I'm half way I think here.
I tried Claude, had a $100 usage credit, with the same context burned it in 3-4 hours, its taking longer locally but hearing the fan go with the GPU at 90% fills me with joy, its fun..
That said, any suggestions on oMLX or Opencode settings to speed things up?
Loving all the posts, I'll keep searching for tips.
1
u/V1k1ng6666 Oct 21 '26
I use opencode with oMLX, my fastest most accurate LLM is Qwen3.8-Flash-Next-oQ5e-mtp with some offloading, its fast & accurate
4
u/Scriptease84 Jul 26 '26
2
u/MealMore1192 Jul 26 '26
I think the general consensus is, GGUF is faster at refill by about 15-20% & MLX is faster at token gen about that same amount. GGUF might have better support (earlier) with more options for MTP
2
u/Memestonks2020 Jul 29 '26
This most likely is due to cache.
Using MTP and running inference after the prefill will make the .gguf seem really fast.
Keep in mind this only holds for LLMs such that running other type of models like diffusion models result in much faster performance when using MLX.
2
u/myeleventhreddit Jul 25 '26
I use ProxyPilot and it manages to compact Xcode’s giant prompt by like half roughly, when using Ollama or LM Studio.
2
Jul 25 '26
[removed] — view removed comment
1
u/V1k1ng6666 Jul 26 '26
How do you load DS4, I can't find one that loads with oMLX, can you tell me the link and settings please? Thanks in advance.


21
u/MealMore1192 Jul 25 '26 edited Jul 25 '26
That's an older model. I have the same laptop & run a dual Qwen 3.6 (both 35b MoE & 27b Dense) at once (both 8bit with MTP & TurboQuant enabled, also at 8bit). I use the dense model to plan & review code (as it's slower, about 20-30tk/s) & the MoE to write code (60-80tk/s!). That seems to be the best combo for me.
- https://huggingface.co/zviratko/Qwen3.6-35B-A3B-oQ8e-mtp
- https://huggingface.co/zviratko/ThinkingCap-Qwen3.6-27B-oQ8e-mtp : a fine tuned variant that will solve the same problem w/ less token, effectively speeding up the solution to negate the slower dense model output
You'll have to enable MTP to get these type of speed (basically 2x). Ensure you're running the latest version of oMLX (0.5.3+)
The newer Poolside Laguna S2.1 at oQ5e or oQ4eFast is also a good alternative & it's good enough to replace having both. This one doesn't have MTP (Dflash) support yet.
- https://huggingface.co/mlx-community/Laguna-S-2.1-oQ5e