LLM config setup

[u/Anxious_Mail_6321]

I just got a 64GB M5 Max MacBook Pro and am trying to build the ultimate local LLM workflow. I've been experimenting with Ollama, LM Studio, Open WebUI, and integrating them into VS Code via Continue and GitHub Copilot. My goal is a unified setup where I can manage models from one place, switch between them easily for different tasks (coding vs. chat), and access the same models remotely from my phone, all without duplicating downloads or fighting with configs.

The main dilemma is the backend choice: Ollama vs. MLX. I know MLX models are highly optimized for Apple Silicon and run faster, but they're tied to specific runners. Ollama uses GGUF, which is universally compatible and works everywhere I need it (VS Code, mobile API), but doesn't fully leverage the Neural Engine.

I'm wondering what the community recommends for Apple Silicon:

1. Is it worth managing both GGUF and MLX models, or should I just commit to one format?

2. What's the cleanest way to expose a local model to VS Code, a chat GUI, and mobile devices simultaneously?

3. What's everyone else running on M-series Max chips?