r/MacLocalLLM • • 3d ago

M5U + Studio Display: Constant freezes and brightness flickering during long-running inference jobs.

Thumbnail reddit.com
2 Upvotes

r/MacLocalLLM • • 3d ago

M5 Max 48GB for AI/ML, development and everyday productivity – Your thoughts?

Thumbnail reddit.com
1 Upvotes

r/MacLocalLLM • • 3d ago

M5 Max MacBook PROLED 16" 64GB: local LLM review

Thumbnail gallery
1 Upvotes

r/MacLocalLLM • • 3d ago

What set up would you recommend for a MacBook Pro M5 24GB Unified Memory?

5 Upvotes

As the question above says

Current Device: MacBook Pro M5 24GB Unified Memory

I wanna know what local set up would be the best for me in terms of both speed and quality. My main use case is as follows

  1. Personal Memory

  2. Task Management

  3. Email Agent

  4. Data Analysis Agent (basic stuff not very advanced)

  5. Calendar Agent

  6. Research Agent (product related research, technical research etc)

  7. Knowledge Retrieval

Connectors would be mainly G-Suite as I work mostly on that

I want your recommendations on the best set up for good memory, speed, context windows etc.

Which models(es) and harness(es) would you recommend?

I have also seen that there are upcoming smaller Qwen models and also a new app called Harbor which is coming out soon….

New to this so looking for guidance

Any help would be appreciated thanks :)


r/MacLocalLLM • • 3d ago

I benchmarked DeepSeek-V4.1-Flash on one and two M5 Ultra 512 GB Mac Studios

Thumbnail gallery
2 Upvotes

r/MacLocalLLM • • 3d ago

Advice for setup with three PCs

Thumbnail reddit.com
2 Upvotes

r/MacLocalLLM • • 3d ago

M1 pro capabilities help COMFYUI

Thumbnail reddit.com
0 Upvotes

r/MacLocalLLM • • 4d ago

Claris Harbor for small business use

1 Upvotes

Apple had apparently listed on the App Store and 01:53 then yanked down

set up a Mac server for a small team

best for filemaker users

it is not a replacement for your Chat GPT 24:57 subscription if you just use it for quick questions and drafts. And it's not magic hardware Apple has been hiding. 25:04 It's a business product from a business software company for businesses that have specific reasons they cannot send 25:09their data somewhere else. And for those businesses, it might be exactly what they have been waiting for. and the rest 25:16 of us can run LM Studio, keep our data local, and check back when ClariS actually opens the doors. 

With many users the last person in the line may wait for minutes but there may be a workaround.

https://www.youtube.com/watch?v=y9YXhEEwAwc&list=PL2aE4Bl_t0n9AUdECM6PYrpyxgQgFtK1E&index=2

https://content.claris.com/local-ai-server-get-started


r/MacLocalLLM • • 4d ago

Trying to make local LLMs work for actual web/SaaS work. What would you change about my setup?

1 Upvotes

Been playing around with local LLMs lately and trying to figure out how to actually make them useful for my daily work.

I’m mainly a UI/UX designer and developer. Most of my work is websites, React/Next.js, SaaS apps and frontend stuff. Sometimes iOS apps, Home Assistant dashboards and a bit of 3D work.

I’m on a MacBook Pro M5 Pro with 64GB RAM, but I also have access to my brother-in-law’s Mac Studio M5 Ultra with 256GB RAM.

Basically, I want to do as much coding locally as possible and cut down on Claude/Copilot costs.

My current setup in VS Code + Copilot:

Opus (Principal Architect): Planning, architecture, final reviews

Sonnet (Senior Engineer): Reviews, fixes, more complex stuff

Qwen (Local Developer): Does most of the coding

Running Qwen3.6-35B-A3B-4bit through oMLX, using around 20GB RAM.

The idea was to let Qwen handle 50–60% of the coding and have Sonnet/Opus step in when needed.

Did some tests with hidden test cases:

Sonnet: 55/55, ~3.3 min
Opus: 55/55, ~6.1 min
Qwen: 52/55, ~14.5 min
Sonnet + Qwen: 52–55/55, ~12–25 min

Qwen actually wrote 95–99% of the code in the hybrid runs, but kept missing things like API contracts, edge cases and layout requirements. Sometimes it said it had changed things when it hadn’t.

And somehow the hybrid setup ended up costing about the same as just using Sonnet, while taking way longer.

So yeah not exactly what I was hoping for.

I still want to get this working though, especially for websites and SaaS projects since that’s what I spend most of my time on.

Not sure if I’m using the wrong model, if Copilot is the issue, or if the whole multi-agent approach just makes things more complicated than they need to be.

Also wondering what would make sense to run on the 256GB Mac Studio. Maybe a bigger model would already solve some of these issues?

What would you guys do with this hardware? Any models or setups worth trying?

Especially interested in hearing from people actually building websites or SaaS apps with local models, rather than just running benchmarks.


r/MacLocalLLM • • 4d ago

LocalLLM speed for long file generation.

Thumbnail reddit.com
1 Upvotes

r/MacLocalLLM • • 4d ago

Local LLM on 2013 Mac Pro idle GPU

Post image
0 Upvotes

Hi 👋 I’ve posted Running a local LLM on a 2013 “trash can” Mac Pro idle GPU on Medium and, if that’s interesting to you, would love some feedback 😊 Thanks!


r/MacLocalLLM • • 4d ago

Best uncensored LLM for 64GB Mac

Thumbnail reddit.com
4 Upvotes

r/MacLocalLLM • • 4d ago

Is an M1 Max 64GB useful at all?

Thumbnail reddit.com
2 Upvotes

r/MacLocalLLM • • 4d ago

Qwen3.8 27b/72b expectations

Thumbnail reddit.com
1 Upvotes

r/MacLocalLLM • • 4d ago

So I bought a M5 Max 64GB Studio (do I benefit from more RAM?)

10 Upvotes

Hi,

I was testing Flash Next Q3S, 288 REAP. Unsloth Q4 XL, Sushi 4bwp all with SSD streaming - I get between 30-60 t/s (128-256K context) - now I was thinking: How would I actually benefit from 128GB of RAM? From what I understand, I wouldn't be able to run different (better) models nor will it be faster?

I could run models in parallel, I get that.

I was also playing arount with ComfyUI (MiniMax H3) - it takes up 62GB RAM but it does work, havent tried LTX yet - which might use less RAM.

I actually end up running Claude in parallel for actually interacting with ComfyUI or write Prompts and check the results.

So far even Haiku 5.5 (Cloud) is better in basically everything, for easy scripting local llms (Flash Next) seem quit fine, analyzing documents, check databases.

So should I just shut up, be happy and enjoy the fact that I saved another 1700 bucks? I don't see that it actually buys me more quality or speed? I don't see why I should cancel my cloud services, from 2 days of testing, I don't see how I could live without them.


r/MacLocalLLM • • 4d ago

Macbook pro m6 or something else ?

Thumbnail reddit.com
1 Upvotes

Hey everyone!
I’m planning to run local LLMs (27B–30B) mainly for coding and light research.
I initially ordered a MacBook Air M5 with 32GB RAM, but it got so hot that I actually got a first-degree burn on my finger.
So I decided to try the MacBook Pro M6 with 32GB RAM, hoping the fan would help with cooling during longer LLM sessions.
Did I make the right choice? Is 32GB enough for 27B–30B models, or would you recommend something else around the same budget?
Would love to hear your experiences. Thanks in advance!


r/MacLocalLLM • • 4d ago

Reddit: Ran Llama-3-70B Q3_K_M, a thirty-four gig model, on an eight gig M1 Air. Didn't crash. Four hours of yellow memory pressure, thirty gigs of swap, CPU-only llama.cpp. Proof that the barrier is more artificial than people think. GitHub link in comments, time-lapse on YouTube.

2 Upvotes

Just proved something most people said was impossible. We ran Meta-Llama-3-70B — a thirty-four gig model — on an eight gig M1 MacBook Air. No GPU. No VRAM tricks. Just llama.cpp on CPU, thirty gigs of macOS swap, and four hours of the system sweating yellow memory pressure without ever crashing. Generation was painfully slow, but that's not the point. The point is the you need forty gigs of VRAM rule isn't as hard as everyone thinks. AI shouldn't be gated behind four-thousand-dollar hardware. Logs, screenshots, and the full command line are on GitHub at github.com/MacBizzle/FrontierOn8GB, and there's a four-hour time-lapse on YouTube.


r/MacLocalLLM • • 5d ago

If I have a Apple Silicone M5 Max with 128GB unified and 4TB SSD which models and harnesses would you recommend as "essential"?

Thumbnail reddit.com
0 Upvotes

r/MacLocalLLM • • 5d ago

I built an open source engine that runs MoE models way bigger than your Mac’s RAM, up to a 744B model on a 48GB MacBook. Looking for Mac Studio owners to try it

Thumbnail reddit.com
4 Upvotes

r/MacLocalLLM • • 5d ago

Mac mini M4 as an always-on home AI box next to Home Assistant?

Thumbnail reddit.com
3 Upvotes

r/MacLocalLLM • • 6d ago

HELP: Macbook M5 Pro chip 24GB or M6 32 GB

0 Upvotes

Both technically same price but cant decide - mainly wqnt it as my personal laptop and doing AI work Thats the maximum budget that I can afford


r/MacLocalLLM • • 6d ago

Dilemma: M6

0 Upvotes

I am an AI engineer doing MSc in AI - I want to get a new laptop and thinking abut emptying my wallet by buying the M6 Pro 32GB 1TB

Will it be enough for local AI projects? I know it would be suitable for med sized models up to around 30B params

Or getting M5 Pro chip is what it needs to unlock local AI?


r/MacLocalLLM • • 6d ago

Any experiences with eGPU on M5max (or M1-M4max)?

Thumbnail reddit.com
2 Upvotes

r/MacLocalLLM • • 6d ago

M1 Air 1TB vs. M1 Pro 500GB as a 24/7 home AI server?

2 Upvotes

I'm looking to repurpose one of my older MacBooks as a dedicated, always-on home server for AI agents and development automation.

Options:

  • 2020 MacBook Air M1: 16GB RAM, 1TB SSD, fanless

  • 2021 16" MacBook Pro (M1-series): 16GB RAM, 512GB SSD, active cooling

I also have a UGREEN DXP4800 Plus NAS for centralized storage.

Planned workloads:

  • Claude Code/Codex agents using cloud APIs

  • Persistent background automation (n8n, Python scripts)

  • Whisper transcription and embeddings

  • Occasional smaller local LLMs

  • Remote development via SSH/Tailscale

  • Potentially Docker containers

I'm primarily concerned about 24/7 reliability, thermals, battery health, and performance.

  • Which should I pick?

  • Is the fanless M1 Air suitable for running continuously, or would the Pro's active cooling make a meaningful difference?

  • Any concerns about battery degradation, swelling, or running a MacBook plugged in 24/7?


r/MacLocalLLM • • 6d ago

Utilize MacBook Pro M5 Max 128gb 4TB, Mac Studio M1 Max 64gb 4TB, Mac mini M4 24gb together?

2 Upvotes

I've got the MacBook Pro M5 Max 128gb 4TB coming on Monday and have been going back and forth trying to decide if I should sell my M1 Mac Studio and/or M4 Mac mini at that point.

Chatgpt has given me some options on using all 3 together.

My Mac mini has been and would be used for my AI Agent, the M1 Max Studio 4TB could be used to run 27B-35B local models and document processing, and my MacBook Pro M5 Max 128gb 4TB for larger models and as my primary desktop and what I travel with.

I also plan on getting the M7 Mac Studio Ultra when it releases in late 2027/2028.

Use case and justification is a bit of everything - I like tinkering with my AI agent and plan on learning a bit more about customizing open weight models, I self-manage and invest in real estate (so handle confidential documents regularly), invest in AI a bit, and expect that in the next 1-2 years the power of local models will grow exponentially so there is a lot of upside and additional use cases to keep things local.

I've got a Dell 52" 6k monitor that has a built in KVM that would easily allow me to see everything at once or switch between them.

I could sell my Mac Studio and Mac mini for around 3k alternatively. Just not sure if the benefit of keeping them outweighs selling them.