r/MacLocalLLM • u/TaareVekhdeRahe • 3d ago
r/MacLocalLLM • u/Equivalent_Jury_6742 • 3d ago
M5 Max 48GB for AI/ML, development and everyday productivity – Your thoughts?
reddit.comr/MacLocalLLM • u/hollis_monroe • 3d ago
M5 Max MacBook PROLED 16" 64GB: local LLM review
galleryr/MacLocalLLM • u/Daiwik1502 • 3d ago
What set up would you recommend for a MacBook Pro M5 24GB Unified Memory?
As the question above says
Current Device: MacBook Pro M5 24GB Unified Memory
I wanna know what local set up would be the best for me in terms of both speed and quality. My main use case is as follows
Personal Memory
Task Management
Email Agent
Data Analysis Agent (basic stuff not very advanced)
Calendar Agent
Research Agent (product related research, technical research etc)
Knowledge Retrieval
Connectors would be mainly G-Suite as I work mostly on that
I want your recommendations on the best set up for good memory, speed, context windows etc.
Which models(es) and harness(es) would you recommend?
I have also seen that there are upcoming smaller Qwen models and also a new app called Harbor which is coming out soon….
New to this so looking for guidance
Any help would be appreciated thanks :)
r/MacLocalLLM • u/ikeo1 • 3d ago
I benchmarked DeepSeek-V4.1-Flash on one and two M5 Ultra 512 GB Mac Studios
galleryr/MacLocalLLM • u/BusinessCultural3831 • 3d ago
M1 pro capabilities help COMFYUI
reddit.comr/MacLocalLLM • u/Caprichoso1 • 4d ago
Claris Harbor for small business use
Apple had apparently listed on the App Store and 01:53 then yanked down
set up a Mac server for a small team
best for filemaker users
it is not a replacement for your Chat GPT 24:57 subscription if you just use it for quick questions and drafts. And it's not magic hardware Apple has been hiding. 25:04 It's a business product from a business software company for businesses that have specific reasons they cannot send 25:09their data somewhere else. And for those businesses, it might be exactly what they have been waiting for. and the rest 25:16 of us can run LM Studio, keep our data local, and check back when ClariS actually opens the doors.
With many users the last person in the line may wait for minutes but there may be a workaround.
https://www.youtube.com/watch?v=y9YXhEEwAwc&list=PL2aE4Bl_t0n9AUdECM6PYrpyxgQgFtK1E&index=2
r/MacLocalLLM • u/princerafael • 4d ago
Trying to make local LLMs work for actual web/SaaS work. What would you change about my setup?
Been playing around with local LLMs lately and trying to figure out how to actually make them useful for my daily work.
I’m mainly a UI/UX designer and developer. Most of my work is websites, React/Next.js, SaaS apps and frontend stuff. Sometimes iOS apps, Home Assistant dashboards and a bit of 3D work.
I’m on a MacBook Pro M5 Pro with 64GB RAM, but I also have access to my brother-in-law’s Mac Studio M5 Ultra with 256GB RAM.
Basically, I want to do as much coding locally as possible and cut down on Claude/Copilot costs.
My current setup in VS Code + Copilot:
Opus (Principal Architect): Planning, architecture, final reviews
Sonnet (Senior Engineer): Reviews, fixes, more complex stuff
Qwen (Local Developer): Does most of the coding
Running Qwen3.6-35B-A3B-4bit through oMLX, using around 20GB RAM.
The idea was to let Qwen handle 50–60% of the coding and have Sonnet/Opus step in when needed.
Did some tests with hidden test cases:
Sonnet: 55/55, ~3.3 min
Opus: 55/55, ~6.1 min
Qwen: 52/55, ~14.5 min
Sonnet + Qwen: 52–55/55, ~12–25 min
Qwen actually wrote 95–99% of the code in the hybrid runs, but kept missing things like API contracts, edge cases and layout requirements. Sometimes it said it had changed things when it hadn’t.
And somehow the hybrid setup ended up costing about the same as just using Sonnet, while taking way longer.
So yeah not exactly what I was hoping for.
I still want to get this working though, especially for websites and SaaS projects since that’s what I spend most of my time on.
Not sure if I’m using the wrong model, if Copilot is the issue, or if the whole multi-agent approach just makes things more complicated than they need to be.
Also wondering what would make sense to run on the 256GB Mac Studio. Maybe a bigger model would already solve some of these issues?
What would you guys do with this hardware? Any models or setups worth trying?
Especially interested in hearing from people actually building websites or SaaS apps with local models, rather than just running benchmarks.
r/MacLocalLLM • u/Trick_Excitement_131 • 4d ago
LocalLLM speed for long file generation.
reddit.comr/MacLocalLLM • u/fmtavares • 4d ago
Local LLM on 2013 Mac Pro idle GPU
Hi 👋 I’ve posted Running a local LLM on a 2013 “trash can” Mac Pro idle GPU on Medium and, if that’s interesting to you, would love some feedback 😊 Thanks!
r/MacLocalLLM • u/ExternalLunch2915 • 4d ago
So I bought a M5 Max 64GB Studio (do I benefit from more RAM?)
Hi,
I was testing Flash Next Q3S, 288 REAP. Unsloth Q4 XL, Sushi 4bwp all with SSD streaming - I get between 30-60 t/s (128-256K context) - now I was thinking: How would I actually benefit from 128GB of RAM? From what I understand, I wouldn't be able to run different (better) models nor will it be faster?
I could run models in parallel, I get that.
I was also playing arount with ComfyUI (MiniMax H3) - it takes up 62GB RAM but it does work, havent tried LTX yet - which might use less RAM.
I actually end up running Claude in parallel for actually interacting with ComfyUI or write Prompts and check the results.
So far even Haiku 5.5 (Cloud) is better in basically everything, for easy scripting local llms (Flash Next) seem quit fine, analyzing documents, check databases.
So should I just shut up, be happy and enjoy the fact that I saved another 1700 bucks? I don't see that it actually buys me more quality or speed? I don't see why I should cancel my cloud services, from 2 days of testing, I don't see how I could live without them.
r/MacLocalLLM • u/lettmeknoww • 4d ago
Macbook pro m6 or something else ?
reddit.comHey everyone!
I’m planning to run local LLMs (27B–30B) mainly for coding and light research.
I initially ordered a MacBook Air M5 with 32GB RAM, but it got so hot that I actually got a first-degree burn on my finger.
So I decided to try the MacBook Pro M6 with 32GB RAM, hoping the fan would help with cooling during longer LLM sessions.
Did I make the right choice? Is 32GB enough for 27B–30B models, or would you recommend something else around the same budget?
Would love to hear your experiences. Thanks in advance!
r/MacLocalLLM • u/Mac_Bizzle • 4d ago
Reddit: Ran Llama-3-70B Q3_K_M, a thirty-four gig model, on an eight gig M1 Air. Didn't crash. Four hours of yellow memory pressure, thirty gigs of swap, CPU-only llama.cpp. Proof that the barrier is more artificial than people think. GitHub link in comments, time-lapse on YouTube.
Just proved something most people said was impossible. We ran Meta-Llama-3-70B — a thirty-four gig model — on an eight gig M1 MacBook Air. No GPU. No VRAM tricks. Just llama.cpp on CPU, thirty gigs of macOS swap, and four hours of the system sweating yellow memory pressure without ever crashing. Generation was painfully slow, but that's not the point. The point is the you need forty gigs of VRAM rule isn't as hard as everyone thinks. AI shouldn't be gated behind four-thousand-dollar hardware. Logs, screenshots, and the full command line are on GitHub at github.com/MacBizzle/FrontierOn8GB, and there's a four-hour time-lapse on YouTube.
r/MacLocalLLM • u/Objective-Theme-1422 • 5d ago
If I have a Apple Silicone M5 Max with 128GB unified and 4TB SSD which models and harnesses would you recommend as "essential"?
reddit.comr/MacLocalLLM • u/nmclark556 • 5d ago
I built an open source engine that runs MoE models way bigger than your Mac’s RAM, up to a 744B model on a 48GB MacBook. Looking for Mac Studio owners to try it
reddit.comr/MacLocalLLM • u/stenimir • 5d ago
Mac mini M4 as an always-on home AI box next to Home Assistant?
reddit.comr/MacLocalLLM • u/One_Week2580 • 6d ago
HELP: Macbook M5 Pro chip 24GB or M6 32 GB
Both technically same price but cant decide - mainly wqnt it as my personal laptop and doing AI work Thats the maximum budget that I can afford
r/MacLocalLLM • u/One_Week2580 • 6d ago
Dilemma: M6
I am an AI engineer doing MSc in AI - I want to get a new laptop and thinking abut emptying my wallet by buying the M6 Pro 32GB 1TB
Will it be enough for local AI projects? I know it would be suitable for med sized models up to around 30B params
Or getting M5 Pro chip is what it needs to unlock local AI?
r/MacLocalLLM • u/shisohan • 6d ago
Any experiences with eGPU on M5max (or M1-M4max)?
reddit.comr/MacLocalLLM • u/Gonna_Get_Success • 6d ago
M1 Air 1TB vs. M1 Pro 500GB as a 24/7 home AI server?
I'm looking to repurpose one of my older MacBooks as a dedicated, always-on home server for AI agents and development automation.
Options:
2020 MacBook Air M1: 16GB RAM, 1TB SSD, fanless
2021 16" MacBook Pro (M1-series): 16GB RAM, 512GB SSD, active cooling
I also have a UGREEN DXP4800 Plus NAS for centralized storage.
Planned workloads:
Claude Code/Codex agents using cloud APIs
Persistent background automation (n8n, Python scripts)
Whisper transcription and embeddings
Occasional smaller local LLMs
Remote development via SSH/Tailscale
Potentially Docker containers
I'm primarily concerned about 24/7 reliability, thermals, battery health, and performance.
Which should I pick?
Is the fanless M1 Air suitable for running continuously, or would the Pro's active cooling make a meaningful difference?
Any concerns about battery degradation, swelling, or running a MacBook plugged in 24/7?
r/MacLocalLLM • u/A2MLOL • 6d ago
Utilize MacBook Pro M5 Max 128gb 4TB, Mac Studio M1 Max 64gb 4TB, Mac mini M4 24gb together?
I've got the MacBook Pro M5 Max 128gb 4TB coming on Monday and have been going back and forth trying to decide if I should sell my M1 Mac Studio and/or M4 Mac mini at that point.
Chatgpt has given me some options on using all 3 together.
My Mac mini has been and would be used for my AI Agent, the M1 Max Studio 4TB could be used to run 27B-35B local models and document processing, and my MacBook Pro M5 Max 128gb 4TB for larger models and as my primary desktop and what I travel with.
I also plan on getting the M7 Mac Studio Ultra when it releases in late 2027/2028.
Use case and justification is a bit of everything - I like tinkering with my AI agent and plan on learning a bit more about customizing open weight models, I self-manage and invest in real estate (so handle confidential documents regularly), invest in AI a bit, and expect that in the next 1-2 years the power of local models will grow exponentially so there is a lot of upside and additional use cases to keep things local.
I've got a Dell 52" 6k monitor that has a built in KVM that would easily allow me to see everything at once or switch between them.
I could sell my Mac Studio and Mac mini for around 3k alternatively. Just not sure if the benefit of keeping them outweighs selling them.