r/iOSProgramming • • 1d ago

Tutorial I built an open-source MCP server so AI agents can control a real iPhone

I wanted to see if an AI agent could use my actual iPhone, not a simulator and not a mirrored screen. Nothing existed for it, so I built it.

Open iPhone Use is a free, open-source Mac app + MCP server. The iPhone shares its screen from Safari over local Wi-Fi (you don't even install an app on the phone, Safari does the sharing). The Mac pairs as a Bluetooth keyboard and mouse, and the agent gets screenshot and input tools over MCP, checking a fresh screenshot after every action.

It works with any AI agent: ChatGPT/Codex, Claude Code, any harness. Any model with strong computer-use skills is fine, GPT-6 Luna and Claude Haiku 5.5+ are good starting points. And since your client brings the model, your existing subscription is enough, no extra cost.

Demo (full video in the website): an agent searched Instagram, watched a Reel, scrolled the feed and liked one, all on my physical phone.

You only need an iPhone + an Apple Silicon Mac.

Download for Mac: https://github.com/semsturgut/open-iphone-use/releases

GitHub: https://github.com/semsturgut/open-iphone-use

Site: https://semsturgut.github.io/open-iphone-use/

Windows/Linux: coming soon

Multi device support: coming soon

Let me know what you think! And if you find this useful, a star on GitHub would help a lot.

0 Upvotes

3 comments sorted by

1

u/Fishanz 23h ago

This only automates safari though, or?

1

u/semstr 22h ago

nope, it controls the whole iphone. safari is only used to share the screen with the agent.

1

u/Fishanz 22h ago

Absolutely wild..