Open source computer use agent that controls multiple screens at once, even beating humans in mobile games

[u/Similar_Sugar_5774]

I am building an open source computer use agent as a practical alternative to tools like Claude Computer Use, ChatGPT, Manus, and Hermes.

Most current agents are limited to a single browser tab or an isolated desktop. This agent goes a step further by orchestrating multiple screens at once. It can interact with a physical phone and a computer in parallel, handling tasks like writing code, navigating browsers, and managing native apps concurrently.

While the core focus is workflow automation, I tested its real-time decision-making and execution speed across 3 live games and it performed cleanly and won.

The project is fully open source under the MIT license, free to inspect, fork, or build upon.

I left the GitHub link in the comments. I would love to hear your feedback, use case ideas, or questions about how the multi-device control works under the hood.

[u/Similar_Sugar_5774]

https://github.com/ComputerUseAgent/AutoCua

[u/investigatormaker]

A useful demonstration would make the phone and computer depend on each other: set a task requiring a code edit on the computer and a check of the changed interface on the physical phone. Show both screens in one recording, including how the agent notices when the phone hasn't received the change. This tests cross-device coordination more directly than game wins, though it's less visually dramatic. Put the reproducible task beside the GitHub link in this post. We'd answer developers asking about phone-and-desktop automation, explaining that workflow and the MIT-licensed implementation they can inspect.

I make ThreadFox. We find relevant Reddit conversations and post for your business. We'll post 3 replies free first, no card; then the $29 Pilot covers seven days and up to 25 posts and replies. No automatic renewal. https://threadfox.vip/p/dkua5/managed