Repository navigation
Releases: ComputerUseAgent/AutoCua
Release list
AutoCua v0.1.2: iPhone, browser and computer at once
The Mac agent can now hand work to a plugged-in iPhone, computer use, the iPhone and the browser run at the same time, and the desktop app opens in its own Chromium window, pip installs included.
What's new
- iPhone from the Mac agent: plug in a paired iPhone or iPad and the Mac computer-use agent connects it in the background and delegates tasks to it (
ios_agent), with the live phone screen in its own window. - Everything at once: computer use, the iPhone and the browser now work at the same time from the app.
- Desktop app in Chromium: the app opens in its own Electron window on macOS, Windows and Linux, on its own port (27321) instead of 5000. pip installs no longer need Node.js: the first
ui=Truelaunch asks before fetching Electron (checked against a pinned SHA-256). Ubuntu 24.04+ is supported. - Web scrape mode: a new
indextool stores what the agent keeps from each chunk as numbered JSON underAutoCua_data/scrapes, and the indexes survive memory compression and resumed chats. - Leaner agent notes: Claude agents'
agent_memoryis now justmemory+next_goal, and memory compression is on. - UI: a new splash with the logo and wordmark, the memory gauge as a ring beside the Skills icon, and Shell runs that show their done message and the chat's earlier runs.
Fixes
- Screen resolution set to 1080p across all OSes.
- Mac
open_appno longer moves or resizes the app's window. - Browser scans wait for the page to load, fixing "no answer from AutoCuaBridge in 40s".
- The first click after typing in the chat box now registers.
- iOS connection fixes.
Get started
pip install -U autocua
This release is autocua 0.1.2 on PyPI. The Quick start in the README covers the rest.
Full changelog: v1.0.0...v0.1.2
AutoCua v1.0.0: Automatic Computer Use Agent
Automatic Computer Use Agent
AutoCua is an agent that drives your computer for you. Describe a task and it looks at the screen, decides what to do, and does it with the mouse and keyboard. It also takes control of iOS, on an iPhone, an iPad, or the iOS Simulator.
What it can drive
- Your computer: macOS, Windows and Linux (computer use)
- iPhone and iPad: a paired device or the iOS Simulator (needs a Mac)
- Your browser: Chrome, through the AutoCua extension or headless
- A terminal: a coding agent working in a real shell
- From your phone: send tasks over Telegram
Get started
pip install autocuaThen call run_agent(...) and pick a surface with mode=. The Quick start in the README walks through it, including the extra steps for Linux and iOS.
Works with multiple model providers. Linux computer use needs a GNOME desktop.