Skip to content

AutoCua v1.0.0: Automatic Computer Use Agent

Choose a tag to compare

@FunctionFreak FunctionFreak released this 09 Oct 11:15
· 48 commits to main since this release

Automatic Computer Use Agent

AutoCua is an agent that drives your computer for you. Describe a task and it looks at the screen, decides what to do, and does it with the mouse and keyboard. It also takes control of iOS, on an iPhone, an iPad, or the iOS Simulator.

What it can drive

  • Your computer: macOS, Windows and Linux (computer use)
  • iPhone and iPad: a paired device or the iOS Simulator (needs a Mac)
  • Your browser: Chrome, through the AutoCua extension or headless
  • A terminal: a coding agent working in a real shell
  • From your phone: send tasks over Telegram

Get started

pip install autocua

Then call run_agent(...) and pick a surface with mode=. The Quick start in the README walks through it, including the extra steps for Linux and iOS.

Works with multiple model providers. Linux computer use needs a GNOME desktop.