Skip to content

AutoCua v0.1.4: Sharper iOS taps and browser fixes

Latest

Choose a tag to compare

@FunctionFreak FunctionFreak released this 20 Oct 09:27
· 19 commits to main since this release

Sharper iPhone control, a browser window that stays out of your way, and a livelier Shell use mascot.

What's new

iOS

  • Sees more controls: the element tree now keeps picker wheels, text boxes (like Google Calendar's "Add title"), scroll lists, and elements that hold a value, like Google Calendar's time wheels and its Event / Task / Birthday row.
  • Wide switches work: tapping a switch wider than 100 pt now hits its knob, so whole-row toggles like Google Calendar's "All day" respond.
  • New ground_click tool: taps a raw point (x, y on a 0–1000 scale of the screenshot) for targets with no [id], like one chip inside a wide element. click stays the main way to tap.
  • Clean shutdown: closing the app now releases the iPhone, and WDA runners left behind by a crashed or force-quit app are cleared on connect. Runners with a live parent are never touched.

Browser

  • Chrome is never the whole screen: in extension mode, a maximised or full-screen window goes back to a normal window when a run starts (or 76% × 96% of the screen, centred). A window you sized yourself is left as it is.
  • Cursor bubble shimmers again: the light sweeps across the words every 1.2 s.

Shell use

  • Round mascot head with moving eyes: the eyes glance around at rest, wake with a quick look when the agent starts, and glide slowly while it works. Motion runs at a steady 60 steps a second, so 120 Hz screens don't speed it up.

Get started

pip install -U autocua

Merged PRs: #18, #19

Full changelog: V0.1.3...v0.1.4