Skip to content

Release v2.0.2

Choose a tag to compare

@github-actions github-actions released this 11 Nov 20:17
d8ddf40

What's Changed

Notes fallback: using CHANGELOG entry from 2.0.0 for 2.0.2.

Physical iPhone and iPad support

AXe now automates connected iPhones and iPads as well as simulators. Pass a device's hardware UDID to the same commands you use on a simulator: screenshots, accessibility reads, taps (by point or by --id, --label or --value), swipes, drags, draw, gestures, typing, keys, buttons, batches, rotate, settings, record-video and stream-video, including native H.264 with --format h264.

axe list-devices
axe doctor --udid "$DEVICE_UDID"     # pairing, Developer Mode, disk image, lock state
axe describe-ui --udid "$DEVICE_UDID"
axe tap --id "$ELEMENT_ID" --wait-timeout 15 --udid "$DEVICE_UDID"

Pair the device in Xcode, turn on Developer Mode and keep it unlocked; AXe never does any of these for you. button lock needs --allow-lock, and a command a device cannot run fails with unsupportedOnDevice. Reading a device's screen takes about 1 second plus 44 ms per element. See Physical iPhone and iPad and docs/device-support.md.

iPhone Duo support

Every input, read and capture command works on the dual-screen iPhone Duo simulator, on whichever screen is active, in any fold and orientation. New commands show the screens and move the hinge:

axe displays --udid "$UDID"               # each screen's role, size, orientation and the hinge angle
axe hinge set tabletop --udid "$UDID"     # 0...180, or closed, tabletop, open
axe rotate left --udid "$UDID"            # also works on physical devices

--input-mode selected with --screen-id and --screen-uuid refuses to act if a different screen becomes active, and record-video --follow-active-display records one movie through folds and rotations. See Displays, hinge and rotation and the device reference.

Agent mode

Add --agent to describe-ui, tap, type, swipe, drag, the key commands, slider, touch, gesture double-tap, gesture pinch and batch so an AI agent can drive the UI with every action checked. A capture returns compact rows with a ref for each control. An action names a ref, AXe checks the control is still there, sends the input and returns the new screen, so an agent needs no separate read after each action.

axe describe-ui --agent --view navigation --udid "$UDID"
axe tap --agent --snapshot-id "$SNAPSHOT_ID" --ref e9 --udid "$UDID"
axe type 'Ada' --agent --focus --snapshot-id "$SNAPSHOT_ID" --ref e18 --udid "$UDID"

batch --agent fills a form in one call, and a refusal sends no input and carries a typed code. Agent mode needs no model or API key. See Agent mode and the agent reference.

Structured output and error codes

Put --output json before a command to get one JSON result with a typed payload, or a typed error code instead of a message to parse. Simulators and devices share one set of error codes, and JSON Schema files describe every result.

$ axe --output json tap --id no-such-element --udid "$UDID"
{"command":"tap","data":{},"didError":true,"error":{"code":"elementNotFound","message":"No accessibility element matched --id 'no-such-element'. …"},…}

Text output is shorter and consistent too: state commands print their state, input commands print nothing except tap, slider and batch, and errors read as plain sentences. --verbose adds the full detail without changing the exit status. See Output and errors and schemas/.

Added

  • Added axe settings for simulators and devices to change appearance, text size, accessibility settings, VoiceOver, simulated location and the simulator status bar (Xcode 27 or later). See Settings.
  • Added axe draw to move one finger through up to 1,000 points. See Swipes, gestures and drawing.
  • Added long press, double tap and two-finger tap to tap (--hold, --count 2, --touches 2), on a point or an element. See Taps, typing and keys.
  • Added --until-id and --until-label to scroll presets and swipe, which scroll until an element is on screen, plus --distance, --inside-id and --inside-label for scroll presets.
  • Added the pinch, double-tap, rotate, two-finger-tap, two-finger-hold and two-finger-swipe gestures, a swipe-from-top-right-corner preset that opens Control Centre, and --edge-inset for edge swipes.
  • Added drag --hold to rest the finger before moving, for reordering a list.
  • Added slider --endpoint minimum|maximum.
  • Added shutdown for one simulator and clipboard copy --stdin to put text in a simulator's clipboard. See Simulator shutdown and clipboard.
  • Added the experimental axe agent "<goal>" command, which works towards a plain-language goal one checked action at a time using TypeSafe AI's Jev model. See docs/agent.md.
  • Added Claude Code and Codex plugin marketplaces, so the AXe skill stays updated as releases ship (#64 by @tal). See AI skill.

Changed

  • Simulator input and screen reads are much faster than in v1.8.0 (measured on an iPhone 18 Pro simulator): a tap takes about 0.08 s instead of about 1 s, a drag 0.9 s instead of 2.5 s, and describe-ui 0.3 s instead of 1.1 to 1.9 s.
  • Every command's --help is rewritten with a short description, examples and one-line option help, and help that was wrong is corrected.
  • The AXe skill that axe init installs is rewritten around agent mode.

Fixed

  • Fixed a command sent straight after button home on Xcode 27.2 failing with DTUHID guest barrier timed out.
  • Fixed a command intermittently failing with setsockopt(SO_RCVTIMEO) failed: Invalid argument.
  • Fixed touch leaving a finger held down after a --delay over 10 seconds, or after touch --down was left without --up.
  • Fixed an uncaught Objective-C exception crashing AXe; it now prints the exception and exits with 70 (#77 by @sbadakhc).
  • Fixed an accessibility read in the first seconds after boot breaking accessibility until the simulator was rebooted (#68).
  • Fixed gesture presets on iPads and large iPhones acting on a 390×844 corner of the screen instead of the whole screen.
  • Fixed stream-video sending PNG data as JPEG frames, and MJPEG streams whose frame boundaries did not match their header.
  • Fixed axe init leaving out the skill's reference files.
  • Fixed tap printing its error twice when a selector matched nothing, and batch hiding a step's validation message.
  • Fixed touch --help examples using options that do not exist (#80 by @demrom).

Various other internal improvements to stability, performance, and code quality.

Removed

  • Building from source no longer clones IDB: its frameworks are in Packages/IDBKit, and the IDB_CHECKOUT_DIR, IDB_GIT_URL, IDB_GIT_REF and IDB_UPSTREAM_BASE_REF build settings are gone.

Installation

Homebrew

brew tap cameroncooke/axe
brew install axe

Manual

Download AXe-macOS-v2.0.2-universal.tar.gz from the assets below and extract it.

Keep the extracted payload together:

axe
Frameworks/
AXe_AXe.bundle/

Then either run ./axe from the extracted directory or symlink that axe executable onto your PATH without moving it away from Frameworks/ and AXe_AXe.bundle/.