Initial Public Release
Give AI agents the ability to observe and act on iOS Simulator and Android emulator / device screens.
Added
- Cross-platform CLI driving iOS Simulator and Android emulator/device through a single command surface.
ui— compact, token-efficient screen outline with@Nalias addressing and#<id>/#N/#N@Mselectors.- Full interaction surface:
tap,swipe,long-press,touch,type,paste,button,gesture,multi-touch,keyboard-state,screenshot,record-video,app-state. - iOS-only verbs under
sim-use ios:key,key-combo,key-sequence,stream-video,batch. - Android bridge APK with AccessibilityService + HTTP server, bootstrapped via
sim-use android init. - Per-UDID background daemon for iOS, amortising per-call init cost.
- Cross-command crash / termination detection with process-liveness tracking and Android crash-dialog detection.
sim-use viewer— bundled local web app for visualising the accessibility tree with blind-spot overlay.sim-use init— install the bundled agent skill into Claude Code or other AI clients.--jsonenvelope on every command for machine consumption.
Install
brew tap lycorp-jp/tap
brew install lycorp-jp/tap/sim-useOn Homebrew 6.0.5+, if you see an "untrusted tap" error, run brew trust lycorp-jp/tap first.
Or build from source — see README.