Skip to content

RoamRun 0.13.0

Latest

Choose a tag to compare

@mh-mobile mh-mobile released this 20 Nov 02:13
ca79cdd

Device control can pinch, turn and tap with two fingers, and elements gives each element's accessibility identifier. roamrunctl can show a device's screen in a browser and take touch and keys from it (roamrunctl view, experimental). Upgrading RoamRun is brew upgrade --cask roamrun.

New

  • roamrun pinch <name> <x> <y> <scale> [ms] [--rotate <degrees>]: two fingers about a point of the last look, ending scale (0.25–4) times as far apart, turned clockwise by --rotate (−180–180); scale 1 without --rotate is a two-finger tap. Also a pinch tool in roamrun mcp and roamrunctl mcp. A finger that would leave the screen is refused, not moved. An app from 0.8.0 to 0.12 answers roamrun mcp's pinch saying the app is older.
  • elements prints — id: <identifier> after a caption when the app set an accessibility identifier (roamrun elements, and the elements tool of roamrun mcp and roamrunctl mcp). It still gives no positions.
  • roamrunctl view (experimental) streams a device's screen (HEVC, decoded in the browser with WebCodecs) to a browser on your tailnet, with its sound when view runs on a Mac, and takes touch and keys from the page. It runs on the machine the device is connected to, by USB (--usb) or on the same Wi‑Fi (--at <IPv4 address>). It doesn't start without --allow; --token-file is needed for the machine itself, and --https <port> serves the page through tailscale serve until Ctrl-C. With --mcp, an agent's looks come from the same stream. See docs/roamrunctl-reference.md.

Changed

  • A bridge's relays and the reachability probes connect to the device without going through the system's proxy settings (#253). Before, a proxy set on the Mac could take those connections, and the handshake failed.
  • A swipe or pinch that is stopped part-way lifts its fingers instead of running to its end.
  • roamrunctl waits at most a set time for Tailscale (whois, status, serve), and says so when it doesn't answer.
  • roamrunctl comes with this release as roamrunctl-linux-x86_64.tar.gz, roamrunctl-linux-aarch64.tar.gz, roamrunctl-windows-x86_64.zip, roamrunctl-windows-aarch64.zip, roamrunctl-macos-aarch64.tar.gz and roamrunctl-macos-x86_64.tar.gz (checksums in roamrunctl-SHA256SUMS); brew install mh-mobile/tap/roamrunctl builds it from source; cargo install --locked --git https://github.com/mh-mobile/RoamRun --tag v0.13.0 roamrunctl with Rust 1.89 or later.

What to know

  • view is experimental: its options and messages may change. Through Tailscale the device's packets go missing and the picture stops until the next key frame; run it by USB or on the device's Wi‑Fi. Anyone --allow lets in sees the screen (notifications included) and can operate the device.
  • The Introducer app isn't in this release: it is built from iOS/ with Xcode.
  • The Windows builds aren't signed: SmartScreen may ask before one runs the first time.
  • Apple Watch has not been tried.

Known limits:

  • Tried for this release with builds of it, on an iPhone Duo: the bridge's checks (away on a hotspot through a relay, lldb at a breakpoint, the switch to "On this Wi‑Fi" and back); roamrun look, pinch, elements, tap, type, paste and press, and the same through roamrun mcp; roamrunctl pair control, and roamrunctl mcp --http with its checks, pinch, elements, tap and type. view by USB with the Duo folded and opened, and over HTTPS. Not tried: view from a browser outside the home network, view --at, pinch on an iPad, and roamrunctl on Linux or Windows with a device.