Skip to content

OpenComputer 0.4.2 — screenshots that finish, Telegram that reads

Choose a tag to compare

@00cyre 00cyre released this 12 Nov 07:20
· 17 commits to main since this release

OpenComputer now captures screenshots reliably, reads apps that hide their list rows, and covers everything since 0.3.0: background keys and clicks, focus restoration, changed-target refusals, and a per-session action log.

New in 0.4.2

  • Screenshots no longer hang. ScreenCaptureKit waits forever when the helper binary lives in ~/Documents, ~/Desktop, ~/Downloads, or iCloud Drive, even with Screen Recording granted. The JavaScript client now runs a copy staged in ~/Library/Application Support/OpenComputer/helper/, and a capture that still stalls fails with CAPTURE_TIMEOUT after 12 s.
  • Hidden list rows. Lists, tables, outlines, and scroll areas that expose no children (Telegram's message list, for example) are hit-tested across their visible area. What turns up is walked like any element and marked via: "hitTest". Only rows on screen are found: scroll and observe again for more.

Since 0.3.0 (0.4.0, 0.4.1)

  • Keys and key-delivered typing go to the target process only. click and clickPoint press through accessibility with no synthetic mouse events. open launches apps or URLs without activating them.
  • Faster batched observation with a compact outline and query search. Element IDs survive actions.
  • An app that brings itself forward is sent back (focusRestored). Only activity in the same window returns USER_BUSY, after waiting up to waitMs for a pause.
  • TARGET_CHANGED and STALE_ELEMENT refuse actions whose window title, tab, or page changed since the snapshot.
  • One JSON Lines action log per session in ~/Library/Logs/OpenComputer. opencomputer log merges them.

Changed: app.pressKey(key, {element}) replaces pressKey(element, key). MCP observe returns text unless format: "json".

Requires macOS 14+ and Node 22+. The runtime ZIP contains an ad-hoc signed universal Apple Silicon/Intel helper. Intel is cross-compiled, not hardware-tested. Reconnect clients after updating. Full details are in CHANGELOG.md.