Skip to content

Computer Use 0.4.0 — macOS beta

Choose a tag to compare

@Hmbown Hmbown released this 14 Sep 05:35
· 145 commits to main since this release

Codewhale Computer Use 0.4.0 adds the accessibility primitives a real messaging task was missing: Return/Enter from type, a filtered and paginated get_app_state, focus and get_value on observed elements, and an app click strategy that stays inside the bound app's window. The shared-desktop pointer gate is unchanged.

Install. Download the disk image, open it, and drag Codewhale Computer Use into Applications. Open it once from Applications. The setup panel walks through Accessibility and Screen Recording permissions. Apple silicon and Intel Macs on macOS 13.5 or later are supported; Node 24.21.0 is bundled, so no separate Node install or compiler is needed.

  • Download and setup guide: https://codewhale.net/computer-use
  • Connect it in Codewhale's plugin marketplace (Computer Use 0.4.0) so local actions go through the helper's Pause and Stop controls.
  • Updates: choose Check for updates… in the app. Before installing, it verifies the archive digest, the Codewhale signing identity and the notarized Developer ID verdict, and keeps the previous app for recovery.

What changed since 0.3.1

  • type treats newlines and press_enter as Return/Enter instead of inserting a literal character. key remains the named key-press tool.
  • get_app_state filters (query, role), paginates (limit, offset) and truncates oversized dumps instead of eating the middle of the JSON; detail:"compact" is smaller. find_elements searches a cached state_id.
  • focus and get_value act on observed elements; text-field values stay in the state dump.
  • Accessibility clicks focus a field that exposes AXFocused even when it is not AXPressable.
  • strategy:"app" allows a pointer event only when the point is inside the bound app's window, then restores the cursor. strategy:"event" still requires shared-desktop authorization.
  • Coordinate targets accept space:"screen"; ocr_region limits OCR to a screen rect; run_actions batches up to 8 steps.
  • Receipts no longer tell the model to use tools that are not in this catalog.

Verification

  • Built from source commit 249ae77fad9162c2af11d5460d91b2b5b909c06c; every packaged plugin file is byte-identical to that commit.
  • Developer ID signed with the hardened runtime. Apple accepted notarization submission 08f574c9-e4d7-4ff7-b7e1-431136fd4262; the stapled app passes codesign --verify --deep --strict, stapler validate, and Gatekeeper (spctl: Notarized Developer ID).
  • Disk image Codewhale-Computer-Use-0.4.0-macos-universal.dmg: SHA-256 3ee12be851a9f7a2feb43fa55eea0abbd5ea9ffc83472b20ccb2d0dab7aae4d8 (88,254,027 bytes), Developer ID signed, notarized (submission 0416455e-1798-4397-b0d0-c9b1bf5cb8dd) and stapled. It contains the same notarized app.
  • ZIP archive Codewhale-Computer-Use-0.4.0-macos-universal.zip: SHA-256 753565134e9fa36ac1435b64af0613d4df8195503bad56b93c80fdee0df6a637 (79,725,412 bytes). This is what Check for updates… installs. release.json and SHA256SUMS.txt cover both files.
  • Source suite at that commit: 245 passed, 0 failed, 15 platform skips.

Beta scope. Qualification so far comes from one maintainer Mac. The new AX primitives are covered by the source suite; their native qualification on an installed build, a clean-machine first install with fresh permission grants, a model-driven task through an installed Codewhale Engine, and the non-admin Applications-folder update path are still being gathered as public evidence; please report anything you hit at https://github.com/Hmbown/codewhale-cu-plugin/issues. This release is the Mac helper only; it does not change the separate Codewhale Engine release.