ghost v0.5.1

Highlights

Semantic computer use

Ghost’s click and type tools now act through macOS AX, Windows UIA, and Linux AT-SPI, with each input tool returning a via field and a disposition: delivered, verified, retried, or refused. Automatic HID fallback happens only in auto mode and only for ACTION_NOT_SUPPORTED or PLATFORM_NOT_SUPPORTED with NotDelivered and known bounds; other failures return POLICY_DENIED with details.semantic_error. Shadow’s computer-use loop and AX tools use the same semantic path, and a failed step ends the run as blocked while keeping earlier steps.

Element references carry the snapshot id as @:eN and resolve strictly, so a ref from an older or different snapshot fails with STALE_REF or AMBIGUOUS_TARGET instead of matching another element; secure field values are never stored. Ghost tools return a shared GhostError with code, message, delivery, and retry information. ghost-hands enforces key policy and layout-aware keys so unsendable keys fail before posting, and macOS Cmd+A follows the active layout.

Affected packages: ghost

Changelog

ghost@0.5.1

Minor changes

• Ghost gained the GhostError contract and classify, strict @:eN refs, semantic action schemas and shared secure-field redaction for perception tools. ghost_click and ghost_type now route through semantic actions with via and disposition fields; the snapshot::resolve_ref shim was removed and a headless error_contract test was added. (#956)

Patch changes

• MCP tools were reorganised into dispatch/tools modules and a refmap subsystem for building, resolving and storing refs was added, alongside perception redaction and walking, action tools for click, keys, pointer, semantic targets, typing and window control, and an error contract test. (a90a427)

Full changelog: amajorai/ryu@v0.5.0...v0.5.1

Full release notes: docs.ryuhq.com/docs/release-notes/v0.5.1