Skip to content

v1.5.0

Choose a tag to compare

@samuelfaj samuelfaj released this 16 Oct 03:24
· 5 commits to main since this release

cua-driver parity (inspired by trycua/cua libs/cua-driver), Jev-first.

  • Apps and desktop: list_apps, launch_app (background), kill_app, bring_to_front, get_accessibility_tree, get_desktop_state, get_screen_size, set_window_frame, clipboard_read/clipboard_write, check_permissions, health_report, get_config/set_config.
  • Input: click, double_click, drag, type_text, press_key, hotkey, move_cursor, get_cursor_position, invoke_menu, verify_state. Background by default; delivery_mode:"foreground" fronts the window and restores the previous app. Mutations refuse with human_activity while you are using the target.
  • verify_state expect.criteria: natural-language checks answered by Jev over filtered labels (no screenshots, values or secrets); without a Jev key the filtered evidence is returned for the agent.
  • jev_decide browser: true: Jev picks the next click in the owned Chrome tab.
  • Sessions, agent cursor overlay (click-through, never moves your pointer), trajectory recording (typed text redacted) and replay.
  • Chrome extension 1.4.0: browser_navigate, browser_click, browser_type, browser_pointer, browser_dialog, browser_set_input_files, browser_download, page. Uses chrome.debugger only during an action (Chrome shows its debugging bar meanwhile); new debugger and downloads permissions — reload the extension.