Skip to content

Agent! 1.1.90.292

Pre-release
Pre-release

Choose a tag to compare

@AgentiLoop AgentiLoop released this 08 Oct 03:25
· 39 commits to main since this release

Agent! 1.1.90 — Pre-release

♿ Accessibility tool (AX automation)

  • New read_text action: reads every visible text of an app's front window in one call (table rows as Row: a | b | c, toggles as Name [on]). Browser pages read like a document, one Text: line per paragraph (226711a6, 76ebcf40)
  • New select_option action: picks popup, menu-button and combo-box options, radio/tab buttons, checkbox on/off and slider values, then checks the result. It also handles web page <select> menus in Safari and Chrome (05471d0f, 242d2dd2)
  • New select_row action: selects or opens table/list/sidebar rows by any cell's text, plus Finder desktop icons and icon-view items (fee21b3a, e8632ec8)
  • press_key is back: keys and shortcuts in any app (cmd+s, down*3 return) (5d09ba12)
  • click_menu_item clicks without opening menus on screen and lists a menu's items. It also reaches menu-bar extras (Wi‑Fi, Focus, Clock, Control Center) and returns a panel's contents as text (ede6bedc, 6e28a923, 4d9d8cdc)
  • click_element uses AXPress first, like AppleScript click, and falls back to a hit-tested mouse click only when needed (ce33824c)
  • type_into_element fills web page forms in Safari and Chrome. New submit:true presses Return after typing (76d8a790, 3ddf8f36)
  • set_properties accepts AppleScript property names and AppleScript-style element references (button 2 of toolbar 1 of window 1). It presses checkboxes/switches when their state differs, picks pop-up menu items and sets sliders (4a3970d1, 159854f9, 163724c0, b834af9a)
  • Element search now ranks matches (focused window > other windows > hidden > menus) (7a4913fc)
  • Removed the blanket Safari veto on accessibility calls from tab tasks (cbe824e8)
  • Updated tool docs (AgentTools 2.53.34) (089bdfae)

🛠️ Tool reliability

  • web navigate, web switch_tab and agent_script update work on the first try. Each one used to fail every call (424b34b0, b94ebbc2, 2a619ca7, 07738648)
  • After 2 failures, UI-scripting tools steer the model to accessibility. Tab tasks get the same advisory (3a3f4144, e330ae39)
  • Chronic tool-failure flags expire with the app build, so fixed tools are no longer flagged (577a767e)
  • xcode select_project with a single open project selects it automatically (ad101ec6)
  • Ollama "model not found" lists the installed models and suggests ollama pull, then tries the fallback chain (c24f8a1c)
  • Fixes in project.pbxproj, ErrorHandler and Localizable (6dbe01c5)

🧭 Auto-Pilot

🗣️ App accessibility (VoiceOver, keyboard, display settings)

Full Changelog: v1.1.89.289...v1.1.90.292