Repository navigation
v0.11.0
Fixes for everything reported this week, and a policy rule that keeps the agent off your screen.
Keep the agent in the background (#55)
policy.json takes "foreground": "block". The agent can no longer take the screen from you:
activate_appandbrowser_select_tab bring_to_frontfail withforeground_requiredbefore anything moves;- on Windows, so do typing into a window that is not in front and any fallback to your real pointer;
- on Linux, so does every pointer action, since they all move the real pointer.
Work that runs in the background goes ahead. "ask" prompts once instead. A tool argument cannot override the rule; see Apps and sites the agent may use.
Browser
- Dialogs inside web components are seen (#46). LinkedIn's invitation dialog lives in a shadow root, and the snapshot listed the profile behind it. Snapshots, clicks,
wait_for_selector, credential fill andbrowser_readnow reach into open shadow roots, and blocked background controls cannot be clicked. A dialog placed near the top of a full-screen backdrop is scoped too. Results say how many embedded frames they could not search. - Menus opened in a background tab are listed (#53). Chrome does not run a hidden tab's fade-in, so a dropdown stayed at opacity 0 and the snapshot showed
total 0. Elements whose animation ends visible now count as shown. A snapshot that still lists nothing says how many controls it left out and why. - Backspace is checked (#54). It now checks that the focused field changed, and deletes the character itself where Chrome did not. A field that still does not change is an error, not a success.
- A page that stops responding no longer holds up a task (#52, #56). Every Chrome call has a deadline, page scripts have Chrome's own execution limit, and the favicon badge gives up after a few seconds. A call stuck behind a hung command fails at once and names it, instead of every later call timing out in turn.
Windows
type_textsays whether the text arrived (#47). It used to report every character typed while a slow field kept only part of the text. It now holds the window in front until the keys are delivered, then reads the field back. The result says read back, not read back, orINCOMPLETEwith character counts; password fields are never read.- A covered click names what covers it (#50). Click-through windows (another agent's pointer overlay) and hidden ones no longer count as covering the target. A real cover is named by program and window class.
Thanks to @ElliotDrel for detailed reports and #51, parts of which are in this release.
Tested:
type_textlive on Windows 11;- the #53 dropdown on the reported page, in a hidden tab;
- everything else with the unit and real-Chrome suites on macOS 27.2 and Windows 11. Linux is covered by CI.