Skip to content

BrowserSkill Extension 0.5.0

Choose a tag to compare

@github-actions github-actions released this 12 Nov 16:08
· 9 commits to main since this release
361da1d

BrowserSkill Extension 0.5.0 improves the browser observations agents use, supports optional local pairing, and fixes shared-control and navigation regressions. Pair it with CLI/daemon 0.5.0.

Added

  • Optional local pairing. Connection settings can verify the daemon and browser identities and recover interrupted pairing. The CLI supports replacing or revoking a paired device.
  • Richer observations. Unlabeled inputs can use nearby captions, native selects show their options, and runs of read-only table rows take fewer lines. Native select can match a unique visible option label.
  • Safer target selection. The extension filters visually hidden instructions from observations while preserving accessible labels. It checks whether a virtualized list has reused the target row before dispatching an action.
  • Collapsible shared-control panel. Minimize the in-page panel to the edge of the tab while a task is active.

Changed

  • When visible text is the only change and the previous observation can be reused, shared-control sync can return a text patch. The extension also reuses recent accessibility data and reduces repeated checks during targeted actions.
  • The extension releases idle debugger connections and reattaches when a browser task needs them. Open dialogs and active downloads keep their connections.
  • Connection settings stay visible in the popup. The pairing control shows the current verification state and offers instructions for pairing or continuing with an unpaired local connection.

Fixed

  • Background fills deliver focus before editing and report page formatting. Sensitive values stay redacted.
  • Navigation waits follow scheduled loads and complete when Chromium restores a page from its back/forward cache.
  • Borrowed blank tabs can navigate or return. Hidden, unresponsive child frames can be reported separately so eligible page actions can proceed.
  • Native input remains correctly attributed after Chromium clock drift, and the control panel preserves click passthrough during status refreshes.
  • Recording captures native select changes in open shadow roots and better recognizes form controls and long button or link names.

Upgrade

  1. Finish active browser tasks and update the CLI/daemon to 0.5.0.
  2. Install extension 0.5.0 from the store or use the ZIP attached to this release. Store availability follows each store's review.
  3. Run bsk doctor to verify the connection. To pair a local browser, run bsk daemon pair and paste the link into the extension's connection settings.

What's changed

  • feat(cli): run decided actions together with bsk plan by @NianJiuZst in #615
  • fix: add constrained DOM reads for changing pages by @NianJiuZst in #616
  • fix(extension): minimize control panel without blocking page clicks by @NianJiuZst in #617
  • feat(cli): replay verified flows with bsk recipe by @NianJiuZst in #618
  • docs(evals): add optional contributor end-to-end testing skill by @NianJiuZst in #619
  • feat: add optional local pairing with recovery and revocation by @NianJiuZst in #620
  • fix(record): capture native select changes in shadow roots by @NianJiuZst in #635
  • fix(fill): accept equivalent end-of-editor caret positions by @columbia11 in #640
  • fix(extension): give punctuation keys a physical code and key code by @PerryLink in #637
  • fix(record): keep clicks on controls in non-editable editor regions by @NianJiuZst in #634
  • fix(extract): keep content visible when CSS overrides hidden by @kesmeey in #610
  • fix: apply CSS case transforms during extraction (#597) by @kesmeey in #613
  • fix(extension): preserve upload handler failure receipts across debugger detach by @NianJiuZst in #654
  • feat: formalize recipe CLI and complete plan/recipe integration by @NianJiuZst in #656
  • fix(cooperation): preserve evidence checks during preparation, retry settling syncs by @NianJiuZst in #655
  • fix(record): preserve form button clicks by @tlysanhuo in #602
  • fix(record): keep clicks on controls that share a form with a search field by @columbia11 in #658
  • fix(record): keep clicks on controls with long names by @columbia11 in #662
  • fix(extension): detach remaining CDP sessions when Agent Window closes by @NianJiuZst in #659
  • fix(cooperation): release blurred edits and auto-resume idle tabs on new task sync by @NianJiuZst in #660
  • feat(evals): expand release test with plan/recipe/read, video/forum sites, and benchmark metrics by @NianJiuZst in #664
  • fix(fill): notify each final value once by @AriaLEntropy in #663
  • fix(evals): isolate recipe fixtures and correct release benchmark accounting by @NianJiuZst in #671
  • fix(cooperation): tolerate proven hidden unresponsive frames (#614) by @NianJiuZst in #672
  • fix: attribute file transfers and report local validation errors by @NianJiuZst in #673
  • fix(record): keep step refs after scrolling and clicks inside controls by @columbia11 in #679
  • test: fix main CI (hidden-frame timing flake, stale download exit code) by @NianJiuZst in #680
  • feat(extension): keep connection settings open and fold pairing advice behind an icon by @columbia11 in #682
  • feat(evaluate): support scoped and unverified scripts by @NianJiuZst in #683
  • feat(skill): add Qoder and Qoder CN install targets by @AriaLEntropy in #677
  • refactor(protocol): unify contracts, exhaustive tool policies, and peer compatibility by @NianJiuZst in #389
  • perf(cooperation): reduce sync and strict verification latency on heavy pages by @NianJiuZst in #687
  • fix(cooperation): calibrate native input timestamps across clock drift by @NianJiuZst in #668
  • feat(vom,cooperation): affordance-typed VOM v2, stealth injection stripper, and virtual-row guard by @NianJiuZst in #689
  • feat(v0.5-wave2): zero-ceremony lifecycle, caller-scope isolation, SKILL/sync slimming, and guarded CDP soft-detach by @NianJiuZst in #688
  • feat(wave3): cut 85% hot-path IPC/CDP polling, optimistic fill fast-path, single-UDS CLI, and <3ms Intent WAL by @NianJiuZst in #696
  • fix(navigation): wait for scheduled and in-flight navigations in wait-for-navigation by @NianJiuZst in #704
  • fix(navigation): complete back/forward waits on back/forward-cache restores by @NianJiuZst in #705
  • fix(extension): flush deferred background-tab focus in handleFill and flag altered sensitive fills by @NianJiuZst in #706
  • fix(wal): settle unpressed clicks and pre-write select/fill validation failures by @NianJiuZst in #708
  • fix(cli): resolve full VOM text when sync/open text waits encounter delta or uncached frames by @NianJiuZst in #707
  • fix(extension): preserve refs, dialogs, and active downloads across idle CDP soft-detach by @NianJiuZst in #711
  • fix(cooperation): keep tab management usable after borrowing an about:blank tab by @NianJiuZst in #710
  • fix(vom): harden stealth stripper for CSS Color 4, gradient text, HiDPI microboxes, and textstyle containers by @NianJiuZst in #709
  • feat(evals): upgrade release-test fixtures into high-fidelity adversarial arena by @NianJiuZst in #712
  • fix(cli): stop get-html --json --out from printing the HTML to stdout by @NianJiuZst in #716
  • fix(vom): exclude style/script text from label fallback by @AriaLEntropy in #697
  • fix(cli): coordinate recording session cleanup by @NianJiuZst in #720
  • fix(dsh): clarify BrowserSkill calls in PTC mode by @NianJiuZst in #721
  • fix(cooperation): send a text delta instead of the whole VOM after an in-place text change by @columbia11 in #722

Full changelog