Skip to content

Sync recent main commits into agentic_os#503

Merged
bobleer merged 8 commits intoGCWing:agentic_osfrom
bobleer:agentic_os
Apr 24, 2026
Merged

Sync recent main commits into agentic_os#503
bobleer merged 8 commits intoGCWing:agentic_osfrom
bobleer:agentic_os

Conversation

@bobleer
Copy link
Copy Markdown
Collaborator

@bobleer bobleer commented Apr 24, 2026

Summary

  • Cherry-pick recent Bob Lee/bobleer/bowen628 main commits after the Monday agentic_os sync point.
  • Adapt browser ControlHub/session changes to the current agentic_os settings and session storage split.
  • Keep agentic_os ControlHub app/SelfControl bridge behavior while adopting the newer unified ControlHub and Computer Use updates.

Validation

  • pnpm run type-check:web
  • cargo check -p bitfun-core
  • cargo check -p bitfun-desktop

Notes

  • This PR is opened as draft for upstream review because the sync includes branch-specific conflict adaptations.

bobleer and others added 8 commits April 24, 2026 15:29
* feat: improve controlhub browser sessions

Tighten ControlHub browser session routing and desktop browser guards, improve relay reconnect handling, and persist FlowChat session title updates alongside model config polish.

Generated with BitFun

Co-Authored-By: BitFun

* fix: resolve SessionModule lint error

Convert requireSessionWorkspacePath to a function declaration so eslint no-use-before-define passes in SessionModule.

Generated with BitFun

Co-Authored-By: BitFun

* fix: handle Windows cert DER bytes correctly

Replace the invalid to_der().ok() call with direct DER byte conversion so bitfun-core compiles on Windows CI.

Generated with BitFun

Co-Authored-By: BitFun
…el settings (GCWing#478)

Co-authored-by: bowen628 <bowen628@noreply.gitcode.com>
…curacy hardening (GCWing#492)

Inspired by the TuriX-CUA open-source project, this overhauls BitFun's
desktop Computer Use stack so the agent can reliably "see → plan →
act → verify" on macOS GUIs.

Highlights
- Interactive-View pipeline (S1-S4): new `AxNode`-derived
  `InteractiveElement` / `InteractiveView` types, AX-tree filtering
  (`interactive_filter.rs`), Set-of-Mark JPEG overlay
  (`som_overlay.rs`), and `desktop_host.rs` wiring on top of the
  macOS AX dump.
- ControlHub desktop actions (S5): four new `interactive_*` /
  `app_*` actions with a single `i` index and `before_view_digest`
  optimistic-locking.
- Click reliability: digest is now geometry/role-stable (ignores
  focus/value jitter); `interactive_click` auto-rebuilds the view on
  `STALE_INTERACTIVE_VIEW` and falls back from AX-press to
  image-pixel pointer click; `click_element` accepts `text_contains`
  / `node_idx` directly.
- Card-merging heuristic in `interactive_filter` collapses redundant
  child widgets inside actionable containers (cells, rows, buttons,
  links, groups), cutting overlay clutter on real apps.
- Prompt update (`claw_mode.md`): mandatory
  OBSERVE → PLAN → EXPECT → VERIFY loop and Interactive-View-first
  guidance.
- Supporting macOS plumbing: `macos_ax_dump`, `macos_ax_write`,
  `macos_bg_input`, `macos_list_apps` (background-input event
  injection, AX press, app enumeration).
- Adds `recursion_limit = "256"` for the new generic-heavy modules.

Tested with `cargo check -p bitfun-desktop -p bitfun-core` and
focused unit tests in `interactive_filter` and `desktop_host`.
…nfig tests (GCWing#499)

- Resolve codex CLI version via codex --version for User-Agent and backend model discovery

- Derive client_version query param from User-Agent in OpenAI common adapter

- Use create_transient_ai_client_for_config for test/list-models so proxy and stream options apply
@bobleer bobleer marked this pull request as ready for review April 24, 2026 08:13
@bobleer bobleer merged commit 268229f into GCWing:agentic_os Apr 24, 2026
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant