Skip to content

Releases

AgentMouse v0.7.0-beta.3

Pre-release

Choose a tag to compare

@github-actions github-actions released this 04 Nov 10:07

AgentMouse 0.7.0-beta.3 — two independent editions, bundled Python in Full.

Download one:

  • AgentMouse-Core-0.7.0-beta.3-windows-x64.zip: our standalone C#/Node background pointer, capture, target guards, MCP/plugins/skills. 11 tools. No Python, Windows-MCP source or fusion adapter.
  • AgentMouse-Full-0.7.0-beta.3-windows-x64.zip: Core + Windows-MCP 0.8.8 + fusion adapter, with an isolated relocatable Python runtime and all locked dependencies. 27 tool names. No separate Python or uv installation/download on the user's machine.

Both require Windows x64 and Node 18+. Each package defaults to its own engine. Extract, run install.cmd and choose agents; refresh/restart clients afterward. They update the same AgentMouse plugin rather than starting two competing mouse services.

Core builds and runs independently; Full's adapter calls the same Core engine for every mouse operation. Windows-MCP contributes target-scoped UIAutomation and retained system tools. MIT/CPython/dependency notices are preserved. Upstream sources are marked vendored in repository language statistics.

Validation covers Core package isolation and native plugin installation, Full install without Python/uv on PATH in a Chinese home after the source payload is moved, 27-tool SDK connectivity, real Windows label/WGC/background-input/result checks, and ten covered-Chrome desktop cases with no detected foreground/z-order/physical-pointer interference. Separate headless checks run in CI. Portable-runtime checks ignore host Python environment variables.

Independent keyboard/shortcuts, Ctrl batches, foreground App activation and several native gesture variants remain unavailable; no physical-input fallback is used. System/clipboard tools affect shared Windows resources. WeChat → QQ Mail and third-party CAPTCHA acceptance remain unverified.

中文:两版独立下载。Core 展示我们的后台鼠标、截图、保护机制、MCP/插件/技能,不含 Python 或 Windows-MCP。Full 在 Core 上融合 Windows-MCP 的系统工具和控件树,自带 Python 与全部依赖,用户不需要另装 Python/uv。安装器识别包类型,默认加载相应引擎。代码按核心、融合适配、上游、运行时打包分层;真实窗口和浏览器链路均有实测,不能宣传所有软件或验证码必过。

AgentMouse v0.7.0-beta.1

Pre-release

Choose a tag to compare

@github-actions github-actions released this 04 Nov 09:05

AgentMouse 0.7.0-beta.1 — Windows-MCP + AgentMouse fusion.

  • One 27-tool MCP server combines Windows-MCP 0.8.8 system services/UIAutomation and AgentMouse-only background images/mouse execution. The supplied Windows-MCP source directory is unchanged; its bundled source retains MIT notices separately from AgentMouse's Apache-2.0 license.
  • Snapshot captures one HWND/browser target and returns scoped control labels, real PNG pixels, coordinateSpace and an observation token. Click/Move/Scroll must address that exact window/token; stale/wrong-target input is rejected. Drag has an explicit start and cannot inherit the real cursor position.
  • Windows-MCP FileSystem, Process, Registry, PowerShell, HTTP Scrape, DisplayInventory, Clipboard and Notification are retained. Its physical mouse hooks/overlay are not started. Keyboard shortcuts/typing, Ctrl batches, foreground App launch/switch/resize, foreground DOM scraping, middle click and horizontal wheel are unavailable in background mode, with no physical-input fallback.
  • Interactive install recommends fusion. Unattended: install.cmd --engine fusion --agent codex,zcode (or all). Requires uv; installs Python 3.14 and locked dependencies. Existing unattended commands without --engine keep native-only mode.
  • Official SDK/27-tool tests, all five host adapter configurations, and real Windows control-label/WGC/input/result integration passed. The complete real-extension fusion path also passed ten desktop cases with Chrome fully covered by the foreground ChatGPT window, with no detected focus, relative-z-order or physical-pointer interference. Headless integration is checked separately in CI.

Refresh/restart selected clients after installing. Enable input in the local controller; load/reload the generated Browser Bridge extension for browser tasks. Clipboard/system operations remain shared Windows operations. Real WeChat → QQ Mail and third-party CAPTCHA acceptance are not verified.

中文:融合 Windows-MCP 的系统工具和控件树,鼠标与真实后台画面统一走 AgentMouse,提供 27 个工具。目标窗口、局部控件标签、观察编号绑定;明确拒绝不支持的共享键盘和前台输入。Windows 与 Chrome 融合链路实测通过;不代表所有应用、微信邮箱或真实验证码都保证可用。运行 install.cmd --engine fusion --agent codex,zcode,升级后刷新智能体会话。

AgentMouse v0.6.0-beta.3

Pre-release

Choose a tag to compare

@github-actions github-actions released this 04 Nov 07:09

AgentMouse 0.6.0-beta.3 — app discovery, window layers and frozen-frame input protection.

  • Adds pointer_list_apps: running processes including WeChat/Weixin/微信 aliases, even when the app is in the tray or has no visible window. A missing visible window does not prove the app is closed.
  • Window inventory includes hidden/minimized states, PID, class, owner, bounds, foreground, front-to-back order and rectangular overlaps above the target.
  • Adds read-only pointer_inspect_window for accessible control names/roles/bounds. Uses built-in .NET UIAutomation in an isolated CLI process; no Python dependency, foreground input or copied upstream code.
  • Every click/drag/scroll declares its intended window ID. Mismatches are rejected. An observation with a window ID defaults to its real background surface, never a foreground crop.
  • Repeated/older native frames after input block subsequent input with inputAllowed=false / unverified_frame. Skills stop repeated clicks/relaunches when a target has no fresh frame.
  • Real owned-window regression verifies overlapping layers, controls, correct native-message recipient, wrong-target and frozen-frame rejection, and hidden/minimized discovery. Message receipt is tested separately from application business success.

The reported WeChat trace used beta.2. Its logged input recipients were WeChat windows, not ZCode; the actual failure was unverified repeated input against a frozen capture, plus missing process discovery. WeChat → QQ Mail has not been verified working. Native message receipt does not guarantee a custom app responds; a covered WinForms button also received messages without raising its business Click event.

The historical beta.2 ten-case covered Chrome desktop report remains available. Browser Bridge still needs the generated extension loaded manually. A new full desktop rerun interrupted by foreground changes is not called a new pass.

Extract the ZIP and run install.cmd. Refresh/restart selected agent clients so they load eleven tools and the changed action schema. Close/reopen an older AgentMouse controller before input. If an older browser daemon is still running, restart Windows and reload the generated extension. Requires Windows x64 and Node 18+; native HWND capture requires Windows 10 1903+.

中文:新增已运行程序查询、隐藏/最小化窗口与层级信息、只读控件树,以及操作后旧帧拦截。点击必须带明确目标窗口,目标不符拒绝执行。专项真实窗口测试通过,但不代表微信后台打开 QQ 邮箱已经成功;收到输入与业务成功必须分开验证。升级后刷新 Agent,加载 11 个工具和新参数,关闭旧控制器再打开新版。

AgentMouse v0.6.0-beta.2

Pre-release

Choose a tag to compare

@github-actions github-actions released this 04 Nov 06:24

AgentMouse 0.6.0-beta.2 — verified covered-window browser operation.

  • Browser Bridge uses your existing Chrome/profile, actual rendered images and coordinate input through chrome.debugger. No DOM selectors, injected clicks, remote debugging port or disabled GPU is needed in normal use.
  • All ten local desktop checks pass with Chrome fully covered by foreground ZCode: fresh page images, click/right-click, wheel, double-click, long press, slider/puzzle paths, ordered points, HTML5 drop and cancellation/release. No foreground, relative z-order or unattributed system-pointer interference was detected.
  • Fixes occluded screenshot timeouts by keeping the attached page rendering, and preserves drag corners/samples when native permission checks are slow. GPU acceleration stays enabled.
  • Windows Graphics Capture reads covered native window surfaces. Native Chromium mouse input is blocked when inactive because it can activate/raise the window.
  • Agent installers prepare a paired extension directory. You load it manually once and review Chrome permissions; no policy bypass or profile change.
  • Preserves native Codex/ZCode plugin installation and other MCP + skills adapters, with backups and isolated installation tests.

Beta limit: desktop acceptance covers one Windows environment and a local fixture in Chrome for Testing 157, with sRGB forced only for fixture color checks. It is not a promise that all apps or real CAPTCHA risk checks accept automation. Simulated page focus/visibility can change page behavior; Windows focus remains separate. Test results and failed native approaches are documented.

When upgrading from beta.1, restart Windows if its older browser service is still running, then reload the generated extension. Version checks reject an older running service instead of silently using it.

Extract the ZIP, double-click install.cmd, select agents, then load the printed generated Chrome extension directory. Refresh/restart agent clients, open AgentMouse and enable input once before actions. Requires Windows x64 and Node 18+; native HWND capture requires Windows 10 1903+.

中文:本版已补齐真实桌面验收:Chrome 完全被前台 ZCode 遮挡时,10 项本地操作及新画面检查全部通过,未检测到抢前台或带动真实鼠标。修复遮挡时截图超时、慢速状态检查跳过拖动转折点的问题。仍需用户加载扩展一次;不能宣传为所有软件或真实验证码必过。beta.1 的旧服务若仍在运行,重启 Windows 后重新加载生成的扩展。

AgentMouse v0.6.0-beta.1

Pre-release

Choose a tag to compare

@github-actions github-actions released this 04 Nov 05:30

AgentMouse 0.6.0-beta.1 — real background images and browser mouse gestures.

  • Browser Bridge uses your existing Chrome/profile, actual rendered images and coordinate input through chrome.debugger. No DOM selectors, injected clicks, remote debugging port or disabled GPU is needed in normal use.
  • Supports click/right-click, wheel, double-click, long press, slider/puzzle paths, HTML5 drop and cancellation/release. Real extension integration passes on local fixtures in headless Chrome for Testing 157.
  • Windows Graphics Capture reads covered native window surfaces. Native Chromium mouse input is blocked when inactive because it can activate/raise the window.
  • Agent installers prepare a paired extension directory. You load it manually once and review Chrome permissions; no policy bypass or profile change.
  • Preserves native Codex/ZCode plugin installation and other MCP + skills adapters, with backups and isolated installation tests.

Beta limit: the interactive desktop became unavailable, so final acceptance with the user's foreground window has not been completed. Headless fixture success is not a desktop pass or a promise that real CAPTCHA risk checks accept automation. Test results and failed native approaches are documented.

Extract the ZIP, double-click install.cmd, select agents, then load the printed generated Chrome extension directory. Refresh/restart agent clients, open AgentMouse and enable input once before actions. Requires Windows x64 and Node 18+; native HWND capture requires Windows 10 1903+.

中文:新版加入真实后台画面与浏览器鼠标通道。真实扩展链路已通过本地滑块、拼图式路径拖动、顺序点选、长按、双击、HTML5 拖放和中断释放测试。仍需用户加载扩展一次;不修改原 Chrome 资料或绕过策略。桌面恢复后的前台保持验收尚未完成,不能把组件通过宣传为所有真实验证码必过。

AgentMouse v0.5.1

Choose a tag to compare

@github-actions github-actions released this 04 Nov 02:15

AgentMouse 0.5.1 fixes native plugin installation for Codex and ZCode. Version 0.5.0 registered standalone MCP and skills but did not create an installed-plugin entry.

  • Codex/ZCode now use their native marketplace/install commands and verify the installed/enabled result. Missing native CLIs fail explicitly.
  • Claude Code, WorkBuddy and DSH use MCP + skills; --mode mcp explicitly selects that mode for any target.
  • Marketplace catalogs, clean plugin payloads, configuration backups and physical Windows path resolution.
  • Real Codex 0.153.4 / ZCode 0.17.1 installation and read-only MCP connectivity checked locally. GUI actions/browser visibility were not accepted.
  • MCP server, five Agent Skills, lifecycle commands and native plugin manifests.
  • Preserves existing settings, makes backups, supports dry runs and rolls back failed settings writes.
  • English/Chinese READMEs and documented compatibility limits.
  • Windows build, MCP/SDK tests, installer tests and native state checks.

Extract the Windows ZIP, install Node.js 18+ x64 if needed, then double-click install.cmd. Choose your agent and restart it. Enable desktop input once in the local controller before use.

Experimental: background messages depend on app compatibility; visible windows only, no independent keyboard/native hover/background drag. Touch may move the real cursor or change focus. Five-host configuration testing does not imply five-host GUI acceptance.

中文:解压 Windows ZIP 后双击 install.cmd,选择要接入的智能体。需要 Node.js 18+ x64。默认后台模式不移动真实鼠标;触摸为实验模式,可能影响真实鼠标和焦点。详见中文 README。

AgentMouse v0.5.0

Choose a tag to compare

@github-actions github-actions released this 03 Nov 16:13

AgentMouse 0.5.0: background Windows computer use through MCP, with an independent Agent pointer.

  • One-click installation for Claude Code, Codex, ZCode, WorkBuddy and DSH.
  • MCP server, five Agent Skills, lifecycle commands and native plugin manifests.
  • Preserves existing settings, makes backups, supports dry runs and rolls back failed settings writes.
  • English/Chinese READMEs and documented compatibility limits.
  • Windows build, MCP/SDK tests, installer tests and native state checks.

Extract the Windows ZIP, install Node.js 18+ x64 if needed, then double-click install.cmd. Choose your agent and restart it. Enable desktop input once in the local controller before use.

Experimental: background messages depend on app compatibility; visible windows only, no independent keyboard/native hover/background drag. Touch may move the real cursor or change focus. Five-host configuration testing does not imply five-host GUI acceptance.

中文:解压 Windows ZIP 后双击 install.cmd,选择要接入的智能体。需要 Node.js 18+ x64。默认后台模式不移动真实鼠标;触摸为实验模式,可能影响真实鼠标和焦点。详见中文 README。