v0.1.0

First public release. A free, open-source MCP server that gives a chat agent window-relative, token-cheap control of any Windows desktop app — with vision powered by the DeepSeek V4.1 Flash model.

Highlights

• 23 MCP tools: window targeting, screenshots, mouse/keyboard input, UI Automation mapping, server-side condition waits, batching and on-demand vision (look).
• Window-relative coordinates, always — the same pixel space as screenshots, so there is no monitor arithmetic and no DPI guessing.
• Token-cheap by design: screenshots return text (shot_id, changed %); images reach the model only through look, which is opt-in, region-capable and cached by image+question.
• Server-side waiting: wait_until on element / window / pixel / stable region — one tool call instead of a poll loop.
• Batch executor: run(steps) performs many steps in one model round-trip, with embedded read_pixel / wait_until verification steps.
• Safety rails: foreground preflight (ERROR[not_foreground]), stable error codes with suggested_recovery, guaranteed mouse-button release, abort via Ctrl+Alt+Q or a STOP file, and every action logged to actions.jsonl.
• Agent and skills included: the computer-use VS Code agent plus the paint-drawing and blender field handbooks — drop them into your workspace and they are part of the product.

Windows release (x64)

Download computer-use-mcp-0.1.0-windows-x64.zip below, extract it anywhere and point your MCP client at computer-use-mcp.exe (see mcp.example.json inside the ZIP). The executable is self-contained — no Python installation needed. Prefer the source? py -3.13 -m venv .venv + pip install -r requirements.txt.

Copy the bundled agents and skills folders into your project so the chat agent loads the operating manual and the app skills.

Requirements

• Windows 10/11 x64.
• Optional: a DeepSeek API key (DEEPSEEK_API_KEY in .env) to enable the look vision tool — every other tool works without one.

Known limits (v1)

• Screen-region capture: keep the target window visible (do not cover it).
• Elevated (UAC) windows cannot receive synthetic input (UIPI).
• One tool call at a time (synchronous); use run(steps) to batch known sequences.

⚠️ Use at your own risk

This server gives an AI agent real control over your desktop: clicks, typing, dialogs and deletions at machine speed, whether or not you are watching. Keep backups, stay present for the first runs, avoid autopilot/allow-all mode on a daily-driver desktop, and keep the kill switch (Ctrl+Alt+Q / STOP file) at hand. See SECURITY.md.

Verification

• ruff clean; CI runs lint, a secret scan and the MCP handshake on every push and pull request.
• The ZIP is built by the windows-zip-release workflow; the packaged executable must pass an automated MCP handshake test (23 tools) before the asset is uploaded.

Full changelog: CHANGELOG.md · License: Apache-2.0