Skip to content

v1.2.0 — First public release

Choose a tag to compare

@ilyafainberg ilyafainberg released this 12 Jun 23:57

TotalControl MCP Server — v1.2.0

First public release. A Model Context Protocol (MCP) server that gives an AI agent hardware-level control of a Windows desktop: synthesized mouse, keyboard, screen capture, and UI Automation introspection.

Built for Microsoft Scout and any MCP-compatible host (Claude Desktop, GitHub Copilot CLI, Continue, Cline, Cursor, …).

⚠️ Use at your own risk

This software gives an AI agent the same control over your computer that you have with a mouse and keyboard. There is no sandbox. It is provided AS IS, WITHOUT WARRANTY OF ANY KIND. The author is not liable for any damages — lost data, deleted files, sent messages, financial transactions, broken systems — arising from use of this software. Not a Microsoft product. Read the full warnings in the README before installing.

What's in this release

  • TotalControl.exeself-contained single-file Windows x64 build (~131 MB; includes .NET 9 runtime + WPF + UI Automation libraries, no .NET install required on the target machine).
  • README.md — full documentation, install instructions, use cases, warnings.
  • LICENSE — MIT.

10 tools

Inputmove_mouse, click_mouse, mouse_button (down/up primitive), drag_mouse (atomic press→glide→release), send_keys
Visionscreenshot_screen, screenshot_window, hover_preview
High-levelclick_in_window (window-relative coords), find_element (UI Automation tree walk; can invoke=true to bypass UWP synthetic-input restrictions)

Install

  1. Download TotalControl-v1.2.0-win-x64.zip from the assets below.

  2. Unzip anywhere (e.g. C:\Tools\TotalControl\).

  3. Register with your MCP host. For Microsoft Scout:

    {
      "name": "totalcontrol",
      "command": "C:\\Tools\\TotalControl\\TotalControl.exe",
      "args": []
    }

    For GitHub Copilot CLI, edit %USERPROFILE%\.copilot\mcp-config.json:

    {
      "mcpServers": {
        "totalcontrol": {
          "command": "C:\\Tools\\TotalControl\\TotalControl.exe",
          "args": [],
          "env": {}
        }
      }
    }
  4. Toggle the server / restart the host so tools/list discovers all 10 tools.

Full details in the README.

Verified working

  • All 10 tools discoverable via tools/list over stdio JSON-RPC.
  • Pixel-accuracy gold test: screenshot_window PNG coordinates match click_in_window / move_mouse at physical-pixel precision on a 4K monitor at 150 % DPI scaling.
  • find_element UI Automation lookup confirmed accurate to ±0 pixels on Notepad menu bar.
  • Build: 0 warnings, 0 errors under .NET 9.0.315 SDK.

Requirements

  • Windows 10 or 11, x64.
  • A logged-in interactive user session (the agent operates the foreground desktop).
  • An MCP-compatible host (Scout, Claude Desktop, GitHub Copilot CLI, Continue, Cline, Cursor, Goose, Zed, …).