Releases: ngotrantronghieu/Computer-Autopilot
Releases · ngotrantronghieu/Computer-Autopilot
Release list
Computer Autopilot v1.0.3
Computer Autopilot v1.0.3 - MCP Integration & Window Selector Release
🎉 Major New Features
1. Window Selector for Targeted Automation
Computer Autopilot now includes a Window Selector feature that allows you to specify exactly which window the assistant should work on. No more manually switching windows - just select your target window from a dropdown and let the assistant handle the rest!
🪟 Window Selector Features
-
Dropdown Window Selector in Main Chat interface
- Located between the input field and control buttons
- Shows all currently open windows with application icons
- Automatically refreshes when opened
-
Auto-detect Mode (Default)
- Works on the currently active window
- Perfect for quick tasks
- No configuration needed
-
Specific Window Selection
- Choose exactly which window to target
- Visual feedback with green highlight when selected
- Window is automatically focused before task execution
-
Minimized Window Support
- All minimized windows appear in the list
- Marked with
[Minimized]indicator for easy identification - Automatically restored and focused when selected
-
Smart Window Filtering
- Filters out system windows and background processes
- Shows only relevant application windows
- Excludes the assistant itself for cleaner list
How to Use Window Selector
- Click the window selector dropdown (shows "🎯 Auto-detect" by default)
- Select a window from the list:
- Auto-detect - Works on currently active window
- [Window Name] - Targets specific window
- [Window Name] [Minimized] - Minimized window (will be restored)
- Type your command in the input field
- Press Enter - The assistant will focus the selected window and execute your task
Example Use Cases
- Type in a specific Notepad window while working in another app
- Click buttons in a minimized browser without manually restoring it
- Automate tasks in background applications without losing focus on your current work
- Switch between multiple instances of the same application easily
Visual Indicators
- White background: Auto-detect mode (default)
- Green background: Specific window selected
- [Minimized] tag: Window is currently minimized
- Window icons: Application icons displayed when available
2. Model Context Protocol (MCP) Support
Computer Autopilot now supports the Model Context Protocol (MCP), enabling the AI assistant to connect to external tools and services through a standardized protocol. This opens up endless possibilities for extending the assistant's capabilities beyond built-in Windows automation.
What is MCP?
The Model Context Protocol is a standardized way for AI applications to interact with external tools, APIs, and data sources. Think of it as a universal plugin system for AI assistants - instead of hardcoding every possible integration, MCP allows you to connect to any compatible server and instantly gain access to its tools.
Key Features
🔧 MCP Servers Management
- Dedicated MCP Servers Tab in Settings for easy configuration
- Visual server status monitoring with automatic health checks
- Tool discovery and metadata display - see all available tools at a glance
- Background status checks - non-blocking UI for testing multiple servers
- Auto-refresh on settings open - servers are tested automatically when you open the MCP tab
🤖 Seamless AI Integration
- Both Main Assistant and Web Agent can call MCP tools
- Natural language tool invocation - just ask the assistant to use a tool
- Full MCP result history preserved in assistant context for better reasoning
- Detailed tool descriptions injected into prompts for accurate tool selection
- Pure-JSON action format for reliable tool calling
⚙️ Easy Configuration
- JSON-based server configuration with visual editor
- Environment variable support for API keys and credentials
- Stdio transport - works with any MCP server using standard input/output
- Automatic tool metadata caching for faster prompt builds
- Live tool discovery with fallback to configured allowlists
Example Use Cases
With MCP integration, Computer Autopilot can now:
- Search the web using search MCP server
- Fetch and parse web content using fetch MCP servers
- Access filesystems with proper permissions via filesystem MCP server
- Query databases through database MCP servers
- Call external APIs via custom MCP server implementations
- And much more - any MCP-compatible server works out of the box!
How to Use
-
Configure MCP Servers in Settings → MCP Servers tab:
- Click "Edit Servers JSON..."
- Add your server configurations (see examples in README.md)
- Click "Refresh Status" to test connections
-
Use MCP Tools via natural language:
- Main Assistant: "Search the web for latest AI news using MCP"
- Web Agent: "Use MCP to fetch content from example.com"
-
Monitor Results:
- MCP tool outputs appear in the chat
- Full result history is preserved in assistant context
- Recent results are shown in the MCP Servers tab
Technical Details
Architecture
- Async MCP SDK integration with synchronous wrappers for compatibility
- Isolated event loops to avoid conflicts with Qt's event loop
- Global result caching for efficient context building
- Thread-safe UI updates using QTimer for background operations
Prompt Context
- MCP tool details: Full tool names and descriptions per server
- Recent MCP results: Complete history of all MCP calls (untruncated)
- Automatic metadata discovery: Tools are discovered and cached on first use
Known Limitations
- Stdio transport only: Currently supports MCP servers using stdio (standard input/output). HTTP/SSE transport coming in future releases.
- Windows-specific paths: MCP server commands must use Windows-compatible paths and executables.
- Node.js dependency: Many popular MCP servers require Node.js/npx to be installed.
Migration Guide
If you're upgrading from v1.0.2:
- No action required - MCP support is optional
- To enable MCP:
- Configure servers in Settings → MCP Servers tab
- Start using MCP tools via natural language
Popular MCP Servers
Get started quickly with these popular MCP servers:
-
Brave Search: Web search capabilities
npx -y @modelcontextprotocol/server-brave-search
-
Fetch: Web content retrieval and parsing
npx -y @lmcc-dev/mult-fetch-mcp-server
-
Filesystem: Secure file system access
npx -y @modelcontextprotocol/server-filesystem <allowed-path>
-
GitHub: Repository and issue management
npx -y @modelcontextprotocol/server-github
For a complete list, visit: https://github.com/modelcontextprotocol/servers
Credits
- MCP Protocol: Anthropic (https://modelcontextprotocol.io)
- Python SDK: Model Context Protocol team
- Community: Thanks to all MCP server developers
Feedback & Support
- Issues: https://github.com/ngotrantronghieu/Computer-Autopilot/issues
- Discussions: https://github.com/ngotrantronghieu/Computer-Autopilot/discussions
Full Changelog: v1.0.2...v1.0.3
Computer Autopilot v1.0.2
Computer Autopilot v1.0.2 — Release Notes
Highlights
- Single-instance app: launching again activates the existing window instead of opening a new one
- Proper Windows identity: Task Manager now shows “Computer Autopilot” with app icon
- Reliable exit: “Quit” from tray fully terminates the process
- Robust tray behavior: close-to-tray and restore-from-tray stabilized
- Startup reliability: improved “Start with Windows” mechanism (Startup folder shortcut)
- Persistent chat sessions for both Desktop Chat and Web Agent
- Auto-named sessions, session management UI, and restored conversations
New
- Single-instance guard
- Prevents multiple instances using a lock file
- Seamless activation: starting the app again brings the running instance to front (or restores from tray)
- Persistent sessions (Desktop + Web)
- Sessions and messages are stored in SQLite with proper schema and indexes.
- You can create, switch, rename, and delete sessions from a sessions bar on each tab.
- Sessions auto‑name from the first user message (rename remains available).
- Most recent sessions are available to restore at any time.
- Start fresh on launch
- App starts with a new session selected; all previous sessions remain available.
Improvements
-
System tray UX
- Minimize to tray on window close (not a full exit)
- Restore by double-clicking the tray icon or “Show/Restore” from the tray menu
- Tray “Quit” performs a full shutdown
-
Conversation memory reuse
- In-memory conversation history continues to power context windows while everything is also persisted in the DB for restoration.
-
Startup with Windows
- Uses Windows Startup folder shortcut approach (ensures correct working directory and is robust for packaged .exe)
- PowerShell fallback for shortcut creation when COM is unavailable
-
App identity/pinning
- Sets a stable Windows AppUserModelID to keep taskbar pin consistent
How to use
- Desktop Chat and Web Agent tabs now show:
- Session: dropdown + New, Rename, Delete
- Use “Clear Chat” to clear messages for the current session.
- Start typing; the session auto-names itself using your first message. Rename at any time from the button.
- Switching sessions restores the full conversation history instantly.
Computer Autopilot v1.0.1
New Features
Web Assistant
- Added advanced browser automation capabilities
- Implemented webpage element detection and interaction
- Added support for form filling and submission
- Enabled JavaScript execution within web pages
- Implemented multi-tab management
- Added robust selector extraction (CSS, XPath)
- Integrated seamless browser interaction with natural language commands
Performance Optimization
- Added configurable performance settings for both desktop and web automation
- Implemented separate action delay settings for web interactions
- Added maximum attempts configuration for more reliable automation
- Optimized browser interaction timing parameters
Improvements
Settings Dialog
- Redesigned settings interface with expanded configuration options
- Added dedicated performance tuning section
- Implemented web-specific configuration parameters
- Enhanced API key management
Technical Enhancements
- Improved selector generation for more reliable web element targeting
- Enhanced browser initialization and management
- Added intelligent page analysis for better web context understanding
- Implemented robust error handling for web interactions
System Requirements
- No changes to system requirements
- Compatible with all previously supported Windows versions
This update significantly expands Computer Autopilot's capabilities with advanced web automation features while maintaining the intuitive natural language interface. Users can now seamlessly control both desktop applications and web browsers with the same consistent experience.
Computer Autopilot v1.0.0
🚀 Features
- Natural language Windows automation
- Modern GUI with chat interface
- Voice input/output capabilities
- RPA task management
- Test case generation
- Cross-application support
🔧 Technical Requirements
- Windows Operating System
- Python 3.x
- Internet connection for LLM API access
⚙️ Configuration
- Visit https://docs.litellm.ai/docs/providers for LLM Model options
- Configure in app settings:
- LLM Model
- LLM Vision Model
- API Keys
- Optional: Use environment variables for API keys
📝 Notes
- First stable release
- Full documentation available in README.md
- Open source under MIT license