Desktop Automation

This guide contains instructions, MCP Servers, and Extensions on how to configure desktop automations with specific Desktop Environments

Gnome

For Gnome, there is Gnome MCP Server. This server provides tools for screenshots, window management, calendar, contacts, toggle management and much more. Installation instructions:

Warning: If you are on Newelle <1.4.5, this is not supported on flatpak version. For native version you need to specify the full path //home/user/.cargo/bin/gnome-mcp-server.

1. If you are running the flatpak version ensure that sandbox escape is enabled
2. Install Gnome MCP server (Follow instructions here)
3. Go to Newelle's settings
4. Go in the "Tools" section
5. Scroll down to MCP servers
6. Expand "Add Server"
7. Select "Stdio" as server type
8. put ~/.cargo/bin/gnome-mcp-server as executable path, leave the rest blank

8. Add server

The AI will now have new tools to interact with the Gnome Desktop.