Desktop Automation
About
A Model Context Protocol server that provides desktop automation capabilities using RobotJS and screenshot capabilities
Details
- Author
- tanob
- GitHub stars
- 30
- Downloads
- 540
- Categories
- Productivity, Automation, Developer Tools
Jump to
- Desktop mouse control (move, click)
- Keyboard input simulation (keys, text typing)
- Screen size detection
- Screenshot capture and listing
- Simple JSON response format
Setting up with Highlight
This MCP is not yet compatible with Highlight’s one-click setup. However, you can still use it with Highlight by following these steps:
- Download and install Highlight from highlightai.com/download
- Navigate to the plugins tab and select "Add Custom Plugin"
-
Configure the plugin with the settings below
Plugin Name
Desktop AutomationCommand (node, npx, python, etc.)Please refer to the README for specific instructions on how to obtain API keys or other required environment variables.
- Enable "Start Automatically" if you want the plugin to start when Highlight launches
From the repository
Configure Claude Desktop with the NPX command as shown in the README. The server requires system-level permissions for screen capture, mouse control, and keyboard simulation, which may need to be granted in your operating system's security settings.
Claude Desktop / Cursor
Paste into your MCP client config file to install this server.
{
"mcpServers": {
"desktop automation": {
"desktop-automation": {
"command": "npx",
"args": [
"-y",
"mcp-desktop-automation"
]
}
}
}
}
McpServers
{
"desktop-automation": {
"command": "npx",
"args": [
"-y",
"mcp-desktop-automation"
]
}
}
Configuration to use Desktop Automation Server
Here's how to configure Claude Desktop to use the MCP Desktop Automation server:
{ "mcpServers": { "desktop-automation": { "command": "npx", "args": ["-y", "mcp-desktop-automation"] } } }
This server requires system-level permissions to:
- Capture screenshots of your screen
- Control mouse movement and clicks
- Simulate keyboard input
When first running Claude Desktop with this server, you may need to grant these permissions in your operating system's security settings.
While this server works with various MCP clients, it has been primarily tested with Claude Desktop.
Important: The current implementation has a 1MB response size limit. For screen captures, this means:
- High-resolution screenshots may exceed this limit and fail
- Testing has shown 800x600 resolution works reliably
- Consider reducing screen resolution or capturing specific screen areas if you encounter issues
- Gets the screen dimensions
- No input parameters required
- Captures the current screen content
- No input parameters required
- Presses a keyboard key or key combination
- Inputs:
- key(string, required): Key to press (e.g., 'enter', 'a', 'control')
- modifiers(array of strings, optional): Modifier keys to hold while pressing the key. Possible values: "control", "shift", "alt", "command"
- Types text at the current cursor position
- Input:text(string, required): Text to type
- Performs a mouse click
- Inputs:
- button(string, optional, default: "left"): Mouse button to click. Possible values: "left", "right", "middle"
- double(boolean, optional, default: false): Whether to perform a double click
- Moves the mouse to specified coordinates
- Inputs:
- x(number, required): X coordinate
- y(number, required): Y coordinate
The server provides access to screenshots:
Screenshot Content(screenshot://{id})
- PNG images of captured screenshots
- Accessible via the screenshot ID (timestamp-based naming)
- Desktop mouse control
- Keyboard input simulation
- Screen size detection
- Screenshot capabilities
- Simple JSON response format
This MCP server is licensed under the MIT License. This means you are free to use, modify, and distribute the software, subject to the terms and conditions of the MIT License. For more details, please see the LICENSE file in the project repository.
Control your computer's mouse, keyboard, and perform OCR using PyAutoGUI and RapidOCR. Works on Windows, with potential support for other platforms.
MCP server for the Computer-Use Agent (CUA), allowing you to run CUA through Claude Desktop or other MCP clients.
MCP server for Mobile Development and Automation | iOS, Android, Simulator, Emulator, and Real Devices
A simple, self-contained notes system with resources, tools, and prompts.
Control your desktop with AI. Automate mouse movements, keyboard inputs, and screen captures.
MCP allowing your Agent to request human validation on webapps and apps.
Typed, policy-enforced local MCP capabilities over LinkedIn's visible web UI.
A Python server for remote macOS control via VNC, featuring an AI-powered chat web interface.
Captures screenshots and performs OCR text recognition.
A local office automation assistant for file system operations, system command execution, and browser control.
Sign in to leave a review
Use Google, GitHub, or an email account so ratings stay tied to real people.
No reviews posted yet.


