Computer Use

by spencerkinney

544 downloads Not rated yet

About

Control virtual computers through the Model Context Protocol (MCP).

Explore

Setting up with Highlight

This MCP is not yet compatible with Highlight’s one-click setup. However, you can still use it with Highlight by following these steps:

  1. Download and install Highlight from highlightai.com/download
  2. Navigate to the plugins tab and select "Add Custom Plugin"
  3. Configure the plugin with the settings below
    Plugin Name Computer Use
    Command (node, npx, python, etc.)

    Please refer to the README for specific instructions on how to obtain API keys or other required environment variables.

  4. Enable "Start Automatically" if you want the plugin to start when Highlight launches

From the repository

- Python 3.8+
- Orgo API key
- Anthropic API key (for Claude CUA)


python3 -m venv mcp-env
source mcp-env/bin/activate

pip install fastmcp pydantic orgo

export ORGO_API_KEY="your_orgo_key"
export ANTHROPIC_API_KEY="your_anthropic_key"

initialize_computer

Start virtual computer

get_screenshot

Take screen capture

scroll

Scroll up/down

wait

Wait for specified seconds

execute_bash

Run terminal commands

prompt

Claude AI Computer Use

| Tool | Description |
|------|-------------|
| initialize_computer | Start virtual computer |
| get_screenshot | Take screen capture |
| left_click, right_click, double_click | Mouse actions |
| scroll | Scroll up/down |
| type_text, press_key | Keyboard input |
| wait | Wait for specified seconds |
| execute_bash | Run terminal commands |
| restart_computer, shutdown_computer | Computer lifecycle |
| get_status, list_sessions | Status and session management |
| prompt | Claude AI Computer Use |

Claude Desktop / Cursor

Paste into your MCP client config file to install this server.

{
    "mcpServers": {
        "computer use": {
            "computer-use-mcp": {
                "command": "python",
                "args": [
                    "computer_mcp_server.py"
                ],
                "env": {
                    "ORGO_API_KEY": "your_orgo_key_here",
                    "ANTHROPIC_API_KEY": "your_anthropic_key_here"
                }
            }
        }
    }
}

McpServers

{
    "computer-use-mcp": {
        "command": "python",
        "args": [
            "computer_mcp_server.py"
        ],
        "env": {
            "ORGO_API_KEY": "your_orgo_key_here",
            "ANTHROPIC_API_KEY": "your_anthropic_key_here"
        }
    }
}

Control virtual computers through the Model Context Protocol (MCP). Built with FastMCP and Orgo.

Spin up cloud desktop environments for Computer Use Agents (CUA).

Quick Start

1. Install Dependencies

```bash
No reviews yet — be the first

Sign in to leave a review

Use Google, GitHub, or an email account so ratings stay tied to real people.

Email sign in

No reviews posted yet.