web-eval-agent MCP Server

by WandererJack1

176 downloads Not rated yet Apache-2.0 license

GitHub

About

About An MCP server that autonomously evaluates web applications.

Details

License: Apache-2.0 license

Explore

- Navigate your webapp using BrowserUse (2x faster with operative backend)
- Capture network traffic - requests are intelligently filtered and returned into the context window
- Collect console errors - captures logs & errors
- Autonomous debugging - the Cursor agent calls the web QA agent mcp server to test if the code it wrote works as epected end-to-end.

Setting up with Highlight

This MCP is not yet compatible with Highlight’s one-click setup. However, you can still use it with Highlight by following these steps:

Download and install Highlight from highlightai.com/download
Navigate to the plugins tab and select "Add Custom Plugin"
Configure the plugin with the settings below

Plugin Name web-eval-agent MCP Server

Command (node, npx, python, etc.)

Please refer to the README for specific instructions on how to obtain API keys or other required environment variables.
Enable "Start Automatically" if you want the plugin to start when Highlight launches

Setting up with Cursor

Open Cursor's settings
Navigate to the MCP section
Click "Add new Global MCP server"
Copy and paste the configuration below based on your operating system

JSON

{
    "mcpServers": {
        "web-eval-agent mcp server": {
            "web-eval-agent": {
                "command": "uvx",
                "args": [
                    "--refresh-package",
                    "webEvalAgent",
                    "--from",
                    "git+https://github.com/Operative-Sh/web-eval-agent.git",
                    "webEvalAgent"
                ],
                "env": {
                    "OPERATIVE_API_KEY": ""
                }
            }
        }
    }
}

JSON

{
    "mcpServers": {
        "web-eval-agent mcp server": {
            "web-eval-agent": {
                "command": "uvx",
                "args": [
                    "--refresh-package",
                    "webEvalAgent",
                    "--from",
                    "git+https://github.com/Operative-Sh/web-eval-agent.git",
                    "webEvalAgent"
                ],
                "env": {
                    "OPERATIVE_API_KEY": ""
                }
            }
        }
    }
}

JSON

{
    "mcpServers": {
        "web-eval-agent mcp server": {
            "web-eval-agent": {
                "command": "uvx",
                "args": [
                    "--refresh-package",
                    "webEvalAgent",
                    "--from",
                    "git+https://github.com/Operative-Sh/web-eval-agent.git",
                    "webEvalAgent"
                ],
                "env": {
                    "OPERATIVE_API_KEY": ""
                }
            }
        }
    }
}

Setting up with Claude Desktop

Open Claude Desktop's settings
Go to the Integrations tab
Click "Add MCP Server"
Use the configuration below based on your operating system

Note: Make sure Claude Desktop is running before attempting to connect.

JSON

{
    "mcpServers": {
        "web-eval-agent mcp server": {
            "web-eval-agent": {
                "command": "uvx",
                "args": [
                    "--refresh-package",
                    "webEvalAgent",
                    "--from",
                    "git+https://github.com/Operative-Sh/web-eval-agent.git",
                    "webEvalAgent"
                ],
                "env": {
                    "OPERATIVE_API_KEY": ""
                }
            }
        }
    }
}

JSON

{
    "mcpServers": {
        "web-eval-agent mcp server": {
            "web-eval-agent": {
                "command": "uvx",
                "args": [
                    "--refresh-package",
                    "webEvalAgent",
                    "--from",
                    "git+https://github.com/Operative-Sh/web-eval-agent.git",
                    "webEvalAgent"
                ],
                "env": {
                    "OPERATIVE_API_KEY": ""
                }
            }
        }
    }
}

JSON

{
    "mcpServers": {
        "web-eval-agent mcp server": {
            "web-eval-agent": {
                "command": "uvx",
                "args": [
                    "--refresh-package",
                    "webEvalAgent",
                    "--from",
                    "git+https://github.com/Operative-Sh/web-eval-agent.git",
                    "webEvalAgent"
                ],
                "env": {
                    "OPERATIVE_API_KEY": ""
                }
            }
        }
    }
}

Setting up with Windsurf

Open Windsurf's preferences
Go to the Integrations section
Click "Add MCP Integration"
Use the configuration below based on your operating system

JSON

{
    "mcpServers": {
        "web-eval-agent mcp server": {
            "web-eval-agent": {
                "command": "uvx",
                "args": [
                    "--refresh-package",
                    "webEvalAgent",
                    "--from",
                    "git+https://github.com/Operative-Sh/web-eval-agent.git",
                    "webEvalAgent"
                ],
                "env": {
                    "OPERATIVE_API_KEY": ""
                }
            }
        }
    }
}

JSON

{
    "mcpServers": {
        "web-eval-agent mcp server": {
            "web-eval-agent": {
                "command": "uvx",
                "args": [
                    "--refresh-package",
                    "webEvalAgent",
                    "--from",
                    "git+https://github.com/Operative-Sh/web-eval-agent.git",
                    "webEvalAgent"
                ],
                "env": {
                    "OPERATIVE_API_KEY": ""
                }
            }
        }
    }
}

JSON

{
    "mcpServers": {
        "web-eval-agent mcp server": {
            "web-eval-agent": {
                "command": "uvx",
                "args": [
                    "--refresh-package",
                    "webEvalAgent",
                    "--from",
                    "git+https://github.com/Operative-Sh/web-eval-agent.git",
                    "webEvalAgent"
                ],
                "env": {
                    "OPERATIVE_API_KEY": ""
                }
            }
        }
    }
}

Setting up with Cline

Open Cline's settings
Navigate to the Integrations section
Click "Add MCP Server"
Copy and paste the configuration below based on your operating system

Note: Make sure to restart Cline after adding the configuration.

JSON

{
    "mcpServers": {
        "web-eval-agent mcp server": {
            "web-eval-agent": {
                "command": "uvx",
                "args": [
                    "--refresh-package",
                    "webEvalAgent",
                    "--from",
                    "git+https://github.com/Operative-Sh/web-eval-agent.git",
                    "webEvalAgent"
                ],
                "env": {
                    "OPERATIVE_API_KEY": ""
                }
            }
        }
    }
}

JSON

{
    "mcpServers": {
        "web-eval-agent mcp server": {
            "web-eval-agent": {
                "command": "uvx",
                "args": [
                    "--refresh-package",
                    "webEvalAgent",
                    "--from",
                    "git+https://github.com/Operative-Sh/web-eval-agent.git",
                    "webEvalAgent"
                ],
                "env": {
                    "OPERATIVE_API_KEY": ""
                }
            }
        }
    }
}

JSON

{
    "mcpServers": {
        "web-eval-agent mcp server": {
            "web-eval-agent": {
                "command": "uvx",
                "args": [
                    "--refresh-package",
                    "webEvalAgent",
                    "--from",
                    "git+https://github.com/Operative-Sh/web-eval-agent.git",
                    "webEvalAgent"
                ],
                "env": {
                    "OPERATIVE_API_KEY": ""
                }
            }
        }
    }
}

Setting up with Goose

Open Goose's preferences
Go to the Integrations tab
Select "MCP Servers"
Click "Add New Server"
Use the configuration below based on your operating system

JSON

{
    "mcpServers": {
        "web-eval-agent mcp server": {
            "web-eval-agent": {
                "command": "uvx",
                "args": [
                    "--refresh-package",
                    "webEvalAgent",
                    "--from",
                    "git+https://github.com/Operative-Sh/web-eval-agent.git",
                    "webEvalAgent"
                ],
                "env": {
                    "OPERATIVE_API_KEY": ""
                }
            }
        }
    }
}

JSON

{
    "mcpServers": {
        "web-eval-agent mcp server": {
            "web-eval-agent": {
                "command": "uvx",
                "args": [
                    "--refresh-package",
                    "webEvalAgent",
                    "--from",
                    "git+https://github.com/Operative-Sh/web-eval-agent.git",
                    "webEvalAgent"
                ],
                "env": {
                    "OPERATIVE_API_KEY": ""
                }
            }
        }
    }
}

JSON

{
    "mcpServers": {
        "web-eval-agent mcp server": {
            "web-eval-agent": {
                "command": "uvx",
                "args": [
                    "--refresh-package",
                    "webEvalAgent",
                    "--from",
                    "git+https://github.com/Operative-Sh/web-eval-agent.git",
                    "webEvalAgent"
                ],
                "env": {
                    "OPERATIVE_API_KEY": ""
                }
            }
        }
    }
}

From the repository

1. Pre-requisites (typically not needed):
- brew: /bin/bash -c "$(curl -fsSL https://raw.githubusercontent.com/Homebrew/install/HEAD/install.sh)"
- npm: (brew install npm)
- jq: brew install jq
2. Run the installer after getting an api key (free)
- Installs playwright
- Installs uv
- Inserts JSON into your code editor (Cursor/Cline/Windsurf) for you!

curl -LSf https://operativelabs.xyz/install.sh -o install.sh && bash install.sh && rm install.sh

3. Visit your favorite IDE and restart to apply the changes
4. Send a prompt in chat mode to call the web eval agent tool! e.g.

Test my app on http://localhost:3000. Use web-eval-agent.

1. Get your API key at operativelabs.xyz
2. Install uv

curl -LsSf https://astral.sh/uv/install.sh | sh)

4. Install playwright:

npm install -g chromium playwright && uvx --with playwright playwright install --with-deps

6. Add below JSON to your relevant code editor with api key 7. Restart your code editor

1. Get your API key at operativelabs.xyz
2. Install uv

curl -LsSf https://astral.sh/uv/install.sh | sh)

3. Install playwright:

npm install -g chromium playwright && uvx --with playwright playwright install --with-deps

4. Add below JSON to your relevant code editor with api key
5. Restart your code editor

We're refining this, please open an issue if you have any issues!
1. Do all this in your code editor terminal
2. curl -LSf https://operativelabs.xyz/install.sh -o install.sh && bash install.sh && rm install.sh
3. Get your API key at operativelabs.xyz
4. Install uv (curl -LsSf https://astral.sh/uv/install.sh | sh)
5. uvx --from git+https://github.com/Operative-Sh/web-eval-agent.git playwright install
6. Restart code editor

Claude Desktop / Cursor

Paste into your MCP client config file to install this server.

{
    "mcpServers": {
        "web-eval-agent mcp server": {
            "web-eval-agent": {
                "command": "uvx",
                "args": [
                    "--refresh-package",
                    "webEvalAgent",
                    "--from",
                    "git+https://github.com/Operative-Sh/web-eval-agent.git",
                    "webEvalAgent"
                ],
                "env": {
                    "OPERATIVE_API_KEY": ""
                }
            }
        }
    }
}

McpServers

{
    "web-eval-agent": {
        "command": "uvx",
        "args": [
            "--refresh-package",
            "webEvalAgent",
            "--from",
            "git+https://github.com/Operative-Sh/web-eval-agent.git",
            "webEvalAgent"
        ],
        "env": {
            "OPERATIVE_API_KEY": ""
        }
    }
}

> Let the coding agent debug itself, you've got better things to do.

Supercharge Your Debugging

operativelabs.xyz's MCP Server launches a browser-use powered agent to autonomously execute and debug web apps directly in your code editor.

Features

🏁 Quick Start (macOS/Linux)

curl -LSf https://operativelabs.xyz/install.sh -o install.sh && bash install.sh && rm install.sh

3. Visit your favorite IDE and restart to apply the changes
4. Send a prompt in chat mode to call the web eval agent tool! e.g.

Test my app on http://localhost:3000. Use web-eval-agent.

🛠️ Manual Installation

1. Get your API key at operativelabs.xyz 2. Install uv

curl -LsSf https://astral.sh/uv/install.sh | sh)

4. Install playwright:

npm install -g chromium playwright && uvx --with playwright playwright install --with-deps

6. Add below JSON to your relevant code editor with api key 7. Restart your code editor

🔃 Updating

- uv cache clean - refresh MCP server

``json "web-eval-agent": { "command": "uvx", "args": [ "--refresh-package", "webEvalAgent", "--from", "git+https://github.com/Operative-Sh/web-eval-agent.git", "webEvalAgent" ], "env": { "OPERATIVE_API_KEY": "<YOUR_KEY>" } }

## Operative Discord Server
🛠️ Manual Installation (Mac + Cursor/Cline/Windsurf) 
1. Get your API key at operativelabs.xyz
2. Install uv

bash
curl -LsSf https://astral.sh/uv/install.sh | sh)
3. Install playwright:
bash
npm install -g chromium playwright && uvx --with playwright playwright install --with-deps
4. Add below JSON to your relevant code editor with api key 
5. Restart your code editor
Manual Installation (Windows + Cursor/Cline/Windsurf)  
We're refining this, please open an issue if you have any issues! 

1. Do all this in your code editor terminal 

2. curl -LSf https://operativelabs.xyz/install.sh -o install.sh && bash install.sh && rm install.sh

3. Get your API key at operativelabs.xyz

4. Install uv (curl -LsSf https://astral.sh/uv/install.sh | sh)

5. uvx --from git+https://github.com/Operative-Sh/web-eval-agent.git playwright install

6. Restart code editor

🚨 Issues 
- Updates aren't being received in code editors, update or reinstall for latest version: Run uv cache clean for latest 
- Any issues feel free to open an Issue on this repo or in the discord!
- 5/5 - static apps without changes weren't screencasting, fixed! uv clean + restart to get fix
Changelog 
- 4/29 - Agent overlay update - pause/play/stop agent run in the browser
📋 Example MCP Server Output Report
text

📊 Web Evaluation Report for http://localhost:5173 complete!

📝 Task: Test the API-key deletion flow by navigating to the API Keys section, deleting a key, and judging the UX.
🔍 Agent Steps

  📍 1. Navigate → http://localhost:5173

  📍 2. Click     “Login”        (button index 2)

  📍 3. Click     “API Keys”     (button index 4)

  📍 4. Click     “Create Key”   (button index 9)

  📍 5. Type      “Test API Key” (input index 2)

  📍 6. Click     “Done”         (button index 3)

  📍 7. Click     “Delete”       (button index 10)

  📍 8. Click     “Delete”       (confirm index 3)

  🏁 Flow tested successfully – UX felt smooth and intuitive.
🖥️ Console Logs (10)

  1. [debug] [vite] connecting…

  2. [debug] [vite] connected.

  3. [info]  Download the React DevTools …

     …
🌐 Network Requests (10)

  1. GET /src/pages/SleepingMasks.tsx                   304

  2. GET /src/pages/MCPRegistryRegistry.tsx             304

     …

⏱️ Chronological Timeline 01:16:23.293 🖥️ Console [debug] [vite] connecting… 01:16:23.303 🖥️ Console [debug] [vite] connected. 01:16:23.312 ➡️ GET /src/pages/SleepingMasks.tsx 01:16:23.318 ⬅️ 304 /src/pages/SleepingMasks.tsx … 01:17:45.038 🤖 🏁 Flow finished – deletion verified 01:17:47.038 🤖 📋 Conclusion repeated above 👁️ See the “Operative Control Center” dashboard for live logs.``

---

Built with <3 @ operativelabs.xyz

No reviews yet — be the first

Use Google, GitHub, or an email account so ratings stay tied to real people.

Email sign in

No reviews posted yet.

About

Details

Explore

Setting up with Highlight

From the repository

Claude Desktop / Cursor

McpServers

Supercharge Your Debugging

Features

🏁 Quick Start (macOS/Linux)

🛠️ Manual Installation

🔃 Updating

🛠️ Manual Installation (Mac + Cursor/Cline/Windsurf)

Manual Installation (Windows + Cursor/Cline/Windsurf)

🚨 Issues

Changelog

📋 Example MCP Server Output Report

More like this

Context 7

1Panel

🔎 GPT Researcher

Serena