Scorecard

This repository allows you to deploy a remote MCP server on Cloudflare Workers that enables Claude and other MCP clients to access Scorecard's evaluation tools.

This will deploy your Scorecard MCP server to a URL like:scorecard-mcp.<your-account>.workers.dev/sse

Alternatively, you can clone this repository and deploy it using Wrangler:

git clone https://github.com/scorecard-ai/scorecard-mcp.git cd scorecard-mcp npm install npm run deploy

This MCP server provides access to Scorecard's evaluation tools directly from Claude and other MCP-compatible clients. It uses Clerk for authentication and is built on Cloudflare Workers for reliable, global deployment.

The server implements the MCP specification (2025-03-26) and provides secure access to Scorecard's API for running experiments, generating synthetic data, configuring metrics, and analyzing model performance.

This MCP server works with various MCP-compatible clients:

Connect to claude.ai, Cursor, and Windsurf

Once deployed, you can connect to your MCP server from Claude and other MCP-compatible clients by providing your server URL:

https://scorecard-mcp.<your-account>.workers.dev/sse

You can also connect through the Cloudflare AI Playground:
- Go tohttps://playground.ai.cloudflare.com/
- Enter your deployed MCP server URL (scorecard-mcp.<your-account>.workers.dev/sse)
- You can now use Scorecard's evaluation tools directly from the playground!

For local testing, you can connect to your MCP server from Claude Desktop by using themcp-remote proxy.

FollowAnthropic's Quickstartand within Claude Desktop go to Settings > Developer > Edit Config.

{ "mcpServers": { "scorecard": { "command": "npx", "args": [ "mcp-remote", "https://scorecard-mcp.<your-account>.workers.dev/sse" // or http://localhost:8787/sse for local testing ] } } }

Restart Claude and you should see the tools become available.

For local development, create a ".dev.vars" file with your Clerk credentials:

Configure the following variables in your .dev.vars file:

Remember to runnpx wrangler typesto generate types for the environment variables.

Special thanks to Dustin Moore for his engineering leadership in developing this MCP implementation.

This is a web browser that enables your coding agent, such as Claude Code, to visit websites on your behalf and assist you in identifying bugs or creating UI test cases.

-

Integrates with Google AI Studio/Gemini API for PDF to Markdown conversion and content generation.