Artificial Analysis

by davidhariri

625 downloads Not rated yet

About

I built this to give my AI assistants the latest information on model performance benchmarks provided by https://artificialanalysis.ai to make informed decisions on model choice.

Explore

- Get real-time pricing for 300+ LLM models (input/output/blended rates)
- Compare speed metrics (tokens/sec, time to first token)
- Access benchmark scores (Intelligence Index, Coding Index, MMLU-Pro, GPQA, and more)
- Filter by provider (OpenAI, Anthropic, Google, etc.)
- Sort by any metric

Setting up with Highlight

This MCP is not yet compatible with Highlight’s one-click setup. However, you can still use it with Highlight by following these steps:

  1. Download and install Highlight from highlightai.com/download
  2. Navigate to the plugins tab and select "Add Custom Plugin"
  3. Configure the plugin with the settings below
    Plugin Name Artificial Analysis
    Command (node, npx, python, etc.)

    Please refer to the README for specific instructions on how to obtain API keys or other required environment variables.

  4. Enable "Start Automatically" if you want the plugin to start when Highlight launches

From the repository

| Environment Variable | Required | Description |
|---------------------|----------|-------------|
| AA_API_KEY | Yes | Your Artificial Analysis API key |

Get your API key at artificialanalysis.ai.

Add to your Claude settings (~/.claude/settings.json):

{
  "mcpServers": {
    "artificial-analysis": {
      "command": "npx",
      "args": ["-y", "artificial-analysis-mcp"],
      "env": {
        "AA_API_KEY": "your-api-key"
      }
    }
  }
}

npm install

list_models

List all available LLM models from Artificial Analysis with pricing, speed, and benchmark data. Filter by creator (OpenAI, Anthropic, Google, etc.) and sort by price, speed, or benchmark scores.

get_model

Get detailed information about a specific LLM model including pricing (input/output/blended per 1M tokens), speed metrics (tokens/sec, TTFT), and benchmark scores (Intelligence Index, Coding Index, MMLU-Pro, GPQA, etc.).

Claude Desktop / Cursor

Paste into your MCP client config file to install this server.

{
    "mcpServers": {
        "artificial analysis": {
            "artificial-analysis": {
                "command": "npx",
                "args": [
                    "-y",
                    "artificial-analysis-mcp"
                ],
                "env": {
                    "AA_API_KEY": "your-api-key"
                }
            }
        }
    }
}

McpServers

{
    "artificial-analysis": {
        "command": "npx",
        "args": [
            "-y",
            "artificial-analysis-mcp"
        ],
        "env": {
            "AA_API_KEY": "your-api-key"
        }
    }
}

An MCP (Model Context Protocol) server that provides LLM model pricing, speed metrics, and benchmark scores from Artificial Analysis.

Features

- Get real-time pricing for 300+ LLM models (input/output/blended rates)
- Compare speed metrics (tokens/sec, time to first token)
- Access benchmark scores (Intelligence Index, Coding Index, MMLU-Pro, GPQA, and more)
- Filter by provider (OpenAI, Anthropic, Google, etc.)
- Sort by any metric

Installation

Claude Code

claude mcp add artificial-analysis -e AA_API_KEY=your-key -- npx -y artificial-analysis-mcp

Or install from GitHub:

claude /mcp add https://github.com/davidhariri/artificial-analysis-mcp

Manual Configuration

Add to your Claude settings (~/.claude/settings.json):

{
  "mcpServers": {
    "artificial-analysis": {
      "command": "npx",
      "args": ["-y", "artificial-analysis-mcp"],
      "env": {
        "AA_API_KEY": "your-api-key"
      }
    }
  }
}

Configuration

| Environment Variable | Required | Description |
|---------------------|----------|-------------|
| AA_API_KEY | Yes | Your Artificial Analysis API key |

Get your API key at artificialanalysis.ai.

Tools

list_models

List all available LLM models with optional filtering and sorting.

Parameters:

| Name | Type | Required | Description |
|------|------|----------|-------------|
| creator | string | No | Filter by model creator (e.g., "OpenAI", "Anthropic") |
| sort_by | string | No | Sort field (see below) |
| sort_order | string | No | "asc" or "desc" (default: "desc") |
| limit | number | No | Maximum results to return |

Sort fields: price_input, price_output, price_blended, speed, ttft, intelligence_index, coding_index, math_index, mmlu_pro, gpqa, release_date

Example usage:
- "List the top 5 fastest models"
- "Show me Anthropic models sorted by price"
- "What are the cheapest models with high intelligence scores?"

get_model

Get detailed information about a specific model.

Parameters:

| Name | Type | Required | Description |
|------|------|----------|-------------|
| model | string | Yes | Model name or slug (e.g., "gpt-4o", "claude-4-5-sonnet") |

Returns: Complete model details including pricing, speed metrics, and all benchmark scores.

Example usage:
- "Get pricing for GPT-4o"
- "What are Claude 4.5 Sonnet's benchmark scores?"

Model Data

Each model includes:

- Pricing: Input/output/blended rates per 1M tokens (USD)
- Speed: Output tokens per second, time to first token
- Benchmarks: Intelligence Index, Coding Index, Math Index, MMLU-Pro, GPQA, LiveCodeBench, and more

Development

```bash

No reviews yet — be the first

Sign in to leave a review

Use Google, GitHub, or an email account so ratings stay tied to real people.

Email sign in

No reviews posted yet.