Sitemcp

by ryoppippi

412 downloads Not rated yet

GitHub Website

Other

About

# sitemcp Fetch an entire site and use it as a MCP Server https://github.com/user-attachments/assets/ebe2d7c6-4ddc-4a37-8e1e-d80fac49d8ae <details> <summary><bold>Demo in Japanese</bold></summary> https://github.com/user-attachments/assets/24288140-be2a-416c-9e7c-c49be056a373 </details> > [!NOTE] > `sitemcp` is a fork…

Explore

- Fetches entire website as an MCP server
- Supports concurrent page fetching
- Match specific pages with glob patterns
- Extract content using CSS selectors
- Uses readability for readable content extraction
- Caches fetched pages locally for performance

Setting up with Highlight

This MCP is not yet compatible with Highlight’s one-click setup. However, you can still use it with Highlight by following these steps:

Download and install Highlight from highlightai.com/download
Navigate to the plugins tab and select "Add Custom Plugin"
Configure the plugin with the settings below

Plugin Name Sitemcp

Command (node, npx, python, etc.)

Please refer to the README for specific instructions on how to obtain API keys or other required environment variables.
Enable "Start Automatically" if you want the plugin to start when Highlight launches

Setting up with Cursor

Open Cursor's settings
Navigate to the MCP section
Click "Add new Global MCP server"
Copy and paste the configuration below based on your operating system

JSON

{
    "mcpServers": {
        "sitemcp": {
            "sitemcp": {
                "command": "npx",
                "args": [
                    "sitemcp"
                ]
            }
        }
    }
}

JSON

{
    "mcpServers": {
        "sitemcp": {
            "sitemcp": {
                "command": "npx",
                "args": [
                    "sitemcp"
                ]
            }
        }
    }
}

JSON

{
    "mcpServers": {
        "sitemcp": {
            "sitemcp": {
                "command": "npx",
                "args": [
                    "sitemcp"
                ]
            }
        }
    }
}

Setting up with Claude Desktop

Open Claude Desktop's settings
Go to the Integrations tab
Click "Add MCP Server"
Use the configuration below based on your operating system

Note: Make sure Claude Desktop is running before attempting to connect.

JSON

{
    "mcpServers": {
        "sitemcp": {
            "sitemcp": {
                "command": "npx",
                "args": [
                    "sitemcp"
                ]
            }
        }
    }
}

JSON

{
    "mcpServers": {
        "sitemcp": {
            "sitemcp": {
                "command": "npx",
                "args": [
                    "sitemcp"
                ]
            }
        }
    }
}

JSON

{
    "mcpServers": {
        "sitemcp": {
            "sitemcp": {
                "command": "npx",
                "args": [
                    "sitemcp"
                ]
            }
        }
    }
}

Setting up with Windsurf

Open Windsurf's preferences
Go to the Integrations section
Click "Add MCP Integration"
Use the configuration below based on your operating system

JSON

{
    "mcpServers": {
        "sitemcp": {
            "sitemcp": {
                "command": "npx",
                "args": [
                    "sitemcp"
                ]
            }
        }
    }
}

JSON

{
    "mcpServers": {
        "sitemcp": {
            "sitemcp": {
                "command": "npx",
                "args": [
                    "sitemcp"
                ]
            }
        }
    }
}

JSON

{
    "mcpServers": {
        "sitemcp": {
            "sitemcp": {
                "command": "npx",
                "args": [
                    "sitemcp"
                ]
            }
        }
    }
}

Setting up with Cline

Open Cline's settings
Navigate to the Integrations section
Click "Add MCP Server"
Copy and paste the configuration below based on your operating system

Note: Make sure to restart Cline after adding the configuration.

JSON

{
    "mcpServers": {
        "sitemcp": {
            "sitemcp": {
                "command": "npx",
                "args": [
                    "sitemcp"
                ]
            }
        }
    }
}

JSON

{
    "mcpServers": {
        "sitemcp": {
            "sitemcp": {
                "command": "npx",
                "args": [
                    "sitemcp"
                ]
            }
        }
    }
}

JSON

{
    "mcpServers": {
        "sitemcp": {
            "sitemcp": {
                "command": "npx",
                "args": [
                    "sitemcp"
                ]
            }
        }
    }
}

Setting up with Goose

Open Goose's preferences
Go to the Integrations tab
Select "MCP Servers"
Click "Add New Server"
Use the configuration below based on your operating system

JSON

{
    "mcpServers": {
        "sitemcp": {
            "sitemcp": {
                "command": "npx",
                "args": [
                    "sitemcp"
                ]
            }
        }
    }
}

JSON

{
    "mcpServers": {
        "sitemcp": {
            "sitemcp": {
                "command": "npx",
                "args": [
                    "sitemcp"
                ]
            }
        }
    }
}

JSON

{
    "mcpServers": {
        "sitemcp": {
            "sitemcp": {
                "command": "npx",
                "args": [
                    "sitemcp"
                ]
            }
        }
    }
}

From the repository

One-off usage (choose one of the followings):

bunx sitemcp
npx sitemcp
pnpx sitemcp

Install globally (choose one of the followings):

bun i -g sitemcp
npm i -g sitemcp
pnpm i -g sitemcp

You can execute server from your MCP client (e.g. Claude Desktop).

The below example configuration for Claude Desktop

{
  "mcpServers": {
    "daisy-ui": {
      "command": "npx",
      "args": [
        "-y",
        "sitemcp",
        "https://daisyui.com",
        "-m",
        "/components/**",
      ]
    }
  }
}

Claude Desktop / Cursor

Paste into your MCP client config file to install this server.

{
    "mcpServers": {
        "sitemcp": {
            "sitemcp": {
                "command": "npx",
                "args": [
                    "sitemcp"
                ]
            }
        }
    }
}

McpServers

{
    "sitemcp": {
        "command": "npx",
        "args": [
            "sitemcp"
        ]
    }
}

Fetch an entire site and use it as a MCP Server

https://github.com/user-attachments/assets/ebe2d7c6-4ddc-4a37-8e1e-d80fac49d8ae

<details>
<summary><bold>Demo in Japanese</bold></summary>

https://github.com/user-attachments/assets/24288140-be2a-416c-9e7c-c49be056a373

</details>

> [!NOTE]
> sitemcp is a fork of sitefetch by @egoist

Install

One-off usage (choose one of the followings):

bunx sitemcp
npx sitemcp
pnpx sitemcp

Install globally (choose one of the followings):

bun i -g sitemcp
npm i -g sitemcp
pnpm i -g sitemcp

Usage

```bash
sitemcp https://daisyui.com

No reviews yet — be the first

Use Google, GitHub, or an email account so ratings stay tied to real people.

Email sign in

No reviews posted yet.

About

Explore

Setting up with Highlight

From the repository

Claude Desktop / Cursor

McpServers

Install

Usage

More like this

Sequential Thinking

Filesystem

EverArt

Google Drive