Sitemcp

by ryoppippi

240 downloads
Not rated
GitHub

Description

# sitemcp Fetch an entire site and use it as a MCP Server https://github.com/user-attachments/assets/ebe2d7c6-4ddc-4a37-8e1e-d80fac49d8ae <details> <summary><bold>Demo in Japanese</bold></summary> https://github.com/user-attachments/assets/24288140-be2a-416c-9e7c-c49be056a373…

About

# sitemcp Fetch an entire site and use it as a MCP Server https://github.com/user-attachments/assets/ebe2d7c6-4ddc-4a37-8e1e-d80fac49d8ae <details> <summary><bold>Demo in Japanese</bold></summary> https://github.com/user-attachments/assets/24288140-be2a-416c-9e7c-c49be056a373 </details> > [!NOTE] > `sitemcp` is a fork…

Details

Author
ryoppippi
Downloads
240
Categories
Other

- Fetches entire website as an MCP server
- Supports concurrent page fetching
- Match specific pages with glob patterns
- Extract content using CSS selectors
- Uses readability for readable content extraction
- Caches fetched pages locally for performance

Setting up with Highlight

This MCP is not yet compatible with Highlight’s one-click setup. However, you can still use it with Highlight by following these steps:

  1. Download and install Highlight from highlightai.com/download
  2. Navigate to the plugins tab and select "Add Custom Plugin"
  3. Configure the plugin with the settings below
    Plugin Name Sitemcp
    Command (node, npx, python, etc.)

    Please refer to the README for specific instructions on how to obtain API keys or other required environment variables.

  4. Enable "Start Automatically" if you want the plugin to start when Highlight launches

From the repository

Install globally with npm i -g sitemcp or run one-off with npx sitemcp. Then invoke sitemcp <url> and optionally add flags like --concurrency, --match, or --content-selector. Configure your MCP client—for example, Claude Desktop—by adding a server entry that runs the command with the target URL and any desired flags.

Claude Desktop / Cursor

Paste into your MCP client config file to install this server.

{
    "mcpServers": {
        "sitemcp": {
            "sitemcp": {
                "command": "npx",
                "args": [
                    "sitemcp"
                ]
            }
        }
    }
}

McpServers

{
    "sitemcp": {
        "command": "npx",
        "args": [
            "sitemcp"
        ]
    }
}

sitemcp

Fetch an entire site and use it as a MCP Server

https://github.com/user-attachments/assets/ebe2d7c6-4ddc-4a37-8e1e-d80fac49d8ae

<details>
<summary><bold>Demo in Japanese</bold></summary>

https://github.com/user-attachments/assets/24288140-be2a-416c-9e7c-c49be056a373

</details>

> [!NOTE]
> sitemcp is a fork of sitefetch by @egoist

Install

One-off usage (choose one of the followings):

bunx sitemcp
npx sitemcp
pnpx sitemcp

Install globally (choose one of the followings):

bun i -g sitemcp
npm i -g sitemcp
pnpm i -g sitemcp

Usage

```bash
sitemcp https://daisyui.com

No reviews yet — be the first

Sign in to leave a review

Use Google, GitHub, or an email account so ratings stay tied to real people.

Email sign in

No reviews posted yet.