XFetch Mcp

by xfetchai

276 downloads Not rated yet MIT
GitHub

About

# XFetch MCP Server [![PyPI version](https://badge.fury.io/py/mcp-server-xfetch.svg)](https://badge.fury.io/py/mcp-server-xfetch) [![Python Versions](https://img.shields.io/pypi/pyversions/mcp-server-xfetch.svg)](https://pypi.org/project/mcp-server-xfetch/) [![License…

Details

License
MIT

Explore

- 🚀 Bypass Protection Systems: Access content from websites protected by Cloudflare and other security systems
- 🌐 JavaScript Rendering: Fetch content from dynamic websites that require JavaScript execution
- 🎯 CSS Selectors: Extract specific content from web pages using CSS selectors
- ⏱️ Dynamic Content Loading: Wait for dynamic content to load before fetching
- 📝 Markdown Conversion: Automatically converts HTML to markdown for easier LLM consumption
- 🔄 Chunked Reading: Read long pages in chunks using start_index parameter

Setting up with Highlight

This MCP is not yet compatible with Highlight’s one-click setup. However, you can still use it with Highlight by following these steps:

  1. Download and install Highlight from highlightai.com/download
  2. Navigate to the plugins tab and select "Add Custom Plugin"
  3. Configure the plugin with the settings below
    Plugin Name XFetch Mcp
    Command (node, npx, python, etc.)

    Please refer to the README for specific instructions on how to obtain API keys or other required environment variables.

  4. Enable "Start Automatically" if you want the plugin to start when Highlight launches

From the repository

Add to your Claude settings:

<details>
<summary>Using uvx (recommended)</summary>

"mcpServers": {
  "xfetch": {
    "command": "uvx",
    "args": ["mcp-server-xfetch"]
  }
}
</details>

<details>
<summary>Using pip installation</summary>

"mcpServers": {
  "xfetch": {
    "command": "python",
    "args": ["-m", "mcp_server_xfetch"]
  }
}
</details>

export XFETCH_API_TOKEN=your_token_here


bash

```python

xfetch

Enhanced web content fetching tool with advanced capabilities

url

(string, required): URL to fetch

max_length

(integer, optional): Maximum number of characters to return (default: 5000)

start_index

(integer, optional): Start content from this character index (default: 0)

raw

(boolean, optional): Get raw content without markdown conversion (default: false)

render

(boolean, optional): Enable JavaScript rendering for dynamic content (default: false)

selector

(string, optional): CSS selector to extract specific content

timeout

(integer, optional): Wait time in seconds for dynamic content loading (1-10 seconds)

- xfetch - Enhanced web content fetching tool with advanced capabilities
- url (string, required): URL to fetch
- max_length (integer, optional): Maximum number of characters to return (default: 5000)
- start_index (integer, optional): Start content from this character index (default: 0)
- raw (boolean, optional): Get raw content without markdown conversion (default: false)
- render (boolean, optional): Enable JavaScript rendering for dynamic content (default: false)
- selector (string, optional): CSS selector to extract specific content
- timeout (integer, optional): Wait time in seconds for dynamic content loading (1-10 seconds)

Claude Desktop / Cursor

Paste into your MCP client config file to install this server.

{
    "mcpServers": {
        "xfetch mcp": {
            "xfetch-mcp": {
                "command": "uvx",
                "args": [
                    "mcp-server-xfetch"
                ]
            }
        }
    }
}

McpServers

{
    "xfetch-mcp": {
        "command": "uvx",
        "args": [
            "mcp-server-xfetch"
        ]
    }
}

PyPI version
Python Versions
License: MIT

Enhanced Model Context Protocol server for web content fetching (fetch on steroids). This server enables LLMs to retrieve and process content from any web pages, including those protected by Cloudflare and other security systems that regular fetch can't handle.

Key Features

- 🚀 Bypass Protection Systems: Access content from websites protected by Cloudflare and other security systems
- 🌐 JavaScript Rendering: Fetch content from dynamic websites that require JavaScript execution
- 🎯 CSS Selectors: Extract specific content from web pages using CSS selectors
- ⏱️ Dynamic Content Loading: Wait for dynamic content to load before fetching
- 📝 Markdown Conversion: Automatically converts HTML to markdown for easier LLM consumption
- 🔄 Chunked Reading: Read long pages in chunks using start_index parameter

Available Tools

- xfetch - Enhanced web content fetching tool with advanced capabilities
- url (string, required): URL to fetch
- max_length (integer, optional): Maximum number of characters to return (default: 5000)
- start_index (integer, optional): Start content from this character index (default: 0)
- raw (boolean, optional): Get raw content without markdown conversion (default: false)
- render (boolean, optional): Enable JavaScript rendering for dynamic content (default: false)
- selector (string, optional): CSS selector to extract specific content
- timeout (integer, optional): Wait time in seconds for dynamic content loading (1-10 seconds)

Prompts

- xfetch
- Fetch a URL and extract its contents as markdown
- Arguments:
- url (string, required): URL to fetch
- render (boolean, optional): Enable JavaScript rendering
- selector (string, optional): CSS selector for content extraction
- timeout (integer, optional): Dynamic content loading timeout

Installation

Using pip

pip install mcp-server-xfetch

Using uv (recommended)

When using uv, no specific installation is needed:

uvx mcp-server-xfetch

Configuration

Configure for Claude.app

Add to your Claude settings:

<details>
<summary>Using uvx (recommended)</summary>

"mcpServers": {
  "xfetch": {
    "command": "uvx",
    "args": ["mcp-server-xfetch"]
  }
}
</details>

<details>
<summary>Using pip installation</summary>

"mcpServers": {
  "xfetch": {
    "command": "python",
    "args": ["-m", "mcp_server_xfetch"]
  }
}
</details>

API Token

XFetch service offers two usage tiers:

Free Tier
The package includes a default API token that allows limited free usage. This is great for: - Testing and evaluation - Personal projects - Small-scale non-commercial use

However, the free tier has rate limits and may have occasional stability issues.

Commercial/Production Use
For stable and reliable service, especially for: - Commercial projects - Production environments - High-volume requests - Guaranteed uptime and support

Visit xfetch.ai to:
1. Register for a commercial account
2. Get your dedicated API token
3. Access premium features and support

Once you have your token, you can set it up in one of these ways:

```bash

No reviews yet — be the first

Sign in to leave a review

Use Google, GitHub, or an email account so ratings stay tied to real people.

Email sign in

No reviews posted yet.