Mcp Server For Searxng Search And Web Scraping

by wfkpk

311 downloads
Not rated
GitHub

Description

# MCP SearXNG Search An MCP server for privacy-focused web search and article scraping using SearXNG instances. ## Tools - **searxng_search** - Execute web searches with titles, URLs, and snippets - Inputs: - `query` (string): Search terms - `searxng_url` (string, optional)…

About

# MCP SearXNG Search An MCP server for privacy-focused web search and article scraping using SearXNG instances. ## Tools - **searxng_search** - Execute web searches with titles, URLs, and snippets - Inputs: - `query` (string): Search terms - `searxng_url` (string, optional): SearXNG instance URL - **scrape_article** -…

Details

Author
wfkpk
Downloads
311
Categories
Search, Web Scraping

- Privacy‑focused web search via SearXNG instances
- Three tools: searxng_search, scrape_article, search
- search automatically scrapes the top 5 results
- Optional per‑call SearXNG instance override
- Clean article content extraction from any URL
- Works with public or self‑hosted SearXNG instances

Setting up with Highlight

This MCP is not yet compatible with Highlight’s one-click setup. However, you can still use it with Highlight by following these steps:

  1. Download and install Highlight from highlightai.com/download
  2. Navigate to the plugins tab and select "Add Custom Plugin"
  3. Configure the plugin with the settings below
    Plugin Name Mcp Server For Searxng Search And Web Scraping
    Command (node, npx, python, etc.)

    Please refer to the README for specific instructions on how to obtain API keys or other required environment variables.

  4. Enable "Start Automatically" if you want the plugin to start when Highlight launches

From the repository

Install via npx -y mcp-searxng-scrape or build locally with npm install && npm run build. Set the SEARXNG_URL environment variable to a SearXNG instance URL (e.g., https://searx.be) and configure the server in your MCP client’s JSON settings.

searxng_search

Performs a web search using a public or self-hosted SearXNG instance. Ideal for privacy-friendly search queries across multiple engines including news, blogs, academic, and technical sources. Use this for general-purpose web search without any tracking or profiling. Returns raw results as-is from the search aggregator.

scrape_article

Extracts the main article content from a given URL. Best used for cleaning and isolating the readable text from news sites, blog posts, research articles, and other content-heavy pages. Returns structured data including title, body, and optional metadata. Use this when you already have a URL and want the actual text content for summarization, analysis, or storage.

search

Performs a web search using a SearXNG instance and automatically scrapes the full article content from the top 5 results. Combines search and extraction in a single step—ideal for quickly collecting real content from multiple sources. Best used when you need not just links but the actual readable text for summarization, NLP tasks, or embeddings. Returns full page text, titles, and metadata from relevant results.

Claude Desktop / Cursor

Paste into your MCP client config file to install this server.

{
    "mcpServers": {
        "mcp server for searxng search and web scraping": {
            "searxng": {
                "command": "npx",
                "args": [
                    "-y",
                    "mcp-searxng-scrape"
                ],
                "env": {
                    "SEARXNG_URL": "https://searx.be"
                }
            }
        }
    }
}

McpServers

{
    "searxng": {
        "command": "npx",
        "args": [
            "-y",
            "mcp-searxng-scrape"
        ],
        "env": {
            "SEARXNG_URL": "https://searx.be"
        }
    }
}

MCP SearXNG Search

An MCP server for privacy-focused web search and article scraping using SearXNG instances.

Tools

- searxng_search

- Execute web searches with titles, URLs, and snippets
- Inputs:
- query (string): Search terms
- searxng_url (string, optional): SearXNG instance URL

- scrape_article

- Extract clean article content from any webpage
- Inputs:
- url (string): URL to scrape

- search
- Search and automatically scrape top 5 results
- Inputs:
- query (string): Search terms
- searxng_url (string, optional): SearXNG instance URL

Configuration

NPX

{
  "mcpServers": {
    "searxng": {
      "command": "npx",
      "args": ["-y", "mcp-searxng-scrape"],
      "env": {
        "SEARXNG_URL": "https://searx.be"
      }
    }
  }
}

Local Development

{
  "mcpServers": {
    "searxng": {
      "command": "node",
      "args": ["dist/index.js"],
      "cwd": "/path/to/mcp-searxng",
      "env": {
        "SEARXNG_URL": "https://searx.be"
      }
    }
  }
}

Popular SearXNG Instances

- https://searx.be
- https://search.sapti.me
- https://searx.tiekoetter.com
- https://searx.work

Build

npm install
npm run build

SearXNG Setup

For more details on SearXNG setup and customization, refer to the official SearXNG documentation:

🔗 SearXNG Installation Guide

License

MIT

No reviews yet — be the first

Sign in to leave a review

Use Google, GitHub, or an email account so ratings stay tied to real people.

Email sign in

No reviews posted yet.