@rog0x/mcp-web-tools

by rog0x

178 downloads
Not rated
GitHub

About

MCP server for AI agents: web content extraction, DuckDuckGo search, site monitoring, HTML to markdown. No API keys needed. Install: npx @rog0x/mcp-web-tools

Details

Author
rog0x
Downloads
178
Categories
Search

- No API keys required — uses DuckDuckGo for search.
- Fast parallel extraction with 15‑second request timeout.
- Clean output — strips scripts, styles, and ads.
- Lightweight — minimal dependencies, no headless browser.
- Production‑ready error handling and input validation.

Setting up with Highlight

This MCP is not yet compatible with Highlight’s one-click setup. However, you can still use it with Highlight by following these steps:

  1. Download and install Highlight from highlightai.com/download
  2. Navigate to the plugins tab and select "Add Custom Plugin"
  3. Configure the plugin with the settings below
    Plugin Name @rog0x/mcp-web-tools
    Command (node, npx, python, etc.)

    Please refer to the README for specific instructions on how to obtain API keys or other required environment variables.

  4. Enable "Start Automatically" if you want the plugin to start when Highlight launches

From the repository

Install by adding a mcpServers entry to your Claude Code or Claude Desktop config using npx @rog0x/mcp-web-tools, or globally via npm install -g @rog0x/mcp-web-tools and run mcp-web-tools. Invoke the five exposed tools: web_extract, web_search, web_monitor, html_to_markdown, and web_multi_extract.

web_extract

Extract structured content from a URL: title, headings, paragraphs, links, images, and metadata

web_search

Search the web using DuckDuckGo and return structured results with titles, URLs, and snippets

web_monitor

Check if a website is up, measure response time, and get HTTP details

html_to_markdown

Convert HTML content or a URL to clean, readable markdown. Removes scripts, styles, and navigation.

web_multi_extract

Extract content from multiple URLs in parallel. Returns results for each URL.

Claude Desktop / Cursor

Paste into your MCP client config file to install this server.

{
    "mcpServers": {
        "@rog0x/mcp-web-tools": {
            "web-tools": {
                "command": "npx",
                "args": [
                    "@rog0x/mcp-web-tools"
                ]
            }
        }
    }
}

McpServers

{
    "web-tools": {
        "command": "npx",
        "args": [
            "@rog0x/mcp-web-tools"
        ]
    }
}

MCP Web Tools

A powerful MCP (Model Context Protocol) server that gives AI agents web superpowers. Extract content, search the web, monitor sites, and convert HTML to markdown — all through a clean tool interface.

Tools

| Tool | Description |
|------|-------------|
| web_extract | Extract structured content from any URL (title, headings, paragraphs, links, images, metadata) |
| web_search | Search the web via DuckDuckGo — no API key needed |
| web_monitor | Check if a site is up, measure response time, get HTTP headers |
| html_to_markdown | Convert any URL or HTML to clean markdown |
| web_multi_extract | Extract content from multiple URLs in parallel |

Installation

For Claude Code

Add to your Claude Code MCP settings (~/.claude/settings.json):

{
  "mcpServers": {
    "web-tools": {
      "command": "npx",
      "args": ["@rog0x/mcp-web-tools"]
    }
  }
}

For Claude Desktop

Add to claude_desktop_config.json:

{
  "mcpServers": {
    "web-tools": {
      "command": "npx",
      "args": ["@rog0x/mcp-web-tools"]
    }
  }
}

Manual Installation

npm install -g @rog0x/mcp-web-tools
mcp-web-tools

Usage Examples

Extract content from a webpage

Use web_extract to get the main content from https://example.com

Search the web

Use web_search to find "best TypeScript frameworks 2026"

Monitor a website

Use web_monitor to check if https://api.example.com is responding

Convert page to markdown

Use html_to_markdown to convert https://docs.example.com/guide to readable markdown

Batch extraction

Use web_multi_extract to get content from these URLs: [url1, url2, url3]

Features

- No API keys required — uses DuckDuckGo for search, direct HTTP for everything else
- Fast — parallel extraction, 15s timeout per request
- Clean output — strips scripts, styles, ads; extracts meaningful content
- Lightweight — minimal dependencies, no headless browser needed
- Production-ready — proper error handling, timeouts, input validation

Requirements

- Node.js 18+

License

MIT — rog0x

No reviews yet — be the first

Sign in to leave a review

Use Google, GitHub, or an email account so ratings stay tied to real people.

Email sign in

No reviews posted yet.