Read URL MCP

by takada-at

Not rated
GitHub

About

Extracts web content from a URL and converts it to clean Markdown format.

Details

Author
takada-at
Categories
Web Scraping, Other

Setup

Install Read URL MCP in your MCP client (Claude Desktop, Cursor, Windsurf, and others).

Repository: https://github.com/takada-at/read_url_mcp

Follow the installation instructions in the repository README, then restart your MCP client.

A Model Context Protocol (MCP) server that provides URL reading capabilities, extracting web content and converting it to clean Markdown format.

- Fetch web content from HTTP/HTTPS URLs
- Extract main content using readability algorithm
- Convert HTML to clean Markdown format
- Configurable timeout and content size limits

{ "mcpServers": { "read_url_mcp": { "command": "uv", "args": [ "run", "--directory", "<directory>", "read_url_mcp/mcp_server" ], "env": { "PYTHONPATH": "<directory>" } } } }
uv run python read_url_mcp/mcp_server.py

- readURLMarkdown(url: str)- Fetches URL content and returns it as Markdown

uv run ruff check # Lint code uv run ruff format # Format code uv run ruff check --fix # Auto-fix issues

- mcp[cli]- MCP framework
- requests- HTTP client
- readability-lxml- Content extraction
- html2text- HTML to Markdown conversion

- Timeout: 30 seconds
- Max content length: 1MB
- User agent: my-mcp-tools/1.0

Fetches web pages and converts them to clean markdown, focusing on main content extraction.

Fetches web content from a URL and converts it from HTML to markdown for easier consumption by LLMs.

Fetch web pages and convert HTML to clean, formatted Markdown. Handles large pages with automatic file saving to bypass token limits.

Local-first MCP server that captures web URLs (X, Reddit, YouTube, Wikipedia, articles) as typed data + Markdown into a self-hosted capture/store/recall substrate, with offline semantic recall. Six tools over a local khiipd daemon; run khiipd serve first.

Download webpages as markdown files using the r.jina.ai service, with configurable directories and persistent settings.

Fetches content from any URL and converts it to HTML, JSON, Markdown, or plain text.

Extracts and transforms webpage content into clean, LLM-optimized Markdown using Mozilla's Readability algorithm.

Convert any URL to clean, LLM-ready Markdown

Extracts and transforms webpage content into clean, LLM-optimized Markdown using the Readability algorithm.

An MCP server for the Urlbox Screenshot API. It enables your client to take screenshots, generate PDFs, extract HTML/markdown, and more from websites.

No reviews yet — be the first

Sign in to leave a review

Use Google, GitHub, or an email account so ratings stay tied to real people.

Email sign in

No reviews posted yet.