Web Scraping MCP Servers

Showing 409–432 of 597 servers

Crawl4AI RAG

Integrate web crawling and Retrieval-Augmented Generation (RAG) into AI agents and coding assistants.

anybrowse

Convert any URL to LLM-ready Markdown via real Chrome browsers. 3 tools: scrape, crawl, search. Free via MCP, pay-per-use via x402.

Stepstone

Fetches job listings from Stepstone.de based on keywords and location parameters.

Khiip

Local-first MCP server that captures web URLs (X, Reddit, YouTube, Wikipedia, articles) as typed data + Markdown into a self-hosted capture/store/recall…

Prerender Buddy

MCP tools for crawler-readability and discovery-file diagnostics, including crawler-visible HTML inspection, raw-vs-rendered comparison, and discovery-file…

Playwright Record MCP

Browser automation using Playwright with video recording. Enables LLMs to interact with web pages through structured accessibility snapshots.

Content-to-Social MCP Server

Transforms any blog/article URL into ready-to-post social media content for Twitter/X, LinkedIn, Instagram, Facebook, and email. Hosted on Apify, zero setup…

HTML to Markdown MCP

Fetch web pages and convert HTML to clean, formatted Markdown. Handles large pages with automatic file saving to bypass token limits.

WebWatch MCP

Website change monitoring with URL watching, snapshot comparison, and intelligent content extraction for AI assistants

screener-mcp

Turn Claude into a personal Indian equity analyst powered by live Screener.in data.

xhs-mcp-tool

MCP Server for Xiaohongshu (小红书) — let AI search notes, read content, and publish via browser automation

Google Scholar MCP

An MCP server for searching Google Scholar, built for AI assistants and automation workflows that need papers, authors, citations, and BibTeX entries.

TheCrawler

Web scraper exposing 5 MCP tools — crawl, markdown extraction, search-and-crawl, sitemap parsing, and LLM JSON-schema structured extraction. AGPL-3.0.

Selenix MCP

MCP server that bridges Claude Desktop (or any other local app supporting MCP) with Selenix for browser automation and testing. Enables creating, running…