Web Scraping MCP Servers

600 servers

Google Search

Automates parallel Google searches with intelligent CAPTCHA detection, browser state persistence, and user behavior simulation to bypass anti-bot measures…

AgentQL

Enable AI agents to get structured data from unstructured web with [AgentQL](https://www.agentql.com/).

Crawl4AI MCP Server

用于提供给本地开发者的 LLM的高效互联网搜索&内容获取的MCP Server, 节省你的token

X Twitter Scraper

X (Twitter) data platform skill for AI coding agents. 111 REST API endpoints, 2 MCP tools, 23 extraction types, HMAC webhooks. Read tweets from $0.00015 per…

Web Scout MCP Server

A powerful MCP server extension providing web search and content extraction capabilities. Integrates DuckDuckGo search functionality and URL content extraction…

Oxylabs

Scrape websites with Oxylabs Web API, supporting dynamic rendering and parsing for structured data extraction.

YouTube Downloader

Integrates with YouTube using yt-dlp to enable downloading of videos and subtitles for content analysis and processing tasks.

LinkedIn

Integrates with an unofficial LinkedIn API to retrieve feed posts, search jobs, and analyze job matches against resumes.

Crawlbase MCP

Enables AI agents to access real-time web data with HTML, markdown, and screenshot support. SDKs: Node.js, Python, Java, PHP, .NET.

Chinese Trends Hub

Provides real-time access to trending topics and content from major Chinese platforms including Weibo, Zhihu, Douyin, Bilibili, Douban, Toutiao, and 36kr…

MCP Rquest

A MCP server providing realistic browser-like HTTP request capabilities with accurate TLS/JA3/JA4 fingerprints for bypassing anti-bot measures. It also…

mcp_server_webcrawl

Bridge the gap between your web crawl and AI language models using Model Context Protocol (MCP). With mcp-server-webcrawl, your AI client filters and analyzes…