Spider Cloud MCP
About
Spider MCP server: crawl, scrape, search, and automate browsers at scale
Details
- Author
- spider-rs
- Categories
- Web Scraping, Search, Knowledge Base
Jump to
Setup
Install Spider Cloud MCP in your MCP client (Claude Desktop, Cursor, Windsurf, and others).
Repository: https://github.com/spider-rs/spider-cloud-mcp-v2
Follow the installation instructions in the repository README, then restart your MCP client.
Spider MCP server: crawl, scrape, search, and automate browsers at scale
The fastest web crawling, scraping, and browser automation server for AI agents. Gives Claude direct access to the web through 22 tools — crawl sites at 100K+ pages/sec, extract structured data with AI, and control remote browsers with built-in anti-bot bypass.
- Speed— Crawl 100K+ pages per second. Smart request routing picks HTTP or headless Chrome automatically. Streaming responses start delivering data immediately.
- Cost— Pay-per-use credits with no subscription required for core tools. Check your balance anytime withspider_get_credits. AI tools available with anAI subscription.
- Reliability— Anti-bot bypass with fingerprinting and proxy rotation. Browser fleet with automatic fallback across Chrome, Firefox, and more. Built-in retry and stealth escalation.
claude mcp add spider -- npx -y spider-cloud-mcp
export SPIDER_API_KEY="your-api-key"
{ "mcpServers": { "spider": { "command": "npx", "args": ["-y", "spider-cloud-mcp"], "env": { "SPIDER_API_KEY": "your-api-key" } } } }
{ "mcpServers": { "spider": { "command": "npx", "args": ["-y", "spider-cloud-mcp"], "env": { "SPIDER_API_KEY": "your-api-key" } } } }
Add to~/.codeium/windsurf/mcp_config.json:
{ "mcpServers": { "spider": { "command": "npx", "args": ["-y", "spider-cloud-mcp"], "env": { "SPIDER_API_KEY": "your-api-key" } } } }
These work on pay-per-use credits with no subscription required.
Natural language web interaction. Describe what you want in plain English.
Direct browser control via spider-browser. Browsers run in Spider's cloud with smart retry, browser switching, anti-bot protection, proxy rotation, and automatic stealth escalation. Supports CDP and BiDi protocols.
Browser sessions auto-close after 5 minutes of inactivity. Always callspider_browser_closewhen done.
"Crawl the React documentation and summarize the hooks API"
Usesspider_crawlto fetch 50+ pages in seconds and return clean markdown ready for context.
spider_crawl: { url: "https://react.dev/reference/react", limit: 50, return_format: "markdown", filter_output_main_only: true }
"Get all product names and prices from this e-commerce page"
Usesspider_ai_scrapeto extract structured JSON with zero CSS selectors.
spider_ai_scrape: { url: "https://example-store.com/products", prompt: "Extract every product name, price, and availability status as JSON" }
"Log into the dashboard, go to reports, and screenshot the monthly summary"
Usesspider_browser_*tools to drive a remote browser with full anti-bot protection.
1. spider_browser_open: { browser: "auto" } 2. spider_browser_navigate: { url: "https://app.example.com/login" } 3. spider_browser_fill: { selector: "input[name='email']", value: "user@example.com" } 4. spider_browser_fill: { selector: "input[name='password']", value: "..." } 5. spider_browser_click: { selector: "button[type='submit']" } 6. spider_browser_wait_for: { navigation: true } 7. spider_browser_navigate: { url: "https://app.example.com/reports/monthly" } 8. spider_browser_screenshot: {} 9. spider_browser_close: {}
"Search for recent AI startup funding rounds and get the details"
Usesspider_searchwith time filtering, thenspider_scrapefor details.
spider_search: { search: "AI startup Series A funding 2025", num: 10, fetch_page_content: true, return_format: "markdown", tbs: "qdr:m" }
All tools map directly to theSpider API. Core tools accept the same parameters as their API counterparts:
- Crawl/Scrape:url,return_format,request,readability,root_selector,proxy_enabled,cache, andmany more
- Search:search,num,fetch_page_content,country,language,tbs
- AI tools: Add apromptparameter describing what you want in natural language
- Browser tools: Usesession_idfromspider_browser_openfor all operations
Full parameter reference:spider.cloud/docs/api
- Website
- Documentation
- API Reference
- Get API Key
- Credit Pricing
- AI Subscription
- Discord
- Support
Official OpenWeb Ninja MCP server connecting any AI agent to 40+ web data APIs for web search, e-commerce, local business, jobs, real estate, and finance data.
Search and retrieve rental property details from Daft.ie via web scraping.
Crawl websites to generate Markdown documentation and make it searchable through an MCP server.
Extracts document content from Microsoft Learn and GitHub URLs and stores it in PocketBase for retrieval and search.
An MCP server that routes search queries through public SearXNG instances. Instead of paying per query to SerpAPI, Exa, or Brave Search, this server fans out to multiple public SearXNG instances simultaneously, merges the results, and returns the best ones.
Give your AI agent live Google Maps search, review, and photo data through one secure MCP connection.
AI Influencer Search, Creator Data, & Live Scraping
Real-time web access for AI agents — fetch any URL, search Google, and query AI chatbots with JS rendering, captcha solving, and 195+ country geo-targeting.
Discovers and collects MCP servers from the internet.
MCP Server for Stealth Web Search and Fetching
Fault-tolerant MCP Server for Stealth Web Search and Fetching
Sign in to leave a review
Use Google, GitHub, or an email account so ratings stay tied to real people.
No reviews posted yet.



