Spider Cloud MCP

by spider-rs

Not rated
GitHub

About

Spider MCP server: crawl, scrape, search, and automate browsers at scale

Details

Author
spider-rs
Categories
Web Scraping, Search, Knowledge Base

Setup

Install Spider Cloud MCP in your MCP client (Claude Desktop, Cursor, Windsurf, and others).

Repository: https://github.com/spider-rs/spider-cloud-mcp-v2

Follow the installation instructions in the repository README, then restart your MCP client.

Spider MCP server: crawl, scrape, search, and automate browsers at scale

The fastest web crawling, scraping, and browser automation server for AI agents. Gives Claude direct access to the web through 22 tools — crawl sites at 100K+ pages/sec, extract structured data with AI, and control remote browsers with built-in anti-bot bypass.

- Speed— Crawl 100K+ pages per second. Smart request routing picks HTTP or headless Chrome automatically. Streaming responses start delivering data immediately.
- Cost— Pay-per-use credits with no subscription required for core tools. Check your balance anytime withspider_get_credits. AI tools available with anAI subscription.
- Reliability— Anti-bot bypass with fingerprinting and proxy rotation. Browser fleet with automatic fallback across Chrome, Firefox, and more. Built-in retry and stealth escalation.

claude mcp add spider -- npx -y spider-cloud-mcp
export SPIDER_API_KEY="your-api-key"
{ "mcpServers": { "spider": { "command": "npx", "args": ["-y", "spider-cloud-mcp"], "env": { "SPIDER_API_KEY": "your-api-key" } } } }
{ "mcpServers": { "spider": { "command": "npx", "args": ["-y", "spider-cloud-mcp"], "env": { "SPIDER_API_KEY": "your-api-key" } } } }

Add to~/.codeium/windsurf/mcp_config.json:

{ "mcpServers": { "spider": { "command": "npx", "args": ["-y", "spider-cloud-mcp"], "env": { "SPIDER_API_KEY": "your-api-key" } } } }

These work on pay-per-use credits with no subscription required.

Natural language web interaction. Describe what you want in plain English.

Direct browser control via spider-browser. Browsers run in Spider's cloud with smart retry, browser switching, anti-bot protection, proxy rotation, and automatic stealth escalation. Supports CDP and BiDi protocols.

Browser sessions auto-close after 5 minutes of inactivity. Always callspider_browser_closewhen done.

"Crawl the React documentation and summarize the hooks API"

Usesspider_crawlto fetch 50+ pages in seconds and return clean markdown ready for context.

spider_crawl: { url: "https://react.dev/reference/react", limit: 50, return_format: "markdown", filter_output_main_only: true }

"Get all product names and prices from this e-commerce page"

Usesspider_ai_scrapeto extract structured JSON with zero CSS selectors.

spider_ai_scrape: { url: "https://example-store.com/products", prompt: "Extract every product name, price, and availability status as JSON" }

"Log into the dashboard, go to reports, and screenshot the monthly summary"

Usesspider_browser_*tools to drive a remote browser with full anti-bot protection.

1. spider_browser_open: { browser: "auto" } 2. spider_browser_navigate: { url: "https://app.example.com/login" } 3. spider_browser_fill: { selector: "input[name='email']", value: "user@example.com" } 4. spider_browser_fill: { selector: "input[name='password']", value: "..." } 5. spider_browser_click: { selector: "button[type='submit']" } 6. spider_browser_wait_for: { navigation: true } 7. spider_browser_navigate: { url: "https://app.example.com/reports/monthly" } 8. spider_browser_screenshot: {} 9. spider_browser_close: {}

"Search for recent AI startup funding rounds and get the details"

Usesspider_searchwith time filtering, thenspider_scrapefor details.

spider_search: { search: "AI startup Series A funding 2025", num: 10, fetch_page_content: true, return_format: "markdown", tbs: "qdr:m" }

All tools map directly to theSpider API. Core tools accept the same parameters as their API counterparts:

- Crawl/Scrape:url,return_format,request,readability,root_selector,proxy_enabled,cache, andmany more
- Search:search,num,fetch_page_content,country,language,tbs
- AI tools: Add apromptparameter describing what you want in natural language
- Browser tools: Usesession_idfromspider_browser_openfor all operations

Full parameter reference:spider.cloud/docs/api

- Website
-
Documentation
-
API Reference
-
Get API Key
-
Credit Pricing
-
AI Subscription
-
Discord
-
Support

Official OpenWeb Ninja MCP server connecting any AI agent to 40+ web data APIs for web search, e-commerce, local business, jobs, real estate, and finance data.

Search and retrieve rental property details from Daft.ie via web scraping.

Crawl websites to generate Markdown documentation and make it searchable through an MCP server.

Extracts document content from Microsoft Learn and GitHub URLs and stores it in PocketBase for retrieval and search.

An MCP server that routes search queries through public SearXNG instances. Instead of paying per query to SerpAPI, Exa, or Brave Search, this server fans out to multiple public SearXNG instances simultaneously, merges the results, and returns the best ones.

Give your AI agent live Google Maps search, review, and photo data through one secure MCP connection.

AI Influencer Search, Creator Data, & Live Scraping

Real-time web access for AI agents — fetch any URL, search Google, and query AI chatbots with JS rendering, captcha solving, and 195+ country geo-targeting.

Discovers and collects MCP servers from the internet.

MCP Server for Stealth Web Search and Fetching

Fault-tolerant MCP Server for Stealth Web Search and Fetching

No reviews yet — be the first

Sign in to leave a review

Use Google, GitHub, or an email account so ratings stay tied to real people.

Email sign in

No reviews posted yet.