Scraper.is MCP

by ai-quill

Not rated
GitHub

About

A powerful web scraping tool for AI assistants, powered by the Scraper.is API.

Details

Author
ai-quill
Categories
Web Scraping, API, Other

Setup

Install Scraper.is MCP in your MCP client (Claude Desktop, Cursor, Windsurf, and others).

Repository: https://github.com/ai-quill/scaperis-mcp

Follow the installation instructions in the repository README, then restart your MCP client.

AModel Context Protocol (MCP)integration forScraper.is- A powerful web scraping tool for AI assistants.

This package allows AI assistants to scrape web content through the MCP protocol, enabling them to access up-to-date information from the web.

- 🌐Web Scraping: Extract content from any website
- πŸ“ΈScreenshots: Capture visual representations of web pages
- πŸ“„Multiple Formats: Get content in markdown, HTML, or JSON
- πŸ”„Progress Updates: Real-time progress reporting during scraping operations
- πŸ”ŒMCP Integration: Seamless integration with MCP-compatible AI assistants

To install scaperis-mcp for Claude Desktop automatically viaSmithery:

npx -y @smithery/cli install @Ai-Quill/scaperis-mcp --client claude

You need a Scraper.is API key to use this package.
- Sign up or log in at
scraper.is
- Navigate to the API Keys section in your dashboard:
https://www.scraper.is/dashboard/apikeys
- Create a new API key or copy your existing key
- Store this key securely as you'll need it to use this package

Create a.envfile with your Scraper.is API key:

To use this package with Claude Desktop:

Add the following configuration to yourclaude_desktop_config.jsonfile:

{ "mcpServers": { "scraperis_scraper": { "command": "scraperis-mcp", "args": [], "env": { "SCRAPERIS_API_KEY": "your-api-key-here", "DEBUG": "*" } } } }

Replaceyour-api-key-herewith your actual Scraper.is API key.

Restart Claude Desktop to apply the changes.

For development and testing, you can use the MCP Inspector:

npx @modelcontextprotocol/inspector scraperis-mcp

This package is designed to be used with AI assistants that support the Model Context Protocol (MCP). When properly configured, the AI assistant can use the following tools:

Thescrapetool allows the AI to extract content from websites. It supports various formats:

- markdown: Returns the content in markdown format
- html: Returns the content in HTML format
- screenshot: Returns a screenshot of the webpage
- json: Returns structured data in JSON format

Can you scrape the latest news from techcrunch.com and summarize it for me?

Scrapes content from a webpage based on a prompt.

- prompt(string): The prompt describing what to scrape, including the URL
- format(string): The format to return the content in (markdown,html,screenshot,json,quick)

{ "prompt": "Get me the top 10 products from producthunt.com", "format": "markdown" }
git clone https://github.com/Ai-Quill/scraperis-mcp.git cd scraperis-mcp

- npm run build: Build the project
- npm run watch: Watch for changes and rebuild
- npm run dev: Run with MCP Inspector for development
- npm run test: Run tests
- npm run lint: Run ESLint

Contributions are welcome! Please feel free to submit a Pull Request.

This project is licensed under the MIT License - see the LICENSE file for details.

1GB Free Trial, World's Leading Proxy Service Platform, Efficient Data Collection

Scrape websites with Oxylabs Web API, supporting dynamic rendering and parsing for structured data extraction.

Access Swedish real estate data from Booli.se through a GraphQL API.

A crawler compliance risk assessment system via a simple API.

An MCP server to interact with the genius.com API and collect song information, annotations, artist data, etc.

An MCP server for making HTTP requests, enabling LLMs to fetch and process web content.

KonbiniAPI gives AI agents direct access to social media data β€” profiles, posts, videos, comments, and search results.

Fetches LinkedIn profile information using the Fresh LinkedIn Profile Data API.

One MCP server for 160+ live web-data APIs (search, social, e-commerce, real estate, jobs, finance) β€” clean JSON, free tier.

No reviews yet β€” be the first

Sign in to leave a review

Use Google, GitHub, or an email account so ratings stay tied to real people.

Email sign in

No reviews posted yet.