Crawlinx
About
Free technical-SEO audit for AI agents — crawl a site, run 77 checks, get an LLM-ready report with a prioritized fix plan. No signup, no API key.
Details
- Author
- im-ff
- Downloads
- 315
- Categories
- Web Scraping, Other, Search, Marketing, AI
Jump to
- ☁️ Remote server over Streamable HTTP — no local install, no API key, no signup
- 🔗 Public shareable reports — every scan has a URL
- "Audit https://example.com and give me the top 5 SEO fixes."
- "Scan my site, then fix the duplicate <title> issues in the codebase and re-scan to confirm."
- "Which pages are orphaned (no internal links) and how do I link them?"
Setting up with Highlight
This MCP is not yet compatible with Highlight’s one-click setup. However, you can still use it with Highlight by following these steps:
- Download and install Highlight from highlightai.com/download
- Navigate to the plugins tab and select "Add Custom Plugin"
-
Configure the plugin with the settings below
Plugin Name
CrawlinxCommand (node, npx, python, etc.)Please refer to the README for specific instructions on how to obtain API keys or other required environment variables.
- Enable "Start Automatically" if you want the plugin to start when Highlight launches
From the repository
Follow the repository README to install the server and add its MCP configuration to your client.
scan_url
Submit a URL to Crawlinx for an SEO audit. Crawls up to max_pages pages (default 50, max 200), runs the technical-SEO checks, and returns a scan id; poll get_report / get_report_markdown until the crawl finishes.
get_report
PREFERRED for reasoning about what to fix. Fetch a finished report as structured JSON (health score, category subscores, all issues with URLs, stats). Use this when you need to decide which problems matter.
get_report_markdown
Fetch a finished report as compact, agent-ready Markdown: health, a prioritized fix plan with remediation, and issues collapsed to one row per code (code | severity | count | example URLs) — small enough to keep in context on a real site. Set full=true for the complete human report (large). Use get_issue_detail to expand any single code.
get_issue_detail
Drill into one issue code: every affected URL plus step-by-step remediation (what to change, why, and when it's a false alarm). Call this after get_report_markdown to expand a code from the collapsed table before applying fixes.
diff_scan
Diff a scan against the previous scan of the same domain: health movement plus the issue codes that were fixed or newly appeared/regressed. Use this when auditing in a loop to verify fixes landed and nothing regressed.
Claude Desktop / Cursor
Paste into your MCP client config file to install this server.
{
"mcpServers": {
"crawlinx": {
"crawlinx": {
"type": "http",
"url": "https://crawlinx.com/mcp"
}
}
}
}McpServers
{
"crawlinx": {
"type": "http",
"url": "https://crawlinx.com/mcp"
}
}Free technical-SEO audit as an MCP server — built for AI coding agents.
- ☁️Remote server over Streamable HTTP— no local install, no API key, no signup
- 🔎156 checks— titles, meta, canonicals, orphan pages, noindex, internal PageRank, JS render-diff, images, performance, sitemap
- 🤖Agent-native— compact reports, per-issue drill-down, and scan diffs so an agent canscan → fix → verifyin a loop
- 🔗Public shareable reports— every scan has a URL
Homepage:https://crawlinx.com· Docs:https://crawlinx.com/api
The server is remote — you only need the endpointhttps://crawlinx.com/mcp. No key.
claude mcp add --transport http crawlinx https://crawlinx.com/mcp
Cursor / Windsurf / Cline / Claude Desktop
Add to your MCP config (mcp.json/ settings):
{ "mcpServers": { "crawlinx": { "type": "http", "url": "https://crawlinx.com/mcp" } } }
A machine-readable manifest is served at/.well-known/mcp.json.
- "Audithttps://example.comand give me the top 5 SEO fixes."
- "Scan my site, then fix the duplicate<title>issues in the codebase and re-scan to confirm."
- "Which pages are orphaned (no internal links) and how do I link them?"
- scan_url→ get ascan_id
- pollget_report_markdownuntil the crawl finishes
- get_issue_detail(scan_id, code)to expand a specific issue before changing code
- apply fixes
- re-scan, thendiff_scan(scan_id)to verify
Audits run asCrawlinxBot, which honorsrobots.txt, limits request rates, and does not bypass access controls. Seecrawlinx.com/bot. Site owners can opt out via robots.txt or the removal form.
This MCP is aliving product— aggregators (Smithery Quality Score, polygraph.so security grades, MCP Bench) activelyrank and gradeit, and the Official Registry cascades our listing everywhere. Keep the endpoint healthy and re-publish on changes. SeeMAINTENANCE.md.
This repository documents the hosted Crawlinx MCP server. The audit engine is operated as a service atcrawlinx.com; this repo is the public reference and install guide for the MCP integration.
Enable AI agents to get structured data from unstructured web with AgentQL.
1GB Free Trial, World's Leading Proxy Service Platform, Efficient Data Collection
Easy web data access. Simplified retrieval of information from websites and online sources.
Real-time web data, structured for agents
Official OpenWeb Ninja MCP server connecting any AI agent to 40+ web data APIs for web search, e-commerce, local business, jobs, real estate, and finance data.
Scrape websites with Oxylabs Web API, supporting dynamic rendering and parsing for structured data extraction.
Integrate real-time Scrapeless Google SERP(Google Search, Google Flight, Google Map, Google Jobs....) results into your LLM applications. This server enables dynamic context retrieval for AI workflows, chatbots, and research tools.
B2B lead generation MCP server - Apollo, Google Maps, email finder, skip trace, and 15+ more tools.
Turn websites into datasets with Scrapezy
Sign in to leave a review
Use Google, GitHub, or an email account so ratings stay tied to real people.
No reviews posted yet.
