CrawlGraph
About
Backlink lookups and competitor gap analysis on Common Crawl's open web graph (4.4B links)
Details
- Transport
- SSE
Explore
Setup
Install CrawlGraph in your MCP client (Claude Desktop, Cursor, Windsurf, and others).
Repository: https://github.com/pucilpet/crawlgraph-mcp
Follow the installation instructions in the repository README, then restart your MCP client.
backlinks
Look up referring domains (backlinks) for a single target domain from the Common Crawl webgraph. Returns each linking domain with host count and CrawlGraph authority score, plus the target's own authority/rank. Costs one backlinks call against the monthly quota (1,000/mo on lifetime).
gap_analysis
Run a competitor backlink gap analysis: find domains that link to one or more of your competitors but NOT to you. Submits an async job and polls until done (usually 5-30s). Returns every gap with `found_on` listing which competitors each domain links to. Costs one gap job against the monthly quota (50/mo on lifetime).
gap_outreach_targets
The warm-outreach play. Runs a gap analysis, then ranks results: PRIORITY = domains linking to ALL your competitors but not you (publishers who cover your whole space and have never heard of you), SECONDARY = domains linking to 2+ competitors. Platform/CDN noise is filtered, top N priority targets are scored by authority. Use 2-3 competitors. Costs one gap job + one backlinks call per enriched target.
releases
List the Common Crawl releases the API can query. Does not count against any quota. Use a release `id` with the backlinks tool to query a specific snapshot.
MCP server for theCrawlGraphbacklink-intelligence API. Gives any MCP client — Claude Desktop, Claude Code, Cursor, Cline, Zed, Windsurf — backlink lookups and competitor gap analysis built on the publicCommon Crawlwebgraph (4.4B edges, 120M domains).
Backlink data without the $129/month subscription. CrawlGraph is $99 lifetime; API access is included on the lifetime tier.
- backlinks— every referring domain for a target, with authority scores
- gap_analysis— domains linking to your competitors but not to you
- gap_outreach_targets— the warm-outreach play: the domains that link toallof your competitors but not to you, ranked and de-noised. These are publishers who cover your whole space and have simply never heard of you — the warmest backlink targets you will ever pitch.
- releases— list the Common Crawl snapshots you can query
You need a CrawlGraph API key (cg_live_...).Free tier: 15 backlink calls/month, no card- get a key emailed to you atcrawlgraph.com/docs/api. Thegap_analysisandgap_outreach_targetstools need the$99 lifetime tier(1,000 calls + 50 gap analyses/month, no subscription).
Add to your MCP config (claude_desktop_config.json, or.mcp.jsonfor Claude Code):
{ "mcpServers": { "crawlgraph": { "command": "npx", "args": ["-y", "crawlgraph-mcp"], "env": { "CRAWLGRAPH_API_KEY": "cg_live_your_key_here" } } } }
Same shape — point the client's MCP config atnpx -y crawlgraph-mcpwithCRAWLGRAPH_API_KEYin the env. Restart the client and the four tools appear.
Once it's connected, you don't call the tools by hand — you describe the goal:
"Use gap_outreach_targets for mydomain.com against competitor-a.com and competitor-b.com, then draft a short, specific outreach email to each priority target."
Behind the scenes the server submits the gap job, polls until it completes, filters the results down to the domains that link toeverycompetitor but not to you, strips out platform/CDN noise (amazonaws, github, facebook, ...), and hands your agent a clean ranked list to write outreach against.
Why 2-3 competitors, not one:a site linking to one competitor might be a fluke or a paid placement. A site linking to three of your competitors is a publisher who covers your whole category. That overlap is the qualifier.
Lifetime quota: 1,000 backlinks calls + 50 gap jobs per calendar month. Full API reference:crawlgraph.com/docs/api.
CrawlGraph is aquarterlyCommon Crawl snapshot, not a live crawler. It's built for one-off competitor prospecting, not live backlink monitoring — for change-tracking within days, a continuous-crawl tool like Ahrefs is the right choice. The gap result carries which competitors each domain links to (found_on) but not per-domain authority; use thebacklinkstool if you need to score an individual target.
npm install npm run build CRAWLGRAPH_API_KEY=cg_live_... npm start
Free MCP that drives an audit of your marketing. Your AI connects, adsOS digs through your ads, email and site, and hands back a growth plan you can run today.
Launch & manage your User Referral and Partner / Affiliate program — for developers and growth teams.
Let AI clients add payments to your website. Create checkout pages, events and forms and embed them on your site in minutes.
Answers questions on AEO, SEO, web development and branding from the published material of GOJI, a Melbourne digital agency, with a goji.agency URL to cite on every result.
A shared campaign canvas for you and your AI agent: briefed by your brand rules, gated by your approval.
Technical SEO audits and crawl insights for AI assistants via MCP.
Run your Linkedin account from claude or chatgpt
AI agents that manage paid ads across Meta, LinkedIn, and Google Ads: campaigns, ad creative, and day-to-day ad operations from any MCP client.
Chat with any brand's Meta (Facebook/Instagram) ads inside Claude — research a competitor's ad library, surface their longest-running winners, extract hooks/formats, and clone winning ads for your own brand.
Sign in to leave a review
Use Google, GitHub, or an email account so ratings stay tied to real people.
No reviews posted yet.
