Socialcrawl MCP
About
Single API key to access 21 + real time social media data
Details
- Author
- socialcrawl
- Categories
- Web Scraping, Other
Jump to
Setup
Install Socialcrawl MCP in your MCP client (Claude Desktop, Cursor, Windsurf, and others).
Repository: https://github.com/socialcrawl/mcp
Follow the installation instructions in the repository README, then restart your MCP client.
Single API key to access 21 + real time social media data
Give your AI agent access to 48 platforms and 381 endpoints — social media, commerce & product reviews, retail, app stores, places & travel, business reputation, news & finance, web research, full web scraping & browser automation, prediction markets, search trends, cross-platform Prism composites, and a universal meta-search — through a single API, with exact credit pricing for every endpoint
Overview|Installation|Setup|Usage|Tools|Platforms
socialcrawl-mcpis anMCP (Model Context Protocol)server that connects AI agents to theSocialCrawl API— a unified data API covering 48 platforms and 381 endpoints.
Retrieve profiles, posts, comments, search results, trending content, and analytics from TikTok, Instagram, YouTube, Twitter/X, LinkedIn, Reddit, GitHub, Hacker News, Polymarket, and 30 more platforms. Pull products, reviews, and sellers from Amazon, Walmart, Target, Home Depot, eBay, and Google Shopping; apps, charts, and reviews from Google Play and the Apple App Store; places, hotels, and traveler reviews from Tripadvisor and Google Business; brand reputation from Trustpilot; Korean search and Data Lab trend series from Naver; cross-web brand mentions with sentiment via Content Analysis; Google News headlines, Google Finance quotes, and Google Trends interest curves — plus web research via Tavily and Perplexity, AI-powered X search via Grok, and a single/search/everywhereendpoint that fans out across 14 sources in one call.
New in this release (v1.9.0): a dedicatedsocialcrawl_pricingtool that answers"what will this cost me"for every endpoint before a single credit is spent — the tier ladder, every flat override, all 26meteredendpoints with their real min–max band and exact charging rule, per-platform cost tables, and budget-filtered rankings. Five new retail and discovery platforms (Walmart,Target,Home Depot,eBay, plus four free API self-discovery endpoints),Naver Data Labsearch-trend and shopping-insight series, a metered multi-countrynewssearch lane, and Reddit post detail, Threads post comments, TikTok on-screen text, and the Facebook full reels feed. Alongside thePrismfamily — server-side composite endpoints that fan out across many platforms and fold the results into one report. One API key, one consistent response format, every platform.
- Discovers platforms and endpoints dynamically, or by free-text search across all 381 of them
- Fetches live data on your behalf across every platform, method, and composite
- Prices every call up front — ladder, flat, or metered band — so an agent can budget before it spends
- Validates requests locally before calling the API: required params,oneOfgroups, enum values, integer ranges, parameter couplings, and CSV limits. A bad call fails free instead of burning credits
- Provides built-in API documentation the agent can query on demand, paged rather than truncated
Connect straight to the hosted Streamable HTTP endpoint — nothing to install or run:
Claude Code(works in the CLIandClaude Code on the web / cloud sandboxes)
claude mcp add --scope user --transport http socialcrawl https://mcp.socialcrawl.dev/mcp \ --header "Authorization: Bearer sc_your_key_here"
{ "mcpServers": { "socialcrawl": { "type": "http", "url": "https://mcp.socialcrawl.dev/mcp", "headers": { "Authorization": "Bearer ${SOCIALCRAWL_API_KEY}" } } } }
Cursor / Windsurf / VS Code— choose the HTTP ("streamable-http") server type with the same URL and header.x-api-key: sc_your_key_hereworks as an alternative header.
The discovery tools (socialcrawl_list_platforms,socialcrawl_list_endpoints,socialcrawl_get_docs) work without a key, so you can explore before signing up. claude.ai custom connectors (Settings → Connectors) require OAuth, which ships in a follow-up release — use the header-based setup above in the meantime.
Prefer running it locally? Every stdio option below works exactly as before.
Available onnpm. Most users don't need this — the MCP client configs below usenpxand auto-install on first run.
claude mcp add --scope user socialcrawl -- npx -y socialcrawl-mcp
claude mcp add-env socialcrawl SOCIALCRAWL_API_KEY sc_your_key_here
Add to~/Library/Application Support/Claude/claude_desktop_config.json(macOS) or%APPDATA%\Claude\claude_desktop_config.json(Windows):
{ "mcpServers": { "socialcrawl": { "command": "npx", "args": ["-y", "socialcrawl-mcp"], "env": { "SOCIALCRAWL_API_KEY": "sc_your_key_here" } } } }
Add to.cursor/mcp.jsonin your project root or~/.cursor/mcp.jsonglobally:
{ "mcpServers": { "socialcrawl": { "command": "npx", "args": ["-y", "socialcrawl-mcp"], "env": { "SOCIALCRAWL_API_KEY": "sc_your_key_here" } } } }
Add to.vscode/mcp.jsonin your project or your user settings:
{ "servers": { "socialcrawl": { "type": "stdio", "command": "npx", "args": ["-y", "socialcrawl-mcp"], "env": { "SOCIALCRAWL_API_KEY": "sc_your_key_here" } } } }
{ "mcpServers": { "socialcrawl": { "command": "npx", "args": ["-y", "socialcrawl-mcp"], "env": { "SOCIALCRAWL_API_KEY": "sc_your_key_here" } } } }
Any MCP client that supports stdio transport can use this server. The general pattern is:
- Command:npx
- Args:["-y", "socialcrawl-mcp"]
- Environment:SOCIALCRAWL_API_KEYset to your API key
Restart your AI client after saving the configuration.
Replacesc_your_key_herein the installation config above with your actual API key (starts withsc_).
[!TIP] You can also setSOCIALCRAWL_API_KEYas a system environment variable instead of putting it in the MCP config. The discovery and documentation tools work even without a key — only actual API requests need one.
Ask your AI agent in natural language. The MCP server handles the rest.
Get the TikTok profile for @charlidamelio
The agent callssocialcrawl_requestwithplatform: "tiktok",resource: "profile",params: { handle: "charlidamelio" }and returns structured profile data including followers, bio, verification status, and engagement metrics.
Search YouTube for "machine learning tutorials"
Get the comments on this Instagram post: https://instagram.com/p/CwA1234abcd
Compare the follower counts of @mkbhd on TikTok, Instagram, YouTube, and Twitter
The agent makes 4 sequential API calls — one per platform — and compiles the results into a comparison.
Find the cheapest 65-inch OLED TV across Amazon, Walmart, Target, and eBay
What social media platforms can you access?
Which endpoints can give me video transcripts?
The last one is a cross-platformsocialcrawl_list_endpointssearch — no platform needed, it looks across all 381 endpoints.
Show me exactly how to call the Prism comments endpoint
Is this MCP server's endpoint list up to date?
All three hitsocialcrawl_discoverand cost nothing.
Check what something costs before running it
What would it cost to run a Prism brand-mentions report?
Show me everything I can call for 1 credit
Why did that last call charge me 7 credits instead of 2?
The first two hitsocialcrawl_pricing; the third reads the credit ledger viasocialcrawl_check_balancewithview: "transactions"and shows the deduction and refund rows for thatrequest_id.
How does the SocialCrawl credit system work?
Every response follows a unified envelope format:
{ "success": true, "platform": "tiktok", "endpoint": "/v1/tiktok/profile", "data": { "content": { "text": "...", "media_urls": ["..."] }, "author": { "username": "charlidamelio", "followers": 156000000 }, "engagement": { "likes": 5200, "engagement_rate": 0.045 }, "metadata": { "language": "en", "content_category": "entertainment" } }, "credits_used": 1, "credits_remaining": 99 }
[!NOTE] The same response structure is returned for every platform — no per-platform parsing logic needed.
Four of the nine tools work without an API key — they query local bundled data generated from the backend registry.socialcrawl_request,socialcrawl_check_balance,socialcrawl_monitors, andsocialcrawl_webrequire a key.socialcrawl_discoveruses a key when it has one and falls back to bundled data when it does not.
Discovery — the API describing itself, for free
socialcrawl_discoverdrives the/v1/utility/family: four endpoints that let any client learn the whole API from inside the API, at0 credits. They are served in-process from the endpoint registry — no upstream call, no network hop — so they can never drift from what is actually callable.
Whyfreshnessmatters.This server ships a catalogue generated when it was built; the API keeps moving. Data calls always hit the live API and keep working — but discovery, pricing, and local validation answer from that snapshot, so a newly added endpoint looks unknown until you upgrade. One free call tells you which situation you are in:
socialcrawl_discover action: "freshness"
Bundled vs live.list_platforms,list_endpoints,pricing, andget_docsanswer instantly from bundled data and need no key — prefer them for browsing. Reach forsocialcrawl_discoverwhen correctness matters more than latency: an endpoint looks missing, you need a metered endpoint's exact live price, or you are generating code that must match production today. Without a key it still answers everything exceptllmsfrom bundled data, so discovery never hard-requires auth.
These same endpoints are plain HTTP, so a third-party integration or a non-MCP agent framework gets the identical information with acurl.
Pricing — know the cost before you spend
socialcrawl_pricingexists because a single number is a lie for most of the surface. SocialCrawl bills three ways:
- Ladder(294 endpoints) — the tier rate per request: standard 1cr, advanced 5cr, premium 10cr.
- Flat(61 endpoints, 18 of them free) — a per-endpoint override, e.g./v1/search/everywhereat 20cr flat.
- Metered(26 endpoints) — the charge depends on the request. An upfront ceiling is deducted and refunded down to the work actually done.
Quoting a metered endpoint's base cost understates every call:/v1/search/newshas a 1cr base but really charges2–14crdepending on how many country legs return articles. The tool returns the real band, the registry's own charging rule, the parameters that move the bill, and the worst case to budget for:
action: "overview" → ladder, every free endpoint, every flat override, every metered band + rule, cache TTLs, full refund matrix action: "endpoint" → one endpoint's price, rule, price-driving params, paging cost, worst case action: "platform" → a whole platform's cost table action: "list" → rank/filter by cost — "everything I can call for 1 credit", "the 10 most expensive endpoints"
It also states the rules that make the real charge differ from the sticker price: cache hits, idempotent replays, empty results, and upstream failures are all 0 credits.
socialcrawl_monitorswraps any registry endpoint or Prism composite in a scheduled, stateful monitor (/v1/monitors/). It re-runs the recipe hourly/daily/weekly (or on a cron), delivers each result to an HMAC-signed webhook, raises alerts on metric thresholds or changes, and keeps a per-run time-series you can read back."Prism answers once; monitors watch it for you."Managing monitors costs 0 credits; each scheduled run bills the recipe's normal cost plus a 1-credit scheduling premium. Seesocialcrawl_get_docstopicmonitorsfor the full contract.
socialcrawl_webdrives the full web-scraping and browser-automation surface (thewebplatform,/v1/web/*) through a singleactionparameter:
- Sync reads—scrape(URL → markdown/HTML/screenshot/links),search(web search with page content),map(discover a site's URLs),extract(LLM structured data from a page).
- Async jobs—crawla whole site,batch_scrapemany URLs, oragent(autonomous multi-step web task); each returns a job you poll withjob_get/job_list, inspect withjob_errors(per-page failures), and stop withjob_cancel.crawl_previewdry-runs a crawl's parameters for free before you pay for it.
- Monitors—monitor_create/list/get/update/delete/checksre-check a URL on a cadence and deliver changes to a webhook.
- Sessions—session_create/get/list,session_execute(run code in the live page),session_close.
Most of the paid web surface is metered rather than flat: a crawl holdslimitcredits and refunds every page it did not crawl; a session holds againstttl_secondsand settles on close. Job, monitor, and session management is 0 credits. Seesocialcrawl_get_docstopicweb, orsocialcrawl_pricingwithplatform: "web".
Before making any API call,socialcrawl_requestmirrors the backend's own pre-billing validator against the bundled registry data: the platform and resource exist, required parameters andoneOfgroups are satisfied, enum values are legal, integers sit inside their declared range, parameter couplings hold (orderneedssort; Reddit'stimeframeneedssort=top), and CSV lists are within their entry limits. A malformed call fails instantly and for free instead of costing a round trip — and an agent gets told exactly what to fix rather than looping on a call that can never succeed.
Pass anidempotencyKeytosocialcrawl_request(UUIDv4 recommended) to make the call retry-safe. If the request is replayed within 24h, the server returns the original response and deducts0 credits(X-Idempotent-Replay: true).
Total: 381 endpoints across 48 platforms.
The MCP server handles errors gracefully and gives the agent actionable guidance:
- Get Your API Key— 100 free credits, no credit card required
- API Documentation— full endpoint reference, credits, and error codes
- SocialCrawl Website
- npm Package
- MCP Registry
- Getting Started Guide
- How It Works
Check availability of domain names, social media handles and subreddits
Monitor web and social media using the Mention API.
The unified API for social media data - built for developers and AI agents.
Transforms any blog/article URL into ready-to-post social media content for Twitter/X, LinkedIn, Instagram, Facebook, and email. Hosted on Apify, zero setup, pay-per-event ($0.07).
Sign in to leave a review
Use Google, GitHub, or an email account so ratings stay tied to real people.
No reviews posted yet.




