Website to Markdown MCP Server

Fetches and converts website content to Markdown with AI-powered cleanup, OpenAPI support, and stealth browsing.

A powerful Model Context Protocol (MCP) server designed for fetching website content and converting it to Markdown format, making it easier for AI to understand and process website information.

🎯 Method 1: NPX Installation (🌟 Recommended)

💡Easiest way: No local installation needed!

{ "websites": [ { "name": "your_website", "url": "https://your-website.com", "description": "Your Project Website" }, { "name": "api_docs", "url": "https://api.example.com/openapi.json", "description": "Your API Specification" } ] }

{ "mcpServers": { "website-to-markdown": { "command": "npx", "args": ["-y", "website-to-markdown-mcp"], "disabled": false, "env": { "WEBSITES_CONFIG_PATH": "./my-websites.json" } } } }

- Restart Cursor
- Open Chat and use Agent mode
- Test command:Please list all configured websites

💡Best Practice: Use this method for development or customization!

git clone https://github.com/your-username/website-to-markdown-mcp.git cd website-to-markdown-mcp npm install npm run build

{ "mcpServers": { "website-to-markdown": { "command": "cmd", "args": ["/c", "node", "./website-to-markdown-mcp/dist/index.js"], "disabled": false, "env": { "WEBSITES_CONFIG_PATH": "./my-websites.json" } } } }

- 📝 Content Summary: AI-generated summary of the main content
- ⏱️ Reading Time: Estimated reading time based on content length
- 🔢 Word Count: Accurate word count for both English and Chinese
- 🌍 Language Detection: Automatic language identification
- 🎯 Content Quality Score: Assessment of content relevance

# 🚀 Example Website Source: https://example.com Website: example_site - Example Website 📊 Reading Time: 5 minutes 🔢 Word Count: 1,250 words 🌍 Language: English 📝 Summary: This article discusses the latest developments in web technology... --- [Enhanced Markdown content with better formatting...]

{ "websites": [ { "name": "petstore_openapi", "url": "https://petstore3.swagger.io/api/v3/openapi.json", "description": "🐕 Swagger Petstore OpenAPI 3.0 Spec (Demo)" }, { "name": "petstore_swagger", "url": "https://petstore.swagger.io/v2/swagger.json", "description": "🐱 Swagger Petstore Swagger 2.0 Spec (Demo)" }, { "name": "github_api", "url": "https://raw.githubusercontent.com/github/rest-api-description/main/descriptions/api.github.com/api.github.com.json", "description": "🐙 GitHub REST API OpenAPI Spec" } ] }

- Node.js20.18.1+ (Recommended: v22.15.0 LTS)
- npm10.0.0+ oryarn
- CursorEditor

⚠️Important: Some dependencies require Node.js v20.18.1 or higher. Please update your Node.js version if you encounter engine compatibility warnings.

# Global installation npm install -g website-to-markdown-mcp # Or use directly with npx (recommended) npx website-to-markdown-mcp

# 1. Clone repository git clone https://github.com/your-username/website-to-markdown-mcp.git cd website-to-markdown-mcp # 2. Install dependencies npm install # 3. Build project npm run build

graph TD A[🔍 Check Environment Variable<br/>WEBSITES_CONFIG_PATH] --> B{File exists?} B -->|Yes| C[✅ Load External Config File] B -->|No| D[🔍 Check Environment Variable<br/>WEBSITES_CONFIG] D --> E{Valid JSON?} E -->|Yes| F[✅ Load Embedded Config] E -->|No| G[🔍 Check config.json] G --> H{File exists?} H -->|Yes| I[✅ Load Local Config] H -->|No| J[🔧 Use Default Config]

📋 Method 1: External Configuration File (🌟 Recommended)

💡Advantages: Easy to edit, syntax highlighting, version control friendly

# Can be placed anywhere touch my-api-configs.json

{ "websites": [ { "name": "my_docs", "url": "https://docs.example.com", "description": "📚 My Documentation Website" } ] }

{ "env": { "WEBSITES_CONFIG_PATH": "./my-api-configs.json" } }

📋 Method 2: Embedded JSON (Backward Compatible)

{ "mcpServers": { "website-to-markdown": { "command": "cmd", "args": ["/c", "node", "./website-to-markdown-mcp/dist/index.js"], "disabled": false, "env": { "WEBSITES_CONFIG": "{\"websites\":[{\"name\":\"example\",\"url\":\"https://example.com\",\"description\":\"Example Website\"}]}" } } } }

Directly editconfig.jsonin the project root directory:

{ "websites": [ { "name": "local_site", "url": "https://local.example.com", "description": "🏠 Local Test Website" } ] }

Each configured website automatically generates corresponding dedicated tools:

- fetch_petstore_openapi- Fetch Petstore OpenAPI 3.0 spec
- fetch_petstore_swagger- Fetch Petstore Swagger 2.0 spec
- fetch_github_api- Fetch GitHub API spec
- fetch_tailwind_css- Fetch Tailwind CSS documentation

🌐 General Website Content with Analytics

# Website Title Source: https://example.com Website: example_site - Example Website 📊 Reading Time: 3 minutes 🔢 Word Count: 650 words 🌍 Language: English 📝 Summary: This article provides a comprehensive overview of modern web development practices, covering frontend frameworks, backend technologies, and deployment strategies. --- [Enhanced cleaned Markdown content with ads removed and main content extracted...]

# 🚀 Example API (v2.1.0) Source: https://api.example.com/openapi.json OpenAPI Version: 3.0.3 Validation Status: ✅ Valid 📊 Processing Time: 1.2 seconds 🔢 Endpoints: 25 endpoints 🌍 Server Locations: 3 servers --- ## 📋 API Basic Information - API Name: Example API - Version: 2.1.0 - OpenAPI Version: 3.0.3 - Description: A powerful example API for modern applications ## 🌐 Servers 1. https://api.example.com - 🏢 Production server 2. https://staging-api.example.com - 🧪 Testing server ## 🛠️ API Endpoints Total of 25 endpoints: ### 👥 /users - GET: Get user list - POST: Create new user ### 🔍 /users/{id} - GET: Get specific user - PUT: Update user information - DELETE: Delete user ## 🧩 Components - Schemas: 12 data models - Parameters: 8 reusable parameters - Responses: 15 reusable responses - Security Schemes: 3 security mechanisms

Please fetch the content from https://docs.example.com and convert to markdown

Please use the fetch_petstore_openapi tool to fetch Petstore OpenAPI specification

Please fetch React official documentation content

📋Complete Troubleshooting Guide: SeeTROUBLESHOOTING.mdfor detailed solutions to common issues.

- Solution: Update Node.js to v20.18.1 or higher
- Download:Node.js Official Website
- Verify:node --version

- 🛠️ UseJSON Validator
- 🛠️ Confirm using double quotes
- 🛠️ Check for extra commas

# View debug messages npm run dev 2> debug.log

Report issues on theIssuespage, please include:

This project is licensed under the MIT License - see theLICENSEfile for details.

Real-time web data, structured for agents