Skill Seekers

by yusufkaraaslan

370 downloads Not rated yet

GitHub

About

Transform 17 source types (docs, GitHub repos, PDFs, videos, Jupyter, Confluence, Notion, Slack/Discord) into AI-ready skills and RAG knowledge. 35 MCP tools for scraping, packaging, and exporting to vector databases. Supports 16+ LLM platforms.

Explore

skill-seekers enhance output/react/
skill-seekers analyze --directory . --enhance

Note: Setting ANTHROPIC_BASE_URL allows you to use any Claude-compatible API endpoint, such as GLM-4.7 (智谱 AI) or other compatible services. </details>

Installation:

bash

skill-seekers analyze --directory tests/ --quick

skill-seekers analyze --directory tests/ --comprehensive

Skill Seekers supports 4 LLM platforms, 17 source types, and full feature parity across all targets.

Platforms: Claude AI, Google Gemini, OpenAI ChatGPT, Generic Markdown
Source Types: Documentation websites, GitHub repos, PDFs, Word (.docx), EPUB, Video, Local codebases, Jupyter Notebooks, Local HTML, OpenAPI/Swagger, AsciiDoc, PowerPoint (.pptx), RSS/Atom feeds, Man pages, Confluence wikis, Notion pages, Slack/Discord chat exports

See Complete Feature Matrix for detailed platform and feature support.

skill-seekers pdf --pdf docs/manual.pdf --name myskill \
--extract-tables \ # Extract tables
--parallel \ # Fast parallel processing
--workers 8 # Use 8 CPU cores

Setting up with Highlight

This MCP is not yet compatible with Highlight’s one-click setup. However, you can still use it with Highlight by following these steps:

Download and install Highlight from highlightai.com/download
Navigate to the plugins tab and select "Add Custom Plugin"
Configure the plugin with the settings below

Plugin Name Skill Seekers

Command (node, npx, python, etc.)

Please refer to the README for specific instructions on how to obtain API keys or other required environment variables.
Enable "Start Automatically" if you want the plugin to start when Highlight launches

Setting up with Cursor

Open Cursor's settings
Navigate to the MCP section
Click "Add new Global MCP server"
Copy and paste the configuration below based on your operating system

JSON

{
    "mcpServers": {
        "skill seekers": {
            "skill-seekers": {
                "command": "python",
                "args": [
                    "-m",
                    "skill_seekers.mcp.server_fastmcp"
                ]
            }
        }
    }
}

JSON

{
    "mcpServers": {
        "skill seekers": {
            "skill-seekers": {
                "command": "python",
                "args": [
                    "-m",
                    "skill_seekers.mcp.server_fastmcp"
                ]
            }
        }
    }
}

JSON

{
    "mcpServers": {
        "skill seekers": {
            "skill-seekers": {
                "command": "python",
                "args": [
                    "-m",
                    "skill_seekers.mcp.server_fastmcp"
                ]
            }
        }
    }
}

Setting up with Claude Desktop

Open Claude Desktop's settings
Go to the Integrations tab
Click "Add MCP Server"
Use the configuration below based on your operating system

Note: Make sure Claude Desktop is running before attempting to connect.

JSON

{
    "mcpServers": {
        "skill seekers": {
            "skill-seekers": {
                "command": "python",
                "args": [
                    "-m",
                    "skill_seekers.mcp.server_fastmcp"
                ]
            }
        }
    }
}

JSON

{
    "mcpServers": {
        "skill seekers": {
            "skill-seekers": {
                "command": "python",
                "args": [
                    "-m",
                    "skill_seekers.mcp.server_fastmcp"
                ]
            }
        }
    }
}

JSON

{
    "mcpServers": {
        "skill seekers": {
            "skill-seekers": {
                "command": "python",
                "args": [
                    "-m",
                    "skill_seekers.mcp.server_fastmcp"
                ]
            }
        }
    }
}

Setting up with Windsurf

Open Windsurf's preferences
Go to the Integrations section
Click "Add MCP Integration"
Use the configuration below based on your operating system

JSON

{
    "mcpServers": {
        "skill seekers": {
            "skill-seekers": {
                "command": "python",
                "args": [
                    "-m",
                    "skill_seekers.mcp.server_fastmcp"
                ]
            }
        }
    }
}

JSON

{
    "mcpServers": {
        "skill seekers": {
            "skill-seekers": {
                "command": "python",
                "args": [
                    "-m",
                    "skill_seekers.mcp.server_fastmcp"
                ]
            }
        }
    }
}

JSON

{
    "mcpServers": {
        "skill seekers": {
            "skill-seekers": {
                "command": "python",
                "args": [
                    "-m",
                    "skill_seekers.mcp.server_fastmcp"
                ]
            }
        }
    }
}

Setting up with Cline

Open Cline's settings
Navigate to the Integrations section
Click "Add MCP Server"
Copy and paste the configuration below based on your operating system

Note: Make sure to restart Cline after adding the configuration.

JSON

{
    "mcpServers": {
        "skill seekers": {
            "skill-seekers": {
                "command": "python",
                "args": [
                    "-m",
                    "skill_seekers.mcp.server_fastmcp"
                ]
            }
        }
    }
}

JSON

{
    "mcpServers": {
        "skill seekers": {
            "skill-seekers": {
                "command": "python",
                "args": [
                    "-m",
                    "skill_seekers.mcp.server_fastmcp"
                ]
            }
        }
    }
}

JSON

{
    "mcpServers": {
        "skill seekers": {
            "skill-seekers": {
                "command": "python",
                "args": [
                    "-m",
                    "skill_seekers.mcp.server_fastmcp"
                ]
            }
        }
    }
}

Setting up with Goose

Open Goose's preferences
Go to the Integrations tab
Select "MCP Servers"
Click "Add New Server"
Use the configuration below based on your operating system

JSON

{
    "mcpServers": {
        "skill seekers": {
            "skill-seekers": {
                "command": "python",
                "args": [
                    "-m",
                    "skill_seekers.mcp.server_fastmcp"
                ]
            }
        }
    }
}

JSON

{
    "mcpServers": {
        "skill seekers": {
            "skill-seekers": {
                "command": "python",
                "args": [
                    "-m",
                    "skill_seekers.mcp.server_fastmcp"
                ]
            }
        }
    }
}

JSON

{
    "mcpServers": {
        "skill seekers": {
            "skill-seekers": {
                "command": "python",
                "args": [
                    "-m",
                    "skill_seekers.mcp.server_fastmcp"
                ]
            }
        }
    }
}

From the repository

- BULLETPROOF_QUICKSTART.md - 🎯 START HERE if you're new!
- QUICKSTART.md - Quick start for experienced users
- TROUBLESHOOTING.md - Common issues and solutions
- docs/QUICK_REFERENCE.md - One-page cheat sheet

pip install skill-seekers skill-seekers video --setup

skill-seekers enhance output/react/ skill-seekers analyze --directory . --enhance

Note: Setting ANTHROPIC_BASE_URL allows you to use any Claude-compatible API endpoint, such as GLM-4.7 (智谱 AI) or other compatible services.

</details>

Installation:



pip install skill-seekers[gemini]
pip install skill-seekers[openai]
pip install skill-seekers[all-llms]

Integration Hub: All AI System Integrations --- - ✅ Multi-Token Configuration System - Manage multiple GitHub accounts (personal, work, OSS) - Secure config storage at ~/.config/skill-seekers/config.json (600 permissions) - Per-profile rate limit strategies: prompt, wait, switch, fail - Configurable timeout per profile (default: 30 min, prevents indefinite waits) - Smart fallback chain: CLI arg → Env var → Config file → Prompt - API key management for Claude, Gemini, OpenAI - ✅ Interactive Configuration Wizard - Beautiful terminal UI for easy setup - Browser integration for token creation (auto-opens GitHub, etc.) - Token validation and connection testing - Visual status display with color coding - ✅ Intelligent Rate Limit Handler - No more indefinite waits! - Upfront warning about rate limits (60/hour vs 5000/hour) - Real-time detection from GitHub API responses - Live countdown timers with progress - Automatic profile switching when rate limited - Four strategies: prompt (ask), wait (countdown), switch (try another), fail (abort) - ✅ Resume Capability - Continue interrupted jobs - Auto-save progress at configurable intervals (default: 60 sec) - List all resumable jobs with progress details - Auto-cleanup of old jobs (default: 7 days) - ✅ CI/CD Support - Non-interactive mode for automation - --non-interactive flag fails fast without prompts - --profile flag to select specific GitHub account - Clear error messages for pipeline logs

Quick Setup:

bash

skill-seekers config --github

cp -r output/skill-seekers ~/.claude/skills/

What you get: - ✅ Complete skill documentation - All CLI commands and usage patterns - ✅ CLI command reference - Every tool and its options documented - ✅ Quick start examples - Common workflows and best practices - ✅ Auto-generated API docs - Code analysis, patterns, and examples - ✅ Git-Based Config Sources - Fetch configs from private/team git repositories - ✅ Multi-Source Management - Register unlimited GitHub, GitLab, Bitbucket repos - ✅ Team Collaboration - Share custom configs across 3-5 person teams - ✅ Enterprise Support - Scale to 500+ developers with priority-based resolution - ✅ Secure Authentication - Environment variable tokens (GITHUB_TOKEN, GITLAB_TOKEN) - ✅ Intelligent Caching - Clone once, pull updates automatically - ✅ Offline Mode - Work with cached configs when offline skill-seekers analyze --directory tests/ --quick

bash

pip install skill-seekers

| Install | Features |
|---------|----------|
| pip install skill-seekers | Scraping, GitHub analysis, PDF, all platforms |
| pip install skill-seekers[gemini] | + Google Gemini support |
| pip install skill-seekers[openai] | + OpenAI ChatGPT support |
| pip install skill-seekers[all-llms] | + All LLM platforms |
| pip install skill-seekers[mcp] | + MCP server for Claude Code, Cursor, etc. |
| pip install skill-seekers[video] | + YouTube/Vimeo transcript & metadata extraction |
| pip install skill-seekers[video-full] | + Whisper transcription & visual frame extraction |
| pip install skill-seekers[jupyter] | + Jupyter Notebook support |
| pip install skill-seekers[pptx] | + PowerPoint support |
| pip install skill-seekers[confluence] | + Confluence wiki support |
| pip install skill-seekers[notion] | + Notion pages support |
| pip install skill-seekers[rss] | + RSS/Atom feed support |
| pip install skill-seekers[chat] | + Slack/Discord chat export support |
| pip install skill-seekers[asciidoc] | + AsciiDoc document support |
| pip install skill-seekers[all] | Everything enabled |

> Video visual deps (GPU-aware): After installing skill-seekers[video-full], run
> skill-seekers video --setup to auto-detect your GPU and install the correct PyTorch
> variant + easyocr. This is the recommended way to install visual extraction dependencies.

---

The fastest way to go from config to uploaded skill - complete automation:


skill-seekers install --config react
skill-seekers install --config configs/custom.json
skill-seekers install --config django --no-upload
| Feature | Claude | Gemini | OpenAI | Markdown |

|---------|--------|--------|--------|----------|

| Format | ZIP + YAML | tar.gz | ZIP + Vector | ZIP |

| Upload | ✅ API | ✅ API | ✅ API | ❌ Manual |

| Enhancement | ✅ Sonnet 4 | ✅ 2.0 Flash | ✅ GPT-4o | ❌ None |

| All Skill Modes | ✅ | ✅ | ✅ | ✅ |
---
skill-seekers scrape --url https://react.dev --name react
skill-seekers pdf --pdf docs/scanned.pdf --name myskill --ocr

pip install skill-seekers[video] # Transcripts + metadata
pip install skill-seekers[video-full] # + Whisper + visual frame extraction

skill-seekers video --setup

export GITHUB_TOKEN=ghp_your_token_here
skill-seekers github --repo facebook/react

skill-seekers unified --config configs/react_unified.json
skill-seekers unified --config configs/django_unified.json

cat > configs/myframework_unified.json << 'EOF'
{
"name": "myframework",
"merge_mode": "rule-based",
"sources": [
{
"type": "documentation",
"base_url": "https://docs.myframework.com/",
"max_pages": 200
},
{
"type": "github",
"repo": "owner/myframework",
"code_analysis_depth": "surface"
}
]
}
EOF

skill-seekers unified --config configs/myframework_unified.json

Conflict Detection automatically finds: - 🔴 Missing in code (high): Documented but not implemented - 🟡 Missing in docs (medium): Implemented but not documented - ⚠️ Signature mismatch: Different parameters/types - ℹ️ Description mismatch: Different explanations Full Guide: See docs/UNIFIED_SCRAPING.md for complete documentation.

fetch_config(source="team", config_name="internal-api")

Supported Platforms:
- GitHub (GITHUB_TOKEN), GitLab (GITLAB_TOKEN), Gitea (GITEA_TOKEN), Bitbucket (BITBUCKET_TOKEN)

Full Guide: See docs/GIT_CONFIG_SOURCES.md for complete documentation.

Before you start, make sure you have:

1. Python 3.10 or higher - Download | Check: python3 --version
2. Git - Download | Check: git --version
3. 15-30 minutes for first-time setup

First time user? → Start Here: Bulletproof Quick Start Guide 🎯

---

Skill Seekers can automatically install skills to 10+ AI coding agents.

skill-seekers install-agent output/react/ --agent cursor skill-seekers install-agent output/react/ --agent all

skill-seekers install-agent output/react/ --agent cursor --dry-run

./setup_mcp.sh

All 26 tools available: - Core (9): list_configs, generate_config, validate_config, estimate_pages, scrape_docs, package_skill, upload_skill, enhance_skill, install_skill - Extended (10): scrape_github, scrape_pdf, unified_scrape, merge_sources, detect_conflicts, add_config_source, fetch_config, list_config_sources, remove_config_source, split_config - Vector DB (4): export_to_chroma, export_to_weaviate, export_to_faiss, export_to_qdrant - Cloud (3): cloud_upload, cloud_download, cloud_list Full Guide: docs/MCP_SETUP.md ---

bash

{
  "name": "myframework",
  "description": "When to use this skill",
  "base_url": "https://docs.myframework.com/",
  "selectors": {
    "main_content": "article",
    "title": "h1",
    "code_blocks": "pre code"
  },
  "url_patterns": {
    "include": ["/docs", "/guide"],
    "exclude": ["/blog", "/about"]
  },
  "categories": {
    "getting_started": ["intro", "quickstart"],
    "api": ["api", "reference"]
  },
  "rate_limit": 0.5,
  "max_pages": 500
}

The tool searches in this order:
1. Exact path as provided
2. ./configs/ (current directory)
3. ~/.config/skill-seekers/configs/ (user config directory)
4. SkillSeekersWeb.com API (preset configs)

---

skill-seekers config --github
```

---

Skill Seekers ships an MCP server for use from Claude Code, Cursor, Windsurf, VS Code + Cline, or IntelliJ IDEA.

```bash

Claude Desktop / Cursor

Paste into your MCP client config file to install this server.

{
    "mcpServers": {
        "skill seekers": {
            "skill-seekers": {
                "command": "python",
                "args": [
                    "-m",
                    "skill_seekers.mcp.server_fastmcp"
                ]
            }
        }
    }
}

McpServers

{
    "skill-seekers": {
        "command": "python",
        "args": [
            "-m",
            "skill_seekers.mcp.server_fastmcp"
        ]
    }
}

🧠 The data layer for AI systems. Skill Seekers turns documentation sites, GitHub repos, PDFs, videos, notebooks, wikis, and 10+ more source types into structured knowledge assets—ready to power AI Skills (Claude, Gemini, OpenAI), RAG pipelines (LangChain, LlamaIndex, Pinecone), and AI coding assistants (Cursor, Windsurf, Cline) in minutes, not hours.

> 🌐 Visit SkillSeekersWeb.com - Browse 24+ preset configs, share your configs, and access complete documentation!

> 📋 View Development Roadmap & Tasks - 134 tasks across 10 categories, pick any to contribute!

🧠 The Data Layer for AI Systems

Skill Seekers is the universal preprocessing layer that sits between raw documentation and every AI system that consumes it. Whether you are building Claude skills, a LangChain RAG pipeline, or a Cursor .cursorrules file — the data preparation is identical. You do it once, and export to all targets.

```bash

No reviews yet — be the first

Use Google, GitHub, or an email account so ratings stay tied to real people.

Email sign in

No reviews posted yet.

About

Explore

Setting up with Highlight

From the repository

Claude Desktop / Cursor

McpServers

🧠 The Data Layer for AI Systems

More like this

Aws Kb Retrieval Server

Memory

Context 7

1Panel