BibiGPT AI video & audio summarizer
About
OpenClaw / Claude Code / Codex Agent skill for summarizing videos/audio via BibiGPT CLI (bibi)
Details
- Author
- JimmyLv
- GitHub stars
- 98
- Downloads
- 1,251
- Categories
- Media
Jump to
- Summarize videos, audio, and podcasts from URLs or local files.
- Chapter-by-chapter summaries, transcript extraction, and article rewriting.
- Batch processing of multiple URLs and cross-source research compilation.
- Export notes to Notion, Obsidian, or local files.
- Visual analysis of video frames and on-screen content.
- Available as CLI, remote MCP server, or OpenAPI.
Setting up with Highlight
This MCP is not yet compatible with Highlight’s one-click setup. However, you can still use it with Highlight by following these steps:
- Download and install Highlight from highlightai.com/download
- Navigate to the plugins tab and select "Add Custom Plugin"
-
Configure the plugin with the settings below
Plugin Name
BibiGPT AI video & audio summarizerCommand (node, npx, python, etc.)Please refer to the README for specific instructions on how to obtain API keys or other required environment variables.
- Enable "Start Automatically" if you want the plugin to start when Highlight launches
From the repository
Three ways: install the bibi CLI and add the skill with npx skills add JimmyLv/bibigpt-skill; use the remote MCP server at https://bibigpt.co/api/mcp with any MCP client; or make direct HTTP calls to the OpenAPI endpoints. After setup, ask your agent to summarize a video/audio URL or a local file.
summarize_video
Summarize an online video or podcast. Supports YouTube, Bilibili, TikTok, Twitter/X, Xiaohongshu, podcasts, and more. Returns AI-generated summary text.
summarize_video_with_config
Summarize a video with custom prompt, AI model, and output language. Use this when the user wants a specific summary style or language.
summarize_by_chapter
Summarize a video chapter by chapter. Returns structured summaries for each section/chapter of the video.
create_summary_task
Create an async summary task for a video. Returns a taskId to poll with get_task_status. Use for long videos that take time to process.
get_task_status
Check the status of an async summary task. Returns the summary when completed, or current status if still processing.
get_subtitle
Get the full transcript/subtitles of a video or podcast. Returns subtitle array with timestamps in the detail field.
Claude Desktop / Cursor
Paste into your MCP client config file to install this server.
{
"mcpServers": {
"bibigpt ai video & audio summarizer": {
"bibigpt": {
"type": "http",
"url": "https://bibigpt.co/api/mcp"
}
}
}
}
McpServers
{
"bibigpt": {
"type": "http",
"url": "https://bibigpt.co/api/mcp"
}
}
bibigpt-skill
AI Agent skill for summarizing videos, audio, and podcasts via BibiGPT.
Three ways to use:
1. BibiGPT Desktop + CLI Skill — install bibi CLI, works with Claude Code / OpenClaw / Codex
2. Remote MCP Server — zero install, works with any MCP client (Claude, ChatGPT, Cursor, etc.)
3. OpenAPI — direct HTTP calls for containers, CI, or custom integrations
---
Skill Structure
skills/bibi/
├── SKILL.md # Intent router — dispatches to workflows
├── scripts/
│ └── bibi-check.sh # Auto-detect CLI vs API mode
├── references/
│ ├── cli.md # CLI command reference
│ ├── api.md # OpenAPI endpoint reference (10 endpoints)
│ ├── installation.md # Setup & auth guide
│ └── supported-platforms.md # URL types & platform limits
└── workflows/
├── quick-summary.md # Paste URL → get AI summary
├── deep-dive.md # Chapter breakdown + follow-up Q&A
├── transcript-extract.md # Subtitle/transcript extraction
├── article-rewrite.md # Video → blog/公众号图文/小红书
├── batch-process.md # Multi-URL batch processing
├── research-compile.md # Multi-source topic synthesis
├── export-notes.md # Save to Notion/Obsidian/local
└── visual-analysis.md # Video frame visual analysis
Workflows
| Workflow | What it does | Trigger examples |
|----------|-------------|-----------------|
| Quick Summary | One URL → AI summary | "summarize this video", "总结" |
| Deep Dive | Chapter-by-chapter + Q&A | "chapter summary", "分章节总结" |
| Transcript Extract | Raw subtitles with timestamps | "get subtitles", "获取字幕" |
| Article Rewrite | Video → polished article | "turn into article", "AI改写" |
| Batch Process | Multiple URLs at once | "batch summarize", "批量总结" |
| Research Compile | Cross-source synthesis | "compare these videos", "综合分析" |
| Export Notes | Save to Notion/Obsidian/file | "save to Notion", "导出笔记" |
| Visual Analysis | Analyze slides & on-screen content | "画面分析", "what's on screen" |
---
Quick Start
1. Install Desktop App
curl -fsSL https://bibigpt.co/install.sh | bash
Works on macOS (auto-uses Homebrew), Linux (downloads AppImage), and detects Windows (prompts to use winget).
Or install manually per platform:
- macOS: brew install --cask jimmylv/bibigpt/bibigpt (Homebrew tap)
- Windows: winget install BibiGPT --source winget or download from bibigpt.co/download/desktop
- Linux: Download .deb / .AppImage from bibigpt.co/download/desktop
Then log in: bibi auth login (opens browser for OAuth, saves token automatically).
2. Install Skill
Claude Code
npx skills add JimmyLv/bibigpt-skill
OpenClaw
npx skills add JimmyLv/bibigpt-skill --agents OpenClaw --yes
3. Usage
Ask your agent to summarize any video, audio URL, or local file:
> Summarize this video: https://www.youtube.com/watch?v=xxxxx
> Summarize this local file: /path/to/meeting-recording.mp4
The agent will automatically detect the best mode and route to the right workflow.
Commands
| Command | Description |
|---------|-------------|
| bibi summarize "<URL>" | Summarize a video/audio URL |
| bibi summarize "/path/to/file.mp4" | Summarize a local audio/video file |
| bibi summarize "<INPUT>" --async | Async mode (long videos) |
| bibi summarize "<INPUT>" --chapter | Chapter-by-chapter summary |
| bibi summarize "<INPUT>" --subtitle | Fetch subtitles/transcript only |
| bibi summarize "<INPUT>" --json | Full JSON output |
| bibi auth check | Check auth status |
| bibi auth login | OAuth login via browser (saves token automatically) |
| bibi check-update | Check for new version |
| bibi self-update | Download and install latest version |
---
Updating
BibiGPT ships three independently updateable layers. Pick the one that matches what you want refreshed.
| Layer | Updates | Command | When to run |
|---|---|---|---|
| Skill content (workflows, references, intent router) | npm-distributed, manual | npx skills update JimmyLv/bibigpt-skill | Weekly, or when changelog adds a new MCP tool / workflow |
| bibi desktop CLI (binary + embedded SKILL.md + manifest dispatcher) | Self-update or package manager | bibi self-update (or brew upgrade --cask bibigpt / winget upgrade BibiGPT) | When the changelog mentions CLI changes |
| Remote MCP server (https://bibigpt.co/api/mcp) | Always latest, server-side | automatic — restart your MCP client to pick up new tools | Never manually; happens server-side |
Update the skill
npx skills update JimmyLv/bibigpt-skill
The skill does not auto-update — Agents read whatever was last fetched. Re-run when you want new BibiGPT capabilities, fixed workflows, or new MCP tools surfaced. For a clean reinstall:
npx skills remove JimmyLv/bibigpt-skill && npx skills add JimmyLv/bibigpt-skill
The GitHub Releases page tracks what each version changed.
Update the bibi CLI
bibi check-update # peek at the latest published version
bibi self-update # download and install (uses brew on macOS, installer on Windows)
Or via package manager: brew upgrade --cask bibigpt / winget upgrade BibiGPT --source winget / fresh download from bibigpt.co/download/desktop.
> Manifest is hot-cached, not embedded. Even without bibi self-update, the CLI dispatcher fetches https://bibigpt.co/api/cli-manifest.json on first call (24h TTL) — newly-released agent procedures show up the next day. bibi self-update only matters when the dispatcher itself or the embedded SKILL.md changes.
Update the MCP server
Nothing to do — the remote MCP endpoint always serves the latest meta.mcp.enabled tool list. Restart your MCP client (Claude Desktop, Cursor, etc.) if you don't see a newly-released tool — that refreshes its tools/list cache.
> Note: The desktop app build is triggered via the build-tauri-desktop-app GitHub Actions workflow. After a successful build, artifacts are uploaded to OSS and the latest.json manifest is updated automatically — the client checks this manifest for update availability.
---
Remote MCP Server (No Install Required)
BibiGPT also provides a remote MCP server at https://bibigpt.co/api/mcp — works with any MCP-compatible client. Streamable HTTP transport with OAuth 2.1 authentication.
Available Tools
| Tool | Description |
|------|-------------|
| summarize_video | Summarize a video or podcast URL |
| summarize_video_with_config | Summarize with custom prompt, model, language |
| summarize_by_chapter | Chapter-by-chapter summary |
| get_subtitle | Get transcript/subtitles with timestamps |
| create_summary_task | Create async task for long videos |
| get_task_status | Check async task status |
Claude Code
Add to .mcp.json in your project root:
{
"mcpServers": {
"bibigpt": {
"type": "http",
"url": "https://bibigpt.co/api/mcp"
}
}
}
Or via CLI:
claude mcp add --transport http bibigpt https://bibigpt.co/api/mcp
OpenAI Codex
Edit ~/.codex/config.toml (or .codex/config.toml in project root):
[mcp_servers.bibigpt]
url = "https://bibigpt.co/api/mcp"
With API key authentication:
[mcp_servers.bibigpt]
url = "https://bibigpt.co/api/mcp"
bearer_token_env_var = "BIBIGPT_API_KEY"
Claude Desktop
Option A — UI (recommended): Settings → Connectors → Add Connector → paste https://bibigpt.co/api/mcp
Option B — Config file (~/Library/Application Support/Claude/claude_desktop_config.json on macOS, %APPDATA%\Claude\claude_desktop_config.json on Windows):
{
"mcpServers": {
"bibigpt": {
"command": "npx",
"args": ["-y", "mcp-remote", "https://bibigpt.co/api/mcp"]
}
}
}
Cursor
Add to .cursor/mcp.json in project root, or configure in Cursor Settings → MCP:
{
"mcpServers": {
"bibigpt": {
"url": "https://bibigpt.co/api/mcp",
"type": "streamable-http"
}
}
}
VS Code (GitHub Copilot)
Add .vscode/mcp.json in your workspace:
{
"servers": {
"bibigpt": {
"type": "http",
"url": "https://bibigpt.co/api/mcp"
}
}
}
Windsurf
Add to ~/.codeium/windsurf/mcp_config.json:
{
"mcpServers": {
"bibigpt": {
"serverUrl": "https://bibigpt.co/api/mcp"
}
}
}
ChatGPT
1. Settings → Apps & Connectors → Advanced settings → enable Developer mode
2. Settings → Apps & Connectors → Create connector
3. Enter URL: https://bibigpt.co/api/mcp
4. Complete OAuth authorization when prompted
Manus
Settings → Connectors → Add Connectors → Custom MCP → +Add Custom MCP:
Enter server URL: https://bibigpt.co/api/mcp
LobeChat
Settings → Plugin Settings → Custom Plugins → Quick Import JSON:
{
"type": "mcp:streamable-http",
"url": "https://bibigpt.co/api/mcp",
"metadata": {
"title": "BibiGPT",
"description": "AI Video & Audio Summarizer"
}
}
Direct API Key (Skip OAuth)
If you have a BibiGPT API key, skip OAuth and use Bearer token directly:
```bash
Sign in to leave a review
Use Google, GitHub, or an email account so ratings stay tied to real people.
No reviews posted yet.
