BibiGPT AI video & audio summarizer

by JimmyLv

98 stars
1.3k downloads
Not rated
GitHub

About

OpenClaw / Claude Code / Codex Agent skill for summarizing videos/audio via BibiGPT CLI (bibi)

Details

Author
JimmyLv
GitHub stars
98
Downloads
1,251
Categories
Media

- Summarize videos, audio, and podcasts from URLs or local files.
- Chapter-by-chapter summaries, transcript extraction, and article rewriting.
- Batch processing of multiple URLs and cross-source research compilation.
- Export notes to Notion, Obsidian, or local files.
- Visual analysis of video frames and on-screen content.
- Available as CLI, remote MCP server, or OpenAPI.

Setting up with Highlight

This MCP is not yet compatible with Highlight’s one-click setup. However, you can still use it with Highlight by following these steps:

  1. Download and install Highlight from highlightai.com/download
  2. Navigate to the plugins tab and select "Add Custom Plugin"
  3. Configure the plugin with the settings below
    Plugin Name BibiGPT AI video & audio summarizer
    Command (node, npx, python, etc.)

    Please refer to the README for specific instructions on how to obtain API keys or other required environment variables.

  4. Enable "Start Automatically" if you want the plugin to start when Highlight launches

From the repository

Three ways: install the bibi CLI and add the skill with npx skills add JimmyLv/bibigpt-skill; use the remote MCP server at https://bibigpt.co/api/mcp with any MCP client; or make direct HTTP calls to the OpenAPI endpoints. After setup, ask your agent to summarize a video/audio URL or a local file.

summarize_video

Summarize an online video or podcast. Supports YouTube, Bilibili, TikTok, Twitter/X, Xiaohongshu, podcasts, and more. Returns AI-generated summary text.

summarize_video_with_config

Summarize a video with custom prompt, AI model, and output language. Use this when the user wants a specific summary style or language.

summarize_by_chapter

Summarize a video chapter by chapter. Returns structured summaries for each section/chapter of the video.

create_summary_task

Create an async summary task for a video. Returns a taskId to poll with get_task_status. Use for long videos that take time to process.

get_task_status

Check the status of an async summary task. Returns the summary when completed, or current status if still processing.

get_subtitle

Get the full transcript/subtitles of a video or podcast. Returns subtitle array with timestamps in the detail field.

Claude Desktop / Cursor

Paste into your MCP client config file to install this server.

{
    "mcpServers": {
        "bibigpt ai video & audio summarizer": {
            "bibigpt": {
                "type": "http",
                "url": "https://bibigpt.co/api/mcp"
            }
        }
    }
}

McpServers

{
    "bibigpt": {
        "type": "http",
        "url": "https://bibigpt.co/api/mcp"
    }
}

bibigpt-skill

AI Agent skill for summarizing videos, audio, and podcasts via BibiGPT.

Three ways to use:
1. BibiGPT Desktop + CLI Skill — install bibi CLI, works with Claude Code / OpenClaw / Codex
2. Remote MCP Server — zero install, works with any MCP client (Claude, ChatGPT, Cursor, etc.)
3. OpenAPI — direct HTTP calls for containers, CI, or custom integrations

---

Skill Structure

skills/bibi/
├── SKILL.md                        # Intent router — dispatches to workflows
├── scripts/
│   └── bibi-check.sh              # Auto-detect CLI vs API mode
├── references/
│   ├── cli.md                     # CLI command reference
│   ├── api.md                     # OpenAPI endpoint reference (10 endpoints)
│   ├── installation.md            # Setup & auth guide
│   └── supported-platforms.md     # URL types & platform limits
└── workflows/
    ├── quick-summary.md           # Paste URL → get AI summary
    ├── deep-dive.md               # Chapter breakdown + follow-up Q&A
    ├── transcript-extract.md      # Subtitle/transcript extraction
    ├── article-rewrite.md         # Video → blog/公众号图文/小红书
    ├── batch-process.md           # Multi-URL batch processing
    ├── research-compile.md        # Multi-source topic synthesis
    ├── export-notes.md            # Save to Notion/Obsidian/local
    └── visual-analysis.md         # Video frame visual analysis

Workflows

| Workflow | What it does | Trigger examples |
|----------|-------------|-----------------|
| Quick Summary | One URL → AI summary | "summarize this video", "总结" |
| Deep Dive | Chapter-by-chapter + Q&A | "chapter summary", "分章节总结" |
| Transcript Extract | Raw subtitles with timestamps | "get subtitles", "获取字幕" |
| Article Rewrite | Video → polished article | "turn into article", "AI改写" |
| Batch Process | Multiple URLs at once | "batch summarize", "批量总结" |
| Research Compile | Cross-source synthesis | "compare these videos", "综合分析" |
| Export Notes | Save to Notion/Obsidian/file | "save to Notion", "导出笔记" |
| Visual Analysis | Analyze slides & on-screen content | "画面分析", "what's on screen" |

---

Quick Start

1. Install Desktop App

curl -fsSL https://bibigpt.co/install.sh | bash

Works on macOS (auto-uses Homebrew), Linux (downloads AppImage), and detects Windows (prompts to use winget).

Or install manually per platform:
- macOS: brew install --cask jimmylv/bibigpt/bibigpt (Homebrew tap)
- Windows: winget install BibiGPT --source winget or download from bibigpt.co/download/desktop
- Linux: Download .deb / .AppImage from bibigpt.co/download/desktop

Then log in: bibi auth login (opens browser for OAuth, saves token automatically).

2. Install Skill

Claude Code

npx skills add JimmyLv/bibigpt-skill

OpenClaw

npx skills add JimmyLv/bibigpt-skill --agents OpenClaw --yes

3. Usage

Ask your agent to summarize any video, audio URL, or local file:

> Summarize this video: https://www.youtube.com/watch?v=xxxxx
> Summarize this local file: /path/to/meeting-recording.mp4

The agent will automatically detect the best mode and route to the right workflow.

Commands

| Command | Description |
|---------|-------------|
| bibi summarize "<URL>" | Summarize a video/audio URL |
| bibi summarize "/path/to/file.mp4" | Summarize a local audio/video file |
| bibi summarize "<INPUT>" --async | Async mode (long videos) |
| bibi summarize "<INPUT>" --chapter | Chapter-by-chapter summary |
| bibi summarize "<INPUT>" --subtitle | Fetch subtitles/transcript only |
| bibi summarize "<INPUT>" --json | Full JSON output |
| bibi auth check | Check auth status |
| bibi auth login | OAuth login via browser (saves token automatically) |
| bibi check-update | Check for new version |
| bibi self-update | Download and install latest version |

---

Updating

BibiGPT ships three independently updateable layers. Pick the one that matches what you want refreshed.

| Layer | Updates | Command | When to run |
|---|---|---|---|
| Skill content (workflows, references, intent router) | npm-distributed, manual | npx skills update JimmyLv/bibigpt-skill | Weekly, or when changelog adds a new MCP tool / workflow |
| bibi desktop CLI (binary + embedded SKILL.md + manifest dispatcher) | Self-update or package manager | bibi self-update (or brew upgrade --cask bibigpt / winget upgrade BibiGPT) | When the changelog mentions CLI changes |
| Remote MCP server (https://bibigpt.co/api/mcp) | Always latest, server-side | automatic — restart your MCP client to pick up new tools | Never manually; happens server-side |

Update the skill

npx skills update JimmyLv/bibigpt-skill

The skill does not auto-update — Agents read whatever was last fetched. Re-run when you want new BibiGPT capabilities, fixed workflows, or new MCP tools surfaced. For a clean reinstall:

npx skills remove JimmyLv/bibigpt-skill && npx skills add JimmyLv/bibigpt-skill

The GitHub Releases page tracks what each version changed.

Update the bibi CLI

bibi check-update    # peek at the latest published version
bibi self-update     # download and install (uses brew on macOS, installer on Windows)

Or via package manager: brew upgrade --cask bibigpt / winget upgrade BibiGPT --source winget / fresh download from bibigpt.co/download/desktop.

> Manifest is hot-cached, not embedded. Even without bibi self-update, the CLI dispatcher fetches https://bibigpt.co/api/cli-manifest.json on first call (24h TTL) — newly-released agent procedures show up the next day. bibi self-update only matters when the dispatcher itself or the embedded SKILL.md changes.

Update the MCP server

Nothing to do — the remote MCP endpoint always serves the latest meta.mcp.enabled tool list. Restart your MCP client (Claude Desktop, Cursor, etc.) if you don't see a newly-released tool — that refreshes its tools/list cache.

> Note: The desktop app build is triggered via the build-tauri-desktop-app GitHub Actions workflow. After a successful build, artifacts are uploaded to OSS and the latest.json manifest is updated automatically — the client checks this manifest for update availability.

---

Remote MCP Server (No Install Required)

BibiGPT also provides a remote MCP server at https://bibigpt.co/api/mcp — works with any MCP-compatible client. Streamable HTTP transport with OAuth 2.1 authentication.

Available Tools

| Tool | Description |
|------|-------------|
| summarize_video | Summarize a video or podcast URL |
| summarize_video_with_config | Summarize with custom prompt, model, language |
| summarize_by_chapter | Chapter-by-chapter summary |
| get_subtitle | Get transcript/subtitles with timestamps |
| create_summary_task | Create async task for long videos |
| get_task_status | Check async task status |

Claude Code

Add to .mcp.json in your project root:

{
  "mcpServers": {
    "bibigpt": {
      "type": "http",
      "url": "https://bibigpt.co/api/mcp"
    }
  }
}

Or via CLI:

claude mcp add --transport http bibigpt https://bibigpt.co/api/mcp

OpenAI Codex

Edit ~/.codex/config.toml (or .codex/config.toml in project root):

[mcp_servers.bibigpt]
url = "https://bibigpt.co/api/mcp"

With API key authentication:

[mcp_servers.bibigpt]
url = "https://bibigpt.co/api/mcp"
bearer_token_env_var = "BIBIGPT_API_KEY"

Claude Desktop

Option A — UI (recommended): Settings → Connectors → Add Connector → paste https://bibigpt.co/api/mcp

Option B — Config file (~/Library/Application Support/Claude/claude_desktop_config.json on macOS, %APPDATA%\Claude\claude_desktop_config.json on Windows):

{
  "mcpServers": {
    "bibigpt": {
      "command": "npx",
      "args": ["-y", "mcp-remote", "https://bibigpt.co/api/mcp"]
    }
  }
}

Cursor

Add to .cursor/mcp.json in project root, or configure in Cursor Settings → MCP:

{
  "mcpServers": {
    "bibigpt": {
      "url": "https://bibigpt.co/api/mcp",
      "type": "streamable-http"
    }
  }
}

VS Code (GitHub Copilot)

Add .vscode/mcp.json in your workspace:

{
  "servers": {
    "bibigpt": {
      "type": "http",
      "url": "https://bibigpt.co/api/mcp"
    }
  }
}

Windsurf

Add to ~/.codeium/windsurf/mcp_config.json:

{
  "mcpServers": {
    "bibigpt": {
      "serverUrl": "https://bibigpt.co/api/mcp"
    }
  }
}

ChatGPT

1. Settings → Apps & Connectors → Advanced settings → enable Developer mode
2. Settings → Apps & Connectors → Create connector
3. Enter URL: https://bibigpt.co/api/mcp
4. Complete OAuth authorization when prompted

Manus

Settings → Connectors → Add Connectors → Custom MCP → +Add Custom MCP:

Enter server URL: https://bibigpt.co/api/mcp

LobeChat

Settings → Plugin Settings → Custom Plugins → Quick Import JSON:

{
  "type": "mcp:streamable-http",
  "url": "https://bibigpt.co/api/mcp",
  "metadata": {
    "title": "BibiGPT",
    "description": "AI Video & Audio Summarizer"
  }
}

Direct API Key (Skip OAuth)

If you have a BibiGPT API key, skip OAuth and use Bearer token directly:

```bash

No reviews yet — be the first

Sign in to leave a review

Use Google, GitHub, or an email account so ratings stay tied to real people.

Email sign in

No reviews posted yet.