Claude Desktop Real-time Audio MCP Server (Python Implementation)
About
Python-based Model Context Protocol (MCP) server for real-time microphone input to Claude Desktop on Windows. FastMCP + sounddevice + multiple STT engines for sub-500ms latency voice conversations.
Details
- Author
- joelfuller2016
- Downloads
- 374
- Categories
- Productivity
Jump to
- Real‑time microphone capture via Windows WASAPI
- Multiple speech recognition engines: Whisper (local/API), Azure, Google
- Voice activity detection (webrtcvad) with configurable sensitivity
- Low‑latency, async architecture using FastMCP and asyncio
- Comprehensive logging and performance monitoring
- Easy JSON/YAML configuration with environment variable support
Setting up with Highlight
This MCP is not yet compatible with Highlight’s one-click setup. However, you can still use it with Highlight by following these steps:
- Download and install Highlight from highlightai.com/download
- Navigate to the plugins tab and select "Add Custom Plugin"
-
Configure the plugin with the settings below
Plugin Name
Claude Desktop Real-time Audio MCP Server (Python Implementation)Command (node, npx, python, etc.)Please refer to the README for specific instructions on how to obtain API keys or other required environment variables.
- Enable "Start Automatically" if you want the plugin to start when Highlight launches
From the repository
Clone the repository, create a Python 3.8+ virtual environment, install dependencies with pip install -r requirements.txt, set required API keys as environment variables (e.g., OPENAI_API_KEY), test audio with python -m audio.test_setup, then start the server with python main.py. Add the server to Claude Desktop’s claude_desktop_config.json as an MCP server entry.
Claude Desktop / Cursor
Paste into your MCP client config file to install this server.
{
"mcpServers": {
"claude desktop real-time audio mcp server (python implementation)": {
"claude-desktop-realtime-audio-mcp-python": {
"command": "python",
"args": [
"-m",
"venv",
"venv"
]
}
}
}
}McpServers
{
"claude-desktop-realtime-audio-mcp-python": {
"command": "python",
"args": [
"-m",
"venv",
"venv"
]
}
}Claude Desktop Real-time Audio MCP Server (Python Implementation)
A Python-based Model Context Protocol (MCP) server that enables real-time microphone input for Claude Desktop on Windows. This implementation leverages Python's superior audio processing ecosystem to provide robust voice-driven conversations with Claude through WASAPI audio capture and multiple speech recognition engines.
🚀 Key Advantages of Python Implementation
- 🐍 Mature Audio Ecosystem: Leverages sounddevice, webrtcvad, and specialized Windows audio libraries
- 🧠 Multiple STT Engines: OpenAI Whisper (local/API), Azure Speech, Google Speech-to-Text
- ⚡ FastMCP Framework: High-level Pythonic interface for rapid MCP development
- 🔧 Easy Configuration: JSON/YAML configuration with environment variable support
- 📊 Better Debugging: Comprehensive logging and performance monitoring
- 🔄 Async Architecture: Non-blocking operations with asyncio
🏗️ Architecture
┌─────────────────┐ ┌──────────────────┐ ┌─────────────────┐
│ Claude │ │ FastMCP Server │ │ Audio Capture │
│ Desktop │◄──►│ (Python) │◄──►│ (sounddevice) │
│ │ │ │ │ + WASAPI │
└─────────────────┘ └──────────────────┘ └─────────────────┘
│ │
▼ ▼
┌──────────────────┐ ┌─────────────────┐
│ STT Engines │ │ Voice Activity │
│ • Whisper │ │ Detection │
│ • Azure Speech │ │ (webrtcvad) │
│ • Google Speech │ │ │
└──────────────────┘ └─────────────────┘
📋 Prerequisites
- Windows 10/11 (Windows 7+ with WASAPI support)
- Python 3.8+
- Claude Desktop (latest version)
🚦 Quick Start
1. Installation
```bash
Sign in to leave a review
Use Google, GitHub, or an email account so ratings stay tied to real people.
No reviews posted yet.
