MCP AI Infra Real Time Agent
About
This project demonstrates a decoupled real-time agent architecture that connects LangGraph agents to remote tools served by custom MCP (Modular Command Protocol) servers. The architecture enables a flexible and scalable multi-agent system where each tool can be hosted independent
Details
- Author
- junfanz1
- GitHub stars
- 27
- Downloads
- 386
- Categories
- AI
Jump to
- Decoupled architecture for agent orchestration and tool execution.
- Supports both SSE and STDIO transport protocols.
- Asynchronous I/O for concurrent and real-time communication.
- MultiServerMCPClient enables connections to multiple tool servers.
- Dynamic tool discovery and MCP handshake protocol.
- LangGraph ReAct agent integration for reasoning and acting.
Run the provided MCP tool servers (e.g., python math_server.py, python weather_server.py) then execute a LangGraph agent client such as multiserver_client.py or stdio_client.py. Configure API keys via a .env file and use the MultiServerMCPClient to bind to multiple tool servers concurrently. Debug tool execution with Anthropic’s MCP Inspector.
Part 2. MCP-AI-Infra-Real-Time-Agent
Developed an MCP-based AI infrastructure enabling real-time tool execution, structured knowledge retrieval, and dynamic agentic interactions for AI clients like Claude and Cursor.
- Designed and implemented an MCP-based AI system enabling real-time tool execution, structured knowledge retrieval, and agentic workflows for AI clients like Claude and Cursor.
- Developed an MCP server-client architecture to facilitate seamless LLM interactions, exposing tools (get_forecast, get_alerts), resources (API responses, file contents), and prompts (structured task templates).
- Engineered a dynamic tool execution framework, allowing AI models to invoke external API services with user approval, improving AI-assisted decision-making and automation.
- Integrated MCP with LangGraph-powered retrieval-augmented generation (RAG) workflows, optimizing contextual document retrieval and structured response generation.
- Implemented composable AI agents by designing an MCP protocol where AI components act as both clients and servers, enabling multi-layer agentic interactions and modular extensibility.
- Enhanced system interoperability by leveraging the MCP protocol as a universal AI interface, allowing plug-and-play AI capabilities across different host environments.
- Built a self-evolving tool registry API, enabling dynamic capability discovery and runtime tool registration, supporting adaptive AI workflows and evolving agentic systems.
- Optimized AI tool execution with caching and parallel request handling, improving MCP server response time and LLM inference efficiency.
- Utilized Anthropic’s MCP Inspector for interactive debugging and testing, refining AI-agent behavior and tool execution pipelines.
- Developed a scalable and extensible framework, enabling future integration of additional AI-driven utilities, automation agents, and external API services within the MCP ecosystem.
Project Overview
The MCP-Servers project is focused on implementing and extending an MCP (Model-Controlled Protocol) Server that facilitates real-time, documentation-grounded responses for AI systems like Claude and Cursor. The goal is to integrate an MCP client-server architecture that enables AI models to access structured knowledge and invoke specific tools dynamically.Core Objectives
1. MCP Client-Server Integration
- Implement an MCP server that connects to AI clients such as Claude 3.7 Sonnet Desktop and Cursor. - Use an existing MCP framework (e.g., mcpdoc) to avoid reinventing core functionalities.2. Extending MCP Server Capabilities
- Develop custom tools for the MCP server, particularly for fetching external data such as weather forecasts and alerts. - Expose these functionalities as MCP tools (get_forecast, get_alerts), making them available to AI clients.
3. Enhancing AI Tool Execution
- Enable AI models to interact with the MCP server by invoking tools with user approval. - Ensure proper handling of resources (e.g., API responses, file contents) and prompts (pre-written templates for structured tasks).---
MCP Architecture & Workflow
1. MCP as a Universal AI Interface
- MCP functions as an interoperability layer, allowing external AI applications (Claude, Cursor, etc.) to interact with structured data sources and executable functions. - It follows a USB-C-like architecture, where an MCP server acts as an external plugin that can be connected to various AI systems.2. MCP Client-Server Roles
MCP Client (embedded in an AI host like Claude or Cursor)
- Requests tools, queries resources, and processes prompts. - Acts as a bridge between the AI system and the MCP server.MCP Server (implemented locally)
- Exposes tools (e.g., weather APIs) to be called dynamically by AI clients. - Provides resources (e.g., API responses, database queries). - Handles prompts to enable structured user interactions.---
Key Features & Future Enhancements
- Agentic Composability: The architecture allows multi-layer agentic interactions, where an AI agent can act as both an MCP client and server. This enables modular, specialized agents to handle different tasks.
- Self-Evolving AI via Registry API: Future iterations could support dynamic tool discovery, where AI clients can register and discover new MCP capabilities in real time.
- Development & Debugging Support: Utilize Anthropic’s MCP Inspector to test and debug MCP interactions interactively without requiring full deployment.
---
Conclusion
This project builds an MCP-driven AI infrastructure that connects AI models with real-time structured knowledge, extends their capabilities via custom tool execution, and enhances agentic composability. The goal is to create an adaptive, plugin-like AI system that can integrate into multiple hosts while dynamically evolving through tool registration and runtime discoveries.
Appendix
- Not reinvent the wheel
MCP is like USB-C, MCP server is like external device that can connect with AI (Claude Desktop) or cloud app. We can write functionality once, and plug into many MCP hosts. MCP client sits inside MCP hosts to 1:1 interact with MCP servers via MCP protocol. MCP clients invoke tools, queries for resources, interpolate prompts; MCP server expose tools (model-controlled: retrieve, DB update, send), resources (app-controlled: DB records, API), prompts (user-controlled: docs).
MCP + Containerizing
Initialize project with UV, create virtual environment with UV, install dependencies (MCP [CLI]), index official MCP documentation with Cursor, update project with Cursor rules
Vibe coding
- @server.py implement a simple MCP server from @MCP . Use the Python SDK @MCP Python SDK and the server should expose one tool which is called terminal tool which will allow user to run terminal commands, make it simple
- help me expose a resource in my mcp server @MCP, again use @MCP Python SDK to write the code. I want to expose mcpreadme.md under my Desktop directory.
Acknowledgements
Sign in to leave a review
Use Google, GitHub, or an email account so ratings stay tied to real people.
No reviews posted yet.
