πŸš€ MCP-Ollama Server

by Sethuram2003

26 stars
324 downloads
Not rated
GitHub

About

Extends Model Context Protocol (MCP) to local LLMs via Ollama, enabling Claude-like tool use (files, web, email, GitHub, AI images) while keeping data private. Modular Python servers for on-prem AI. #LocalAI #MCP #Ollama

Details

Author
Sethuram2003
GitHub stars
26
Downloads
324
Categories
AI

- πŸ”’ Complete data privacy – all computations run locally via Ollama
- πŸ”§ Tool use for local LLMs (file, calendar, and more)
- 🧩 Modular architecture with independent Python service modules
- πŸ”Œ Easy integration via simple APIs
- πŸš€ Performance optimized for responsive AI interactions
- πŸ“¦ Containerized deployment with Docker (coming soon)
- πŸ§ͺ Extensive test coverage for reliability

Setting up with Highlight

This MCP is not yet compatible with Highlight’s one-click setup. However, you can still use it with Highlight by following these steps:

  1. Download and install Highlight from highlightai.com/download
  2. Navigate to the plugins tab and select "Add Custom Plugin"
  3. Configure the plugin with the settings below
    Plugin Name πŸš€ MCP-Ollama Server
    Command (node, npx, python, etc.)

    Please refer to the README for specific instructions on how to obtain API keys or other required environment variables.

  4. Enable "Start Automatically" if you want the plugin to start when Highlight launches

From the repository

Install prerequisites (Python 3.8+, Ollama, Git), clone the repository, and pull a model (e.g., ollama pull llama3). Then navigate to a module directory (e.g., client_mcp/) and run uv run client.py ../file_system/file_system.py to start interacting with the agent.

Claude Desktop / Cursor

Paste into your MCP client config file to install this server.

{
    "mcpServers": {
        "\ud83d\ude80 mcp-ollama server": {
            "MCP-ollama_server": {
                "command": "uv",
                "args": [
                    "run",
                    "client.py",
                    "../file_system/file_system.py"
                ]
            }
        }
    }
}

McpServers

{
    "MCP-ollama_server": {
        "command": "uv",
        "args": [
            "run",
            "client.py",
            "../file_system/file_system.py"
        ]
    }
}

πŸš€ MCP-Ollama Server

<div align="center">

Connect the power of Model Context Protocol with local LLMs

GitHub license
GitHub stars
GitHub forks
GitHub issues
PRs Welcome

Getting Started β€’
Features β€’
Architecture β€’
Documentation β€’
Contributing β€’
FAQ

</div>

πŸ“‹ Overview

MCP-Ollama Server bridges the gap between Anthropic's Model Context Protocol (MCP) and local LLMs via Ollama. This integration empowers your on-premise AI models with Claude-like tool capabilities, including file system access, calendar integration, web browsing, email communication, GitHub interactions, and AI image generationβ€”all while maintaining complete data privacy.

Unlike cloud-based AI solutions, MCP-Ollama Server:
- Keeps all data processing on your local infrastructure
- Eliminates the need to share sensitive information with third parties
- Provides a modular approach that allows you to use only the components you need
- Enables enterprise-grade AI capabilities in air-gapped or high-security environments

✨ Key Features

- πŸ”’ Complete Data Privacy: All computations happen locally through Ollama
- πŸ”§ Tool Use for Local LLMs: Extends Ollama models with file, calendar, and other capabilities
- 🧩 Modular Architecture: Independent Python service modules that can be deployed selectively
- πŸ”Œ Easy Integration: Simple APIs to connect with existing applications
- πŸš€ Performance Optimized: Minimal overhead to maintain responsive AI interactions
- πŸ“¦ Containerized Deployment: Docker support for each module (coming soon)
- πŸ§ͺ Extensive Testing: Comprehensive test coverage for reliability

πŸš€ Quick Start

Prerequisites

- Python 3.8+ installed
- Ollama set up on your system
- Git for cloning the repository

🧩 Component Overview

MCP-Ollama Server is organized into specialized modules, each providing specific functionality:

πŸ“… Calendar Module

calendar/
β”œβ”€β”€ README.md          # Module-specific documentation
β”œβ”€β”€ google_calendar.py # Google Calendar API integration
β”œβ”€β”€ pyproject.toml     # Dependencies and package info
└── uv.lock        # Dependency lock file

The Calendar module enables your local LLM to:
- Create, modify, and delete calendar events
- Check availability and scheduling conflicts
- Send meeting invitations
- Set reminders and notifications

πŸ”„ Client MCP Module

client_mcp/
β”œβ”€β”€ README.md      # Module-specific documentation
β”œβ”€β”€ client.py      # Main client implementation
β”œβ”€β”€ pyproject.toml # Dependencies and package info
β”œβ”€β”€ testing.txt    # Test data
└── uv.lock        # Dependency lock file

The Client module provides:
- A unified interface to interact with all MCP-enabled services
- Conversation history management
- Context handling for improved responses
- Tool selection and routing logic

πŸ“ File System Module

file_system/
β”œβ”€β”€ README.md          # Module-specific documentation
β”œβ”€β”€ file_system.py     # File system operations implementation
β”œβ”€β”€ pyproject.toml     # Dependencies and package info
└── uv.lock            # Dependency lock file

The File System module allows your local LLM to:
- Read and write files securely
- List directory contents
- Search for files matching specific patterns
- Parse different file formats (text, CSV, JSON, etc.)

Installation

```bash

No reviews yet β€” be the first

Sign in to leave a review

Use Google, GitHub, or an email account so ratings stay tied to real people.

Email sign in

No reviews posted yet.