MCP-Ollama Client
About
Lightweight MCP client that uses a local Ollama LLM to query multiple MCP servers defined in config.json
Details
- Author
- Nagharjun17
- Downloads
- 406
- Categories
- AI
Jump to
- Runs entirely offline with a local LLM via Ollama
- Connects to multiple MCP servers side‑by‑side
- Collision‑free tool names via server‑name prefixing
- Everything configured in one config.json file
- No cloud API keys required
Setting up with Highlight
This MCP is not yet compatible with Highlight’s one-click setup. However, you can still use it with Highlight by following these steps:
- Download and install Highlight from highlightai.com/download
- Navigate to the plugins tab and select "Add Custom Plugin"
-
Configure the plugin with the settings below
Plugin Name
MCP-Ollama ClientCommand (node, npx, python, etc.)Please refer to the README for specific instructions on how to obtain API keys or other required environment variables.
- Enable "Start Automatically" if you want the plugin to start when Highlight launches
From the repository
Clone the repository, set up a Python ≥ 3.12 virtual environment with uv, install dependencies, pull a local model with ollama pull qwen3:14b, edit the model name and server settings in config.json, then run uv run client.py. At startup the client launches every MCP server, aggregates their tool schemas with server‑name prefixes (e.g. postgres., filesystem.), and presents the merged list to the LLM.
Claude Desktop / Cursor
Paste into your MCP client config file to install this server.
{
"mcpServers": {
"mcp-ollama client": {
"MCP-Ollama-Client": {
"command": "uv",
"args": [
"venv"
]
}
}
}
}McpServers
{
"MCP-Ollama-Client": {
"command": "uv",
"args": [
"venv"
]
}
}MCP-Ollama Client
Small command‑line chat client that
1. Runs entirely offline with a local LLM via Ollama
2. Talks to any number of Model‑Context‑Protocol (MCP) servers, all declared in one config.json
At start‑up the client launches every server, fetches their tool schemas, prefixes tool names (postgres., filesystem., …) and gives the merged list to the model.
The LLM decides which server to call for each user request.
---
Features
| Feature | Notes |
| ------------------------------- | ------------------------------------------------------------------------------------------------------------------- |
| Local LLM first | Default model is qwen3:14b, but any function‑calling model that Ollama exposes will work. No cloud keys required. |
| Multi‑server out‑of‑the‑box | Postgres, filesystem, or your own MCP servers can run side‑by‑side; all are defined in config.json. |
| Collision‑free tool names | Tools are exposed as <server>.<tool> so names never clash. |
---
Requirements
| Component | Version tested |
| ------------- | -------------------------------------------|
| Python | ≥ 3.12 |
| Ollama | ≥ 0.8.0 |
| MCP server(s) | Anything that supports stdio transport |
---
Quick start
```bash
Sign in to leave a review
Use Google, GitHub, or an email account so ratings stay tied to real people.
No reviews posted yet.
