Secure LLM Proxy

by wootock

371 downloads Not rated yet
GitHub

About

OpenAI-compatible proxy with PII scrubbing, audit logging, and model routing. Drop-in replacement — set OPENAI_BASE_URL to point to this server. Supports GPT-4o, Claude, Gemini, and Llama via single endpoint.

Explore

- PII scrubbing — strips emails, phone numbers, SSNs, and credit card numbers before forwarding
- Audit logging — every request logged with hash of original content
- OpenAI-compatible — drop-in replacement, just change OPENAI_BASE_URL
- Model routing — supports GPT-4o, Claude, Gemini, and Llama via single endpoint
- Rate limit pooling — spreads load across multiple upstream keys

Setting up with Highlight

This MCP is not yet compatible with Highlight’s one-click setup. However, you can still use it with Highlight by following these steps:

  1. Download and install Highlight from highlightai.com/download
  2. Navigate to the plugins tab and select "Add Custom Plugin"
  3. Configure the plugin with the settings below
    Plugin Name Secure LLM Proxy
    Command (node, npx, python, etc.)

    Please refer to the README for specific instructions on how to obtain API keys or other required environment variables.

  4. Enable "Start Automatically" if you want the plugin to start when Highlight launches

From the repository

export OPENAI_BASE_URL=https://nexus.exchange-secure.com/v1
export OPENAI_API_KEY=your-key  # forwarded after PII scrub

Or with the MCP tool:

{
  "mcpServers": {
    "secure-llm-proxy": {
      "url": "https://nexus.exchange-secure.com/mcp",
      "headers": {
        "Authorization": "Bearer your-key"
      }
    }
  }
}

Claude Desktop / Cursor

Paste into your MCP client config file to install this server.

{
    "mcpServers": {
        "secure llm proxy": {
            "secure-llm-proxy": {
                "url": "https://nexus.exchange-secure.com/mcp",
                "headers": {
                    "Authorization": "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"
                }
            }
        }
    }
}

McpServers

{
    "secure-llm-proxy": {
        "url": "https://nexus.exchange-secure.com/mcp",
        "headers": {
            "Authorization": "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"
        }
    }
}

An OpenAI-compatible proxy with enhanced privacy controls, PII scrubbing, and audit logging.

Features

- PII scrubbing — strips emails, phone numbers, SSNs, and credit card numbers before forwarding
- Audit logging — every request logged with hash of original content
- OpenAI-compatible — drop-in replacement, just change OPENAI_BASE_URL
- Model routing — supports GPT-4o, Claude, Gemini, and Llama via single endpoint
- Rate limit pooling — spreads load across multiple upstream keys

Quick Start

export OPENAI_BASE_URL=https://nexus.exchange-secure.com/v1
export OPENAI_API_KEY=your-key  # forwarded after PII scrub

Or with the MCP tool:

{
  "mcpServers": {
    "secure-llm-proxy": {
      "url": "https://nexus.exchange-secure.com/mcp",
      "headers": {
        "Authorization": "Bearer your-key"
      }
    }
  }
}

Available Tools

chat_completion

Generate a chat completion via the privacy-preserving proxy.

Input:

{
"messages": [{"role": "user", "content": "Hello"}],
"model": "gpt-4o"
}

Response includes audit ID, scrub report, and completion.

Privacy

Keys are never stored. Requests are hashed for audit purposes only. PII is removed before any data leaves your network perimeter.

No reviews yet — be the first

Sign in to leave a review

Use Google, GitHub, or an email account so ratings stay tied to real people.

Email sign in

No reviews posted yet.