DINO-X

by idea-research

167 downloads
Not rated
GitHub

About

Advanced computer vision and object detection MCP server powered by Dino-X, enabling AI agents to analyze images, detect objects, identify keypoints, and perform visual understanding tasks.

Details

Author
idea-research
Downloads
167
Categories
Developer Tools, Media

- Fine-grained image understanding with full-scene recognition.
- Targeted object detection based on natural language prompts.
- Object counting, localization, and bounding box output.
- Human pose keypoint detection (17 keypoints per person).
- Visualizes detection results by drawing annotations on images.

Setting up with Highlight

This MCP is not yet compatible with Highlight’s one-click setup. However, you can still use it with Highlight by following these steps:

  1. Download and install Highlight from highlightai.com/download
  2. Navigate to the plugins tab and select "Add Custom Plugin"
  3. Configure the plugin with the settings below
    Plugin Name DINO-X
    Command (node, npx, python, etc.)

    Please refer to the README for specific instructions on how to obtain API keys or other required environment variables.

  4. Enable "Start Automatically" if you want the plugin to start when Highlight launches

From the repository

To use the server, install Node.js and configure an MCP client (e.g., Cursor, WindSurf, Cherry Studio) with the server’s NPM package or a local build. Set the required environment variable DINOX_API_KEY (obtain from the DINO-X Platform) and optionally IMAGE_STORAGE_DIRECTORY. After restarting the client, the server exposes four tools: detect-all-objects, object-detection-by-text, detect-human-pose-keypoints, and visualize-detections.

detect-objects-by-text

Analyze an image based on a text prompt to identify and count specific objects, and return detailed descriptions of the objects and their 2D coordinates.

detect-all-objects

Analyze an image to detect all identifiable objects, returning the category, count, coordinate positions and detailed descriptions for each object.

detect-human-pose-keypoints

Detects 17 keypoints for each person in an image, supporting body posture and movement analysis.

visualize-detection-result

Visualize detection results by drawing bounding boxes and labels on the original image. Images are saved to the directory specified by IMAGE_STORAGE_DIRECTORY environment variable.

Claude Desktop / Cursor

Paste into your MCP client config file to install this server.

{
    "mcpServers": {
        "dino-x": {
            "dinox-mcp": {
                "command": "npx",
                "args": [
                    "-y",
                    "@deepdataspace/dinox-mcp"
                ],
                "env": {
                    "DINOX_API_KEY": "Get free api key from https://cloud.deepdataspace.com/request_api",
                    "IMAGE_STORAGE_DIRECTORY": "/path/to/your/image/directory"
                }
            }
        }
    }
}

McpServers

{
    "dinox-mcp": {
        "command": "npx",
        "args": [
            "-y",
            "@deepdataspace/dinox-mcp"
        ],
        "env": {
            "DINOX_API_KEY": "Get free api key from https://cloud.deepdataspace.com/request_api",
            "IMAGE_STORAGE_DIRECTORY": "/path/to/your/image/directory"
        }
    }
}

- Detect all objects in a scene— Ask the assistant to identify every object in an image with categories and bounding boxes usingdetect-all-objects.
- Find objects by text prompt— Request detection of specific items (e.g., “person.car”) in an image viadetect-objects-by-text.
- Estimate human pose keypoints— Get 17 body keypoints and bounding boxes for people in an image withdetect-human-pose-keypoints.
- Generate annotated visualizations— Produce an image with detection results drawn on it usingvisualize-detection-result(STDIO mode only).

DINO-X Official MCP Server — powered by the DINO-X and Grounding DINO models — brings fine-grained object detection and image understanding to your multimodal applications.

<!-- -->Your browser does not support the video tag. <!-- -->

-

Fine-Grained Understanding: Full image detection, object detection, and region-level descriptions.

Structured Outputs: Get object categories, counts, locations, and attributes for VQA and multi-step reasoning tasks.

Composable: Works seamlessly with other MCP servers to build end-to-end visual agents or automation pipelines.

DINO-X MCP supports two transport modes:

Apply on the DINO-X platform:Request API Key(new users get free quota).

Option A: Official Hosted Streamable HTTP (Recommended)

Add to your MCP client config and replace with your API key:

{ "mcpServers": { "dinox-mcp": { "url": "https://mcp.deepdataspace.com/mcp?key=your-api-key" } } }

Option B: Use the NPM package locally (STDIO)

# macOS / Linux curl -o- https://raw.githubusercontent.com/nvm-sh/nvm/v0.40.1/install.sh | bash # or wget -qO- https://raw.githubusercontent.com/nvm-sh/nvm/v0.40.1/install.sh | bash # load nvm into current shell (choose the one you use) source ~/.bashrc || true source ~/.zshrc || true # install and use LTS Node.js nvm install --lts nvm use --lts # Windows (one of the following) winget install OpenJS.NodeJS.LTS # or with Chocolatey (in admin PowerShell) iwr -useb https://raw.githubusercontent.com/chocolatey/chocolatey/master/chocolateyInstall/InstallChocolatey.ps1 | iex choco install nodejs-lts -y
{ "mcpServers": { "dinox-mcp": { "command": "npx", "args": ["-y", "@deepdataspace/dinox-mcp"], "env": { "DINOX_API_KEY": "your-api-key-here", "IMAGE_STORAGE_DIRECTORY": "/path/to/your/image/directory" } } } }

Note: Replaceyour-api-key-herewith your real key.

Make sure Node.js is installed (see Option B), then:

# clone git clone https://github.com/IDEA-Research/DINO-X-MCP.git cd DINO-X-MCP # install deps npm install # build npm run build
{ "mcpServers": { "dinox-mcp": { "command": "node", "args": ["/path/to/DINO-X-MCP/build/index.js"], "env": { "DINOX_API_KEY": "your-api-key-here", "IMAGE_STORAGE_DIRECTORY": "/path/to/your/image/directory" } } } }

- --http: start in Streamable HTTP mode (otherwise STDIO by default)
- --stdio: force STDIO mode
- --dinox-api-key=...: set API key
- --enable-client-key: allow API key via URL?key=(Streamable HTTP only)
- --port=8080: HTTP port (default 3020)

- DINOX_API_KEY(required/conditionally required): DINO-X platform API key
- IMAGE_STORAGE_DIRECTORY(optional, STDIO): directory to save annotated images
- AUTH_TOKEN(optional, HTTP): if set, client must sendAuthorization: Bearer <token>

# STDIO (local) node build/index.js --dinox-api-key=your-api-key # Streamable HTTP (server provides a shared API key) node build/index.js --http --dinox-api-key=your-api-key # Streamable HTTP (custom port) node build/index.js --http --dinox-api-key=your-api-key --port=8080 # Streamable HTTP (require client-provided API key via URL) node build/index.js --http --enable-client-key
{ "mcpServers": { "dinox-mcp": { "url": "http://localhost:3020/mcp?key=your-api-key" } } }

UsingAUTH_TOKENwith a gateway that injectsAuthorization: Bearer <token>:

AUTH_TOKEN=my-token node build/index.js --http --enable-client-key
{ "mcpServers": { "dinox-mcp": { "command": "npx", "args": [ "-y", "supergateway", "--streamableHttp", "http://localhost:3020/mcp?key=your-api-key", "--oauth2Bearer", "my-token" ] } } }

- Supported image sources?

- STDIO:file://andhttps://
- Streamable HTTP:https://only

Use watch mode to auto-rebuild during development:

This is a web browser that enables your coding agent, such as Claude Code, to visit websites on your behalf and assist you in identifying bugs or creating UI test cases.

Create crafted UI components inspired by the best 21st.dev design engineers.

Bring agent evaluations, observability, and synthetic test set generation directly into your IDE for free with Galileo's new MCP server

An MCP server to help AI assistants to answer questions and generate AccelByte Extend SDK code more effectively .

MCP server for AI Diagram Maker — generate beautiful software engineering diagrams directly inside Cursor, Claude Desktop, Claude Code, or any MCP-compatible AI agent

ALAPI MCP Tools,Call hundreds of API interfaces via MCP

AI-powered SVG animation generator that transforms static files into animated SVG components using the Allyson platform

MCP server that gives AI assistants on-demand access to 1,500+ amCharts docs, ~300 code examples, and 1000+ class API references.

APIMatic MCP Server is used to validate OpenAPI specifications using APIMatic. The server processes OpenAPI files and returns validation summaries by leveraging APIMatic’s API.

One shared context layer for AI agents and humans — live API specs, DB schemas, and versioned contracts across repos so every agent and teammate works from the same source of truth.

Build and deploy full-stack Next.js apps with 98 tools for React, AWS, and MongoDB

No reviews yet — be the first

Sign in to leave a review

Use Google, GitHub, or an email account so ratings stay tied to real people.

Email sign in

No reviews posted yet.