Isaac Sim MCP Extension and MCP Server
About
The MCP Server and its extension leverage the Model Context Protocol (MCP) to enable natural language control of NVIDIA Isaac Sim, turning conversational AI inputs into precise simulation manipulation. It bridges the MCP ecosystem with embodied intelligence applications.
Details
- Author
- omni-mcp
- GitHub stars
- 180
- Downloads
- 497
- Categories
- Developer Tools
Jump to
- Natural language control of Isaac Sim
- Dynamic robot positioning and movement
- Custom lighting and scene creation
- Advanced robot simulations with obstacle navigation
- Interactive code preview before execution
Setting up with Highlight
This MCP is not yet compatible with Highlight’s one-click setup. However, you can still use it with Highlight by following these steps:
- Download and install Highlight from highlightai.com/download
- Navigate to the plugins tab and select "Add Custom Plugin"
-
Configure the plugin with the settings below
Plugin Name
Isaac Sim MCP Extension and MCP ServerCommand (node, npx, python, etc.)Please refer to the README for specific instructions on how to obtain API keys or other required environment variables.
- Enable "Start Automatically" if you want the plugin to start when Highlight launches
From the repository
Install the extension in NVIDIA Isaac Sim 4.2.0+ by cloning the repository and enabling it via the Isaac Sim launcher. Run the MCP server using uv run server.py, then configure it as a global MCP server in Cursor AI editor. Use natural language prompts in Agent mode to control simulations.
Claude Desktop / Cursor
Paste into your MCP client config file to install this server.
{
"mcpServers": {
"isaac sim mcp extension and mcp server": {
"isaac-sim-mcp": {
"command": "uv",
"args": [
"run",
"mcp",
"dev",
"~/Documents/isaac-sim-mcp/isaac_mcp/server.py"
]
}
}
}
}McpServers
{
"isaac-sim-mcp": {
"command": "uv",
"args": [
"run",
"mcp",
"dev",
"~/Documents/isaac-sim-mcp/isaac_mcp/server.py"
]
}
}Isaac Sim MCP Extension and MCP Server
The MCP Server and its extension leverage the Model Context Protocol (MCP) framework to enable natural language control of NVIDIA Isaac Sim, transforming conversational AI inputs into precise simulation manipulation. This expansion bridges the MCP ecosystem with embodied intelligence applications.
Features
- Natural language control of Isaac Sim
- Dynamic robot positioning and movement
- Custom lighting and scene creation
- Advanced robot simulations with obstacle navigation
- Interactive code preview before execution
Requirements
- NVIDIA Isaac Sim 4.2.0 or higher
- Python 3.9+
- Cursor AI editor for MCP integration
Mandatory Pre-requisite
- Install uv/uvx: https://github.com/astral-sh/uv
- Install mcp[cli] to base env: [uv pip install "mcp[cli]"](https://pypi.org/project/mcp/)
Installation
cd ~/Documents
git clone https://github.com/omni-mcp/isaac-sim-mcp
Install and Enable Extension
Isaac Sim extension folder should point to your project folder:
- Extension location: ~/Documents/isaac-sim-mcp
- Extension ID: isaac.sim.mcp_extension
```bash
Sign in to leave a review
Use Google, GitHub, or an email account so ratings stay tied to real people.
No reviews posted yet.
