Open Computer Use

[!TIP] Interested in Browser Use? Check outopen-browser-use.

This project was inspired by OpenAI'sCodex Computer Use. It showed that non-intrusive CUA can be built on top of Accessibility, so I decided to build an open-source version.

I started this repo with myharness template, a template for quickly spinning up AI-first projects. It has been one of our most useful workflows lately, especially for nearly 100% AI-generated projects. I also wrotea postabout the methodology behind it.

https://github.com/user-attachments/assets/eacb3b15-f939-46c7-b3b3-6f876977a58d

https://github.com/user-attachments/assets/e036b1c8-2200-4896-abd4-19225915cf66

[!IMPORTANT] The macOS runtime requires macOS 14.0 or later.

On macOS, run it once and grantAccessibilityandScreen Recording. Windows and Linux do not need this step.

Before using it, install it into your agent:

# Install into Codex by writing to ~/.codex/config.toml open-computer-use install-codex-mcp

{ "mcpServers": { "open-computer-use": { "command": "open-computer-use", "args": ["mcp"] } } }

# Install for Codex npx skills add iFurySt/open-codex-computer-use -g -a codex --skill open-computer-use -y npx skills ls -g -a codex | rg 'open-computer-use'

npx skills add iFurySt/open-codex-computer-use -g -a claude-code --skill open-computer-use -y

Update an existing global install, including the Codex install created above:

npx skills update open-computer-use -g -y

You can also manually download and install theopen-computer-useskill.

# Install into Codex by writing to ~/.codex/config.toml open-computer-use install-codex-mcp ocu install-codex-mcp # Install as a Codex plugin, mainly for Codex App open-computer-use install-codex-plugin # Install into Claude Code by writing to ~/.claude.json open-computer-use install-claude-mcp # Install into Gemini CLI for the current project by writing to ./.gemini/settings.json open-computer-use install-gemini-mcp # Install into Gemini CLI user config instead open-computer-use install-gemini-mcp --scope user # Install into opencode by writing to ~/.config/opencode/opencode.json (or the active config file) open-computer-use install-opencode-mcp # Call a single Computer Use tool and print the MCP-style JSON result open-computer-use call list_apps ocu call list_apps open-computer-use call get_app_state --args '{"app":"TextEdit"}' # Run a sequence in one process so element_index state can be reused # Sequence runs sleep 1s between successful operations by default open-computer-use call --calls '[{"tool":"get_app_state","args":{"app":"TextEdit"}},{"tool":"press_key","args":{"app":"TextEdit","key":"Return"}}]' open-computer-use call --calls-file examples/textedit-overlay-seq.json --sleep 0.5 # Check permissions; onboarding only opens when something is missing open-computer-use doctor # Run local validation from a source checkout make smoke OPEN_COMPUTER_USE_STRESS_LOOPS=20 make stress make agent-smoke make agent-smoke SCENARIO=fixture-full node ./scripts/run-agent-smoke-tests.mjs --agents=claude,codex --command=open-computer-use node ./scripts/run-agent-smoke-tests.mjs --scenario=fixture --agents=claude,codex --command=open-computer-use node ./scripts/run-agent-smoke-tests.mjs --scenario=fixture-full --agents=claude,codex --command=open-computer-use OPEN_COMPUTER_USE_HERMES_PROVIDER=anthropic OPEN_COMPUTER_USE_HERMES_MODEL=claude-opus-4-20250514 make agent-smoke AGENTS=hermes SCENARIO=fixture-full node ./scripts/run-agent-smoke-tests.mjs --agents=hermes --hermes-provider=anthropic --hermes-model=claude-opus-4-20250514 node ./scripts/run-agent-smoke-tests.mjs --scenario=fixture --agents=hermes --hermes-provider=anthropic --hermes-model=claude-opus-4-20250514 node ./scripts/run-agent-smoke-tests.mjs --scenario=fixture-full --agents=hermes --hermes-provider=anthropic --hermes-model=claude-opus-4-20250514 --hermes-max-turns=12 # Show help open-computer-use -h ocu -h

Cursor Motion is an open-source cursor motion system for macOS, based on public information shared by members of the Software.Inc team. You can download the app from theReleases page.

MIT. Third-party attribution is listed inTHIRD_PARTY_NOTICES.md.

Control Chrome with debugging capabilities, userscript injection, and extension support.