mcp-server-macos-use

Official website: https://macos-use.dev/

Model Context Protocol (MCP) server in Swift. It allows controlling macOS applications by leveraging the accessibility APIs, primarily through the MacosUseSDK.

You can use it in Claude Desktop or other compatible MCP-client.

The server listens for MCP commands over standard input/output (stdio) and exposes several tools to interact with applications.

https://github.com/user-attachments/assets/cd203171-bac6-4124-9a58-59947a25be07

https://github.com/user-attachments/assets/f274560a-559f-4140-b133-c0b5c500a02d

Available Tools

The server exposes the following tools via the CallTool MCP method:

1. macos-use_open_application_and_traverse
Description: Opens or activates a specified application and then traverses its accessibility tree.
Parameters:
identifier (String, Required): The application's name, bundle ID, or file path.

2. macos-use_click_and_traverse
Description: Simulates a mouse click at specific coordinates within the window of the target application (identified by PID) and then traverses its accessibility tree.
Parameters:
pid (Number, Required): The Process ID (PID) of the target application.
x (Number, Required): The X-coordinate for the click (relative to the window/screen, depending on SDK behavior).
y (Number, Required): The Y-coordinate for the click.

3. macos-use_type_and_traverse
Description: Simulates typing text into the target application (identified by PID) and then traverses its accessibility tree.
Parameters:
pid (Number, Required): The Process ID (PID) of the target application.
text (String, Required): The text to be typed.

4. macos-use_press_key_and_traverse
Description: Simulates pressing a specific keyboard key (e.g., 'Enter', 'Tab', 'a', 'B') with optional modifier keys held down, targeting the application specified by PID, and then traverses its accessibility tree.
Parameters:
pid (Number, Required): The Process ID (PID) of the target application.
keyName (String, Required): The name of the key (e.g., Return, Escape, ArrowUp, Delete, a, B). Case-sensitive for letters if no modifiers are active.
modifierFlags (Array<String>, Optional): An array of modifier keys to hold during the press. Valid values: CapsLock (or Caps), Shift, Control (or Ctrl), Option (or Opt, Alt), Command (or Cmd), Function (or Fn), NumericPad (or Numpad), Help.

5. macos-use_refresh_traversal
Description: Only performs the accessibility tree traversal for the specified application (identified by PID). Useful for getting the current UI state without performing an action.
Parameters:
pid (Number, Required): The Process ID (PID) of the application to traverse.

Common Optional Parameters (for CallTool)

These can potentially be passed in the arguments object for any tool call to override default MacosUseSDK behavior (refer to ActionOptions in the code):

traverseBefore (Boolean, Optional): Traverse accessibility tree before the primary action.
traverseAfter (Boolean, Optional): Traverse accessibility tree after the primary action (usually defaults to true).
showDiff (Boolean, Optional): Include a diff between traversals (if applicable).
onlyVisibleElements (Boolean, Optional): Limit traversal to visible elements.
showAnimation (Boolean, Optional): Show visual feedback animation for actions.
animationDuration (Number, Optional): Duration of the feedback animation.
delayAfterAction (Number, Optional): Add a delay after performing the action.

MacosUseSDK (Assumed local or external Swift package providing macOS control functionality)

Building and Running

```bash