Eyes and hands on the real Windows desktop, for Claude Code.

desk-pilot sees the actual screen, reads each window’s controls and drives the real mouse and keyboard. It does it with three tools, on purpose: every tool schema costs tokens.

3 tools
Windows 10 2004+ / 11
MIT

What the setup does

Run the downloaded file and follow the wizard.

Checks that Claude Code (claude) and Node.js 22.19 or newer are installed.
Runs claude plugin marketplace add acus9345/desk-pilot and claude plugin install desk-pilot@desk-pilot for you.
Start a new Claude Code session afterwards to load it. Uninstalling removes the plugin.

Other ways to install

From a terminal

claude plugin marketplace add acus9345/desk-pilot
claude plugin install desk-pilot@desk-pilot

Inside a claude session

/plugin marketplace add acus9345/desk-pilot
/plugin install desk-pilot@desk-pilot

What it does

From the project’s README.

`screen_view`

The live screen, one window or a region, as a real image with coordinate rulers. An unchanged frame isn’t sent again.

`desktop_control`

Click, drag, scroll, type, keys, focus, wait, move or resize windows, and read a window’s UI Automation controls.

`desktop_sequence`

Many actions in one call, checked step by step, with one frame at the end.

Controls, not pixels

Click a control by name or index. It is looked up again right before the click, and a disabled or stale one is refused.

Checked actions

Every input reports where it actually went, type reads the text back, and expect makes a step fail if the effect never shows.

You stay in charge

Risky batches need your approval, a banner shows while Claude acts, and Esc stops it between steps.

In the README’s measurement (2026-10-25), desk-pilot added +191 tokens per session with tool search on, against +327 for Windows-MCP. Full comparison ↗

Requirements

Windows 10 version 2004 or later, or Windows 11.
Claude Code, and Node.js 22.19 or newer on PATH.
Nothing else: the engine compiles itself with the C# compiler that ships with Windows (.NET Framework 4.x).