Skip to main content
Record the screen and what was clicked, then decide who drives the live view: the agent, a person, or both.

Record what happens

start_recording returns rec_id, status, bytes, and duration_ms. include chooses what to record. Omit it to record everything: window_id records one window. 0 records the whole screen. label is a name you can filter on later. dir overrides where the MP4 and trajectory artifacts land in the guest — an absolute path, created if missing; omit it for the platform default. Download the MP4 with recording_video (recordVideo in TypeScript) — it is playable while the recording is still running. The trajectory JSONL records input events and marks — sensitive text is represented by length/redacted metadata, never verbatim keystrokes.
recordings lists every recording — active first, then completed newest-first. An input-only recording (include: ["input"]) produces a trajectory without a video path.

Hand control to a person

set_control_mode sets the live-view takeover mode, also reported as control_mode on desktop.status/desktop.info: While the mode is human, input calls return 400; screenshots, snapshots, and status keep working so the agent can still observe.
Pair this with a live view URL: mint the view, switch to human so the operator can intervene, then return to shared when they hand control back.

Endpoints