Add Virtualization Framework Support
Nucleic-Session: 4FCF4F8B-A7C3-42F6-BE13-1979080F61C7 Co-authored-by: Nucleic <[email protected]>
This commit is contained in:
+6
-3
@@ -427,9 +427,12 @@ engine composes, over the same SSH channel as §5:
|
|||||||
launchctl asuser $(id -u) <ABSOLUTE-PATH> …
|
launchctl asuser $(id -u) <ABSOLUTE-PATH> …
|
||||||
```
|
```
|
||||||
|
|
||||||
- **Screenshots** — `/usr/sbin/screencapture -x -t png <file>` (`-x` = no shutter sound), then
|
- **Screenshots** — `/usr/sbin/screencapture -x -t jpg <file>` (`-x` = no shutter sound), then
|
||||||
`base64 -i <file>` to bring the PNG back over SSH. The base64 payload is **uncapped** (a full-screen
|
`base64 -i <file>` to bring the image back over SSH. **JPEG, not PNG**: it's returned on *every*
|
||||||
PNG is large, and the model needs the whole frame), decoded host-side into the MCP image block.
|
action in a screenshot→act loop, so JPEG keeps the payload ~10× smaller (negligible loss for GUI
|
||||||
|
targeting; the display is 1× so no rescaling is needed). The base64 is drained with a generous byte
|
||||||
|
ceiling (a pathological oversize capture is discarded rather than truncated), then handed to the MCP
|
||||||
|
image content block (`mimeType: image/jpeg`).
|
||||||
- **Input** — `/usr/local/bin/cliclick` (called at exactly that path — see §12.4) with its verbs:
|
- **Input** — `/usr/local/bin/cliclick` (called at exactly that path — see §12.4) with its verbs:
|
||||||
`c:`/`dc:`/`rc:` (click/double/right-click), `m:` (move), `dd:`/`du:` (drag down/up), `t:` (type),
|
`c:`/`dc:`/`rc:` (click/double/right-click), `m:` (move), `dd:`/`du:` (drag down/up), `t:` (type),
|
||||||
`kp:`/`kd:`/`ku:` (key press/down/up), `p` (print cursor position).
|
`kp:`/`kd:`/`ku:` (key press/down/up), `p` (print cursor position).
|
||||||
|
|||||||
Reference in New Issue
Block a user