Skip to content

ScreenCue 0.1.0 - Agent hints over your desktop

Pre-release
Pre-release

Choose a tag to compare

@CrioNIK CrioNIK released this 16 Oct 23:15

First preview of ScreenCue: an agent can point to a control directly over the current desktop.

  • Large animated SKETCH arrow with four hand-drawn frames and adaptive contrast that prefers red.
  • Independent ellipse, rectangle, rounded rectangle, or polygon target outline, with a gap before the arrow tip.
  • Click-through hints that retain no keyboard focus and remain until cleared or hidden with Ctrl+Alt+X (Ctrl+Option+X on macOS).
  • Local tracking of the original window, with a labeled edge cue when the target is offscreen or the window is minimized. Scrolling, layout changes, and resizing require refreshed coordinates.
  • Local stdio MCP and newline-delimited JSON for other agents. Screen observation and voice belong to the host client.
  • Native binary with no Rust, Node.js, .NET, or browser runtime required.

This is an older preview. Use the newest release for English runtime labels and the complete native client integration packages.

Download your platform archive, extract it, and run screencue demo (.\screencue.exe demo in Windows PowerShell). See the integration guide.

Windows x64; macOS Apple Silicon or Intel with macOS 12.3+; Linux x64 with X11 and a compositor. Local macOS color sampling requires macOS 15.2+ and existing screen-recording permission. Native Wayland is not supported. Protected desktops and some fullscreen applications may limit overlays.

All four builds passed CI. Live desktop and MCP checks were performed on Windows; macOS/Linux desktop interaction and each AI client require separate validation. Binaries are unsigned. SHA-256 checksums are in SHA256SUMS.txt. Code is MIT licensed; IBM Plex Mono is SIL OFL 1.1.