sam-ui v0.4.0

sam-ui 0.4.0: agents that work alongside you, Find in clip, and a faster SAM 3. macOS 14 or newer, Apple Silicon (M1 or later); 16 GB of memory recommended, and needed for SAM 3. The browser demo needs WebGPU; it's tested in Chrome, Firefox and Safari. After Effects export needs AE MCP Vision v2.2.0.

• Agents (MCP), off by default. Claude Code, Codex or any MCP client can drive sam-ui: open a video, click or describe objects, track, review, capture frames with the masks drawn on, and export. Turn it on with Agents > Allow agents (MCP). The server listens on 127.0.0.1:8793 only, wants the bearer token in ~/.sam-ui/token, and refuses requests from web pages. (#55)
• Agents work in your view. On the video you have open, an agent's clicks, tracks and review marks show up as they happen. Its tracks fill the timeline lane like yours. An Agent chip names each change and lists the last 20 with Go to, and studio's normal undo undoes an agent's click. An agent can also read the frame and layer you're on, so you can ask it about what you're looking at. Changes on other videos raise a toast with Open. (#75, #73)
• Find in clip. With SAM 3, describe an object and sam-ui looks for it across the whole clip. Each appearance becomes a candidate range in the Review queue, so an object that leaves and comes back is two candidates. It writes no seeds and makes no track stale. (#50)
• SAM 3 at half precision on Apple Silicon. About 40% faster, with the app's worst case down from 6.9 to 6.1 GB. Masks stay within 0.96 IoU of full precision on every frame. Set SAM_UI_SAM3_DTYPE=fp32 to go back. (#57)
• Track finished notifications, opt-in. sam-ui > Notify When a Track Finishes shows a system notification when a track ends while sam-ui isn't in front, failures included. Clicking it opens that track's first review stop. (#53, #74)
• Edits that skip the model. Marking an absent range that only shortens a tracked stretch no longer re-tracks the window around it. (#56)
• Renaming. Rename an object from its timeline lane, and a group from its Actions menu on phones and tablets. (#47, #66)
• Keyboard and touch. The Layers list is one Tab stop: Up and Down select layers, and Shift+F10 or a right-click opens a layer's lane actions. Group buttons stay visible on phones. (#63, #51)
• After Effects footage. Linked footage can be removed from Media without touching the file. ProRes and other footage the browser can't play previews through a frame-exact H.264 proxy, while tracking and export read the original. Footage is re-hashed before export, and variable frame rate footage is refused (conform it first). (#48, #54, #52)
• More browsers. The browser demo now works in Firefox 157, about 2.4 times slower than Chrome, and tracks in Safari 27 (tested through Safari's automation). It no longer crashes WebKit on reload, and the Android Chrome preview no longer goes blank. (#64, #65, #49, #61)
• Reliability. A read during a save can no longer break the track store, and retention works when the data folder sits behind a symlink. (#58, #59)
• The app stays intact after first launch. The bundled backend no longer writes Python cache files inside the app, which broke its code signature after the first run. (#72)
• Measured hardware figures. The hardware table is now measured on an M4 Max, for SAM 2.1 large and tiny and SAM 3 at both precisions. (#60)

Unsigned build: macOS may ask you to approve the app in System Settings > Privacy & Security on first launch. See desktop/README.md for installation steps.