ScreenClaw-v0.1.6

screenclaw v0.1.6

更新功能

1. 桌面级截图+操作

• 直接对桌面截图和操作，不绑定进程，可操作桌面图标、任务栏、开始菜单等任何可见内容
• 支持多显示器，每个显示器独立坐标空间，支持跨屏拖拽
• 操作方式与窗口级一致，共用网格绘制和百分比坐标体系

2. 录制+沉淀场景

• 人工带跑：通过快捷键或托盘菜单启动录制，人工操作，后台自动捕获每步截图、坐标和操作类型
• AI 沉淀：调用 screenclaw 技能，给出录制产物文件夹（程序根目录 record 下），让 AI 将产物沉淀为场景模板

3. 沉淀复用

• AI 操作+AI 沉淀：AI 自动操作完后，支持将成功的任务流程沉淀为场景模板，下次直接复用。也可以优化历史模板
• 坐标适配检测：使用模板时，若应用尺寸与模板不符，支持按比例调整坐标，尝试复用

4. 优化技能

• 更新 Skill 文档，新增桌面级 API 文档。新增录制转场景模板的沉淀流程文档和模板规范。

更新说明

1. 下载最新程序包，解压并覆盖历史文件。
2. 双击运行screenclaw.exe
3. 更新技能：npx skills update https://github.com/ginsing1226/screenclaw -y-g

---

screenclaw v0.1.6

What's New

1. Desktop-Level Capture & Control

• Capture and operate directly on the desktop without binding to any process — control desktop icons, taskbar, Start menu, and any visible content
• Multi-monitor support with independent coordinate spaces per display, including cross-monitor dragging
• Shares the same grid rendering and percentage coordinate system as window-level operations

2. Record & Distill Scenarios

• Manual walkthrough: Start recording via hotkey or tray menu, perform operations manually, and the backend automatically captures per-step screenshots, coordinates, and action types
• AI distillation: Invoke the screenclaw skill, provide the recording output folder (under the program's record/ directory), and let AI distill it into a scenario template

3. Knowledge Accumulation & Reuse

• AI operation + AI distillation: After AI completes a task automatically, save the successful workflow as a scenario template for next-time reuse, or refine existing templates
• Coordinate adaptation: When reusing a template, if the application size differs, coordinates can be proportionally adjusted for attempted reuse

4. Skill Improvements

• Updated Skill documentation with new desktop-level API docs. Added recording-to-scenario distillation workflow documentation and template specification.

Update Instructions

1. Download the latest package, extract and overwrite existing files.
2. Double-click to run screenclaw.exe.
3. Update the skill: npx skills update https://github.com/ginsing1226/screenclaw -y-g