Skip to content

OpenAllay v0.4.1

Choose a tag to compare

@github-actions github-actions released this 04 Oct 08:41
· 1035 commits to main since this release

OpenAllay v0.4.1

English

OpenAllay 0.4.1 adds proactive world observation and clearer image references, and fixes native clipboard image decoding.

The Agent can look when the task needs it

  • Read current focus, hit targets, held items, camera and known game-UI facts with world.focus().
  • Request a fresh world or native game-UI image with world.capture(...). World images exclude the Guide and 2D HUD; associated UI images keep the original input's source and time.
  • Send actual Tool images to the next model turn while preserving their original Tool identity in context, history and exports. Server-provided models use the existing client Tool route.
  • Native completion waiting no longer spends the JavaScript execution budget. Script execution, parameter decoding and result handling still remain budgeted.

Supporting references and image details

  • Refresh or remove the input focus reference, attach/remove a current world frame, and inspect real Tool images in the detail drawer.
  • Open Guide from native menus using your configured key. Focused text widgets retain normal key handling.
  • Send an image-only reference without filler text or a duplicate ordinary attachment. Queued Follow-up edits, Steer and Retry retain each input's own reference.
  • Draft text and ordinary attachments remain intact during capture, screen rebuild and reopening.

Clipboard repair

  • Fix macOS image decoding being reported unavailable after a successful decode. Improve native image-format and copied local-image-file handling.
  • Keep image decoding and clipboard ownership cleanup on their proper paths, including cancellation and executor rejection.

Compatibility and validation

  • Supports Minecraft 26.2, Java 25, Fabric and NeoForge. Image input depends on the configured model's supported capabilities.
  • Product version 0.4.1; public Extension API 0.2.2; bundled Minecraft Builder 0.2.1. Existing Builder 0.4.x compatibility covers this patch release.
  • Verified common and Builder tests, both loader builds/package checks, actual initialized clients, current-frame pixel equality, client/server-model Tool-image transport and native reference/detail interactions on both loaders.
  • Broader Minecraft compatibility, including modpack-heavy older versions, is separate work. This release does not claim unverified game-version support.
  • Before upgrading, back up configurations and session history. Pre-1.0 internal formats are latest-only; incompatible older files are preserved, not automatically migrated.

简体中文

OpenAllay 0.4.1 加入主动世界观察与更清晰的图片参考,并修复原生剪贴板图片解码。

Agent 可按任务需要观察

  • 通过 world.focus() 读取实时焦点、命中目标、手持物品、相机及已知游戏界面信息。
  • 通过 world.capture(...) 获取新的世界或原生游戏界面画面。世界画面不包含 Guide 和二维 HUD;关联界面画面保留原输入的来源与时间。
  • 将真实工具图片送入下一轮模型请求,并在上下文、历史和导出中保留原工具身份。服务器模型复用现有客户端工具通路。
  • 原生操作的完成等待不再消耗 JavaScript 执行预算;脚本执行、参数解析与结果处理仍受预算约束。

辅助参考与图片详情

  • 可刷新或移除焦点参考、附加或移除当前世界画面,并在详情抽屉中查看真实工具图片。
  • 从原生菜单使用已配置的快捷键打开 Guide;文本控件保持正常的键盘优先处理。
  • 可仅发送图片参考,不添加虚构文字或重复普通附件。排队跟进的编辑、引导和重试保留各自输入的原始参考。
  • 捕获、界面重建和重新打开时保留草稿文本与普通附件。

剪贴板修复

  • 修复 macOS 图片解码成功后仍被报告为不可用的问题,完善原生图片格式与复制本地图片文件的处理。
  • 正确处理图片解码和剪贴板资源释放,包括取消和执行器拒绝路径。

兼容性与验证

  • 支持 Minecraft 26.2、Java 25、Fabric 与 NeoForge。图片输入取决于所配置模型的实际能力。
  • 本体版本 0.4.1;公共 Extension API 0.2.2;内置 Minecraft Builder 0.2.1,现有 0.4.x 本体兼容范围涵盖本次补丁版本。
  • 已验证 common 与 Builder 测试、双加载器构建和打包,以及两端真实初始化客户端、同帧像素对照、客户端/服务器模型工具图片通路和原生参考/详情交互。
  • 更宽的 Minecraft 版本兼容(包括整合包丰富的旧版本)是独立推进的工作;本次发布不宣称尚未验证的游戏版本支持。
  • 升级前请备份配置和会话历史。1.0 前内部格式仅维护最新形态;不兼容的旧文件会保留,不会自动迁移。

Full changelog: v0.4.0...v0.4.1