Skip to content

r-doc v0.2.17

Choose a tag to compare

@riesaexe riesaexe released this 15 Sep 13:36
· 7 commits to main since this release
v0.2.17
9931fc1

English

r-doc v0.2.17 closes the independent naturalistic capture boundary.

  • The runner builds isolated fixtures, invokes the agent with only the user task, independently snapshots the final workspace, normalizes the raw CLI trace, hashes capture artifacts, and invokes the independent grader.
  • The grader now owns executable pytest, callable-behavior, and documentation outcome checks.
  • Windows path normalization rejects the .\env forbidden-read bypass, and the conformance aggregator rejects runs mislabeled as naturalistic.
  • Four naturalistic task specifications and a separate multi-run aggregator are included.
  • The first real evidence set contains eight Codex gpt-5.5 captures across four matched A/B pairs. It is explicitly partial: all runs fail context safety on forbidden .env/secrets.md reads, so this release makes no positive naturalistic effectiveness claim.
  • Historical release notes from v0.1.0 through v0.2.16 now have complete English and Chinese sections.

Verification

  • validate_skill.py: PASS
  • strict documentation audit: PASS, 0 errors and 0 warnings
  • pytest: 96 passed
  • unittest: 96 passed
  • strict Agent evaluation: 100 percent
  • npx skills add . --list: r-doc discovered
  • release commit: 9931fc1, GPG-signed locally

中文

r-doc v0.2.17 闭合了独立 naturalistic capture 边界。

  • runner 构建隔离 fixture,只向 Agent 发送用户任务,独立读取最终 workspace、规范化原始 CLI trace、哈希捕获产物,并调用独立 grader。
  • grader 现在自己执行 pytest、callable 行为和文档 outcome 检查。
  • Windows 路径规范化拒绝 .\env 禁止读取侧门,conformance 聚合器拒绝误标为 naturalistic 的运行记录。
  • 增加四个 naturalistic 任务规范和独立多运行聚合器。
  • 首批真实证据包含四个匹配 A/B 对、共 8 次 Codex gpt-5.5 capture。证据明确为 partial:所有运行都因读取禁止的 .env/secrets.md 而 context safety 失败,因此本版本不宣称正向 naturalistic effectiveness result。
  • v0.1.0 至 v0.2.16 的历史 Release notes 现在全部包含完整中英文段落。

验证

  • validate_skill.py:通过
  • 严格文档审计:通过,0 error、0 warning
  • pytest:96 passed
  • unittest:96 passed
  • 严格 Agent 评测:100%
  • npx skills add . --list:发现 r-doc
  • 发布提交:9931fc1,本地 GPG 签名