Skip to content

v0.14.0 - Attested eval evidence provenance

Choose a tag to compare

@lindixu6-hash lindixu6-hash released this 17 Aug 00:31

What shipped

  • A source-bound provenance-manifest.json covering repository/workflow identity, five trusted inputs, all 34 evidence files, and Eval Result counts.
  • A least-privilege producer job that executes the OpenAI Agents SDK eval, creates one deterministic tarball, and signs it with GitHub OIDC + Sigstore.
  • A separate reusable verifier pinned to immutable commit 8d4b435f66f58a570b65dd8b4952bf7e1e2dd62f.
  • The reusable workflow checks out verifier code pinned to the older immutable trust root 34b12355a27a647adfb5b09578234a19ee076f0f.
  • Every external Action in the producer/verifier chain is pinned to a full commit SHA.
  • Attestation verification enforces signer workflow, signer digest, source digest/ref, repository identity, and a GitHub-hosted runner.
  • Negative checks prove a modified bundle and wrong source digest fail verification.
  • Manifest verification rejects changed evidence, changed trusted inputs, source-identity mismatches, and any failing Eval Result.
  • Complete English and Simplified Chinese provenance documentation and web evidence.
  • 141 deterministic tests; npm package remains free of nested dependencies.

中文说明

  • 新增绑定源码的 provenance-manifest.json,覆盖仓库/Workflow 身份、5 个可信输入、全部 34 个证据文件与 Eval Result 计数。
  • 最小权限 Producer Job 执行 OpenAI Agents SDK Eval、生成一个确定性 Tarball,并使用 GitHub OIDC + Sigstore 签名。
  • 独立 Reusable Verifier 锁定到不可变 Commit 8d4b435f66f58a570b65dd8b4952bf7e1e2dd62f
  • Reusable Workflow 检出锁定到更早不可变信任根 34b12355a27a647adfb5b09578234a19ee076f0f 的 Verifier 代码。
  • Producer/Verifier 链路中的全部外部 Action 均锁定完整 Commit SHA。
  • Attestation 验证会约束 Signer Workflow、Signer Digest、Source Digest/ref、仓库身份与 GitHub 托管 Runner。
  • 负向检查证明被修改的 Bundle 与错误 Source Digest 无法通过验证。
  • Manifest Verifier 会拒绝被修改的证据、可信输入变化、Source Identity 不一致与任意失败 Eval Result。
  • 提供完整中英文 Provenance 文档与网页证据。
  • 141 项确定性测试通过;npm 包仍无嵌套依赖。

Verified release evidence

Explicit limitation / 明确限制

The repository main branch was not protected when this evidence was generated. This attestation proves workflow, commit, runner, and artifact identity; it does not prove independent code review, semantic correctness, SLSA level, or general Agent safety.

生成该证据时,仓库 main 分支没有 Branch Protection。Attestation 能证明 Workflow、Commit、Runner 与 Artifact 身份,但不能证明独立代码审核、语义正确性、SLSA 等级或 Agent 普遍安全。