Skip to content

diff0 v0.1.2

Choose a tag to compare

@knowbody knowbody released this 03 Sep 21:08
7713476

A hardening release focused on making the public comparison guarantees match actual behavior.

What changed

  • Reject dirty local HEAD comparisons instead of silently testing uncommitted state.
  • Flag eval-harness changes and comparison-validity mismatches.
  • Detect checkout v7 persisted credentials and recover from stale PR comments.
  • Counterbalance AB/BA execution order to reduce order bias.
  • Clarify limitations, the default yellow verdict, and spend controls.
  • Improve website navigation, accessibility, metadata, and SEO.

Try it

npx @knowbody/diff0@0.1.2 run --base main

For GitHub Actions, pin knowbody/diff0/action@v0.1.2.

Validation

  • 321 unit tests and 6 integration tests
  • package install and CLI smoke test
  • minimum-supported Node 20 smoke test
  • Action bundle verification
  • production website build
  • 10-run-per-ref real-model dogfood comparison with no confirmed regression or comparison-validity mismatch