Skip to content

v0.12.0

Choose a tag to compare

@Ehesp Ehesp released this 22 Oct 00:31
c241d0b

0.12.0 (2026-10-22)

⚠ BREAKING CHANGES

  • insights: classify and explain each eval at the end of reeval run (#451)
  • cli: scaffold an environment, add --bare and a docker check to init (#444)
  • compare: print reeval compare as the catch-regressions layout (#425)

Features

  • cli: scaffold an environment, add --bare and a docker check to init (#444) (3f97710)
  • compare: print reeval compare as the catch-regressions layout (#425) (185eb94)
  • environment: plugin builds (#437) (7f9e255)
  • environment: plugins input (#435) (9186e05)
  • harness: plugins on Claude Code and Grok Build (#439) (687e5a8)
  • init: set analysis.model in the generated config, warn in doctor when it's unset, and document insights and remarks (#459) (f4e5d1f)
  • insights: classify and explain each eval at the end of reeval run (#451) (5c21e46)
  • insights: write a recorded run's insights with reeval analyze --insights, and print them in reeval show (#426) (cfcd501)
  • mcp: time server start-up (#434) (1361bae)
  • plugins: plugin.marketplace, and plugins on Codex, Goose, Antigravity, Cursor, OpenCode, pi and fx (#455) (f0d9a9a)
  • remarks: end reeval run with deterministic remarks on the evals themselves (#450) (7aa8b27)
  • remarks: raise model remarks behind kind and quote gates, with the eval rubric, a flaky insight tier and a one-line skip (#460) (bd4ea8a)
  • test: enforce plan-case tier for eval options in CI (#376) (d0dade0)

Bug Fixes

  • claude-code: turn off AskUserQuestion so the next turn can start (#466) (25247be)
  • cursor: default fast to false so unpinned Cursor runs are standard-priced (#467) (0f3be6a)
  • history: serialize concurrent history.db syncs with begin immediate (#452) (74ae40b)
  • insights: refuse a headline that says all of a single result (#465) (f87d643)
  • release: open a release PR per package so a reeval-only release tags (#432) (3464ff6)
  • remarks: count a remark as seen only in a run that printed it, and find the default branch in ci (#457) (04d117c)
  • results: fence summary.md blocks past any backticks they carry (#454) (99fa22b)
  • sandbox: keep the diff's snapshot unreadable and free of pre-seed content (#438) (96129ee)
  • sandbox: run every exec with umask 022 (#456) (cebf376)
  • stats: mcnemar overflow, family rank ties, effort test direction and tied floor (#463) (7838776)
  • view: make SuiteResult agree with the exit code and list every check (#430) (243ad7b)