Skip to content

v0.19.0

Choose a tag to compare

@Ehesp Ehesp released this 03 Nov 02:29
9f14243

0.19.0 (2026-11-03)

⚠ BREAKING CHANGES

  • sandbox: pull tart() images in reeval image build, never in a run (#784)
  • history: make an eval with cases one eval in records, views and the plan (#759)
  • cli: add reeval show --trace, a run's timeline for Perfetto, and drop run's --trace alias (#777)
  • authoring API groundwork (plural axes, compare.control, cases, where, --trait) (#745)

Features

  • authoring API groundwork (plural axes, compare.control, cases, where, --trait) (#745) (008f984)
  • cli: add reeval show --trace, a run's timeline for Perfetto, and drop run's --trace alias (#777) (4fdbb76)
  • cli: rerun a finished run's infra errors with reeval run --retry-errors (#785) (c93714b)
  • history: make an eval with cases one eval in records, views and the plan (#759) (c7f6608)
  • sandbox: add a tart() sandbox kind that plans and prepares macOS VMs, at most two at once (#774) (988a590)
  • sandbox: add the boat sandbox provider (#773) (3ff6bff)
  • sandbox: pull tart() images in reeval image build, never in a run (#784) (22d8a9f)
  • sandbox: run each tart() attempt in a cloned macOS VM over tart exec, with SSH as the fallback (#775) (39909ac)
  • ui: show an eval's case table live in the interactive list, five cases then all (#783) (625158e)
  • ui: spin while waiting, print failed checks as fails and tighten the compare block (#770) (d3a0961)

Bug Fixes

  • cli: keep a staged rerun and finish a killed --retry-errors on --resume (#788) (0dafda1)
  • sandbox: give boat attempts the start-up allowance a vm boot needs (#789) (b03708d)
  • ui: measure the prepare spinner in columns and finish the run output follow-ups (#781) (2808b8a)