Skip to content

v0.18.0

Choose a tag to compare

@Ehesp Ehesp released this 02 Nov 01:30
845838e

0.18.0 (2026-11-02)

⚠ BREAKING CHANGES

  • ui: print reeval run's results as a per-eval status list (#765)
  • results: show a lift's direction at any number of runs (#762)

Features

  • judge: show c.observe values to judges and questions, in compare and the studio (#743) (99af246)
  • record non-gating attempt values with c.observe (#741) (cdb582f)
  • results: compare each variant with its baseline on every measure (#764) (a82029b)
  • results: show a lift's direction at any number of runs (#762) (74eb5e9)
  • ui: print reeval run's results as a per-eval status list (#765) (b9af22c)

Bug Fixes

  • analysis: default maxOutputTokens to 32000 and name the option on a cut-off (#747) (8ed883b)
  • assert: back toHaveEdited with the files each turn changed (#763) (9e05dcf)
  • capture: give the date format hint only while a date or time field has focus (#744) (862741a)
  • capture: make vision journeys hold up on scrolled pages, frames and late content (#740) (fd66d32)
  • ci: drop retired Claude 4.0 ids and fail docs:check on retired Claude models (#754) (321fcd1)
  • ci: retire claude-sonnet-4-5 and refuse claude code's sonnet alias on vertex (#761) (c90e09d)
  • ci: run claude code's contract rows on claude-haiku-5-5 and the plan cases on claude-sonnet-5-5 (#757) (e432bd5)
  • cli: keep the attempts a filtered resume leaves out, and the run incomplete (#753) (eb077b3)
  • cli: make --resume plan with the run's own --runs, profile, filters and concurrency (#749) (416df31)
  • docs: skip changelog and captured data in the retired-model guard and catch Bedrock and claude-4-sonnet forms (#755) (29c0aef)
  • evaluate: mask secrets in eval, group and todo names, and refuse names that mask alike (#752) (d491f0d)
  • history: hash evaluate.each case data with its secrets masked (#756) (d711952)
  • history: mark declared skips in the record so a filtered resume counts them as done (#758) (0b82b71)
  • observe: mask observation names and refuse two that mask the same (#748) (8f414d8)
  • sandbox: turn off npm's and pnpm's update checks in the container (#760) (f846a1d)
  • serve: refuse a given port that was already in use before c.serve started (#746) (36c1707)