Releases
v0.18.0
Compare
Sorry, something went wrong.
No results found
Ehesp
released this
02 Nov 01:30
0.18.0 (2026-11-02)
⚠ BREAKING CHANGES
ui: print reeval run's results as a per-eval status list (#765 )
results: show a lift's direction at any number of runs (#762 )
Features
judge: show c.observe values to judges and questions, in compare and the studio (#743 ) (99af246 )
record non-gating attempt values with c.observe (#741 ) (cdb582f )
results: compare each variant with its baseline on every measure (#764 ) (a82029b )
results: show a lift's direction at any number of runs (#762 ) (74eb5e9 )
ui: print reeval run's results as a per-eval status list (#765 ) (b9af22c )
Bug Fixes
analysis: default maxOutputTokens to 32000 and name the option on a cut-off (#747 ) (8ed883b )
assert: back toHaveEdited with the files each turn changed (#763 ) (9e05dcf )
capture: give the date format hint only while a date or time field has focus (#744 ) (862741a )
capture: make vision journeys hold up on scrolled pages, frames and late content (#740 ) (fd66d32 )
ci: drop retired Claude 4.0 ids and fail docs:check on retired Claude models (#754 ) (321fcd1 )
ci: retire claude-sonnet-4-5 and refuse claude code's sonnet alias on vertex (#761 ) (c90e09d )
ci: run claude code's contract rows on claude-haiku-5-5 and the plan cases on claude-sonnet-5-5 (#757 ) (e432bd5 )
cli: keep the attempts a filtered resume leaves out, and the run incomplete (#753 ) (eb077b3 )
cli: make --resume plan with the run's own --runs, profile, filters and concurrency (#749 ) (416df31 )
docs: skip changelog and captured data in the retired-model guard and catch Bedrock and claude-4-sonnet forms (#755 ) (29c0aef )
evaluate: mask secrets in eval, group and todo names, and refuse names that mask alike (#752 ) (d491f0d )
history: hash evaluate.each case data with its secrets masked (#756 ) (d711952 )
history: mark declared skips in the record so a filtered resume counts them as done (#758 ) (0b82b71 )
observe: mask observation names and refuse two that mask the same (#748 ) (8f414d8 )
sandbox: turn off npm's and pnpm's update checks in the container (#760 ) (f846a1d )
serve: refuse a given port that was already in use before c.serve started (#746 ) (36c1707 )
You can’t perform that action at this time.