Skip to content

v0.6.1

Choose a tag to compare

@github-actions github-actions released this 12 Jun 05:21
· 3 commits to main since this release

v0.6.1 (2026-06-12)

This release is published under the MIT License.

Bug Fixes

  • Opencode non-cached input semantics + LLM grader retry on dropped assertions (f0939bc)

OpenCode reports input_tokens excluding cache reads (live runs show cached consistently larger than input), so the codex-style subtraction clamped non_cached_input_tokens to a bogus 0 and capped cached_pct at 100%. Override the split like claude-code.

The LLM judge intermittently drops an assertion from its JSON answer, which skipped the assertion and failed strict e2e runs. Retry once with only the dropped assertions before skipping; matched results are now also deduplicated and filtered to the requested assertions so a retry cannot double-count.

Co-Authored-By: Claude Fable 5 noreply@anthropic.com

  • Tolerate malformed judge rows, correct cached_pct denominator (review feedback) (45b2677)

A malformed individual result row (non-dict, missing keys, non-string text) now only loses that row — its assertion goes to the retry instead of crashing the whole attempt and skipping everything.

cached_pct now divides by non_cached + cached, the only denominator valid for both reporting styles; cached / max(input, cached) showed a bogus 100% for claude-code/opencode.

Co-Authored-By: Claude Fable 5 noreply@anthropic.com


Detailed Changes: v0.6.0...v0.6.1