Repository navigation
v0.6.1
v0.6.1 (2026-06-12)
This release is published under the MIT License.
Bug Fixes
- Opencode non-cached input semantics + LLM grader retry on dropped assertions (
f0939bc)
OpenCode reports input_tokens excluding cache reads (live runs show cached consistently larger than input), so the codex-style subtraction clamped non_cached_input_tokens to a bogus 0 and capped cached_pct at 100%. Override the split like claude-code.
The LLM judge intermittently drops an assertion from its JSON answer, which skipped the assertion and failed strict e2e runs. Retry once with only the dropped assertions before skipping; matched results are now also deduplicated and filtered to the requested assertions so a retry cannot double-count.
Co-Authored-By: Claude Fable 5 noreply@anthropic.com
- Tolerate malformed judge rows, correct cached_pct denominator (review feedback) (
45b2677)
A malformed individual result row (non-dict, missing keys, non-string text) now only loses that row — its assertion goes to the retry instead of crashing the whole attempt and skipping everything.
cached_pct now divides by non_cached + cached, the only denominator valid for both reporting styles; cached / max(input, cached) showed a bogus 100% for claude-code/opencode.
Co-Authored-By: Claude Fable 5 noreply@anthropic.com
Detailed Changes: v0.6.0...v0.6.1