Skip to content

Agent ETA v0.7.0 — Frozen review targets and guarded holdout checks

Pre-release
Pre-release

Choose a tag to compare

@maxi-max-dev maxi-max-dev released this 11 Oct 00:41

Agent ETA v0.7.0 adds a reproducible review step for the existing empirical shadow candidate. Declare a fresh future window and exact workflow with gate-plan, then use gate to check saved paired forecasts against targets frozen before implementation.

  • Freeze scope, primary/baseline/candidate versions, and fixed error, severe-underestimate, coverage, interval-width, availability and sample-count targets.
  • Withhold accuracy metrics until the start window has ended and all in-scope tasks have closed. Reject invalid or future-dated evidence and mixed model versions.
  • Report every observed value and threshold. A numerically favorable result still requires independent review; no command promotes the candidate or changes the default estimator.
  • Preserve v0.6.0 evaluation/comparison output and the legacy CLI alias. Normalize macOS disconnected export pipes to the existing closed-output error.

Validation: 276 local tests passed; a fresh package installation verified the CLI/API, read-only behavior, fixed-clock determinism, unchanged v0.6.0 reports, missing-file behavior and package contents. All four Linux/Windows × Node 22/24 CI jobs passed on the published commit (CI evidence).

All new acceptance samples use synthetic data and controlled clocks. This is an experimental tooling release: it does not establish improved real-world accuracy, an independently collected holdout, or sufficient statistical power. The review targets are engineering screening criteria. Private databases and conversations are not included.

Protocols: candidate review targets · roadmap