Skip to content

1.0

Choose a tag to compare

@lopadova lopadova released this 04 May 21:50
· 140 commits to main since this release

padosoft/eval-harness 1.0

Roadmap is now fully complete for the v1.0 slice. This release includes:

  • Stable core contracts for Metric, EvalReport, JSON report schema, batch execution, command surface, queue jobs, and report API resources.
  • Parallel batch execution (SerialBatch, LazyParallelBatch) with --batch=serial and --batch=lazy-parallel.
  • Adversarial lane with regression manifests, eval-harness:adversarial, --regression-gate, and --promote-failures.
  • Read-only report API for list/show, cohorts, histograms, CSV export, and artifact download.
  • Contract stability and migration docs for pre-1.0 users.

For package compatibility details and usage, see:

  • docs/CONTRACT_STABILITY.md
  • docs/MIGRATION_FROM_PRE_1_0.md
  • docs/REPORT_API_CONTRACT.md
  • README.md