Skip to content

v1.2.0 - Report API completeness for companion UI

Choose a tag to compare

View all tags
@lopadova lopadova released this 06 May 06:06
v1.2.0
d848e3f

Highlights

  • Report diff endpoint: GET /<configured-prefix>/reports/{id}/diff/{otherId} with metric, cohort, sample-count, failure-count, and adversarial deltas.
  • Adversarial manifest discovery endpoints for configured manifest storage.
  • Live batch registry and progress endpoints backed by cache, with best-effort observability registration/cleanup.
  • Dataset trend endpoint with chronological points, metrics, cohorts, usage summaries, arbitrary report-prefix discovery, and configurable scan cap.
  • Companion UI package spec in docs/UI_PACKAGE_SPEC.md for the future optional padosoft/eval-harness-ui package.
  • README updated with the Eval Harness banner, v1.2 feature coverage, endpoint docs, and companion UI link.

Compatibility

  • All changes are additive for v1 consumers.
  • ReportApiSchema::VERSION remains eval-harness.report-api.v1.
  • New v1.2 endpoint payloads include per-payload schema discriminators.

Quality Gates

  • Local release gate on d848e3f: composer validate --strict, PHPUnit OK (778 tests, 2165 assertions), PHPStan no errors, Pint passed.
  • CI matrix green across PHP 8.3 / 8.4 / 8.5 x Laravel 12 / 13.

Merged PRs

  • #40 report diff endpoint
  • #41 adversarial manifest discovery
  • #42 batch live registry and progress endpoints
  • #43 dataset trend endpoint
  • #44 macro PR into main
Assets 2
Loading