Skip to content

V1.4.2 — Readiness measurement closure

Latest

Choose a tag to compare

@troycheng troycheng released this 04 Aug 05:36
· 3 commits to main since this release
6b58e3f

V1.4.2

V1.4.2 closes the existing V1.4 readiness and measurement contracts and makes system-level optimization decisions more explicit.

Changes

  • New optimization Targets require combined readiness with a two-sample smoke.
  • Readiness and baseline exactly validate metric names, units, constraint sets, and requested sample counts.
  • Command and measurement failures preserve actionable codes, field differences, bounded output, return codes, and cleanup status.
  • Profile evidence is checked against Target, Variant, request slice, phase, coverage, system attribution, and the idealized end-to-end ceiling before Candidate and formal-target decisions.
  • Shared-host performance evidence requires continuous, time-aligned resource observation; missing evidence makes performance inconclusive without discarding independent correctness facts.
  • Added live-workload cost disclosure, bounded subagent use, and complete Handoff requirements.

Frozen legacy separate Targets remain readable by the evaluator, but new optimization readiness is combined-only until a versioned multi-probe evidence contract exists.

Validation

  • Focused conformance: Candidate 7/7 passed; Original failed 6 of the 7 cases.
  • Full suite: 242 passed, 2 skipped on Python 3.9.6.
  • GitHub CI passed on Python 3.10 and 3.12.
  • Four clean behavioral trials confirmed safe decisions; the Candidate made applicability, resource, and Handoff closure explicit.

This release makes no GPU performance or production-workload speed claim and contains no private workload, trace, host address, model path, or internal data.