Skip to content

v0.12.0 — --help everywhere + more MET conversions (honest 35.7%)

Choose a tag to compare

@momomuchu momomuchu released this 05 Jul 14:53

v0.12.0 — standards-completeness pass continues (35.7% → climbing)

More PARTIAL/NOT-MET → MET conversions, each with a negative control, driven by two rounds of independent adversarial re-measurement that keep the number honest (they caught — and I fixed — a real commit-message overclaim and doc-drift in this batch itself).

  • --help/-h on EVERY entry point (17 scripts) — shared lib.sh::_maybe_help + a python print(__doc__) handler; test_help.sh iterates the scripts dir (53 assertions) so a new script without --help fails by omission. Fixes the prior batch's "every entry point" overclaim by making it true; log_verdict.sh --help (the standard's cited proof-point) now works. (ISO/IEC 25010 Interaction Capability.)
  • Requirement→artifact traceability gate + real coverage floor + STUCK-BUDGET end-to-end eval + mnm-loop wrapper tests (SWEBOK Requirements, ISO 29119).
  • docs/TEST-DESIGN.md — decision-table / boundary-value / state-transition / property-based technique tables, each mapped to a real assertion (29119-4 test-design artifact).
  • Community profile + doc currency: CODE_OF_CONDUCT.md, PULL_REQUEST_TEMPLATE.md, de-staled INCENTIVES.md (mutation/coverage/sast now marked shipped, not deferred), and the last stale docs (STATUS.md, CONTRIBUTING.md).

Honest measurement (Campbell / Goodhart)

Independently re-measured: 23.3% → 31.8% → 35.7% strict MET and climbing. 80% strict remains structurally unreachable — ~10-14 items are permanently capped for a solo/unfunded/unaudited repo (IEEE 1012 managerial + financial V&V independence, genuine PR peer review, production false-DONE telemetry, live-interactive hook-fire proof, third-party pentest, the in-band adversarial-panel-skip residual). Realistic near-term ceiling ≈ 55-70%. The number is moved by fixing substance and reported as measured, never gamed to a target — the re-measurement even caught this batch's own overclaim, which was then corrected in code rather than in the number.

Verification

  • 621 unit tests + 18 eval scenarios, 0 failed; both CI workflows green; manifest re-signed each script change.