Repository navigation
v0.2.0 - Quality, token, and duration PR reporting
Pre-release
Pre-release
Quality, token, and duration reporting prerelease
Surfaces quality scores, duration, token usage, and per-case outcomes in sticky PR reports and workflow job summaries so authors and marketplace maintainers can review skill improvements at a glance.
Highlights
- Adds a compact Quality & token summary table (Passed, Failed, Avg Score, Total Tokens, Total Duration) to sticky PR reports and job summaries when trial metrics are recorded.
- Surfaces per-case quality score percentages, durations, token usage (in/out), and failed check details directly in the ### Evals table and expandable failure details.
- Preserves existing lint/run/report contracts and zero-leakage handling when optional metrics are absent.
- Includes open-source readiness, contribution terms, license alignment, and Vally telemetry preservation updates (#12, #13, #14, #18, #20, #21, #24).
Release provenance
- Merged PR: #24
- Release commit:
6e4c077e92194c7e75663d8d782426841047e887 - Post-merge model-free CI: https://github.com/github/evals-action/actions/runs/42852601761
- Post-merge CodeQL: https://github.com/github/evals-action/actions/runs/42852600544