Repository navigation
TraceBench 0.2.0 — Standalone HTML evaluation reports
TraceBench 0.2.0 adds a standalone HTML report for recorded-output evaluations, with complete case/check results, exact numeric text, search, status filters, keyboard access and print support. HTML works without JavaScript; the optional controls use a fixed hash-restricted script. Recorded text is rendered as inert text with no external assets.
tracebench evaluate --cases fixtures/cases.jsonl --outputs fixtures/clean.jsonl --pricing fixtures/pricing.json --format html --report clean.htmlOpen the synthetic report · CLI and report contracts · Verification
Validation: 65 Python tests; independent code review and boundary fixes; hosted Python 3.11/3.13 CI; fresh wheel/source installs; real installed CLI outcomes 0/1/2/3; Chromium desktop/mobile, filters, keyboard, no-JavaScript, print and hostile-text checks. The final wheel is byte-identical to the installed verified candidate and its runtime modules match merged main. The public report matches the reproducible synthetic sample byte-for-byte. Main-only Pages publication was also tested against an overlapping non-main dispatch.
All outputs, observations and prices are synthetic. Standard-library Python runtime; no provider calls or model-quality benchmark. This is an educational offline evaluator, not a production security audit or adoption claim. HTML only reports the supplied evaluation; it does not authenticate baseline provenance. No PyPI publication is implied. Existing JSON/Markdown schemas and exit meanings are preserved.