Skip to content

TraceBench 0.2.0 — Standalone HTML evaluation reports

Choose a tag to compare

@ult666666 ult666666 released this 23 Oct 21:58
· 10 commits to main since this release
61de7e3

TraceBench 0.2.0 adds a standalone HTML report for recorded-output evaluations, with complete case/check results, exact numeric text, search, status filters, keyboard access and print support. HTML works without JavaScript; the optional controls use a fixed hash-restricted script. Recorded text is rendered as inert text with no external assets.

tracebench evaluate --cases fixtures/cases.jsonl --outputs fixtures/clean.jsonl --pricing fixtures/pricing.json --format html --report clean.html

Open the synthetic report · CLI and report contracts · Verification

Validation: 65 Python tests; independent code review and boundary fixes; hosted Python 3.11/3.13 CI; fresh wheel/source installs; real installed CLI outcomes 0/1/2/3; Chromium desktop/mobile, filters, keyboard, no-JavaScript, print and hostile-text checks. The final wheel is byte-identical to the installed verified candidate and its runtime modules match merged main. The public report matches the reproducible synthetic sample byte-for-byte. Main-only Pages publication was also tested against an overlapping non-main dispatch.

All outputs, observations and prices are synthetic. Standard-library Python runtime; no provider calls or model-quality benchmark. This is an educational offline evaluator, not a production security audit or adoption claim. HTML only reports the supplied evaluation; it does not authenticate baseline provenance. No PyPI publication is implied. Existing JSON/Markdown schemas and exit meanings are preserved.