v0.2.0
Changelog
[0.2.0] - 2026-09-30
Added
- Output normalization: new
normalizationblock insuite.yamland per-case config
(strip_keys,strip_paths,replace_paths,replace_textwith regex flags). Applied to
tool results/errors before recording and to final output before assertions, so volatile
values (timestamps, IDs, seeds) no longer break replay or baselines. runledger init --language nodegenerates a Node.js agent template (agent/agent.js);
requiresnodeonPATH.
Fixed
- Portable baselines/artifacts:
summary.jsonand regression output now record
cwd-relative, POSIX-style paths forsuite_path,agent_command, cassette paths, and
baseline_pathinstead of machine-specific absolute paths. runledger baseline promotestrips theregressionblock from the promoted summary and
recomputesrun.exit_statusfrom case results.runledger initprints relative paths and emits a CI snippet that includes--baseline;
generated Python agent now exits with a proper status code.- Python 3.9 support: added
eval_type_backport(Python < 3.10 only) so pydantic models using
X | Noneannotations load on 3.9 (previously every command failed on 3.9). - Fixed an over-escaped regex in the
replace_textnormalization test.
Changed
- Demo suite regression thresholds stabilized; demo baselines regenerated.
- CI and release workflows can be triggered manually (
workflow_dispatch; release takes ataginput). - Docs: README no longer claims token/cost budgets or cost-regression gates are enforced
(onlymax_wall_ms,max_tool_calls,max_tool_errorsfail runs today). README tightened, newdocs/integrations.md, quickstart updates; Action usage now
points torunledger/Runledger@v0.2. - Packaging: SPDX
license = "MIT"+license-files(clears setuptools deprecation); build
requiressetuptools>=77; dropped redundantwheelbuild requirement.
[0.1.1] - 2025-12-26
Changed
- GitHub Action now includes Marketplace branding metadata.
pytestconfig avoids collecting tests inautomation/workdir/clones.- Docs: composite action usage points to
runledger/Runledger@v0.1; release notes link to the demo repo.
[0.1.0] - 2025-12-17
Added
- Deterministic record/replay harness for tool-using agents.
- CLI commands:
run,diff,baseline promote, andinit. - Assertions for JSON schema, required fields, and tool contracts.
- Budget enforcement and regression gating vs baselines.
- Artifact outputs:
run.jsonl,summary.json,junit.xml,report.html. - Composite GitHub Action for CI usage.
Demo repo: https://github.com/runledger/runledger-demo