Skip to content

v2.4.0 — Baseline Comparison

Choose a tag to compare

@lucioduran lucioduran released this 16 Apr 13:09
· 11 commits to main since this release

Baseline Comparison Mode

Track AX score changes over time by saving baselines and comparing against them in subsequent runs.

New CLI flags

  • --save-baseline <path> — save audit results as a baseline JSON file
  • --baseline <path> — compare against a previous baseline, show per-check score deltas (▲/▼)
  • --fail-on-regression <points> — exit with code 1 if any check regresses by more than N points

Works with all output formats (terminal, JSON, HTML).

CI/CD usage

# Save baseline on main branch
- run: npx ax-audit https://your-site.com --save-baseline .ax-baseline.json

# Gate PRs on regressions
- run: npx ax-audit https://your-site.com --baseline .ax-baseline.json --fail-on-regression 5

Programmatic API

New exports: saveBaseline(), loadBaseline(), diffBaseline(), toBaselineData() with full TypeScript types (BaselineData, BaselineDiff, CheckDiff).

Other

  • 15 new tests (total: 121)
  • Fixed test runner glob that was silently skipping root-level test files