Repository navigation
v2.5.0
What's Changed
- feat(cli): add Mann-Whitney U and the Hodges-Lehmann shift for comparing runs by @nucliweb in #367
- feat(cli): decide a baseline regression with the runs, with Mann-Whitney U from five runs a side by @nucliweb in #368
- feat(cli): say how much the runs agree, with their coefficient of variation, in --runs and --matrix by @nucliweb in #369
- feat(cli): record the machine in the conditions, and warn when a baseline ran on another CPU by @nucliweb in #370
- chore(cli): release 1.9.0, with statistics in --baseline and --runs by @nucliweb in #371
- feat(cli): add the trend of the CrUX field data over the last weeks, with --crux-history and weeks in get_crux by @nucliweb in #372
- feat(cli): set the CrUX sub-parts of the LCP against the lab, with the round trip time and the navigation types by @nucliweb in #373
- chore(cli): release 1.10.0, with the trend and the LCP sub-parts of the CrUX field data by @nucliweb in #374
- fix(cli): scale the sparkline of --crux-history to the smallest change of its metric by @nucliweb in #375
- test(mcp): grade the tools an agent picks and their order by @nucliweb in #377
- ci: audit the build with the Agentic browsing category of Lighthouse by @nucliweb in #378
- feat(skills): pass the script to evaluate_script by path by @nucliweb in #379
- feat(mcp): compare a run with a baseline from run_snippet and run_workflow by @nucliweb in #380
- feat(mcp): measure several runs from run_snippet and run_workflow by @nucliweb in #381
- docs: add a page on what agents get wrong with the CLI and the MCP server by @nucliweb in #382
- chore: release 2.5.0 and the CLI 1.11.0 by @nucliweb in #383
Full Changelog: v2.4.2...v2.5.0