Skip to content

v2.5.0

Choose a tag to compare

@github-actions github-actions released this 02 Nov 20:43
· 26 commits to main since this release
0867b67

What's Changed

  • feat(cli): add Mann-Whitney U and the Hodges-Lehmann shift for comparing runs by @nucliweb in #367
  • feat(cli): decide a baseline regression with the runs, with Mann-Whitney U from five runs a side by @nucliweb in #368
  • feat(cli): say how much the runs agree, with their coefficient of variation, in --runs and --matrix by @nucliweb in #369
  • feat(cli): record the machine in the conditions, and warn when a baseline ran on another CPU by @nucliweb in #370
  • chore(cli): release 1.9.0, with statistics in --baseline and --runs by @nucliweb in #371
  • feat(cli): add the trend of the CrUX field data over the last weeks, with --crux-history and weeks in get_crux by @nucliweb in #372
  • feat(cli): set the CrUX sub-parts of the LCP against the lab, with the round trip time and the navigation types by @nucliweb in #373
  • chore(cli): release 1.10.0, with the trend and the LCP sub-parts of the CrUX field data by @nucliweb in #374
  • fix(cli): scale the sparkline of --crux-history to the smallest change of its metric by @nucliweb in #375
  • test(mcp): grade the tools an agent picks and their order by @nucliweb in #377
  • ci: audit the build with the Agentic browsing category of Lighthouse by @nucliweb in #378
  • feat(skills): pass the script to evaluate_script by path by @nucliweb in #379
  • feat(mcp): compare a run with a baseline from run_snippet and run_workflow by @nucliweb in #380
  • feat(mcp): measure several runs from run_snippet and run_workflow by @nucliweb in #381
  • docs: add a page on what agents get wrong with the CLI and the MCP server by @nucliweb in #382
  • chore: release 2.5.0 and the CLI 1.11.0 by @nucliweb in #383

Full Changelog: v2.4.2...v2.5.0