Skip to content

v0.4.0

Choose a tag to compare

@jesrav jesrav released this 08 Oct 20:00
· 3 commits to main since this release
c4a1d0d

Added

  • evaltrack report, which writes a recorded run as one HTML file with the run embedded. It shows
    the run as the dashboard does and opens anywhere with no server and no network, for CI artifacts
    and sharing results. The page also holds the run's history over the mainline and the baseline
    run, so Compare to mainline works in it. A value over 16 KB is left out of the page unless
    --full is passed, so a report of a large run stays small. See
    CLI › report.
  • Report in the dashboard, on a run, which saves the same page for the run on screen, to share
    with someone without the dashboard.

Changed

  • The dashboard's history leaves out a promoted run whose body does not parse, and logs it, instead
    of failing the whole history. A damaged baseline reflog still fails it.
  • evaltrack.ui no longer re-exports create_app and MountedRepository. Import them from
    evaltrack.ui.app.
  • Breaking: the mainline is the configured remote and nothing else. A dashboard with only a
    local repository mounted no longer measures reliability history over the local baseline.
    promote and push --ref baseline into the local repository now exit 2. To tell the local
    repository apart, both read pyproject.toml, so an invalid [tool.evaltrack] table now stops
    them with --repository too.