Skip to content

promptcheckup 1.0.1

Choose a tag to compare

@gael55x gael55x released this 01 Nov 13:38
· 6 commits to main since this release
6e5fc41

Fixed

  • Workflow templates install the published package. The CI templates written by promptcheckup init now install promptcheckup>=1,<2 from PyPI instead of this repository's default branch, so your CI runs a signed release. If you ran init with 1.0.0, change the install line in .github/workflows/promptcheckup-gate.yml and promptcheckup-checkup.yml to python -m pip install "promptcheckup>=1,<2".
  • README figures:
    • the false "better" rate is 2.2–2.7% on symmetric noise, and 2.0% falling to almost 0% on crash-skewed P&L;
    • ten variants tried on the same cases carry about a 22% chance of a false "better";
    • evolve keeps that chance below 2.5%.
  • The integration guide installs from PyPI.

Changed

  • The README is rewritten in a plainer voice. It adds a table of how many cases are needed to detect small, medium and large improvements, and a section on what the results mean in practice.
pip install --upgrade promptcheckup