Skip to content

jeval v0.1.2 — the distribution is jeval-cli

Choose a tag to compare

@rlaope rlaope released this 21 Sep 00:29
· 77 commits to main since this release

Install

uvx --from git+https://github.com/rlaope/jeval@v0.1.2 jeval demo   # nothing installed
pip install https://github.com/rlaope/jeval/releases/download/v0.1.2/jeval_cli-0.1.2-py3-none-any.whl

The PyPI distribution is jeval-cli: pip install jeval installs an unrelated project owned by
another account. The jeval command is unchanged.

Hand it to an agent

Install jeval (uvx --from git+https://github.com/rlaope/jeval jeval --help), find where my
classifier's decisions are logged, describe that shape in .jeval/ingest-map.yaml, run
jeval report, and show me the report file.

What comes out

Artifact What it answers Who reads it
report.html — one self-contained file Are the confidences trustworthy, where do they break, what does the threshold in use cost? the human
thresholds.yaml The threshold to deploy, with a bootstrap interval your application
labels.csv Which decisions, labeled next, buy the most certainty whoever has the answers
calibration-*.yaml An optional correction map, exported only when the gain is real your application

Verified

490 tests, ruff + mypy clean, CI green on 3.10 / 3.11 / 3.12. Installed from this release's wheel
into a clean virtualenv, jeval demo produced a 257 KB report with no external references.