Skip to content

jeval v0.1.1 — install today, hand it to an agent

Choose a tag to compare

@rlaope rlaope released this 21 Sep 00:22
· 80 commits to main since this release

Install

uvx --from git+https://github.com/rlaope/jeval@v0.1.1 jeval demo   # nothing installed
pip install https://github.com/rlaope/jeval/releases/download/v0.1.1/jeval-0.1.1-py3-none-any.whl

pip install jeval needs a PyPI publisher registration that is not done yet. The wheel above is
built by the release workflow for this tag, not uploaded by hand.

Hand it to an agent

Nobody runs a command tour. One sentence, and the artifact comes back:

Install jeval (uvx --from git+https://github.com/rlaope/jeval jeval --help), find where my
classifier's decisions are logged, describe that shape in .jeval/ingest-map.yaml, run
jeval report, and show me the report file.

  • Machine-readable entry point: llms.txt
  • The playbook it follows: docs/agent-setup.md
    — including the two places every attempt stalls: nothing logged yet, and no labels yet.

What comes out

Artifact What it answers Who reads it
report.html — one self-contained file Are the confidences trustworthy, where do they break, what does the threshold in use cost? the human
thresholds.yaml The threshold to deploy, with a bootstrap interval your application
labels.csv Which decisions, labeled next, buy the most certainty whoever has the answers
calibration-*.yaml An optional correction map, exported only when the gain is real your application

Verified

489 tests, ruff + mypy clean, CI green on 3.10 / 3.11 / 3.12. Installed from the release URL into a
clean virtualenv, jeval demo produced a 257 KB report.