Skip to content

jeval v0.1.6 — a synthetic classifier that answers more than one class

Choose a tag to compare

@rlaope rlaope released this 21 Sep 01:15
· 67 commits to main since this release

Install

curl -fsSL https://raw.githubusercontent.com/rlaope/jeval/main/install.sh | sh
jeval demo

Fixed in this release

The synthetic classifier only ever answered one class. generate() set prediction = classes[0]
for every record, so the demo, the committed example report and the drift example all described a
classifier that routes exactly one class: per-class thresholds, per-class cost actions and slices by
predicted class were unreachable. The prediction now follows the sampled outcome. Confidence is also
capped below certainty — clipping at 1.0 stacked 45% of records on exactly 1.0 at inflation 1.22 and
handed the threshold sweep a free bucket.

The example report and every number quoted from it were regenerated, including the screenshots.

The drift block in the README is reproducible: examples/make-drift-log.py builds the log it
quotes.