Skip to content

Releases: AbdelStark/jev-benchmarks

jev-benchmarks v0.1.0

Choose a tag to compare

@AbdelStark AbdelStark released this 17 Sep 07:55
0d610cc

First public research release of jev-benchmarks.

Highlights:

  • reproducible Jev and GLiNER2.5 pilot across AG News, DAIR Emotion, and BTZSC Banking77
  • accuracy, macro-F1, calibration, selective-risk, latency, paired-bootstrap, and cost reporting
  • manifest and prediction identity checks with SHA-256 artifact provenance
  • machine-readable aggregate results and an evidence-first README
  • typed package, Apache-2.0 licensing, contribution and security policies
  • CI-tested on Python 3.11, 3.12, and 3.13 with a 90% coverage gate

See the committed report and JSON artifact for the full result and limitations.