Skip to content

v1.0.4

Latest

Choose a tag to compare

@virattt virattt released this 17 Jul 19:23

Changes

  • Add rubric-based partial-credit scoring and contradiction detection
  • Add reproducible sampling, quick runs, configurable models, concurrency, and timeouts
  • Improve eval reporting with metadata, latency, and failure metrics

Fixes

  • Fix inaccurate finance evaluation answers and rubric criteria