Skip to content

JevGraph v0.4.0

Choose a tag to compare

@chenmingtang830 chenmingtang830 released this 20 Sep 18:49
· 22 commits to main since this release
3776854

Direct relation-selection benchmark

v0.4 makes the direct, one-case FewRel relation-selection protocol the primary benchmark. It uses opaque provider case IDs, 16 relations-only choices, 160 shared cases, batch size one, temperature zero, no retries/fallbacks, and a 4,096-token chat cap.

The primary result and full cost/failure audit are in docs/evidence/direct-2026-09-20.json. The evidence ZIP includes sanitized raw receipts, including all failures, plus SHA-256 manifest.

  • v0.2 is superseded for capability claims because its provider-visible IDs exposed gold-bearing relation prefixes.
  • v0.3 episodic validation is retained as an additional stress test.

Artifacts: wheel, source distribution, sanitized evidence ZIP, and ZIP checksum.