Repository navigation
JevGraph v0.4.0
Direct relation-selection benchmark
v0.4 makes the direct, one-case FewRel relation-selection protocol the primary benchmark. It uses opaque provider case IDs, 16 relations-only choices, 160 shared cases, batch size one, temperature zero, no retries/fallbacks, and a 4,096-token chat cap.
The primary result and full cost/failure audit are in docs/evidence/direct-2026-09-20.json. The evidence ZIP includes sanitized raw receipts, including all failures, plus SHA-256 manifest.
- v0.2 is superseded for capability claims because its provider-visible IDs exposed gold-bearing relation prefixes.
- v0.3 episodic validation is retained as an additional stress test.
Artifacts: wheel, source distribution, sanitized evidence ZIP, and ZIP checksum.