Skip to content

JevGraph v0.5.1 — Visual direct relation benchmark

Latest

Choose a tag to compare

@chenmingtang830 chenmingtang830 released this 20 Sep 19:58
· 18 commits to main since this release
19e501e

Result-first benchmark brief

v0.5.1 publishes the controlled direct relation-selection benchmark as a Proofpress-style two-page brief and self-contained HTML report. The first page leads with aligned bar charts for p95 latency, cost per 100 planned decisions, and planned-case accuracy; the second records protocol, failures, release readiness, and limits.

Jev is 3.94× lower in p95 latency than GPT-5.6 Luna and 2.88× lower than DeepSeek V4.1 Flash in this run. Its illustrative input list-price equivalent is 2.99–3.56× lower than the chat providers receipt costs. Accuracy is lower, so this remains an operational tradeoff rather than a general model ranking.

No new provider calls were made. The release preserves the same controlled 160-case evidence, including the Jev HTTP 503 and DeepSeek prediction_outside_criteria failure, with opaque provider-visible case IDs and no retries.