Skip to content

v2.0.4

Choose a tag to compare

@beyondworks beyondworks released this 23 Sep 02:58
· 3 commits to main since this release

Fixes

  • Jev was silently off. The TypeSafe API edge now rejects Python's default User-Agent (HTTP 403, error 1010), so every Jev call failed and the gate closed every request. Requests now send a User-Agent.
  • A refused marker counted as a used hatch. When Jev had answered and the agent still wrote the marker file, the turn never moved to asked, and the user's answer was triaged as a new request.
  • Background-task notices re-triaged the gate. A <task-notification> reaches the prompt hook like a user message; the gate now keeps its state.

Statistics corrected

  • Earlier READMEs pooled the 36 hidden tests as if independent and reported p < 0.001. Results are now clustered by task (paired differences, 95% CI, sign test), and bench/significance.py prints the same numbers.
  • The accuracy gain over Castra + Ponytail holds: task pass rate +0.46 (95% CI +0.17 to +0.76), at about a minute and $0.18 more per task. The personal-setup comparison is not conclusive at 7 tasks.
  • Added: on Claude Opus 5.5, 0.75 with no harness vs 0.97 with lean-forge (+0.23, 95% CI −0.04 to +0.49).