Skip to content

UNTIL 0.2.0 — verified autonomy, honest economics

Choose a tag to compare

@Balanov Balanov released this 05 Nov 20:27
· 14 commits to main since this release

UNTIL 0.2.0 hardens acceptance, exports real model evidence and publishes the complete same-model comparison — including the result that does not favour UNTIL.

Measured, not promised

A frozen protocol published all 48 selection and held-out trials, without discarding errors.

Six held-out JSON-deliverable trials Accepted Median time Median model calls
UNTIL 0.1 0/6 9.589 s 1.5
UNTIL 0.2 6/6 14.105 s 3
Direct 0.1 1/6 3.910 s 1
Direct 0.2 6/6 4.299 s 1

The current direct arm is 3.281× faster than UNTIL. Both current arms received strict JSON Schema, so the acceptance improvement cannot be attributed to the outer loop alone. Local provider charges were $0; hardware and electricity were not measured.

This is a bounded JSON-deliverable experiment — not production coding, customer interviews, a competitor benchmark, a business outcome or evidence that a product team can be replaced.

Engineering changes

  • Owner-supplied goal.policy.acceptance is merged into every contract and cannot be discarded by the model. Live contracts without external acceptance fail closed.
  • Strict role-specific JSON Schemas for compatible providers; structuredOutputs: false remains available per model or globally.
  • Opt-in raw response tracing, role/model economics and until export --output FILE.
  • A downloadable raw bundle with 102 files, SHA-256 manifest and integrity checks covering every trial, response and accepted release receipt.
  • Six-language RTL site with live GitHub stars/forks, sourced capability comparisons, explicit product gaps and an assumption-based pilot calculator.

Verification

Known boundaries remain: no native Git/PR delivery or managed sandbox, no production deployment of the agent core, and no external effect without a configured risk boundary. Raw tracing is disabled by default because responses can contain sensitive data.

MIT. Fork it, inspect it, challenge it.