Skip to content

VeriRun v0.2.0 — Async Model Gateway

Choose a tag to compare

View all tags
@aaron-for-value aaron-for-value released this 17 Aug 08:46
· 14 commits to main since this release
v0.2.0
7db0c0c

VeriRun v0.2.0 — Async Model Gateway

v0.2.0 delivers the M1 bounded async candidate-generation gateway.

Included

  • OpenAI-compatible asynchronous HTTP client with one reusable connection pool per gateway lifetime.
  • Independent local controls for concurrency, QPS, and anticipated in-flight output tokens.
  • Bounded worker/queue batch submission, layered HTTP timeouts, cancellation cleanup, fail-fast, and partial-failure behavior.
  • Classified 429, 5xx, timeout, transport, malformed-response, and client errors with capped full-jitter retry and retained retry root-cause history.
  • Public gateway schemas, contract documentation, ADR, credential-free fake-server smoke, and checked-in evidence.

Evidence

The gateway smoke report is bound to implementation revision d6021141fd6bdff6c6366fa7a0b593f612146354. It records 429/5xx retries, slow response, disconnect, malformed JSON, bounded concurrency, and a local sequential/eager-task/bounded-worker comparison.

Validation: GitHub Actions quality passed on PR #17; local release checks passed ruff, strict mypy, 48 pytest cases at 89.57% coverage, schema verification, pip check, and sdist/wheel build.

Limitations

  • This release is local-process admission policy, not distributed rate limiting or durable idempotency.
  • The local fake-server comparison is directional; it is not a provider-compatibility, model-quality, CPU-parallelism, or production-scale performance claim.
  • v0.2 does not run untrusted code and does not make a sandbox-security claim.
Assets 4
Loading