Skip to content

VeriRun v0.1.0 — Protocol Baseline

Choose a tag to compare

@aaron-for-value aaron-for-value released this 16 Aug 14:42
· 20 commits to main since this release

VeriRun v0.1.0 — Protocol Baseline

The first VeriRun release establishes an evidence-first protocol baseline for reproducible executable evaluation. It supports trusted fixtures only; it is not a sandbox for model-generated or otherwise untrusted code.

Included

  • Immutable manifests, candidates, attempts, verification results, and replay records.
  • Canonical JSON, content hashing, exported JSON Schemas, and content-addressed artifacts.
  • Structured verification outcomes and deterministic replay comparison.
  • verify, replay, smoke, and optional evalplus-smoke command-line workflows.
  • EvalPlus v0.3.1 HumanEval+ compatibility adapter and labeled subset evidence.

Release evidence

The release gate includes 39 passing tests, 88.60% branch coverage against an 85% threshold, strict type checking, schema drift checks, and a clean sdist/wheel build.

Supported environment

  • Python 3.12
  • EvalPlus v0.3.1 is optional and pinned by the published lockfile.
  • macOS evidence uses the documented EvalPlus Darwin memory-limit workaround only for deterministic trusted smoke; it is not a resource-isolation claim.

Deliberately not included

  • Real model endpoints or provider orchestration.
  • A security boundary for untrusted code.
  • PostgreSQL, Ray, Kubernetes, KubeRay, gVisor, or object storage.
  • A benchmark score or full HumanEval+/MBPP+ result claim.

Release assets

Asset SHA-256
verirun-0.1.0.tar.gz 593b6d6b8b0049dcf246736caf6b6bc98597973c76f292c3ba6448209487816a
verirun-0.1.0-py3-none-any.whl 06eb2e73ad9b9596d10177fac2efd326a9dcb989f4bdbca618c62276e8e41030