VeriRun v0.1.0 — Protocol Baseline
VeriRun v0.1.0 — Protocol Baseline
The first VeriRun release establishes an evidence-first protocol baseline for reproducible executable evaluation. It supports trusted fixtures only; it is not a sandbox for model-generated or otherwise untrusted code.
Included
- Immutable manifests, candidates, attempts, verification results, and replay records.
- Canonical JSON, content hashing, exported JSON Schemas, and content-addressed artifacts.
- Structured verification outcomes and deterministic replay comparison.
verify,replay,smoke, and optionalevalplus-smokecommand-line workflows.- EvalPlus v0.3.1 HumanEval+ compatibility adapter and labeled subset evidence.
Release evidence
- Synthetic protocol and replay report
- EvalPlus HumanEval+ compatibility report
- GitHub CI and Linux EvalPlus smoke both passed.
The release gate includes 39 passing tests, 88.60% branch coverage against an 85% threshold, strict type checking, schema drift checks, and a clean sdist/wheel build.
Supported environment
- Python 3.12
- EvalPlus v0.3.1 is optional and pinned by the published lockfile.
- macOS evidence uses the documented EvalPlus Darwin memory-limit workaround only for deterministic trusted smoke; it is not a resource-isolation claim.
Deliberately not included
- Real model endpoints or provider orchestration.
- A security boundary for untrusted code.
- PostgreSQL, Ray, Kubernetes, KubeRay, gVisor, or object storage.
- A benchmark score or full HumanEval+/MBPP+ result claim.
Release assets
| Asset | SHA-256 |
|---|---|
verirun-0.1.0.tar.gz |
593b6d6b8b0049dcf246736caf6b6bc98597973c76f292c3ba6448209487816a |
verirun-0.1.0-py3-none-any.whl |
06eb2e73ad9b9596d10177fac2efd326a9dcb989f4bdbca618c62276e8e41030 |