Repository navigation
Evaris v0.1.0
Evaris's first release provides an offline CLI for reproducible agent and skill evaluation.
- Validate experiments, prepare blind baseline/specialist workspaces, and import externally produced results with frozen provenance.
- Grade deterministic artifacts and source authorization, retain immutable evaluations, and generate JSON/Markdown reports with explicit missing evidence and pending review.
- Compare baseline/specialist arms and instruction revisions; mismatched or unobserved conditions remain NOT_COMPARABLE.
- Optionally verify through Invaris pinned to
ee92f3c00c1b59b2f576bad05569fb6eafb83097. Native ACCEPT/REJECT/REFUSE remains separate from the Evaris assessment. - Report the binary version through
evaris --versionandevarisVersionin reports.
Install
Download the binary for Linux or macOS, amd64 or arm64. Verify its entry in SHA256SUMS, make it executable, and place it on PATH.
Alternatively, with Go 1.27.4 or newer:
go install github.com/akkaraponph/evaris/cmd/evaris@v0.1.0
evaris --versionVerification
Release commit: d0062f4a796aa470a7e55de5943d9e9fb338a288.
Hosted Go checks cover build, vet, race tests, offline acceptance, and pinned real-Invaris integration on Linux and macOS. The macOS output-limit test now uses its own time budget and asserts an exact 4 MiB retained bound.
All four release binaries were rebuilt with Go 1.27.4 on macOS and in an offline Linux container and matched byte-for-byte across hosts. Linux/arm64 and macOS/arm64 binaries passed version and experiment-validation smoke checks. Installation through go install ...@v0.1.0 also returned evaris v0.1.0.
Known limitations
- All bundled runs are synthetic controls; no real agent or model performance has been measured. Agents must be run externally.
- Command graders and Invaris guards require
--allow-commands, execute trusted commands, and are not sandboxed. - Windows and Invaris revisions other than the pinned revision are unsupported.
- Stored
v1alpha1records have no cross-minor compatibility promise; evidence stores are not migrated.
See workflow, support and reproducible builds, and changelog.