Skip to content

Evaris v0.1.0

Choose a tag to compare

@akkaraponph akkaraponph released this 15 Nov 03:12
· 27 commits to main since this release

Evaris's first release provides an offline CLI for reproducible agent and skill evaluation.

  • Validate experiments, prepare blind baseline/specialist workspaces, and import externally produced results with frozen provenance.
  • Grade deterministic artifacts and source authorization, retain immutable evaluations, and generate JSON/Markdown reports with explicit missing evidence and pending review.
  • Compare baseline/specialist arms and instruction revisions; mismatched or unobserved conditions remain NOT_COMPARABLE.
  • Optionally verify through Invaris pinned to ee92f3c00c1b59b2f576bad05569fb6eafb83097. Native ACCEPT/REJECT/REFUSE remains separate from the Evaris assessment.
  • Report the binary version through evaris --version and evarisVersion in reports.

Install

Download the binary for Linux or macOS, amd64 or arm64. Verify its entry in SHA256SUMS, make it executable, and place it on PATH.

Alternatively, with Go 1.27.4 or newer:

go install github.com/akkaraponph/evaris/cmd/evaris@v0.1.0
evaris --version

Verification

Release commit: d0062f4a796aa470a7e55de5943d9e9fb338a288.
Hosted Go checks cover build, vet, race tests, offline acceptance, and pinned real-Invaris integration on Linux and macOS. The macOS output-limit test now uses its own time budget and asserts an exact 4 MiB retained bound.

All four release binaries were rebuilt with Go 1.27.4 on macOS and in an offline Linux container and matched byte-for-byte across hosts. Linux/arm64 and macOS/arm64 binaries passed version and experiment-validation smoke checks. Installation through go install ...@v0.1.0 also returned evaris v0.1.0.

Known limitations

  • All bundled runs are synthetic controls; no real agent or model performance has been measured. Agents must be run externally.
  • Command graders and Invaris guards require --allow-commands, execute trusted commands, and are not sandboxed.
  • Windows and Invaris revisions other than the pinned revision are unsupported.
  • Stored v1alpha1 records have no cross-minor compatibility promise; evidence stores are not migrated.

See workflow, support and reproducible builds, and changelog.