Skip to content

v1.0.0-rc — Release Candidate

Pre-release
Pre-release

Choose a tag to compare

View all tags
@Mathews-Tom Mathews-Tom released this 30 Apr 23:23
· 833 commits to main since this release
v1.0.0-rc
c5fccc9
This commit was created on GitHub.com and signed with GitHub’s verified signature.
GPG key ID: B5690EEEBB952194
Verified
Learn about vigilant mode.

First release candidate for v1.0.0. Phases 0–6 of the local-first agent-evaluation framework are complete.

Highlights

  • 8-layer assertion pipeline — schema, constraint, trace, content, embedding, llm_judge, trace_tree, plugin. Layers 1–4 are deterministic and free; 5–6 cost money and run with a bounded worker pool plus per-provider rate limiting.
  • Diagnostic JSON v2 reports — every assertion result carries layer, type, trace_node_path, expected, actual, judge_metadata, failure_class, and (when applicable) a baseline delta block. The Markdown renderer surfaces all of it in a PR-comment-ready format.
  • Calibrated judge subsystem — rubric versioning, repeat:N for variance summaries, bias probes (verbosity/position/self-preference), and Cohen's-kappa calibration sets via attest calibrate.
  • OpenTelemetry GenAI parity — ingest the current GenAI span set (chat, text_completion, embeddings, invoke_agent, execute_tool, retrieval) and export Attest traces back as OTLP-compatible spans.
  • CI workflow affordances — attest-engine baseline pin/list/show/delete snapshots reference runs; attest-engine policy evaluate returns tiered exit codes (0/1/2 = pass/block/warn) for merge gating; the .github/actions/pr-annotate composite action posts inline review comments per failed assertion.

Versions

Engine, Python SDK (attest-ai), and TypeScript SDK (@attest-ai/core, @attest-ai/vitest) all aligned at 1.0.0-rc. PyPI normalises to 1.0.0rc0 per PEP 440; npm publishes literal 1.0.0-rc.

Engine binaries

Six platforms attached: darwin/linux/windows × amd64/arm64. Verify with shasum -a 256 -c checksums-sha256.txt.

Install

# Python — pinned to RC
uv add attest-ai==1.0.0rc0

# TypeScript
pnpm add @attest-ai/core@1.0.0-rc @attest-ai/vitest@1.0.0-rc

# Engine binary auto-downloads on first SDK use; or download manually from this release.

Known limitations

  • 4 pre-existing optional-adapter import-guard tests fail in local dev venvs that have all extras installed — unrelated to this RC, fixed in CI's clean venv.
  • TS admin CLI shim (attest baseline/attest policy for npm-only users) deferred to v1.0.0 final; Python SDK ships them today.
  • attest-website MDX guides for baselines/policies/PR annotations land on the docs site separately.

Promotion path to v1.0.0

Dogfood window: open a deliberately-regressing PR against attest-examples/ to exercise the pr-annotate action end-to-end; collect any RC-only fixes; cut v1.0.0 final once dogfood is clean.

Assets 9
Loading