Skip to content

auditable 0.2.0

Choose a tag to compare

@yzhao062 yzhao062 released this 20 Jul 11:24
· 16 commits to main since this release

What's New

Data module completed (internal v0.2). The fitted dependency-state detector now has its full story: fit from captured history (DataAuditor.fit_records over decision records, fit_from_log over a FileSink JSONL through the fail-closed loader), a value-level fault injector for detector evaluation (auditable.data.inject: stale / drift / OOD over snapshot copies, deterministic, non-circular injection-site labels), the previously missing anomaly extra (pip install "auditable[anomaly]"), a documentation page (Data Module), and an offline composed example (examples/example_state_anomaly.py). The learned path remains an unpromoted module API: concept-demo evidence only, benchmark-grade evidence pending.

Two new capture integrations.

  • LangChain (auditable.integrations.langchain, pip install "auditable[langchain]"): a callback handler that lowers a real runnable/tool/LLM run into the typed session graph with honest dependency grading: OBSERVED only on digest-matched value handoffs, DECLARED for sequence topology, INFERRED for payload equality. Scored support is scoped to flat sequences.
  • MCP (auditable.integrations.mcp, pip install "auditable[mcp]", Python 3.10+): instrument a FastMCP server in place so every tool call is captured at the boundary with digest-only arguments, results, and errors, and an honest zero-coverage report (no fabricated dependency or handoff edges).

LiveSession data hook. LiveSession(data_auditor=...) scores per-step dependency snapshots while a run streams, with an owned evidence boundary: observe(step, snapshot=...) deep-copies at ingestion, duplicate step ids are rejected before commit, and scorer outages surface as availability notes instead of vanishing.

Hardening. The block went through two external review rounds; fixes include version bounds for both integration extras, error fingerprints instead of raw exception text (privacy), generation-aware reset semantics with cancellation capture, canonical hashing for direct CallToolResult returns, and a pinned integration-contracts CI job with a langchain-core floor canary.

Full test suite: 311 passed. See the docs and examples/README.md.