Causal Audit Framework

[thisisbhanuj]

Summary

Introduces an Agents Runtime governance capability that ingests auditable execution evidence, detects runtime findings, and performs explainable Causal Audits using durable controlled Replay—not inferred metadata. This release adds governed, deterministic counterfactual evidence controls for causal audits, with improved runtime operations visibility.

Causal Audit now proves evidence influence through:
Observed execution → explicit replay capability → controlled Replay → counterfactual execution → outcome comparison → deterministic classification

What changed

• Added tenant-scoped Agent Execution and ordered event ingestion APIs, persistence, projections, and Studio views.
• Added runtime findings, detectors, worker processing, governance projections, and SQLite/PostgreSQL/Neo4j repository support.
• Added Causal Audit domain model, REST API, persistence, settings, worker handling, immutable completed results, and product taxonomy:
  • NO_TOOL_EVIDENCE
  • EVIDENCE_IGNORED
  • OVER_EXTENDED
  • EVIDENCE_ALIGNED
• Added an explicit AgentRuntimeReplayCapability contract, requiring a runtime-declared adapter, opaque frozen replay reference, and supported interventions.
• Extended Replay with immutable controlled-evidence interventions: NULLIFY, REPLACE, and PERTURB.
• Added a safe deterministic reference adapter through the existing Replay adapter registry; historical Replay fails closed when asked to apply controlled evidence.
• Causal Audit creates durable child Replay records/jobs, waits for counterfactual executions, then records baseline/counterfactual scores, influence, classification reason, and Replay/execution lineage.
• Replay worker schedules Causal Audit finalization after controlled Replay completion.
• Added Studio navigation for Executions | Findings | Causal Audit, contextual Help drawer, tabbed runtime settings, demo data, and operator documentation.
• Refined the Causal Audit detail UI with signed score chains, explicit saturation summaries, and collapsed evidence/lineage details.
• Introduces versioned, tenant-scoped Evidence Intervention Policies.
• Adds REST APIs and Studio workflows to create, validate, activate, retire, and apply intervention policies.
• Supports deterministic structured-evidence interventions during controlled causal replays.
• Records intervention-policy version, provenance, evidence digests, and counterfactual replay lineage as durable causal-audit evidence.
• Extends causal-audit eligibility and results with policy and lineage details.
• Adds SQLite, PostgreSQL, and in-memory persistence support for intervention policies.
• Updates local Compose configuration so API and replay workers share durable Agent Runtime persistence.
• Enhances the Agents Runtime experience with execution selection, policy management, causal-audit review, and local demo-data guidance.
• Expands the Home dashboard with runtime health, operational metrics, attention signals, provider readiness, and richer recent activity.
• Improves Studio theme consistency and auto-dismisses the local-demo-ready confirmation after five seconds.
• Adds architecture, interoperability, sequence, and PostgreSQL OpenTelemetry documentation.

Safety and governance guarantees

• Cross-tenant execution IDs fail closed.
• Missing replay capability, evidence references, unsupported interventions, unsafe adapters, or failed counterfactual samples fail closed.
• Controlled Replay carries reference-only evidence; no raw prompts, responses, credentials, reasoning traces, or raw tool payloads are persisted.
• Completed Causal Audits are immutable.
• Every influence result carries durable controlled Replay and produced-execution lineage.

Compatibility and rollout

For deployments using causal-audit workers, ensure the API and worker processes share the configured durable Agent Runtime store. The local Docker Compose setup now configures this automatically.

---

This discussion was created from the release Causal Audit Framework.