-
Notifications
You must be signed in to change notification settings - Fork 0
Architecture
flowchart LR
A[Versioned Agent Manifest] --> B[Change Fingerprinting]
B --> C[Assurance / Impact Graph]
C --> D[Selective Test Planner]
D --> E[Execution and Oracles]
F[DeltaBench Scenarios] --> C
F --> E
E --> G[Runtime Evidence and Traces]
G --> H[Certificate Status]
Captures security-relevant state such as model identity, prompts, tools, schemas, permissions, policies, memory configuration, dependencies, and runtime controls.
Records which security-relevant elements differ between the certified and candidate configurations.
Links changed components to assurance claims and candidate tests.
Constructs a scoped suite from impacted tests plus risk-triggered sentinels. It escalates when impact cannot be bounded conservatively.
Runs selected scenarios and evaluates task behavior, policy violations, containment, attack success, and regression outcomes.
Evidence remains configuration-scoped and traceable to the exact change, model profile, mutation, test, and repetition.
DeltaCert-Agent — research prototype for change-impact-aware recertification of tool-using LLM agents.