You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
Sub-issue of #9216 (frozen-repo benchmark harness), epic #8534. Requirement 4 of that issue: candidate agents are untrusted by construction — arbitrary third-party code, submitted to be scored. Running it needs the isolation the attested-evaluation stack already builds, plus the sandbox properties that matter regardless of whether attestation hardware is present.
Sandbox properties that hold with or without SNP hardware, since attestation is not a sandbox: no network egress during scoring (the runner already proves --network none works), read-only task input, bounded CPU/memory/wall-clock, non-root, no host filesystem access. A candidate agent that can reach the network can fetch the realized future and score perfectly.
Fail-closed: a run that cannot establish its claimed isolation does not score, matching decideAttestedRunOutcome's existing fail-closed posture under a claimed TEE.
Deliverables
Candidate-agent execution harness built on the existing runner image and attester seam
Tests proving each sandbox property, including a real fail-closed test (a run claiming isolation it does not have must not produce a score)
Documented resource limits and the reasoning behind each
Expected outcome
Third-party code can be scored without trusting it, and without a second, weaker execution path existing alongside the attested one.
References
Sub-issue of #9216. Reuses #9214 (scripts/replay-runner/), #9211 (scripts/attested-backtest-run.ts), #9213 (k8s/coco-dev/). Trust tiers: #9215. Depends on #9259. Epic #8534.
Context
Sub-issue of #9216 (frozen-repo benchmark harness), epic #8534. Requirement 4 of that issue: candidate agents are untrusted by construction — arbitrary third-party code, submitted to be scored. Running it needs the isolation the attested-evaluation stack already builds, plus the sandbox properties that matter regardless of whether attestation hardware is present.
Requirements
k8s/coco-dev/) already exist. This issue adapts them to execute a candidate agent, it does not start a parallel execution path.--network noneworks), read-only task input, bounded CPU/memory/wall-clock, non-root, no host filesystem access. A candidate agent that can reach the network can fetch the realized future and score perfectly.attestedonly under genuine SNP,reproducibleotherwise. Never label an unattested run as attested because the plumbing supports it.decideAttestedRunOutcome's existing fail-closed posture under a claimed TEE.Deliverables
Expected outcome
Third-party code can be scored without trusting it, and without a second, weaker execution path existing alongside the attested one.
References
Sub-issue of #9216. Reuses #9214 (
scripts/replay-runner/), #9211 (scripts/attested-backtest-run.ts), #9213 (k8s/coco-dev/). Trust tiers: #9215. Depends on #9259. Epic #8534.