Skip to content

Seed 2 traces

Latest

Choose a tag to compare

@samarmstrong samarmstrong released this 11 Nov 21:50

The six run directories of seed 2 (outputs/vl/{a-plain,b-conveyor,c-review,d-tests,a-plain-stripped,c-review-stripped}/sonnet-5.5_medium/20261110T1535), Sonnet 5.5 medium on Vertex, 20 problems, 101 checkpoints per arm. Each checkpoint's workspace snapshot, Claude Code trace, reviewer and shadow-reviewer verdicts and hidden-test results are included, with the stripped-spec diff and manifest, as a tar.zst (29 MB, sha256 c5e0881777448e2285a06f26bb3824b2ff6502b6b17483267207dbf85b53fd51). The traces were scanned for credential patterns before packing, and the run used a dedicated single-purpose key that has since been shredded. The results table, CSV, pooled intervals and flip rate are in results/seed-2/ (commit 3cbbfe2). Read the Deviations section of docs/preregistration-seed-2.md before using them: the traces of five errored reviewer runs were lost, and their as-run rows are in results/seed-2/asrun-backup/.