Repository navigation
Per-run artifact bundles for the twelve runs published on https://evals.preetdhaliwal.dev — one bundle-<run_id>.tar.gz per run, SHA256SUMS over all of them, and bundles.json (run, harness, model, size, sha256).
Each bundle holds, per attempt: the agent's patch (exact bytes), the normalised and native trajectories, the per-call inference ledger (timing, tokens, cost, status; no request or response bodies), the CLI's stdout; per attempt on the eval side: the official harness's eval_report.json, full test_output.txt, run_instance.log and resource_usage.json; per run: every LLM-judge pass, a README.md with the provenance block and the re-grade command, and preds.jsonl (also committed under published-runs/).
Strings belonging to the rig were removed before packing (VPC-internal host names, the per-run gateway key an agent printed by dumping its environment, a queue receipt handle; 203 replacements in 8 of 12 runs, all in attempts on three instances). Patches were never rewritten. The gateway's request and response bodies are not included.
Re-grade any run with no infrastructure: see the site's Downloads page or docs/SETUP.md step 0.