You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
This commit was created on GitHub.com and signed with GitHub’s verified signature.
Deploys main at ba70ba1. It also carries #279, whose own release (prod-20261002-20b1479) was cancelled before deploying, so one deploy ships both.
#280 Publish a release's tasks on selfbench.dev, to browse and download: Publish Tasks in the release dialog; a Tasks list and viewer on repository pages; downloads without the repository snapshot; task data kept out of search and training crawls, cached a minute, and marked with a canary once its secret is set (Terraform adds the empty selfbench-task-canary secret)
#279 Keep run summaries in the database so the Results page stops reading every run's record
Production: Time-Limited Trials Scored and Backfillable
This commit was created on GitHub.com and signed with GitHub’s verified signature.
Deploys main at 6e6fd60. - #282 Score trials whose agent hit its time limit instead of dropping them: Harbor's verifier result now counts, Pi timeout costs are recovered, timed-out trials are marked in the app, and backfill-agent-timeouts.js can score earlier timeouts
Production: Long-Prompt Costs Priced Where Rates Change
This commit was created on GitHub.com and signed with GitHub’s verified signature.
Deploys main at 2a70a03. - #284 Price long prompts only where rates change, and recover missing eval costs - #287 Find Claude Code's own cost by its result event - #285 Close the task viewer on a click around it, and make the snapshot rebuild one command - #286 Publish a release's tasks by default, and box Publish Tasks so it is plain to see
Production: Faster Results Page from Stored Run Summaries