Skip to content

Complete Anthropic eval campaign and judge backfill - #44

Merged
justsml merged 8 commits into
mainfrom
agent/anthropic-eval-campaign
Jul 29, 2026
Merged

Complete Anthropic eval campaign and judge backfill#44
justsml merged 8 commits into
mainfrom
agent/anthropic-eval-campaign

Conversation

@justsml

@justsml justsml commented Jul 29, 2026

Copy link
Copy Markdown
Owner

Summary

  • records three complete Opus 5 none-reasoning model/tool passes
  • preserves the Fable 5 low canary refusal and stops the invalid paid batch
  • adds an auditable replay-only thread judge backfill
  • completes judge coverage for all 12 Opus 5 Minimal thread rows

Verification

  • pnpm typecheck
  • all 42 Opus 5 candidate/judge rows completed
  • all 12 Opus Minimal backfill judges completed

@justsml
justsml merged commit fb97ee2 into main Jul 29, 2026
6 of 7 checks passed
@justsml
justsml deleted the agent/anthropic-eval-campaign branch July 29, 2026 02:49
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant