-
Notifications
You must be signed in to change notification settings - Fork 1
Pull requests: OpenRouterTeam/benchmark-harness
Author
Label
Projects
Milestones
Reviews
Assignee
Sort
Pull requests list
feat: add agent_dx benchmark for OpenRouter agent-experience evals
#15
opened Aug 7, 2026 by
devin-ai-integration
Bot
Loading…
5 tasks done
feat(benchmarks): chess — full games vs Stockfish, first-party original
#4
opened Aug 5, 2026 by
LukasParke
Loading…
feat(benchmarks): EvalManifestV1 — unified eval description schema + first-party manifests
#3
opened Aug 5, 2026 by
LukasParke
Loading…
feat(benchmarks): custom_eval — declarative user evals as run-config data
#2
opened Aug 5, 2026 by
LukasParke
Loading…
feat(harness): durable per-(sample, epoch) result store + fiber-scoped request context
#1
opened Aug 5, 2026 by
LukasParke
Loading…
ProTip!
Mix and match filters to narrow down what you’re looking for.