-
Notifications
You must be signed in to change notification settings - Fork 0
All issues
Issue creation is restricted in this repository
Issues
is:issue state:open
is:issue state:open
Search results
Release process: package a run, its closed issues and its measured delta
publishingThe results page, contract and docsThe results page, contract and docsStatus: Open.#13 In hookdeck/evals;Track the CLI agent-safety work that came out of this benchmark
findingA result we do not yet understand and should investigateA result we do not yet understand and should investigateStatus: Open.#12 In hookdeck/evals;Confirm the docs-suppression mechanism rather than inferring it
findingA result we do not yet understand and should investigateA result we do not yet understand and should investigateStatus: Open.#10 In hookdeck/evals;Start LOOPS.md: record improvement loops with before and after
publishingThe results page, contract and docsThe results page, contract and docsStatus: Open.#9 In hookdeck/evals;Investigate and resolve stages are too thin to publish as scores
scenarioScenario coverage, design or correctnessScenario coverage, design or correctnessStatus: Open.#8 In hookdeck/evals;Review and merge or drop the Codex cost-reporting branch
harnessRunner, scorers, provisioner and CIRunner, scorers, provisioner and CIStatus: Open.#6 In hookdeck/evals;Decide which models and scenarios earn a place in the weekly run
harnessRunner, scorers, provisioner and CIRunner, scorers, provisioner and CIStatus: Open.#5 In hookdeck/evals;Nearly every failure is Codex: real finding or model capability?
findingA result we do not yet understand and should investigateA result we do not yet understand and should investigateStatus: Open.#4 In hookdeck/evals;Outpost has one scenario carrying a whole product's score
scenarioScenario coverage, design or correctnessScenario coverage, design or correctnessStatus: Open.#3 In hookdeck/evals;Why do our skills make the weak model worse?
findingA result we do not yet understand and should investigateA result we do not yet understand and should investigateStatus: Open.#2 In hookdeck/evals;