SciPIvot v1.0.0 — 248 cases, prompts, results, and project-record access

First complete release of SciPIvot: Benchmarking Principal-Investigator Judgment at Pivotal Moments of Scientific AutoResearch Agents.

• Question set — 248 cases (data/questions.json, plain text twin): both plans in exact wording, reference answers, and a snapshot pointer to the frozen project record each case is asked against
• Project records — 230 frozen records (26 projects, 21 GB compressed) on Hugging Face, byte-for-byte as mounted for the paper's models; scripts/fetch_records.py downloads and verifies them
• Prompts — exact evaluation, reconsideration, and case-writing instructions
• Aggregate results — all twelve conditions with uncertainty estimates
• Scripts — make_prompt.py, run_project.py (Claude Code / Codex sandboxed runner, both option orders), score.py (paper scoring + bootstrap CIs)

Paper: arXiv:2610.21082 · Landing page: autoresearch-factory.github.io/SciPIvot