HydroTuring v0.1

First tagged release of HydroTuring: suite 0.1.0, with 37 probes (24 mass, 7 energy, 6 momentum) on the synthetic track and 106 packaged models, reference controls included. Scores are only comparable within a suite version, so cite this version alongside any score.

Archive

models/result.csv records the commit behind each row. Every model ran on every probe at 3e86a79. Later guards against NaN changed counterfactual_response and two adapters, so dhbv2 and google_flood_forecast on every probe, and every model on mass/precipitation-counterfactual, were re-run at 66118d8, and no verdict changed. Across the 32 submitted and physical models they hold 474 PASS, 131 FAIL, 579 N/A and no ERROR. An N/A means the probe could not be put to the model, and it counts neither way.

Licence

The harness, probes, reference models and adapters are released under CC BY-NC 4.0. Each model an adapter installs keeps its own licence, named under license in its model.yaml.

Known limits

• Rows were run in Docker on Apple Silicon, with some images under x86-64 emulation, not on native x86-64.
• A clean build of dhbv2 currently fails because its upstream weights URL returns 404. Its rows come from an image built with a saved copy of those weights, pinned by hash.
• SHUD runs upstream commit 851fb8c, because no upstream tag carries its canopy fix. Its pass on stage-discharge-monotonic is weak: 1 of 12 extra seeds fails.
• Three criteria were corrected while preparing this release, and the maintainer cut the version, before the steering committee was formed. GOVERNANCE.md records this.
• Some probes have known limits that this release leaves unresolved, including area-invariance, which cannot fail on 23 of its 25 passes. .claude/skills/hydroturing-evaluate-model/references/findings.md records them.