Skip to content

Benchmark v1: train and dev

Pre-release
Pre-release

Choose a tag to compare

@omkar-k0 omkar-k0 released this 19 Nov 06:43

Run archives for the faultline benchmark, train and dev splits, generated 2026-11-18 from benchmark/plan.toml on branch m2-benchmark. Projects: jaffle_shop, stripe, court_cases (synthetic, our own).

Asset Runs sha256
benchmark-train.tar.gz 96 faulted + 30 clean cf3b50902a87cbb5f0b64583ee5484080291f37a0a3e10af62f6363be6a97287
benchmark-dev.tar.gz 48 faulted + 30 clean 4b03de862025322908c3b3036bc9b8d7617139e3a01eb3dd6403ecea504ed5a4

The same hashes are in benchmark/manifest.json. Each incident directory holds the dbt artefacts, the dbt log, the workspace git log and an aggregate profile of every table. No raw rows. Ground truth lives in the repository under benchmark//. The held-out split is not part of this release.