Skip to content

DreamBench-SWE v2 — Paper A Artifact

Choose a tag to compare

View all tags
@iroiro147 iroiro147 released this 08 Jul 13:33
· 8 commits to main since this release
v2.0.0
8896e9c

DreamBench-SWE v2 — Paper A Submission Artifact

Artifact SHA-256: 539241e85982a40dc61bd692eece14b0fcdbff174fbaef2be5b7a16a7f412516

arXiv source package SHA-256: c919edcae62181b5d8c77d34624b2490c9f3436b87688be4e6fb99dcd379ea44

Verify the artifact download with:

shasum -a 256 dreambench-swe-artifact.tar.gz

Included: public benchmark fixtures, evaluation scripts, frozen folded analysis artifacts, package manifest/checksums, tests, and publication figure PDFs.

Excluded by design: hidden scoring oracle labels, reference-solution trajectories, and raw hosted-model result directories. These exclusions preserve benchmark integrity and avoid exposing answer keys. Live hosted-model reruns require external agent credentials and are new experiments, not exact replay of the paper fold.

Public history reconstruction notice (2026-07-10)

The artifact tarball with SHA-256 539241e85982a40dc61bd692eece14b0fcdbff174fbaef2be5b7a16a7f412516 was withdrawn because it unintentionally included raw operational fixtures. The other audited assets remain available. Use v2.0.5 for the current public artifact.

The public Git graph and tag metadata were reconstructed with a neutral GitHub noreply identity. External clones or caches made before reconstruction cannot be revoked. The frozen Paper A analysis and reported results were not changed by this operation.

Assets 5
Loading