Skip to content

Reforge Pipeline Data v1.0

Latest

Choose a tag to compare

@NicolasKol NicolasKol released this 01 Mar 18:03

Reforge reproducibility artifact (data-v1.0)

This release contains precomputed pipeline outputs allowing the evaluation
notebooks to run without external LLM calls.

Setup:
Extract the archive into docker/local-files/ so the structure becomes:

docker/
local-files/
artifacts/
ghidra/

Then run the notebooks normally. The pipeline automatically detects local artifacts.

Contents:

  • Oracle outputs for test corpus
  • Join results
  • Ghidra decompilation outputs
  • Join mappings
  • Benchmark results for 7 evaluated models

The release is pinned to a commit known to correctly load and evaluate the artifacts.