Skip to content

v1.0.0

Latest

Choose a tag to compare

@kholdrex kholdrex released this 04 Oct 01:49
· 1 commit to main since this release

Data and analysis for the paper "Behavioral test feedback for one-step repair of LLM-generated code" (O. Kholodniak, O. Prokhorov).

  • Corpus of 24 behavioral contracts for database-backed Ruby on Rails code with diagnostic and held-out test partitions.
  • Paired outcomes of the main experiment (960 roots), the confirmatory experiment with a length-matched control (1,080 roots) and the signal-only addendum.
  • Analysis code reproducing every reported value, frozen protocols of the confirmatory experiment and the addendum, and isolated replay of saved programs.

Evidence archives (prompts, responses, programs and evaluation logs): https://doi.org/10.5281/zenodo.23129973