Skip to content

v1.0-paper — Frozen Benchmark Results (Paper Reference)

Choose a tag to compare

View all tags
@yakew7 yakew7 released this 27 Jul 09:09
v1.0-paper
bbef2ba

This tag freezes the exact Fair Code benchmark results cited in the research paper currently in peer review. It exists so the paper's tables and the repository never drift apart.

🔒 Paper freeze — active

The benchmark results are frozen at this point and must not change until the paper is published. Any drift would make the paper's tables disagree with the repo. Full policy: CLAUDE.md.

  • Tag: v1.0-paper
  • Frozen commit: bbef2ba

What's frozen

  • paper/results-frozen/ — the paper's evidence (never modified, for any reason)
  • results/ — results_fairness.csv, results_performance.csv, summary.csv, figures/
  • The faircode/ analysis core and every audit.yaml manifest + dataset CSV
  • Reproducibility parameters: random_state = 42, test_size = 0.2 (stratified), DemographicParity, the six fairness metrics, and the bootstrap/permutation counts

No new audits during the freeze

The paper covers exactly seven domains, so new audits will not be merged into main until the paper is published. Contributions are still welcome — audits are parked on a branch or held with a post-paper label and merged after publication. This is a timing hold, not a rejection. Explainers, docs, and website content are unaffected.

When the freeze lifts

On publication: the benchmark may be re-run, parked audits merge, v3.0.0 is cut, and the paper's citation + DOI are added to README.md and CITATION.cff. paper/results-frozen/ stays permanently untouched as the historical record.

Assets 2
Loading