Skip to content

SanctionBench 1.0.0

Latest
Latest

Choose a tag to compare

View all tags
@hangingahaw hangingahaw released this 08 Aug 01:21
1.0.0
30a6755
This commit was signed with the committer’s verified signature.
hangingahaw Haihang Wang
SSH Key Fingerprint: LIVC9JafF2cceIvIgwqwTSpmZSvKySk/oDBJ9OlO4fY
Verified
Learn about vigilant mode.

SanctionBench 1.0.0 is the first public release of an evidence-traceable benchmark for legal citation verification and pre-filing document audit.

Highlights:

  • 76 matched fake and real citation pairs, covering 152 citation items
  • 10 whole-document scenarios covering 196 authorities
  • Closed-book and tool-assisted evaluation conditions
  • Provider-neutral model adapters, deterministic grading, reproducibility receipts, and submission packaging
  • A public development leaderboard with explicit separation from organizer-run private-holdout results

Release assets:

  • Wheel SHA-256: b876157294f016691bd710d2b3f95f6c8938e5132a6082ddd10ceb84fe98d541
  • Source archive SHA-256: 9097d5b3448e21edd373793b89363c5fe07797379ca8ce3f761494e36d988ae8
  • PUBLIC_EXPORT_MANIFEST.json audits the 114-file public payload and confirms that the official private holdout is excluded.

See README.md for the benchmark rationale and docs/SCORING.md for the scoring contract.

Assets 5
Loading