CaptchaBench 16K Evaluation Subset

CaptchaBench 16K evaluation subset

This release contains the full stratified benchmark subset:

• 16,000 adversarial PNGs: 2 generators × 8 attack methods × 1,000 samples
• 16,000 paired JSON annotations
• One source-to-target match file and one attack-run metadata file for each generator--method cell
• A normalized 16,000-record manifest.jsonl, summary.json, and SHA256SUMS

The 16 image archives are split by generator and method to stay within GitHub release-asset limits. Download every CaptchaBench_16k_*.tar.gz archive and CaptchaBench_16k_metadata.tar.gz, verify with shasum -a 256 -c SHA256SUMS, then extract them in the same directory.

See DATASET.md for layout and extraction details.