Skip to content

CaptchaBench 16K Evaluation Subset

Latest
Latest

Choose a tag to compare

View all tags
@Linzy19 Linzy19 released this 10 Aug 09:21
· 9 commits to main since this release
v1.0.0
d49884c

CaptchaBench 16K evaluation subset

This release contains the full stratified benchmark subset:

  • 16,000 adversarial PNGs: 2 generators × 8 attack methods × 1,000 samples
  • 16,000 paired JSON annotations
  • One source-to-target match file and one attack-run metadata file for each generator--method cell
  • A normalized 16,000-record manifest.jsonl, summary.json, and SHA256SUMS

The 16 image archives are split by generator and method to stay within GitHub release-asset limits. Download every CaptchaBench_16k_*.tar.gz archive and CaptchaBench_16k_metadata.tar.gz, verify with shasum -a 256 -c SHA256SUMS, then extract them in the same directory.

See DATASET.md for layout and extraction details.

Assets 20
Loading