Skip to content

CrackedPDFs paper v1.0.0

Latest

Choose a tag to compare

@volkthienpreecha volkthienpreecha released this 01 Aug 09:25
fb63233

CrackedPDFs paper release

This release freezes the citable artifact for CrackedPDFs: A Controlled Benchmark for Hidden Prompt Injection in PDFs.

Paper and artifacts

Frozen benchmark

  • 29,322 PDFs
  • 4,983 base documents
  • 9,774 benign/confounder/injected triplets
  • 0.960 held-out F1
  • 95.9% paper-reported paired result

The repository includes the exact paper tables and metrics, frozen splits, reproducibility manifests, environment versions, checksums, and fifteen example triplets under paper-v1/.

Fast reproduction

With Python 3.13, Node.js 22, npm, GNU Make, and Git installed:

make smoke
make reproduce-results

make reproduce-results downloads hash-pinned frozen features and regenerates the compact result table. It does not regenerate all 29,322 PDFs.

Citation

Use the paper citation for the research contribution and DOI 10.5281/zenodo.21735803 for the versioned dataset artifact. Copyable BibTeX is provided in CITATION.bib.