v5.2 — Complete Database Collection
All databases consolidated into a single release. Replaces v4.0, v5.0, and v5.1.
What's new in v5.2
- PII redactions applied to
full_text_corpus.db— two rounds. - All databases from previous releases included in one place
Databases included
| File | Description |
|---|---|
full_text_corpus.db.gz.part_aa/ab |
Master text database — 1.39M docs, 2.77M pages, DS1-12 + DS98 + DS99 (split; cat part_aa part_ab > full_text_corpus.db.gz to reassemble) |
concordance_complete.db.gz |
Cross-reference database with email threads, folder inventory |
redaction_analysis_v2.db.gz |
2.6M redactions across 850K docs |
redaction_analysis_ds10.db.gz |
DS10-specific redaction analysis |
image_analysis.db.gz |
21,859 extracted images with descriptions |
image_analysis_clean.db.gz |
Image analysis (cleaned version) |
ocr_database.db.gz |
Tesseract OCR results |
alteration_results.db.gz |
DOJ document alteration forensic analysis |
secondary_stamps.db.gz |
Secondary Bates stamp re-OCR results |
communications.db.gz |
Communications/email analysis |
document_status.db.gz |
Document availability status tracking |
document_status_clean.db.gz |
Document status (cleaned version) |
deposition_transcripts.db.gz |
Whisper-transcribed depositions with speaker diarization |
handwriting_transcriptions.db.gz |
Handwriting transcription results |
native_files.db.gz |
Native file (XLSX/media) metadata |
transcripts.db.gz |
Audio/video transcriptions |
prosecutorial_query_graph.db |
Subpoena analysis graph |
knowledge_graph.db |
Entity-relationship graph (524 entities, 2,096 relationships) |
spreadsheet_corpus.db |
Native spreadsheet data (DS8) |
persons_registry.json |
1,538 persons with aliases and descriptions |
NATIVE_FILES_CATALOG.csv |
Non-PDF native file catalog |
VERIFICATION_URLS.csv.gz |
EFTA verification URLs |
Reassembling split files
cat full_text_corpus.db.gz.part_aa full_text_corpus.db.gz.part_ab > full_text_corpus.db.gz
gunzip full_text_corpus.db.gz