Skip to content

v0.5.1: 25 MB document ceiling via streaming extraction

Choose a tag to compare

View all tags
@cyanheads cyanheads released this 17 Aug 04:22
· 9 commits to main since this release
v0.5.1
This tag was signed with the committer’s verified signature.
cyanheads Casey Hand
SSH Key Fingerprint: lkZCAfVCK5qsrcvEYCs0BnVRDCX7pKsdCZkw5yYKMuw
Verified
Learn about vigilant mode.
479472c
This commit was signed with the committer’s verified signature.
cyanheads Casey Hand
SSH Key Fingerprint: lkZCAfVCK5qsrcvEYCs0BnVRDCX7pKsdCZkw5yYKMuw
Verified
Learn about vigilant mode.

25 MB document ceiling via streaming extraction

  • Raised the content document fetch ceiling 5,000,000 → 25,000,000 bytes, reaching the largest enacted bills in either published format (116th Congress H.R. 133: 6,790,482 bytes as Formatted Text, 9,812,888 as XML) (#56)
  • New incremental extractor streams and retains only the requested character window instead of buffering the whole body, held byte-identical to the existing extractor by a differential test
  • Fixed: a body that fails mid-stream now maps to document_fetch_failed; the document_too_large recovery hint no longer points at a format that fails the same way

CHANGELOG v0.5.1

Assets 3
Loading