Repository navigation
v0.9.6
- Fixed silent truncation of extracted text at Tika's 500,000-character default limit -
text_extractnow allows up to 10,000,000 characters (a fixed constant, deliberately not
configurable so independent parties derive identical ISCCs) and logs a warning when the cap is
reached; Text-Code and granular text features change for documents longer than 500,000
characters - Updated
iscc-libto 0.7.0 (now the minimum required version), which fixes Image-Codes longer
than 64 bits to follow ISO 24138:2024 - Image-Code units at 96, 128 or 256 bits change beyond
the first 64 bits and should be regenerated; 64-bit Image-Codes and ISCC-CODEs are unaffected - Updated locked dependency versions (notably
Pillow13.0.0,exiv20.19.2,xxhash4.0.1,
pypdf6.21.1,pypdfium25.14.0,resvg-py0.5.0,numpy2.5.4,bitarray3.12.2) - with
Pillow 13 EPUB cover thumbnails come out slightly different, and with exiv2 0.19.2 files written
byimage_meta_embeddiffer at the byte level (embedded metadata is unchanged) - Hardened EPUB XML parsing with an explicit parser that disables entity resolution and network
access (#156) - Fixed EXIF
XPTitle(and other WindowsXP*tags) being extracted as a raw byte listing instead
of text - changesnameand the Meta-Code for affected images (#163) - Fixed XMP struct containers being extracted as the placeholder
type="Struct"(for example as
name) - they are now skipped so the next mapped field or the file name applies (#165) - Fixed
code_metacrashing withUnicodeEncodeErroron image metadata that is not valid UTF-8,
such as legacy IPTC text - such values are now decoded as Latin-1, the IPTC default (#164) - Added support for M4A audio (
audio/mp4, withaudio/x-m4anormalized to it) -.m4afiles were
sniffed asvideo/mp4and failed with "No video stream detected"; ISCC metadata is embedded in
M4A files asISCC_*tags because TagLib drops MP4 tag names that contain a colon (#166) - Changed
text_featuresto drop a final chunk shorter than the CDC minimum chunk size (128
characters at defaults) unless it is the only chunk - its simprint carried too little evidence
and matched unrelated documents; retained simprints, offsets and sizes are unchanged, but
persisted granular text features lose such tail entries (#162) - Fixed per-call
text_avg_chunk_sizeandbyte_offsetsoptions being ignored for granular text
features -text_featuresread the global setting andcode_textdid not forward its options
Changes to generated output
Re-generate stored results for affected assets if you compare them with codes from earlier
releases:
- Text-Code and granular text features of non-PDF documents longer than 500,000 characters
- Image-Code units at 96, 128 or 256 bits (bits beyond the first 64)
- Meta-Code of images with EXIF
XP*titles, XMP struct values, or non-UTF-8 IPTC/EXIF text - Granular text features: undersized final chunks are no longer emitted
- Data-Code and Instance-Code of files written by
image_meta_embed(byte-level changes from
exiv2 0.19.2)