Skip to content

0.27.22

Choose a tag to compare

@CyMule CyMule released this 08 Oct 14:43
· 4 commits to main since this release
2e49ed9

This release rolls up all changes since 0.27.16.

Fixes

  • Faster chunk serialization with stable source-element IDs. Avoid copying orig_elements twice during serialization. IDs minted during serialization now remain stable across calls, including inside orig_elements; explicit and hash-derived IDs are unchanged. (#4472)
  • Preserve figure and table images with differently ordered coordinates. Derive crop boxes from coordinate extents to avoid invalid boxes and silently dropped images. (#4371)
  • Handle empty XLSX worksheets without crashing. Empty sheets yield no connected components and partitioning continues. (#4531)
  • Chunk text containing literal tokenizer special-token spellings. Text such as <|endoftext|> is counted as ordinary text instead of raising ValueError. (#4533)
  • Preserve slide number and category depth on PPTX email addresses, including custom starting page numbers. (#4534)

Compatibility notes

PPTX email addresses and elements that follow an email on the same slide receive different element_id values when reprocessed. Consumers that upsert or deduplicate by element_id should account for this change.

Maintenance

  • Start CI tests without waiting for setup and lint. (#4521)
  • Add the Transform v2 benchmark note to README. (#4532)

Full changelog: 0.27.16...0.27.22