What's New
- Improve performance for documents that have very distant semantic boundaries. #1184
Python
- Build
abi3twheels for free-threaded Python. #1180 - Release the GIL while loading Rust-backed tokenizers and running Rust-only chunking calls for
TextSplitter,MarkdownSplitter, andCodeSplitter. Callback-backed splitters continue to hold the GIL while calling into Python. #1183
Full Changelog: v0.31.0...v0.32.0