Release v1.5.0 · feyninc/chonkie

✨ Highlights

This version removes support for Py3.9, and adds support for Py3.13.
Added a RowTokenizer to chunk tables based on row values, thanks to @chonk-lain.
Parameter hints now pass through from their original object to the pipelines, thanks to @akx!
Multiple bug fixes and patches!

Fix broken pricing link by @shreyash-chonkie in #389
Feat: Add Pipeline to the cloud client + Add Docs Pages by @chonknick in #390
Fix: Add update flow if the pipeline already exists on the run() by @chonknick in #391
fix(slumber): preserve spaces in chunk concatenation by @kiendoantrung in #381
chore: update geminie geinie default parameters by @chonk-lain in #393
Add support for custom Chonkie tokenizer instances by @chonknick in #396
Feat: Add ByteTokenizer by @chonknick in #397
Docs: Add byte-level tokenizer to documentation by @chonknick in #398
Fix: Add ability to wrap AutoTokenizer in another AutoTokenizer instance by @chonknick in #399
Fix: Deprecate Py3.9 and add support for Py3.13! by @chonknick in #320
feat: add row based table chunker by @chonk-lain in #392
Feat: Add Catsu embeddings support to Chonkie by @chonknick in #402
Fix: Pass-through original object type through pipeline registration functions by @akx in #394

Full Changelog: v1.4.2...v1.5.0