v1.4.0
✨ Highlights
- Introduced
chonkie.Pipelinefor composable chunking + retrieval workflows - Added
TableChefandTableChunkerfor smart table-aware chunking, plusMarkdownChef.parse()for quick Markdown ingestion - New search methods land on
ChromaHandshake,ElasticHandshake, andTurboPufferHandshakefor one-line vector-store checks - Two new visualizer themes—
ocean_breezeandmidnight—for prettier chunk inspection - File-handling helpers baked into every cloud chunker for drag-and-drop simplicity
🔨 Breaking
numpyis now a core dependency—remove any pinned excludes in your env- The old
tokenizer_or_token_counterkwarg is gone; usetokenizereverywhere (single, consistent name)
What's Changed
- Feat: add table chef by @chonk-lain in #297
- Feat: add search method for chroma handshake by @AlanPonnachan in #293
- docs: update docs by @chonk-lain in #307
- Feat: Add
parsemethod to theMarkdownChef+ Enhance testing for chefs by @chonknick in #310 - Fix: Remove error for malformed/absent tables in
Documentand more... by @chonknick in #308 - Feat: Add ElasticHandshake by @AlanPonnachan in #314
- Docs: Update Cloud API docs by @shreyash-chonkie in #318
- Feat: Change
tokenizer_or_token_countertotokenizerby @chonknick in #311 - docs: fix broken links in python-sdk docs by @IvanMiao in #316
- Fix: remove
legacychunkers for the next breaking change inchonkieby @chonknick in #286 - feat(visualizer): Add ocean_breeze and midnight themes by @amithadityacp in #328
- Fix: Update
TableChefto always returnMarkdownTable+ remove stalesdpmdocs by @chonk-lain in #332 - Feat: Add
numpyas a default install inchonkieby @chonknick in #333 - Feat: Add logging by @chonknick in #313
- Feat: Add
chonkie.Pipelineby @chonknick in #319 - Feat: add search method for turbopuffer handshake by @AlanPonnachan in #303
- Update docs by @shreyash-chonkie in #337
- Fix typos by @shreyash-chonkie in #338
- A test was causing an error in a test. by @cappuch in #334
- Docs: Add Pipelines + FileFetcher Documentation by @chonknick in #339
- Feat: Add pipeline tests + simplify some logic by @chonknick in #340
New Contributors
- @AlanPonnachan made their first contribution in #293
- @IvanMiao made their first contribution in #316
- @amithadityacp made their first contribution in #328
- @cappuch made their first contribution in #334
Full Changelog: v1.3.1...v1.4.0