v1.5.5

Chonkie v1.5.5 🦛

A patch release focused on stability improvements and bug fixes. This release makes Chonkie more robust for users with partial dependencies and custom implementations.

🐛 Bug Fixes

• OpenAI Lazy Import - Users without openai installed can now import Chonkie without errors. Previously, importing chonkie would fail with ModuleNotFoundError even when not using OpenAI features. (#481)

• Multiprocessing Safe by Default - Custom chunkers now work out-of-the-box without pickle errors. The BaseChunker now defaults to sequential processing, with parallel processing available as an opt-in. (#471)

• CodeChunker Leaf Node Handling - Fixed an edge case where leaf nodes in the syntax tree could produce empty output, causing valid code to be dropped during chunking. (#473)

• SlumberChunker Safe Split - Improved split index handling in SlumberChunker for better reliability. (#479)

🧹 Code Quality

• CodeChunker Cleanup - Removed dead code, improved variable naming consistency, and standardized UTF-8 decoding with error handling. (#482)

📚 Documentation

• Updated recipe repository link in documentation (#476)

---

What's Changed

• fix: openai lazy import by @chonk-lain in #481
• fix: make BaseChunker multiprocessing safe by default by @anaslimem in #471
• Fix leaf node handling in CodeChunker to prevent missing chunks by @chimchim89 in #473
• chore: cleanup CodeChunker leaf node handling by @chonknick in #482
• slumber chunker with safe split_index by @chonk-lain in #479
• Update recipe repository link in documentation by @bolzzzz in #476
• chore: bump version to 1.5.5 by @chonknick in #483

New Contributors

• @anaslimem made their first contribution in #471
• @bolzzzz made their first contribution in #476

Full Changelog: v1.5.4...v1.5.5