v0.7.0
What's New
-
New Feature:
split_at_delimitersfor delimiter-based text splitting- Splits at every delimiter occurrence (unlike
chunkwhich is size-based) - Supports
include_delimoption: "prev", "next", or "none" - Supports
min_charsfor merging short segments
- Splits at every delimiter occurrence (unlike
-
Refactored: Modular Rust crate structure (
chunk.rs,split.rs,delim.rs) -
Optimized: Single-pass min_chars merging and Vec pre-allocation
-
Python (
chonkie-core): Addedsplit_offsets() -
JavaScript (
@chonkiejs/chunk): Addedsplit()andsplit_offsets() -
Fixed: Updated bump-version script to include all version locations