Skip to content

v0.7.0

Choose a tag to compare

@chonknick chonknick released this 21 Jan 04:01
· 27 commits to main since this release

What's New

  • New Feature: split_at_delimiters for delimiter-based text splitting

    • Splits at every delimiter occurrence (unlike chunk which is size-based)
    • Supports include_delim option: "prev", "next", or "none"
    • Supports min_chars for merging short segments
  • Refactored: Modular Rust crate structure (chunk.rs, split.rs, delim.rs)

  • Optimized: Single-pass min_chars merging and Vec pre-allocation

  • Python (chonkie-core): Added split_offsets()

  • JavaScript (@chonkiejs/chunk): Added split() and split_offsets()

  • Fixed: Updated bump-version script to include all version locations