Release 🚀 Chunklet-py v2.3.0 — smarter sentence splitting, faster visualizer · speedyk-005/chunklet-py

✨ What's New

Non-Latin scripts in fallback splitter — Arabic, Chinese, Japanese, etc. now handled correctly via Unicode property escapes (\p{Lo}, \p{Lt})
Fallback splitter preserves quotes, parens, and numbered lists — quoted text, parenthesized content, and 1. 2. 3. lists stay as single sentences instead of getting split apart (uses hash-based masking)
Visualizer API now supports MessagePack — browser requests it automatically for ~30-50% smaller payloads; programmatic clients can opt in via Accept: application/msgpack header (JSON still default)
~2x faster span detection — replaced regex-based _find_span with a deterministic finder, no more backtracking on large texts
Visualizer extra has a new shortcut "chunklet-py[viz]"
Lazy imports for splitter libraries — faster startup
Better markdown heading detection in DocumentChunker

pkg_resources crash on install — finally sorted out the setuptools dependency mess
Custom splitter registration — no more TypeError when registering functools.partial or other callables without a __name__
Log spam with lang='auto' — stopped warning you every single time you auto-detect a language
CodeChunker tree hierarchy — methods now appear under their class instead of "global"

Python 3.10 support — Dropped becuase of recurring CI multiprocessing hangs + approaching EOL.

pip install chunklet-py -U

Feedback and bug reports welcome. Thanks!