v1.6.2

TeraflopAI Chunker

A new chunker has been added to your toolkit 🎉
you can now use the newly added TeraflopAI chunker freely using the code below

from chonkie import TeraflopAIChunker


chunker = TeraflopAIChunker(api_key="your_api_key_here")

text = "Your text here"
chunker.chunk(text)

What's Changed

• Fixed per-chunk overlap calculation for float context_size by @anaslimem in #512
• add teraflopai chunker by @chonk-lain in #539
• Validate tree-sitter language support in CodeChunker by @chimchim89 in #469
• chore: bump version by @chonk-lain in #541

Dependencies

• chore(deps): bump requests from 2.32.5 to 2.33.0 by @dependabot[bot] in #532
• chore(deps): bump pygments from 2.19.2 to 2.20.0 by @dependabot[bot] in #535
• chore(deps): bump cryptography from 46.0.5 to 46.0.6 by @dependabot[bot] in #534
• chore(deps): bump langchain-core from 1.2.19 to 1.2.22 by @dependabot[bot] in #533
• chore(deps): bump aiohttp from 3.13.3 to 3.13.4 by @dependabot[bot] in #538
• chore(deps): bump litellm from 1.82.3 to 1.83.0 by @dependabot[bot] in #540

Full Changelog: v1.6.1...v1.6.2