v1.6.2
TeraflopAI Chunker
A new chunker has been added to your toolkit 🎉
you can now use the newly added TeraflopAI chunker freely using the code below
from chonkie import TeraflopAIChunker
chunker = TeraflopAIChunker(api_key="your_api_key_here")
text = "Your text here"
chunker.chunk(text)What's Changed
- Fixed per-chunk overlap calculation for float context_size by @anaslimem in #512
- add teraflopai chunker by @chonk-lain in #539
- Validate tree-sitter language support in CodeChunker by @chimchim89 in #469
- chore: bump version by @chonk-lain in #541
Dependencies
- chore(deps): bump requests from 2.32.5 to 2.33.0 by @dependabot[bot] in #532
- chore(deps): bump pygments from 2.19.2 to 2.20.0 by @dependabot[bot] in #535
- chore(deps): bump cryptography from 46.0.5 to 46.0.6 by @dependabot[bot] in #534
- chore(deps): bump langchain-core from 1.2.19 to 1.2.22 by @dependabot[bot] in #533
- chore(deps): bump aiohttp from 3.13.3 to 3.13.4 by @dependabot[bot] in #538
- chore(deps): bump litellm from 1.82.3 to 1.83.0 by @dependabot[bot] in #540
Full Changelog: v1.6.1...v1.6.2
