Release v1.0.8 · feyninc/chonkie

✨ Highlights

Use base_url with OpenAIEmbeddings to use OpenAI API compatible embedding services!
You can now provide the AutoEmbeddings a URI string with the alias to choose different providers for a model simply and easily. Just do AutoEmbeddings.get_embedding("model2vec://minishlab/potion-base-8M") or equivalently for the sentence_transformers version do AutoEmbeddings.get_embedding("st://minishlab/potion-base-8M"). This would work with all the supported embeddings in Chonkie. As Chonkie grows, it would support various providers and these notations help you choose between them quite easily.
Added full support for the chonkie.cloud chunkers with updated support for NeuralChunker and SlumberChunker.

Tutorial: Add example to show SlumberChunker with OpenRouter models by @chonknick in #103
Tutorial: fix the tutorial to remove the Invalid Notebook error by @chonknick in #104
Tutorial: Update the readability of the tutorial with better markdown by @chonknick in #105
Feat: update workflow by @not-lain in #94
Feat: Enhance the CI/CD Pipeline to have linting run in parallel by @chonknick in #106
Fix: Linting errors + Add cloud.SDPMChunker + cloud.LateChunker by @chonknick in #107
Feat: Add the base_url to the OpenAIEmbeddings and **kwargs support by @chonknick in #108
Add RAGHub by @chonknick in #111
Fix: Better AutoEmbeddings model matching + URI support for providers by @chonknick in #146
Feat: Add URI support via provider://organization/model style strings in AutoEmbeddings by @chonknick in #148
Enhance chunker module by adding NeuralChunker and SlumberChunker to the imports and all list for improved functionality. by @chonknick in #150
Minor: fix error messages in cloud.NeuralChunker by @chonknick in #152
Fix: Add NeuralChunker and SlumberChunker to the chonkie.cloud by @chonknick in #151

Full Changelog: v1.0.7...v1.0.8