Repository navigation
v0.4.0
pip install toktok-rs== · cargo add toktok-rs@
What's Changed
- Add embeddinggemma-2: exact token counts for Google's EmbeddingGemma 2 by @nicoloboschi in #7
Full Changelog: v0.3.0...v0.4.0
pip install toktok-rs== · cargo add toktok-rs@
Full Changelog: v0.3.0...v0.4.0