Skip to content

v0.2.0

Choose a tag to compare

View all tags
@stef41 stef41 released this 10 Apr 16:39
· 8 commits to master since this release
v0.2.0
fd4594d

What's Changed in v0.2.0

  • add tokenizer training data coverage estimation
  • add visual token diff between tokenizers
  • add GGUF tokenizer extraction

Full Changelog: v0.1.0...v0.2.0

Assets 4
Loading