Skip to content

v0.1.2

Choose a tag to compare

@ictorv ictorv released this 19 Jan 16:31
· 2 commits to main since this release
d8a76cb
  • Directly pass_file() path with encoding type
  • fit() to create vocabulary
  • encode() & decode() for LLMs Tokenization