Skip to content

Specify transformer model
Compare
Choose a tag to compare
@R1j1t R1j1t released this 06 Sep 11:42
· 53 commits to master since this release
v0.3.0
be9c064
This commit was created on GitHub.com and signed with GitHub’s verified signature. The key has expired.
GPG key ID: 4AEE18F83AFDEB23
Expired
Learn about vigilant mode.

This release adds following important changes:

  1. Feature addition: Specifying the transformer model
    This will enable the package to be used on other languages as well for which transformers has a model
  2. Feature addition: specify the maximum edit distance
  3. Update: Vocab loading now happens from the transformers tokenizer. Previously it used a static file (vocab.txt)

A big thanks to @dc-aichara for contributing Feature addition 1 and 2.

Assets 3