Skip to content

Bling Fire v0.1.5
Compare
Choose a tag to compare
@SergeiAlonichau SergeiAlonichau released this 12 Mar 21:14
· 90 commits to master since this release
v0.1.5
3d90b41
This commit was created on GitHub.com and signed with GitHub’s verified signature. The key has expired.
GPG key ID: 4AEE18F83AFDEB23
Expired
Learn about vigilant mode.
  • Added byte BPE algorithm support
  • Added GPT2, Roberta tokenization models
  • Added hyphenation / syllabification APIs and a sample model: syllab
  • Added URL tokenization models: uri100k, uri250k, uri500k
  • Some small changes in the C# interface (it should be backwards compatible), uses Span instead of byte[] to allow on stack allocations of input and output buffers
Assets 2