Skip to content

Sonic core v0.1.3

Choose a tag to compare

View all tags
@github-actions github-actions released this 09 Jul 18:15
core-v0.1.3
This tag was signed with the committer’s verified signature.
RemiBardon Rémi Bardon
GPG key ID: FE713FF38988654D
Verified
Learn about vigilant mode.
5c5fe14
This commit was signed with the committer’s verified signature.
RemiBardon Rémi Bardon
GPG key ID: FE713FF38988654D
Verified
Learn about vigilant mode.

Changes

Dependency updates:

  • Bump jieba-rs from 0.9 to 0.10 (in 5d4a432)
  • Disable unnecessary rocksdb features (in 421d13d)
  • Disable default features for all dependencies (in cd7f328)

New Features

  • feat: Improve the tokenizer to avoid splitting special tokens (in f290006)
  • feat: Make tokenizer pattern matching opt-in (in ddd6848)
  • feat: Make tokenizer pattern matching non-breaking (in e744fd0)
Assets 2
Loading