Skip to content

v1.0.0-beta1

Pre-release
Pre-release

Choose a tag to compare

@broken broken released this 23 Jul 18:53
· 916 commits to master since this release

Major updates:

  • Include data necessary for normalize & case folding ops.

Minor updates:

  • Update unit tests to work with Python3.
  • Fix some wordpiece corner case bugs.
  • Wordpiece efficiency improvements.
  • Add missing shape_fn to Wordpiece's tokenizeWithOffsets.