Skip to content

v0.6.8

Latest
Compare
Choose a tag to compare
@eiennohito eiennohito released this 14 Dec 01:45
· 17 commits to develop since this release

Highlights

Surface Projections

  • For chiTra compatibility SudachiPy can now directly produce different tokens in the surface field.
  • Original surface is accessible via Morheme.raw_surface() method
  • It is possible to customize projection dictionary-wise, via Config object, passing it on a dictionary creation, or for a single pre-tokenizer.