Skip to content

Kreyolib v0.1.0 (Initial release)

Latest
Latest

Choose a tag to compare

View all tags
@speedyk-005 speedyk-005 released this 23 Aug 20:17
· 4 commits to main since this release
v0.1.0
914eeb3
This commit was created on GitHub.com and signed with GitHub’s verified signature.
GPG key ID: B5690EEEBB952194
Verified
Learn about vigilant mode.

Initial release of Kreyolib, providing foundational Natural Language Processing tools tailored for Haitian Creole.

Highlights

  • Text Standardization & Modernization: Rule-based orthography normalization for cleaning chat slang, historical variants, and automatic article corrections.
  • Contraction Expansion: Automatic clitic and contraction expansion to convert conversational forms into full standalone tokens.
  • Diacritics Removal: Utility support to strip accent marks for legacy systems and search index normalization.
  • POS Tagging Engine: Specialized Part-of-Speech tagging pipeline trained on Universal Dependencies treebanks (Autogramm and Adolphe).

Installation

pip install kreyolib -U
Assets 2
Loading