Skip to content
#

folia

Star

Here is 1 public repository matching this topic...

Language: Cython
Filter by language
All 1 Java 46 Python 7 Shell 6 C++ 5 Kotlin 4 JavaScript 3 Rust 3 Batchfile 2 C# 1 Cython 1

proycon / python-ucto

Star 29

This is a Python binding to the tokenizer Ucto. Tokenisation is one of the first step in almost any Natural Language Processing task, yet it is not always as trivial a task as it appears to be. This binding makes the power of the ucto tokeniser available to Python. Ucto itself is regular-expression based, extensible, and advanced tokeniser writt…

python nlp tokenizer computational-linguistics text-processing nlp-library folia
  • Updated Oct 31, 2023
  • Cython

Improve this page

Add a description, image, and links to the folia topic page so that developers can more easily learn about it.

Curate this topic

Add this topic to your repo

To associate your repository with the folia topic, visit your repo's landing page and select "manage topics."

Learn more