中文分词 词性标注 命名实体识别 依存句法分析 成分句法分析 语义依存分析 语义角色标注 指代消解 风格转换 语义相似度 新词发现 关键词短语提取 自动摘要 文本分类聚类 拼音简繁转换 自然语言处理

Gathers machine learning and Tensorflow deep learning models for NLP problems, 1.13 < Tensorflow < 2.0

Underthesea - Vietnamese NLP Toolkit

Persian NLP Toolkit

Developer friendly Natural Language Processing ✨

Jcseg is a light weight NLP framework developed with Java. Provide CJK and English segmentation based on MMSEG algorithm, With also keywords extraction, key sentence extraction, summary extraction implemented based on TEXTRANK algorithm. Jcseg had a build-in http server and search modules for lucene,solr,elasticsearch,opensearch

Self-contained Japanese Morphological Analyzer written in pure Go

A Japanese Tokenizer for Business

PhoBERT: Pre-trained language models for Vietnamese (EMNLP-2020 Findings)

A Vietnamese natural language processing toolkit (NAACL 2018)

Natural Language Toolkit for Malaysian language, https://malaya.readthedocs.io/

CogComp's Natural Language Processing Libraries and Demos: Modules include lemmatizer, ner, pos, prep-srl, quantifier, question type, relation-extraction, similarity, temporal normalizer, tokenizer, transliteration, verb-sense, and more.

A suite of Arabic natural language processing tools developed by the CAMeL Lab at New York University Abu Dhabi.

A neural network architecture for NLP tasks, using cython for fast performance. Currently, it can perform POS tagging, SRL and dependency parsing.

API of Articut 中文斷詞 (兼具語意詞性標記)：「斷詞」又稱「分詞」，是中文資訊處理的基礎。Articut 不用機器學習，不需資料模型，只用現代白話中文語法規則，即能達到 SIGHAN 2005 F1-measure 94% 以上，Recall 96% 以上的成績。

Python version of Sudachi, a Japanese tokenizer.

A Japanese tokenizer based on recurrent neural networks

Juman++ (a Morphological Analyzer Toolkit)

Empower Sequence Labeling with Task-Aware Neural Language Model | a PyTorch Tutorial to Sequence Labeling

Sudachi in Rust 🦀 and new generation of SudachiPy