专注于可解释的NLP技术 An NLP Toolset With A Focus on Explainable Inference

The fast scanner generator for Java™ with full Unicode support

CogComp's Natural Language Processing Libraries and Demos: Modules include lemmatizer, ner, pos, prep-srl, quantifier, question type, relation-extraction, similarity, temporal normalizer, tokenizer, transliteration, verb-sense, and more.

NLP framework: sentence detector, tokeniser, pos-tagger and dependency parser

SNL(Small Nested Language) Compiler. Maven jUnit Tokenizer Lexer Syntax Parser. 编译原理 词法分析 语法分析

Fuzzing Parsers with Tokens

Some native scoring script plugins for elasticsearch

AC自动机 文本相似检索 词库匹配 分词器

Token Replacer is a simple and small Java Library that helps replacing tokens in strings. You can replace the tokens with static values or create values "on-the-fly" by calling a generator. You can even pass arguments to the generator which makes it pretty powerful.

lucene chinese analyzer and tokenizer by jieba.

Vietnamese Tokenizer for Apache Solr

🔧 My studies on context-free grammar, using ANTLR4 (C++) to generate the parser files. Some basics are developed, such as token processing, recursion, variable definition, array processing, Abstract Syntax Tree (AST) manipulation, UNICODE support, and error handling.

Twitter Tokenizer

solr-ik

A flexible and customizable complete parser with your manual configuration written with java language and javafx library

Search query language parser written in Java

Course Project for CS536 Intro to PLs and Compilers

A Java-based Library for the Processing of Arabic Text

A very small and versatile parser used to evaluate simple expressions

A simple search engine that has been implemented for the Information Retrieval course