Optimised tokenizer/lexer generator! 🐄 Uses /y for performance. Moo.

🌿 NodeJS PHP Parser - extract AST or tokens

Tiny JavaScript tokenizer.

JS tokenizer for LLaMA 1 and 2

Collection of developer toolkits

bison / YACC / LEX in JavaScript (LALR(1), SLR(1), etc. lexer/parser generator)

😻 Markdown with easy tokenization, a fast highlighter, and a lean HTML sanitizer

Tokenizes Chinese texts into words.

JS tokenizer for LLaMA 3 and LLaMA 3.1

Multilingual tokenizer that automatically tags each token with its type

A small ECMAScript parser, tokenizer and minifier written in JavaScript.

A very small and very fast spec compliant css lexer

A modern CSS value compiler in JavaScript

Compress GraphQL Query String

POS Tagger, lemmatizer and stemmer for french language in javascript

JavaScript Reverse Engineering Toolkit (JSRETK) - Experimental tools for analyzing (minified/obfuscated) JavaScript

A simple interpreter for a large subset of Pascal language written for educational purposes

The first language I made.

💠The Lel programming language

HTML5 compliant lexer