🌿 NodeJS PHP Parser - extract AST or tokens
-
Updated
May 7, 2024 - JavaScript
A grammar describes the syntax of a programming language, and might be defined in Backus-Naur form (BNF). A lexer performs lexical analysis, turning text into tokens. A parser takes tokens and builds a data structure like an abstract syntax tree (AST). The parser is concerned with context: does the sequence of tokens fit the grammar? A compiler is a combined lexer and parser, built for a specific grammar.
🌿 NodeJS PHP Parser - extract AST or tokens
Optimised tokenizer/lexer generator! 🐄 Uses /y for performance. Moo.
Multilingual tokenizer that automatically tags each token with its type
POS Tagger, lemmatizer and stemmer for french language in javascript
Collection of developer toolkits
Converts a string into an array of tokens, with useful methods for looking ahead and behind, capturing, matching, et cetera.
A small ECMAScript parser, tokenizer and minifier written in JavaScript.