Releases: boxbeam/RedLex
Releases · boxbeam/RedLex
Fixed Parser
Refactor TokenType to remove unneeded methods
No changes in behavior.
Add wrapper tokens
Wrapper tokens are used to allow you to create aliases for tokens. Example:
word ::= [a-z]+
name ::= word
This can be useful when needing to extract multiple tokens of the same type from one statement.
Add support for unicode escape sequences
1.3.2.2 Add support for unicode escape sequences
Make DebugToken not subject to recursion rules
This should fix debug mode causing different lexer behavior
Improve and optimize recursion stopper
1.3.2 Improve and optimize recursion stopper
Create debugging tools
Lexer#debug() creates a DebugLexer, which can return a DebugHistory after each tokenizing attempt
Create Parser tool
- Simple parser combinator allows you to define complex parsers in terms of functions that handle individual tokens
Fix bug with case-insensitive strings
1.2.1 Fix bug with case-insensitive strings
Add support for case-insensitive strings
1.2 Add support for case-insensitive strings