Skip to content

FastTokenize 0.1.0

Latest

Choose a tag to compare

@andrestubbe andrestubbe released this 16 Aug 15:20
· 37 commits to main since this release

⚡ Minimal, deterministic, high-performance C++/AVX2 code tokenizer and lexical analyzer for Java. Zero-allocation, O(n) syntax parsing engine.