Lexer

[ghost]

The lever involves some very complicated operations. You have hashing as a token mapper and all these string operations. Since String has variable lengths encoding some of the O(n) operations are secretly O(n^2). I have the same problem in my lexer for Swizzle but I use string indices rather than this so the string only has to scan starting from the current index.