Trim whitespace around token-possibles #1

travisby opened this Issue Mar 2, 2014 · 0 comments


None yet
1 participant

travisby commented Mar 2, 2014

"{ } $" (two spaces between { and }) will pass a list ["{"; " "; "}"; "$"] to the tokenize_all* function.

The space (rightfully so) fails in the token step, and forces the program to exit.

Either we should trim extra whitespace, or filter our lists from the empty string

@travisby travisby added the bug label Mar 2, 2014

@travisby travisby closed this Apr 10, 2014

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment