Skip to content

Commit

Permalink
simple-tokenizer: whoops, need to escape \
Browse files Browse the repository at this point in the history
  • Loading branch information
mrjbq7 committed Apr 20, 2015
1 parent db1485b commit d235a65
Showing 1 changed file with 1 addition and 1 deletion.
2 changes: 1 addition & 1 deletion basis/simple-tokenizer/simple-tokenizer.factor
Original file line number Diff line number Diff line change
Expand Up @@ -5,7 +5,7 @@ IN: simple-tokenizer

EBNF: tokenize
space = [ \t\n\r]
escaped-char = "\" .:ch => [[ ch ]]
escaped-char = "\\" .:ch => [[ ch ]]
quoted = '"' (escaped-char | [^"])*:a '"' => [[ a ]]
unquoted = (escaped-char | [^ \t\n\r"])+
argument = (quoted | unquoted) => [[ >string ]]
Expand Down

0 comments on commit d235a65

Please sign in to comment.