Join GitHub today
GitHub is home to over 36 million developers working together to host and review code, manage projects, and build software together.Sign up
Escaping quotes doesn't work correctly #177
Well...... im a bit puzzled at what's happening here:
$ node > var line = "plz foo with '\''"; undefined > line 'plz foo with \'\'\'' > line.match(/'[^']+'|\S+/g) [ 'plz', 'foo', 'with', '\'\'\'' ] > '\''.match(/'[^']+'|\S+/g) [ '\'' ]
So the 'tokenizer' is identifying 4 chunks, at least through node. When I debug through it it somehow matches 5:
I have something partial here (before trying to swap out the tokenizer, I wanted to test it out)
Surprisingly, that last test doesn't fail.
@vpzomtrrfrt I think i might have a fix for this:
However, some of the tests sort of expect extra lines......