Skip to content
Permalink
Browse files

Integrate contributed patch for multi-byte whitespace character literals

Patch provided by Patrick Thomson (@patrickt) - thanks a lot!
  • Loading branch information
simonrepp committed Jan 8, 2020
1 parent 49182d6 commit c059967d243487c1c2f567bd56c1d40c9a92dbe4
Showing with 3 additions and 3 deletions.
  1. +3 −3 src/scanner.cc
@@ -85,9 +85,9 @@ struct Scanner {
inline bool is_horizontal_whitespace(TSLexer *lexer) {
return lexer->lookahead == ' ' ||
lexer->lookahead == '\t' ||
lexer->lookahead == '\uFEFF' ||
lexer->lookahead == '\u2060' ||
lexer->lookahead == '\u200B';
lexer->lookahead == 0xFEFF ||
lexer->lookahead == 0x2060 ||
lexer->lookahead == 0x200B;
}

bool scan(TSLexer *lexer, const bool *valid_symbols) {

0 comments on commit c059967

Please sign in to comment.
You can’t perform that action at this time.