Handling form feed character

[casouri]

The parser is awesome! However, it sometimes chokes on form feed character, which is used in source files from time to time. The grammar should treat it as whitespace.

[amaanq]

Do you have an example of where it could choke?

[casouri]

First of all, it's parsed as an error node in the parser. I remember seeing it cause some problem but I couldn't find the example now, sorry about that. I put together an example of a typical usage of form feed character in source files: put before a section header comment for delimiting sections.

int main() {
  return 0;
}


/* Section header */


int subr() {
  return 1;
}

[amaanq]

Thank you! I'm a bit surprised \f & \v isn't included in \s for tree-sitter core

See tree-sitter/tree-sitter#2428