Python grammar support for string literal concatenation

[microbit-matt-hillsdon]

At least in this simple case, the Python grammar doesn't seem to support string literal concatenation, where adjacent string literals are valid and are concatenated at compile time to form a single string. The parser appears to be marking an error on the second string.

print('00300:'
      '03630:'
      '36963:'
      '03630:'
      '00300')

Parse tree:

Script(ExpressionStatement(CallExpression(VariableName,ArgList("(",String,⚠))),ExpressionStatement(String),ExpressionStatement(String),ExpressionStatement(String),ExpressionStatement(String,⚠(")")))

A Python session showing the behaviour:

Python 3.9.0 (default, Dec  2 2020, 10:34:08) 
[Clang 12.0.0 (clang-1200.0.32.27)] on darwin
Type "help", "copyright", "credits" or "license" for more information.
>>> print('00300:'
...       '03630:'
...       '36963:'
...       '03630:'
...       '00300')
00300:03630:36963:03630:00300

[marijnh]

It did support concatenated strings, but had a bug around its behavior for newlines in argument lists. Attached patch should fix that.

[microbit-matt-hillsdon]

Thank you. That makes sense. I've tried it out and it's working well.

I'd love a lezer-python release with this change as it's a common construct for me.

[marijnh]

I've tagged 0.13.7