add 'async' and 'await' keywords. Also add the '@' operator.

[AlanCristhian]

Python 3.5 introduce syntax changes. See https://docs.python.org/3.5/whatsnew/3.5.html#summary-release-highlights.

[MattDMo]

Thanks for the PR, I actually haven't gotten around to reviewing 3.5 yet. Have you tested this with decorators to ensure the @ isn't scoped keyword.operator.arithmetic.python?

[MattDMo]

Also, can you add @= to keyword.operator.assignment.augmented.python? It's just above keyword.operator.arithmetic.python. Thanks.

[AlanCristhian]

I broke decorators, I will try to fix them. And yes, I can add the inplace operator.

Don't worry so much about this PR, we have time. Python 3.5 is planned for September.

[MattDMo]

Yeah, I know it's not due to be officially released until this fall, but it shows up on python.org on the downloads page (for example here) and the first beta is out, so it'll be getting more exposure. I'd like to stay ahead of the game if we can.

[MattDMo]

From PEP-0465:

Currently, the only legal use of the @ token in Python code is at statement beginning in decorators. The new operators are both infix; the one place they can never occur is at statement beginning. Therefore, no existing code will be broken by the addition of these operators, and there is no possible parsing ambiguity between decorator-@ and the new operators.

This can help with designing the regex to differentiate between the @ infix operator and the beginning of a decorator. @= doesn't have this problem, as both characters are required for it to be valid, and are not present in decorators.

[1st1]

When are you guys going to merge this in master?

[AlanCristhian]

I've been using the patched version since my last pull request and I not found any problem. So I think that is ready to merge.

[1st1]

@MattDMo ?

[MattDMo]

These changes have been added to the unicode branch. As soon as I'm done testing the changes there, it will be merged back into master and a new version released.

[1st1]

BTW, we also need to highlight StopAsyncIteration and RecursionError – new built-ins in Python 3.5

[1st1]

See also PR #44