This was added to support languages like Python that use indentation to create scopes. For these you need to be able to close the last scopes when the input ends.
… matchHandler (CPRegexpKeywordRecogniserMatchHandler)
Instead of returning a Keyword token, use a block to allow dynamically define the behavior of the recogiser.
…RegularExpression and return a CPKeywordToken.
… used non-terminals are defined in a grammar.