Calva locking up when opening files with very long lines

[PEZ]

When opening a file with very long lines all Calva commands stop working.

A symptom is that even just hitting backspace stops doing what it should. Another is that the CPU gets very a lot of load.

I think this is because that the tokenizer (probably the TokenCurosr, but it could also be the Calva highlight tokenizer) locks up trying to split the line up with its regular expressions.

A ”solution” is to do what the VS Code built-in syntax highlighter does: Recognise that tokenisation will take a long time and just skip doing it then.