Async tokenization fails in chat view

[roblourens]

Since the setup with copilot in OSS is tricky, I can do some debugging if you tell me where to look

• Open the vscode workspace
• Use Code OSS (I am not seeing this fail in Insiders, not sure what the difference is)
  • If you want to run the Copilot extension in OSS, you will have to add "--extensionDevelopmentPath=/Users/roblou/code/copilot", to "args" in Launch VS Code Internal
• Ask a question that produces a code block
• Use the Clear button in the view title menubar
• Ask another question that produces a codeblock
• Hit the debugger statement in BugIndicatingError, an exception is thrown with this stack

Uncaught BugIndicatingError Error: An unexpected bug occurred.
    at createBackgroundTokenizer (/Users/roblou/code/vscode/src/vs/workbench/services/textMate/browser/workerHost/textMateWorkerHost.ts:134:10)
    at <anonymous> (/Users/roblou/code/vscode/src/vs/workbench/services/textMate/browser/textMateTokenizationFeatureImpl.ts:284:49)
    at createBackgroundTokenizer (/Users/roblou/code/vscode/src/vs/workbench/services/textMate/browser/tokenizationSupport/textMateTokenizationSupport.ts:42:16)
    at createBackgroundTokenizer (/Users/roblou/code/vscode/src/vs/workbench/services/textMate/browser/tokenizationSupport/tokenizationSupportWithLineLimit.ts:47:24)
    at resetTokenization (/Users/roblou/code/vscode/src/vs/editor/common/model/tokenizationTextModelPart.ts:475:64)
    at handleDidChangeContent (/Users/roblou/code/vscode/src/vs/editor/common/model/tokenizationTextModelPart.ts:503:9)
    at handleDidChangeContent (/Users/roblou/code/vscode/src/vs/editor/common/model/tokenizationTextModelPart.ts:97:22)
    at _emitContentChangedEvent (/Users/roblou/code/vscode/src/vs/editor/common/model/textModel.ts:430:35)
    at _setValueFromTextBuffer (/Users/roblou/code/vscode/src/vs/editor/common/model/textModel.ts:483:8)
    at setValue (/Users/roblou/code/vscode/src/vs/editor/common/model/textModel.ts:443:8)
    at setText (/Users/roblou/code/vscode/src/vs/workbench/contrib/interactiveSession/browser/interactiveSessionListRenderer.ts:727:19)
    at render (/Users/roblou/code/vscode/src/vs/workbench/contrib/interactiveSession/browser/interactiveSessionListRenderer.ts:666:8)
    at renderCodeBlock (/Users/roblou/code/vscode/src/vs/workbench/contrib/interactiveSession/browser/interactiveSessionListRenderer.ts:422:14)
    at codeBlockRendererSync (/Users/roblou/code/vscode/src/vs/workbench/contrib/interactiveSession/browser/interactiveSessionListRenderer.ts:392:22)
    at renderer.code (/Users/roblou/code/vscode/src/vs/base/browser/markdownRenderer.ts:159:26)
    at parse (/Users/roblou/code/vscode/src/vs/base/common/marked/marked.js:2404:36)
    at parse (/Users/roblou/code/vscode/src/vs/base/common/marked/marked.js:2325:21)
    at renderMarkdown (/Users/roblou/code/vscode/src/vs/base/browser/markdownRenderer.ts:250:29)
    at render (/Users/roblou/code/vscode/src/vs/editor/contrib/markdownRenderer/browser/markdownRenderer.ts:62:50)
    at renderMarkdown (/Users/roblou/code/vscode/src/vs/workbench/contrib/interactiveSession/browser/interactiveSessionListRenderer.ts:389:32)
    at doNextProgressiveRender (/Users/roblou/code/vscode/src/vs/workbench/contrib/interactiveSession/browser/interactiveSessionListRenderer.ts:359:25)
    at runProgressiveRender (/Users/roblou/code/vscode/src/vs/workbench/contrib/interactiveSession/browser/interactiveSessionListRenderer.ts:241:15)
    at <anonymous> (/Users/roblou/code/vscode/src/vs/base/common/async.ts:818:4)

The clear step isn't necessary, you can also hit it by asking enough questions that a codeblock editor scrolls out of view and is reused for another question.

[hediet]

/duplicate of #180222