Take inspiration from mypy, but we probably want to log exceptions too.
https://github.com/microsoft/vscode-mypy/blob/0c4492c3f85553cc5b2612ed830dcba198dff8bb/bundled/tool/lsp_server.py#L766
This issue caused VS Code extension to stop working because new setting was added