LSP: hovering over comments highlights entire enclosing function

[antonsynd]

Problem

When hovering over a comment inside a function body, the hover tooltip shows the function's type info and the highlight range covers the entire function definition. This is because the innermost AST node at the comment's position is the enclosing FunctionDef, which the hover handler then resolves as the function symbol.

Comments are not represented in the AST (they're stored as trivia on tokens), so FindNodeAtPosition falls through to the enclosing node.

Expected behavior

• Hovering over a comment should not trigger the hover of its enclosing context (function, class, etc.)
• Ideally, comments should show their own content in the hover tooltip, with markdown formatting — especially useful for multiline comments

Reproduction

1. Open any .spy file with a comment inside a function
2. Hover over the comment text
3. Observe: the entire function definition highlights and the tooltip shows the function's type signature

Possible approaches

1. Suppress hover for comment positions: Check if the cursor position falls within a trivia/comment span before resolving hover. If so, return null (or the comment content).
2. Show comment content: Format the comment text as a hover tooltip (strip # prefix, render as markdown). This would be useful for multiline doc comments.

Reported during LSP review session.

[antonsynd]

In fact, it's even whitespace in the function. Actually it seems a recent change made it so even a part of something like an await expression highlights the entire expression rather than just the relevant semantic part. Arguably, this creates noise, and it should just be the most relevant part that creates the highlight, like the def ... statement for a function (not its body), and the await keyword of an await expression, not the expression itself (which has its own highlight+hover).

[antonsynd]

Closed — implemented across two commits: 784b404 (fix(lsp): suppress hover on comments and function body whitespace) for sub-fix A, and a5fec6a (fix(lsp): narrow hover highlight to keyword tokens for compound expressions) for sub-fix B. Hover now returns null when the cursor falls inside a comment/trivia span or outside the header of a FunctionDef/ClassDef/Module. For AwaitExpression, YieldStatement, and UnaryOp(Not), hover narrows the highlight range to the keyword token span while delegating markdown to the inner operand. Tests added in HoverServiceTests.cs.