Syntax visualizer sometimes stops working after opening color picker for classified spans

[DoctorKrolic]

Version Used:
Latest main (dotnet/roslyn@1113a49)

Steps to Reproduce:

1. Open VS with the empty project and a blank file
2. Open roslyn Syntax visualizer
3. Paste this code:

new SomeClass
{
    A = 1,
    B = new SomeOtherClass()
    {
        D = 7,
        E = "test",
        F = new int[]
    {
                      1,
                      2,
                      3
    }
    },
    C = new
    {
        G = new List<AndAnotherClass>
                    {
                      new AndAnotherClass
                      {
                        J = 8,
                        K = new Dictionary<int, string>
                        {
                          [1] = "test1",
                          [2] = "test2",
                          [3] = "test3"
                        },
                        L = new List<Whatever>$$()
                        {
                        }
                      }
                    },
        H = new
        {
        },
        I = new MixedClass()
        {
            ["test1"] = new MixedClass
            {
                ["innerTest"] = new MixedClass
                {
                    M = 5.01m
                }
            },
            M = 2.71m,
            ["test2"] = new MixedClass()
        }
    }
}

4. Navigate mouse to $$
5. Open color picker in the synax visualizer for this element
6. Close color picker
7. Observer that syntax visualizer stops responding to user actions and always stays empty

Demo:

[Youssef1313]

The syntax visualizer is implemented in dotnet/roslyn-sdk.

https://github.com/dotnet/roslyn-sdk/tree/main/src/VisualStudio.Roslyn.SDK/SyntaxVisualizer