Welcome always shows even when closed

[bpasero]

Steps to Reproduce:

1. fresh everything, insiders
2. open some editors (close welcome)
3. close
4. start

=> 🐛 welcome puts itself to the front

I actually found this only by trying to fix the smoke tests #96459