Delays in surface tracker UI result in wrong surface edit input

[pfaion]

This probably happens only on Windows, as there are delays when interacting with surfaces.
See following GIF:

1. Go in add/remove marker mode for a surface
2. Click on one marker
3. Immediately click on a second marker
4. Move mouse to a third marker

Result: After a delay, the first and third (!) marker get toggled
Expected: The first and second marker should get toggled

[pfaion]

Note that the large delay is the result of building from source and attaching the debugger in Windows. When starting without the debugger, the delay is orders of magnitude smaller and thus the problem does not arise this easily. Therefore this should be rather low priority.