Since stylus leaving proximity of screen doesn't change the hovered state, we have to take that into account

Since stylus leaving proximity of screen doesn't change the hovered state, we have to take that into account #599