Consider the removal of a blocked or not ready label a last touch

[danielma]

Here's the broken scenario:

I submit a PR at 11am with the not ready label.

3 hours later I remove the not ready label.

reviewbot immediately starts notifying people to review my PR, because it think it's been open for 3 hours with no reviews, even though it's only been available for review for 5 minutes