Please reload window appears when running the development version of the extension

[rchiodo]

This image appears whenever I hit F5 on the extension source.

[karrtikr]

This is the expected behavior in Extension Development Host with the current implementation.
We realize it's not appropriate, so will removing it as part of #2772.