Add "do not show again" button to install notifications

[karthiknadig]

Thanks for bringing this up, would it help if we added a "do not show again" button in this notification?

Originally posted by @luabud in #14840 (comment)

[karrtikr]

We haven't faced this problem as of recent so closing this.