This solution might not be ideal because it's not hiding the button until you do something, even clicking anywhere, for some reason + using the has pseudo class is expensive from what I've read but this is the only reliable way to do it that I found.

Other ways wouldn't work if you had more buttons in the playbar (like the volume profiles extension adding some volume buttons)