Tested on Bizhawk 2.3.1
If you are seeking to somewhere in your .tasproj it can be kind of confusing to not have the pause button displayed because you can't tell if it's loading, crashed, or paused.
Seeking (both paused and unpaused):

Paused (but not seeking):

I propose having the "pause status" be a separate widget on the toolbar from the seeking widget so that both can be displayed simultaneously.