Add something like a button to the test explorer toolbar/menu to enable/disable dryrun. or/and select a run config with dryrun enabled.