CI: test cases run in subprocesses cannot be disabled

[janeyx99]

For more context please read #68173 (comment)

This is bad because most distributed tests are now run in a subprocess, and they cannot be disabled by an issue currently.

The code for how the subprocess is spawned is here: https://github.com/pytorch/pytorch/blob/master/torch/testing/_internal/common_utils.py#L601

cc @ezyang @gchanan @zou3519 @bdhirsh @jbschlosser @pietern @mrshenli @pritamdamania87 @zhaojuanmao @satgera @rohan-varma @gqchen @aazzolini @osalpekar @jiayisuse @SciPioneer @H-Huang