Quarantining tests

[sebastienros]

#30700
#30701

[Tratcher]

#30672 already addresses the hosting issues.

[sebastienros]

@Tratcher is quarantining other tests though

[sebastienros]

And now it's StartupConfigureServicesThrows_Fallback that is also in WebHostBuilderTests that is failing.

[sebastienros]

@JunTaoLuo so it's a side effect of the other test that you are disabled? I will remove this then, I understand what you meant now @Tratcher.

Addressed

[shirhatti]

I don't enough about how we quarantine tests, but in this instance the test was failing due to shared global state in the process. I assume after quarantining, the test now runs in a separate process, making it unlikely to ever fail while quarantined 😄

I'll file a work item to make our Activity tests more resilient by preferably moving them into a separate process.

[ghost]

Hi @shirhatti. It looks like you just commented on a closed PR. The team will most probably miss it. If you'd like to bring something important up to their attention, consider filing a new issue and add enough details to build context.

[Tratcher]

I don't enough about how we quarantine tests, but in this instance the test was failing due to shared global state in the process. I assume after quarantining, the test now runs in a separate process, making it unlikely to ever fail while quarantined 😄

Not quite. I think quarantined tests are skipped in normal runs but run normally in our special quarantine build. Quarantine is inadequate for tests that can cause side-effects for other tests.