[Stopwatch] Different behaviour if grouped with other tests

[EmanueleMinotto]

I don't know if this is related to #14444 or not, but everytime I try locally the tests (branch 2.8) related to the Stopwatch I have this behaviour:

[TomasVotruba]

Oh, came across that yesterday too (3.0). Took me while to figure out it requires standalone run.

I'd be for make these test independent on outer timings.

Shall I prepare PR?

[TomasVotruba]

It looks it's caused by one Symfony\HttpKernel test: https://github.com/symfony/symfony/blob/64917c726d2540bfe1d9f233cfaf04a4ebec5504/src/Symfony/Component/HttpKernel/Tests/Debug/TraceableEventDispatcherTest.php

While digging deeper, it's dispatch() method in TraceableEventDispatcher.

[jakzal]

@TomasVotruba great job! Are you working on a PR?

[TomasVotruba]

@jakzal I would love to, but I'm not exactly sure, why it's nulled. Got any idea?

I'll try checking tonight.

[jakzal]

@TomasVotruba I didn't look into this yet as I wouldn't like to duplicate your efforts :)

[TomasVotruba]

It looks like it's passing with:

phpupnit (my local phar file or vendor native PHPUnit binary)

but not with the custom script:

php phpunit.

[TomasVotruba]

It looks like it's not passing with the custom script:

php phpunit.

but my local phar file or vendor native PHPUnit binary:

phpupnit

---

Minimal changed phpunit.xml setup to reproduce the issue:

<testsuites>
    <testsuite name="Symfony Test Suite">
        <directory>./src/Symfony/Component/HttpKernel/Tests/Debug/</directory>
        <directory>./src/Symfony/Component/Stopwatch/*</directory>
    </testsuite>
</testsuites>

My PHP version is 5.6.

[TomasVotruba]

I've tried to delete /.phpunit directory and rerun the Symfony phpunit script and all passes well now.

Could you retry @EmanueleMinotto ?

[EmanueleMinotto]

@TomasVotruba sorry for the delay.

Changing the testsuite (in the phpunit.xml.dist) to:

    <testsuites>
        <testsuite name="Symfony Test Suite">
            <directory>./src/Symfony/Component/HttpKernel/Tests/Debug/</directory>
            <directory>./src/Symfony/Component/Stopwatch/*</directory>
        </testsuite>
    </testsuites>

I have all green tests on every tests execution (also after just the git clone and composer install).

[nicolas-grekas]

@EmanueleMinotto did you delete the .phpunit folder the test using ./phpunit again?

[EmanueleMinotto]

@nicolas-grekas yes, also removing the .phpunit directory it works (always with the last testsuite I wrote above).

[nicolas-grekas]

So, is there still an issue? You had a legacy .phpunit installation and the issue has gone now isn't it?

[TomasVotruba]

For me it's gone.

[EmanueleMinotto]

yes, it's solved for me too, thank you

[nicolas-grekas]

cool