The tests are slow

[BraisGabin]

The tests take around 25 seconds to start running an example:

It's not a complete record but you get the idea. Why does it take more than 20 seconds to test :detekt-report-xml?

[cortinico]

The tests take around 25 seconds to start running an example:

Same. I thought it was a misconfiguration of mine, but apparently not.
@arturbosch was doing profiling so maybe has more insights on this

[schalkms]

The same holds true on my machine.

[arturbosch]

Even running :detekt-report-xml:test without any detekt-test dependencies/accidentally creating KtCompiler the test discovery is slow.

 g/r/detekt/detekt-report-xml{} $ gradle cleanTest test -x :detekt-gradle-plugin:test -Dorg.gradle.caching=false -Dorg.gradle.unsafe.watch-fs=false -Dorg.gradle.parallel=false       4s 776ms

I've used this branch if someone is interested: https://github.com/detekt/detekt/pull/new/debug-test-performance

Reference: spekframework/spek#782

It's actually hard to profile this as the Gradle Daemon creates a Gradle Main Process which creates a Gradle Worker Main Process ...

Edit: I understand that testcase discovery in Spek for modules creating KotlinEnvironments in tests can be high (init lambda in constructor, however now we only have a dependency on detekt-api which pulls the whole kotlin-compiler into the classpath.
Maybe classpath scanning of Junit is the problem here ... ?

[arturbosch]

I've migrated the report-xml and report-txt module tests to junit jupiter test engine and the test discovery got reduced by 2 seconds (https://github.com/detekt/detekt/pull/new/debug-tests):

With Spek:

https://scans.gradle.com/s/mdxkbujmuzqw4/tests

With Junit Jupiter:

https://scans.gradle.com/s/udwjw43v5ravw/tests

Edit:

With spekframework/spek#905

https://scans.gradle.com/s/dvvdyqdjwq77q/tests

[arturbosch]

#2921 introduces many improvements.

The big penalty for us still is and will be: kotlin environment first inits (2s) + mockk first inits (2s) in many modules (multiplier) building in parallel (slowing down each other).

[BraisGabin]

#2921 introduces many improvements.

The big penalty for us still is and will be: kotlin environment first inits (2s) + mockk first inits (2s) in many modules (multiplier) building in parallel (slowing down each other).

At least the really fast tests that don't need does things will run fast. This will help to keep more threads free or don't the real work.

2s for mockk? We don't need nearly any mock. I vote to remove them and write fakes.