You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
I'm trying to get incremental analysis working in github actions. When I'm running locally, the incremental analysis works as expected. The input and output file remains the same when the test and source code remains the same between pitest runs.
When running in GitHub runner (ubuntu docker image) the history file before and after is different across multiple runs.
When looking at the base64 encoded content. most of the lines remain the same between the runs, but there are slight diffs in about 10% or so of the lines.
Is the cache machine-specific or is there something that could prevent this behavior? If I run pitest consecutively in the same runner, the incremental scan also works.
The text was updated successfully, but these errors were encountered:
The history file shouldn't be machine specific, but unfortunately its format is opaque and badly thought out so it is difficult to debug what's going on. It might be time to finally fix it.
What might be happening here is variation in the results due to timeouts and/or static initialisation code (see the Is It Random? section of the FAQ).
The history file shouldn't be machine specific, but unfortunately its format is opaque and badly thought out so it is difficult to debug what's going on. It might be time to finally fix it.
What might be happening here is variation in the results due to timeouts and/or static initialisation code (see the Is It Random? section of the FAQ).
@hcoles - OK, thanks. Is there a feature request that needs to be added for a future release for this? It's really hurting the productivity of our team.
I'm trying to get incremental analysis working in github actions. When I'm running locally, the incremental analysis works as expected. The input and output file remains the same when the test and source code remains the same between pitest runs.
When running in GitHub runner (ubuntu docker image) the history file before and after is different across multiple runs.
When looking at the base64 encoded content. most of the lines remain the same between the runs, but there are slight diffs in about 10% or so of the lines.
Gradle Configuration:
Just for reference, here is how I'm caching the history file in github actions.
Is the cache machine-specific or is there something that could prevent this behavior? If I run pitest consecutively in the same runner, the incremental scan also works.
The text was updated successfully, but these errors were encountered: