Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Random error when running parallel tests in Cypress #49

Open
tgrimmeissen opened this issue Jul 14, 2021 · 7 comments
Open

Random error when running parallel tests in Cypress #49

tgrimmeissen opened this issue Jul 14, 2021 · 7 comments
Labels
bug Something isn't working help wanted Extra attention is needed

Comments

@tgrimmeissen
Copy link

Hi team,

When running my tests with cypress-parallel I encounter about 50% of the time the following error:

image

This error fails the suite so it is problematic.

My main issue issue is that it does not happen consistently. I can run 6 suites in parallel, 2 random ones will encounter this and thus only 4 will finish. Next run it won't happen; next run a different suite gets the error etc.

Have any of you encountered this? If not, any clue how to debug?

Thanks in advance :)

@shrohitpatel
Copy link

Also getting this same error on some executions.

@tgrimmeissen
Copy link
Author

It seems to me as a random thrown error caused by a parallelization/system issue. The more threads, the more chances to get that error.

@tnicola
Copy link
Owner

tnicola commented Dec 4, 2021

@tgrimmeissen How many parallel thread are you using?Could you please check if you're still getting that error with the new version 0.6.0?

@tgrimmeissen
Copy link
Author

hi @tnicola , yes this is still happening with the new version. I use 4 threads, but it also can happen with 2/3 threads.

@tnicola
Copy link
Owner

tnicola commented Dec 6, 2021

Which Cypress version are you using?Does this happen only using cypress-parallel?Are you running your test on Chrome/Chrome Headless?The more insights you provide the more I can help you solving this issue!

@tgrimmeissen
Copy link
Author

I am using Cypress 8.7.0 but have the same issue with Cypress 9.0.0. Cypress 9.1.1 doesn't work at all for some reason (cannot launch).
Yes this only happens using cypress parallel. Normal headless tests work perfectly.

With Parallel, random (different) errors not related to my tests just pop up randomly:
image

I use electron as one of my tests suite only works with electron (not sure why though).

Thanks for the help!

@tnicola tnicola added help wanted Extra attention is needed bug Something isn't working labels Mar 20, 2022
@ISanjeevKumar
Copy link

it looks like issue is with your test scripts . I had faced the similar issue with previous version and that time issue was with my test script . I was trying to generate test case during runtime using Foreach for a list of items .

are you using the same approach for generating the tcs? If yes then make sure test cases are able to fetch required data before running the tcs.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
bug Something isn't working help wanted Extra attention is needed
Projects
None yet
Development

No branches or pull requests

4 participants