Does not work for Edge or IE

[owen-m1]

If I run my tests using any version of Edge or IE (eg. browserstack:edge@16.0:Windows 10, browserstack:ie@11.0:Windows 10, etc.), the test will never begin and it will hang for minutes until it eventually will give the error:
ERROR Unable to establish one or more of the specified browser connections. This can be caused by network issues or remote device failure.

If I watch the live streaming of the Browserstack emulator, I can see it is just stuck on the testcafe loading screen, but the browser has indeed started.

Similar issue: DevExpress/testcafe#2480

[owen-m1]

Since this issue has been reported in other testing frameworks, and the issue seems to be resolved just by running the test at a different time (though my results are inconsistent), I am going to guess this is most likely an issue with Browserstack's emulators.

[owen-m1]

It seems that the error I am getting is now a validation error:
StatusCodeError: 403 - {"message":"Validation Failed","errors":[{"field":"id","code":"invalid"}]}

It happens with CircleCI as you can see here: https://circleci.com/gh/SortableJS/Sortable/12

Take a look at this test compared to this test. In the commit, I only removed an unused variable, but the second test fails with a validation error while the first one passed.

[aleks-pro]

Hello @owen-m1 ,

Thank you for the provided information but it's insufficient to determine the cause of the problem you encounter. The validation error you are facing is not a TestCafe error and we need to check in what way it is related to the TestCafe code.
If it is possible, provide us with the project running on the Circle Ci server so we will be able to examine the issue on our side.

[owen-m1]

@aleks-pro This is the branch that I have the tests on: https://github.com/SortableJS/Sortable/tree/testcafe-tests

Here is the CircleCI test with the failure: https://circleci.com/gh/SortableJS/Sortable/12
Here you can see it passes when I remove IE and Edge: https://circleci.com/gh/SortableJS/Sortable/13

[LavrovArtem]

https://circleci.com/gh/SortableJS/Sortable/15

Judging by the build, your tests work in IE/Edge now, so we are closing the ticket. However, we did not find out the cause of this behavior. Could you explain what you had to change in order to achieve this?

[owen-m1]

@LavrovArtem It really seems to be an issue on Browserstack's end. It even started happening on other browsers such as MacOS Safari. I contacted them about it, but it looks like I am going to have to switch to Saucelabs as of right now, since I have tested with them and had no problems 👌. Thanks for your help.

[ckzgraphics]

The error- 'Unable to establish one or more of the specified browser connections. This can be caused by network issues or remote device failure' is thrown from runner-test.js file. Also note that It is a generic exception and there must be multiple scenarios why this error is thrown.

Hi @AndreyBelym - Could you please review this and share your thoughts on this? While using TestCafe + BrowserStack + Concurrent execution above error is faced by many users. I have faced similar issue.

I guess it would be helpful if TestCafe and testcafe-browser-provider-browserstack has some kind of option/modifier for verbose logging that can allow users to debug such errors. Does this make sense?

[AndreyBelym]

@ckzgraphics, the file you mentioned is a test that checks the error message. This is the correct reference to the code that throws this error: src/runner/browser-set.js#L59.

It means that the TestCafe server didn't receive any request from the browser. Unfortunately, it can be caused by a number of reasons and we have no additional debug information. Since there is no connection between the browser and the TestCafe server, you can only try to open DevTools in the browser, open the Network tab and export a HAR report.