Occasionally Protractor fails to execute test using selenium grid 2

[luiscspinho]

Hi.

I've been experiencing some weird errors when launching my tests using selenium grid. Context: I've a lot of suites defined on my protractor-conf.js and use grunt launch tests on the pipeline. I've a selenium server working on my grid hub ('https://path:4444/wd/hub') which is responsible to forward the tests to 20 slaves that have chromedriver installed to run the tests. I don't have any kind of problem for the most part of the time, I am able to trigger this process with success and everything works fine. However, sometimes I get the following error:

13:37:05 [chrome #1-4] Using the selenium server at http://path:4444/wd/hub
13:37:05 [chrome #1-4]
13:37:05 [chrome #1-4] /PATH/node_modules/protractor/node_modules/selenium-webdriver/lib/atoms/error.js:108
13:37:05 [chrome #1-4] var template = new Error(this.message);
13:37:05 [chrome #1-4] ^
13:37:05 [chrome #1-4] UnknownError: Error forwarding the new session Error forwarding the request Read timed out
13:37:05 [chrome #1-4] at new bot.Error (/PATH/node_modules/protractor/node_modules/selenium-webdriver/lib/atoms/error.js:108:18)
13:37:05 [chrome #1-4] at Object.bot.response.checkResponse (/PATH/node_modules/protractor/node_modules/selenium-webdriver/lib/atoms/response.js:109:9)
13:37:05 [chrome #1-4] at /PATH/node_modules/protractor/node_modules/selenium-webdriver/lib/webdriver/webdriver.js:160:24
13:37:05 [chrome #1-4] at [object Object].promise.ControlFlow.runInFrame_ (eval at (/PATH/node_modules/protractor/node_modules/selenium-webdriver/lib/goog/base.js:1124:19), :1857:20)
13:37:05 [chrome #1-4] at [object Object].goog.defineClass.notify (eval at (/PATH/node_modules/protractor/node_modules/selenium-webdriver/lib/goog/base.js:1124:19), :2448:25)
13:37:05 [chrome #1-4] at [object Object].promise.Promise.notify_ (eval at (/PATH/node_modules/protractor/node_modules/selenium-webdriver/lib/goog/base.js:1124:19), :564:12)
13:37:05 [chrome #1-4] at Array.forEach (native)
13:37:05 [chrome #1-4] at [object Object].promise.Promise.notifyAll_ (eval at (/PATH/node_modules/protractor/node_modules/selenium-webdriver/lib/goog/base.js:1124:19), :553:15)
13:37:05 [chrome #1-4] at [object Object].goog.async.run.processWorkQueue as _onTimeout
13:37:05 [chrome #1-4] at Timer.listOnTimeout as ontimeout
13:37:05 [chrome #1-4] From: Task: WebDriver.createSession()
13:37:05 [chrome #1-4] at Function.webdriver.WebDriver.acquireSession_ (/PATH/node_modules/protractor/node_modules/selenium-webdriver/lib/webdriver/webdriver.js:157:22)
13:37:05 [chrome #1-4] at Function.webdriver.WebDriver.createSession (/PATH/node_modules/protractor/node_modules/selenium-webdriver/lib/webdriver/webdriver.js:131:30)
13:37:05 [chrome #1-4] at [object Object].Builder.build (/PATH/node_modules/protractor/node_modules/selenium-webdriver/builder.js:445:22)
13:37:05 [chrome #1-4] at [object Object].DriverProvider.getNewDriver (/PATH/node_modules/protractor/lib/driverProviders/driverProvider.js:38:7)
13:37:05 [chrome #1-4] at [object Object].Runner.createBrowser (/PATH/node_modules/protractor/lib/runner.js:182:37)
13:37:05 [chrome #1-4] at driverprovider_.setupEnv.then.then.then.frameworkPath (/PATH/node_modules/protractor/lib/runner.js:263:21)
13:37:05 [chrome #1-4] at _fulfilled (/PATH/node_modules/protractor/node_modules/q/q.js:797:54)
13:37:05 [chrome #1-4] at self.promiseDispatch.done (/PATH/node_modules/protractor/node_modules/q/q.js:826:30)
13:37:05 [chrome #1-4] at Promise.promise.promiseDispatch (/PATH/node_modules/protractor/node_modules/q/q.js:759:13)
13:37:05 [chrome #1-4] at /PATH/node_modules/protractor/node_modules/q/q.js:525:49
13:37:05
13:37:05 [launcher] Runner process exited unexpectedly with error code: 1

I must say that this happens with the same codebase of a successful execution. For instance, I push something to my pipeline, the tests run and everything passes. Then I restart the job with the exact same codebase/environment and that error occurs (the error can happen first and then disappears, this doesn't follow a specific rule). I can provide more information if necessary.

Thanks in advance.

[NickTomlin]

Hi there!

Your question is better suited for StackOverflow or Gitter. Please ask a question there with the 'protractor' tag or post in the Gitter Channel to get help.

From the the getting help section of the README:

Please ask usage and debugging questions on StackOverflow (use the "protractor" tag) or in the Angular discussion group. (Please do not ask support questions here on Github.)

[juliemr]

This is almost certainly not an issue with Protractor, but with webdriver connecting to the selenium grid. Error forwarding the new session is the relevant part of the stack trace. Maybe you're hitting problems with the maximum number of instances sometimes?

Stack Overflow would be a better place to have this discussion.

[guiprav]

I experience similar issues though I use Selenium standalone and the exceptions sometimes look much sillier, like this one I just got:

          ✗ Toggle work inclusion on website (0.665 sec)
            - Failed: No element found using locator: By.cssSelector("button[data-ng-model='wcmWebsiteEdit.model.includeOnWebsite'].active")
                at new bot.Error (/home/n2liquid/prog/wmg/tango-app/tests/e2e/node_modules/protractor/node_modules/selenium-webdriver/lib/atoms/error.js:108:18)
                at /home/n2liquid/prog/wmg/tango-app/tests/e2e/node_modules/protractor/lib/element.js:694:15
                at [object Object].promise.ControlFlow.runInFrame_ (/home/n2liquid/prog/wmg/tango-app/tests/e2e/node_modules/protractor/node_modules/selenium-webdriver/lib/goog/../webdriver/promise.js:1857:20)
                at [object Object].goog.defineClass.notify (/home/n2liquid/prog/wmg/tango-app/tests/e2e/node_modules/protractor/node_modules/selenium-webdriver/lib/goog/../webdriver/promise.js:2448:25)
                at [object Object].promise.Promise.notify_ (/home/n2liquid/prog/wmg/tango-app/tests/e2e/node_modules/protractor/node_modules/selenium-webdriver/lib/goog/../webdriver/promise.js:564:12)
                at Array.forEach (native)
                at [object Object].promise.Promise.notifyAll_ (/home/n2liquid/prog/wmg/tango-app/tests/e2e/node_modules/protractor/node_modules/selenium-webdriver/lib/goog/../webdriver/promise.js:553:15)
                at goog.async.run.processWorkQueue (/home/n2liquid/prog/wmg/tango-app/tests/e2e/node_modules/protractor/node_modules/selenium-webdriver/lib/goog/async/run.js:130:15)
                at process._tickCallback (node.js:356:9)
            Error
                at [object Object].ElementArrayFinder.applyAction_ (/home/n2liquid/prog/wmg/tango-app/tests/e2e/node_modules/protractor/lib/element.js:392:21)
                at [object Object].self.(anonymous function) [as getText] (/home/n2liquid/prog/wmg/tango-app/tests/e2e/node_modules/protractor/lib/element.js:76:19)
                at [object Object].self.(anonymous function) [as getText] (/home/n2liquid/prog/wmg/tango-app/tests/e2e/node_modules/protractor/lib/element.js:721:11)
                at [object Object].module.exports.selectedWorkInclusionOnWebsiteOption (/home/n2liquid/prog/wmg/tango-app/tests/e2e/envs/common/pages/works/work.js:724:58)
                at Object.<anonymous> (/home/n2liquid/prog/wmg/tango-app/tests/e2e/envs/common/steps/works/work.js:922:38)
                at /home/n2liquid/prog/wmg/tango-app/tests/e2e/node_modules/protractor/node_modules/jasminewd2/index.js:96:23
                at new promise.Promise (/home/n2liquid/prog/wmg/tango-app/tests/e2e/node_modules/protractor/node_modules/selenium-webdriver/lib/goog/../webdriver/promise.js:368:5)
                at controlFlowExecute (/home/n2liquid/prog/wmg/tango-app/tests/e2e/node_modules/protractor/node_modules/jasminewd2/index.js:82:18)
                at [object Object].promise.ControlFlow.runInFrame_ (/home/n2liquid/prog/wmg/tango-app/tests/e2e/node_modules/protractor/node_modules/selenium-webdriver/lib/goog/../webdriver/promise.js:1857:20)
                at [object Object].promise.ControlFlow.runEventLoop_ (/home/n2liquid/prog/wmg/tango-app/tests/e2e/node_modules/protractor/node_modules/selenium-webdriver/lib/goog/../webdriver/promise.js:1729:8)
            From: Task: Run it("Toggle work inclusion on website") in control flow
                at Object.<anonymous> (/home/n2liquid/prog/wmg/tango-app/tests/e2e/node_modules/protractor/node_modules/jasminewd2/index.js:81:14)
            From asynchronous test:
            Error
                at Object.module.exports.toggleWorkInclusionOnWebsite (/home/n2liquid/prog/wmg/tango-app/tests/e2e/envs/common/steps/works/work.js:920:5)
                at Suite.<anonymous> (/home/n2liquid/prog/wmg/tango-app/tests/e2e/envs/common/steps/works/work.js:1609:52)
                at Object.module.exports.editBasicWork (/home/n2liquid/prog/wmg/tango-app/tests/e2e/envs/common/steps/works/work.js:1398:5)
                at Suite.<anonymous> (/home/n2liquid/prog/wmg/tango-app/tests/e2e/node_modules/factory-testing-framework/modules/controller.js:127:40)

/home/n2liquid/prog/wmg/tango-app/tests/e2e/node_modules/protractor/node_modules/selenium-webdriver/lib/atoms/error.js:108
  var template = new Error(this.message);
                 ^
NoSuchElementError: No element found using locator: By.cssSelector("button[data-ng-model='wcmWebsiteEdit.model.includeOnWebsite'].active")
    at new bot.Error (/home/n2liquid/prog/wmg/tango-app/tests/e2e/node_modules/protractor/node_modules/selenium-webdriver/lib/atoms/error.js:108:18)
    at /home/n2liquid/prog/wmg/tango-app/tests/e2e/node_modules/protractor/lib/element.js:694:15
    at [object Object].promise.ControlFlow.runInFrame_ (/home/n2liquid/prog/wmg/tango-app/tests/e2e/node_modules/protractor/node_modules/selenium-webdriver/lib/goog/../webdriver/promise.js:1857:20)
    at [object Object].goog.defineClass.notify (/home/n2liquid/prog/wmg/tango-app/tests/e2e/node_modules/protractor/node_modules/selenium-webdriver/lib/goog/../webdriver/promise.js:2448:25)
    at [object Object].promise.Promise.notify_ (/home/n2liquid/prog/wmg/tango-app/tests/e2e/node_modules/protractor/node_modules/selenium-webdriver/lib/goog/../webdriver/promise.js:564:12)
    at Array.forEach (native)
    at [object Object].promise.Promise.notifyAll_ (/home/n2liquid/prog/wmg/tango-app/tests/e2e/node_modules/protractor/node_modules/selenium-webdriver/lib/goog/../webdriver/promise.js:553:15)
    at goog.async.run.processWorkQueue (/home/n2liquid/prog/wmg/tango-app/tests/e2e/node_modules/protractor/node_modules/selenium-webdriver/lib/goog/async/run.js:130:15)
    at process._tickCallback (node.js:356:9)
Error
    at [object Object].ElementArrayFinder.applyAction_ (/home/n2liquid/prog/wmg/tango-app/tests/e2e/node_modules/protractor/lib/element.js:392:21)
    at [object Object].self.(anonymous function) [as getText] (/home/n2liquid/prog/wmg/tango-app/tests/e2e/node_modules/protractor/lib/element.js:76:19)
    at [object Object].self.(anonymous function) [as getText] (/home/n2liquid/prog/wmg/tango-app/tests/e2e/node_modules/protractor/lib/element.js:721:11)
    at [object Object].module.exports.selectedWorkInclusionOnWebsiteOption (/home/n2liquid/prog/wmg/tango-app/tests/e2e/envs/common/pages/works/work.js:724:58)
    at Object.<anonymous> (/home/n2liquid/prog/wmg/tango-app/tests/e2e/envs/common/steps/works/work.js:922:38)
    at /home/n2liquid/prog/wmg/tango-app/tests/e2e/node_modules/protractor/node_modules/jasminewd2/index.js:96:23
    at new promise.Promise (/home/n2liquid/prog/wmg/tango-app/tests/e2e/node_modules/protractor/node_modules/selenium-webdriver/lib/goog/../webdriver/promise.js:368:5)
    at controlFlowExecute (/home/n2liquid/prog/wmg/tango-app/tests/e2e/node_modules/protractor/node_modules/jasminewd2/index.js:82:18)
    at [object Object].promise.ControlFlow.runInFrame_ (/home/n2liquid/prog/wmg/tango-app/tests/e2e/node_modules/protractor/node_modules/selenium-webdriver/lib/goog/../webdriver/promise.js:1857:20)
    at [object Object].promise.ControlFlow.runEventLoop_ (/home/n2liquid/prog/wmg/tango-app/tests/e2e/node_modules/protractor/node_modules/selenium-webdriver/lib/goog/../webdriver/promise.js:1729:8)
From: Task: Run it("Toggle work inclusion on website") in control flow
    at Object.<anonymous> (/home/n2liquid/prog/wmg/tango-app/tests/e2e/node_modules/protractor/node_modules/jasminewd2/index.js:81:14)
    at attemptAsync (/home/n2liquid/prog/wmg/tango-app/tests/e2e/node_modules/protractor/node_modules/jasmine/node_modules/jasmine-core/lib/jasmine-core/jasmine.js:1819:24)
    at QueueRunner.run (/home/n2liquid/prog/wmg/tango-app/tests/e2e/node_modules/protractor/node_modules/jasmine/node_modules/jasmine-core/lib/jasmine-core/jasmine.js:1774:9)
    at QueueRunner.execute (/home/n2liquid/prog/wmg/tango-app/tests/e2e/node_modules/protractor/node_modules/jasmine/node_modules/jasmine-core/lib/jasmine-core/jasmine.js:1762:10)
    at Spec.Env.queueRunnerFactory (/home/n2liquid/prog/wmg/tango-app/tests/e2e/node_modules/protractor/node_modules/jasmine/node_modules/jasmine-core/lib/jasmine-core/jasmine.js:627:35)
    at Spec.execute (/home/n2liquid/prog/wmg/tango-app/tests/e2e/node_modules/protractor/node_modules/jasmine/node_modules/jasmine-core/lib/jasmine-core/jasmine.js:353:10)
    at Object.fn (/home/n2liquid/prog/wmg/tango-app/tests/e2e/node_modules/protractor/node_modules/jasmine/node_modules/jasmine-core/lib/jasmine-core/jasmine.js:2360:37)
    at attemptAsync (/home/n2liquid/prog/wmg/tango-app/tests/e2e/node_modules/protractor/node_modules/jasmine/node_modules/jasmine-core/lib/jasmine-core/jasmine.js:1819:24)
    at QueueRunner.run (/home/n2liquid/prog/wmg/tango-app/tests/e2e/node_modules/protractor/node_modules/jasmine/node_modules/jasmine-core/lib/jasmine-core/jasmine.js:1774:9)
    at /home/n2liquid/prog/wmg/tango-app/tests/e2e/node_modules/protractor/node_modules/jasmine/node_modules/jasmine-core/lib/jasmine-core/jasmine.js:1801:16
From asynchronous test:
Error
    at Object.module.exports.toggleWorkInclusionOnWebsite (/home/n2liquid/prog/wmg/tango-app/tests/e2e/envs/common/steps/works/work.js:920:5)
    at Suite.<anonymous> (/home/n2liquid/prog/wmg/tango-app/tests/e2e/envs/common/steps/works/work.js:1609:52)
    at addSpecsToSuite (/home/n2liquid/prog/wmg/tango-app/tests/e2e/node_modules/protractor/node_modules/jasmine/node_modules/jasmine-core/lib/jasmine-core/jasmine.js:743:25)
    at Env.describe (/home/n2liquid/prog/wmg/tango-app/tests/e2e/node_modules/protractor/node_modules/jasmine/node_modules/jasmine-core/lib/jasmine-core/jasmine.js:713:7)
    at jasmineInterface.describe (/home/n2liquid/prog/wmg/tango-app/tests/e2e/node_modules/protractor/node_modules/jasmine/node_modules/jasmine-core/lib/jasmine-core/jasmine.js:3219:18)
    at Object.module.exports.editBasicWork (/home/n2liquid/prog/wmg/tango-app/tests/e2e/envs/common/steps/works/work.js:1398:5)
    at Suite.<anonymous> (/home/n2liquid/prog/wmg/tango-app/tests/e2e/node_modules/factory-testing-framework/modules/controller.js:127:40)
    at addSpecsToSuite (/home/n2liquid/prog/wmg/tango-app/tests/e2e/node_modules/protractor/node_modules/jasmine/node_modules/jasmine-core/lib/jasmine-core/jasmine.js:743:25)
    at Env.describe (/home/n2liquid/prog/wmg/tango-app/tests/e2e/node_modules/protractor/node_modules/jasmine/node_modules/jasmine-core/lib/jasmine-core/jasmine.js:713:7)
    at jasmineInterface.describe (/home/n2liquid/prog/wmg/tango-app/tests/e2e/node_modules/protractor/node_modules/jasmine/node_modules/jasmine-core/lib/jasmine-core/jasmine.js:3219:18)
[launcher] Process exited with error code 1

Looks like Protractor fails to handle exceptions sometimes. This would be a bug, wouldn't it?

I'm using Protractor 2.5.1 and Node 4.0.0 on a Debian 9 machine, but have experienced this problem in earlier versions of Protractor and Node and also on other machines (Elementary OS and maybe CentOS, but I'm not sure about CentOS). Should I create a ticket for that, @juliemr?

[juliemr]

@n2liquid yes, that error should be caught, not sure what's going on. Can you open a new issue with a reproducible test case?

[guiprav]

@juliemr, I'll do that when I have some time to see if I can come up with one, because right now all I know is that it sometimes "just happens". Thanks.