Skip to content

Various changes of Eclipse Che selenium tests result handling#11049

Merged
dmytro-ndp merged 7 commits intomasterfrom
che-10257-4
Sep 4, 2018
Merged

Various changes of Eclipse Che selenium tests result handling#11049
dmytro-ndp merged 7 commits intomasterfrom
che-10257-4

Conversation

@dmytro-ndp
Copy link
Copy Markdown
Contributor

@dmytro-ndp dmytro-ndp commented Sep 3, 2018

What does this PR do?

It improves handling of selenium tests results:

  • does not treat SeleniumTestHandler error as test failure;
  • prevents Workspace with id 'null' doesn't exist error when reading logs of non-existed workspace;
  • attaches screenshots and links to result resources in alphabetical order into failsafe-report.html;
  • unifies file name of test result resources and uses current time in nanosec instead of random string
  • stores logs of workspaces for all test method invocation separately;
  • capture test result objects in case of TestNG configuration method error;
  • don't capture results objects if test/configuration method is skipping;
  • capture html dumps and logs from all opened windows;
  • add link to Che server logs into E2E test report.

What issues does this PR fix or reference?

#10257

Dmytro Nochevnov added 3 commits September 3, 2018 17:53
…l order

Signed-off-by: Dmytro Nochevnov <dnochevnov@codenvy.com>
Signed-off-by: Dmytro Nochevnov <dnochevnov@codenvy.com>
Signed-off-by: Dmytro Nochevnov <dnochevnov@codenvy.com>
@dmytro-ndp dmytro-ndp added kind/bug Outline of a bug - must adhere to the bug report template. team/che-qe labels Sep 3, 2018
@benoitf benoitf added the status/code-review This issue has a pull request posted for it and is awaiting code review completion by the community. label Sep 3, 2018
Signed-off-by: Dmytro Nochevnov <dnochevnov@codenvy.com>
@dmytro-ndp
Copy link
Copy Markdown
Contributor Author

ci-test

@riuvshin
Copy link
Copy Markdown
Contributor

riuvshin commented Sep 4, 2018

ci-test build report:
Build details
Test report
selenium tests report data
docker image: eclipseche/che-server:11049
https://github.com/orgs/eclipse/teams/eclipse-che-qa please check this report.

Dmytro Nochevnov added 3 commits September 4, 2018 12:55
Signed-off-by: Dmytro Nochevnov <dnochevnov@codenvy.com>
Signed-off-by: Dmytro Nochevnov <dnochevnov@codenvy.com>
Signed-off-by: Dmytro Nochevnov <dnochevnov@codenvy.com>
@dmytro-ndp dmytro-ndp merged commit 38e7e90 into master Sep 4, 2018
@dmytro-ndp dmytro-ndp deleted the che-10257-4 branch September 4, 2018 14:42
@benoitf benoitf removed the status/code-review This issue has a pull request posted for it and is awaiting code review completion by the community. label Sep 4, 2018
@benoitf benoitf added this to the 6.11.0 milestone Sep 4, 2018
dmytro-ndp added a commit that referenced this pull request Sep 4, 2018
* Attach screenshots and links into failsafe-report.html in alphabetical order

Signed-off-by: Dmytro Nochevnov <dnochevnov@codenvy.com>

* Prevent "Workspace with id 'null' doesn't exist" error

Signed-off-by: Dmytro Nochevnov <dnochevnov@codenvy.com>

* Do not treat SeleniumTestHandler error as test failure

Signed-off-by: Dmytro Nochevnov <dnochevnov@codenvy.com>

* Capture test result objects in case of configuration method error

Signed-off-by: Dmytro Nochevnov <dnochevnov@codenvy.com>

* Capture html dumps and logs from all opened windows

Signed-off-by: Dmytro Nochevnov <dnochevnov@codenvy.com>

* Add link to Che server logs into E2E test report

Signed-off-by: Dmytro Nochevnov <dnochevnov@codenvy.com>

* Add millis into test result resources files

Signed-off-by: Dmytro Nochevnov <dnochevnov@codenvy.com>
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

kind/bug Outline of a bug - must adhere to the bug report template.

Projects

None yet

Development

Successfully merging this pull request may close these issues.

5 participants