Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

When having multiple test components, MRO reports wrong test results #377

Closed
martsec opened this issue Jun 11, 2020 · 1 comment · Fixed by #692
Closed

When having multiple test components, MRO reports wrong test results #377

martsec opened this issue Jun 11, 2020 · 1 comment · Fixed by #692
Assignees
Labels
bug Something isn't working

Comments

@martsec
Copy link
Contributor

martsec commented Jun 11, 2020

Describe the bug
When having multiple ods-test components in a project, the MRO will override the test results from the components with the latter one.

Let's say we have two test components:

 - id: spock-int-repo
    type: ods-test
 - id: geb-e2e-repo
    type: ods-test

And you have implemented Tests 1 and 2 in spock and 3 in Geb.
You will see the correct information in Jenkins, but not in the documents nor Jira, since the results get overwritten

bug-mro-test-components-jira

To Reproduce
Steps to reproduce the behavior:

  1. Have in a project (and in the release manager metadata.yml) two ods-test repositories
  2. Set-up integration/acceptance/installation tests in Jira and implement them in code
  3. Execute the pipeline

Expected behavior
Tests results coming from multiple components should be merged before reporting to Jira and the creation of the documents.

Affected version (please complete the following information):

  • OpenShift: 3.11
  • OpenDevStack 2.x
@martsec martsec added the bug Something isn't working label Jun 11, 2020
@clemensutschig clemensutschig added this to To Do in OpenDevStack 3.0 via automation Jun 12, 2020
@martsec
Copy link
Contributor Author

martsec commented Jul 16, 2020

Won't fix in ODS 3. Will be moved to 3.1 or so.

@martsec martsec removed this from To Do in OpenDevStack 3.0 Jul 16, 2020
@metmajer metmajer added this to To Do in OpenDevStack 4.0.0 via automation Apr 28, 2021
OpenDevStack 4.0.0 automation moved this from To Do to Done Jul 26, 2021
hrcornejo added a commit that referenced this issue Jul 26, 2021
Enable the co-existence of multiple E2E test components. Closes #377
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
bug Something isn't working
Projects
No open projects
Development

Successfully merging a pull request may close this issue.

1 participant