Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Is it possible to have a consolidated report from 2 executions of the different tests? #3266

Open
Darenth opened this issue Sep 25, 2023 · 4 comments

Comments

@Darenth
Copy link

Darenth commented Sep 25, 2023

What happened?

I run 2 separate executions with different tests and want to have the results in one report, but I see only from one execution

What did you expect to happen?

I want to copy the data of the report from 2 executions in one folder and see the results of 2 executions.

Serenity BDD version

3.4.3

JDK version

8

Execution environment

No response

How to reproduce the bug.

To run any test, run another test, and copy report data from the first execution to the second data, and the report should contain results of 2 tests

How can we make it happen?

Work on this myself and propose a PR (with Serenity BDD team guidance)

@Rangiferus
Copy link

Split executions to 2 test phases and the final report generation phase.
In Maven you end up with:

mvn test ...
mvn test ...
mvn serenity:aggregate

@scormaq
Copy link
Contributor

scormaq commented Sep 27, 2023

There's nothing wrong in running 2 separate maven/gradle tasks with different sub-sets of tests, then copy everything to 1 target/site/serenity folder and run aggregate task, I do it on CI/CD. How do you run your tests - on same machine or different? Do you use clean task?

@Darenth
Copy link
Author

Darenth commented Sep 27, 2023

Thanks guys, @Rangiferus your solution works in general. But I realized that it was not what I was looking for.
@scormaq thanks for your comment and idea. I need to try this one too. Currently, I run tests in azure sequentially on one node and use clean task.

@Rangiferus
Copy link

What's your expectation then? If you run tests sequentially, then you propbably do it on one Azure agent as separate Maven tasks. If you don't use clean but just test then you have results from both test runs in one directory, where aggregate looks at.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

3 participants