New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Report test selection as a build artifact #49

Closed
bartoszmajsak opened this Issue Jul 6, 2017 · 0 comments

Comments

Projects
None yet
1 participant
@bartoszmajsak
Member

bartoszmajsak commented Jul 6, 2017

Next to printing out which strategies and modes have been used it would useful to report it as a build artifact (report file). This report could contain following information:

  • Selected strategies/criteria and mode
  • List of tests

XML format is all that we need I believe. It will not only be useful for storing historical executions (and maybe fine tune the selection based on it), but also will let us write stronger tests as we will have a way to peek into the selection in the functional tests.

Reporting selected tests

Maybe next to having fully qualified test classes it would be useful to indicate to which categories particular test belonged. This will imply changing

public interface TestExecutionPlanner {

    Collection<String> getTests();
}

To return type representing selected test with needed information. As we are storing those tests in a Set we would need to make sure that we compare only class names and not other metadata this new type will contain.

Thoughts?

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment