Skip to content

Split Precommit Integration Tests into a separate Build#4023

Closed
tgroh wants to merge 2 commits intoapache:masterfrom
tgroh:split_integration_and_unit_tests
Closed

Split Precommit Integration Tests into a separate Build#4023
tgroh wants to merge 2 commits intoapache:masterfrom
tgroh:split_integration_and_unit_tests

Conversation

@tgroh
Copy link
Member

@tgroh tgroh commented Oct 20, 2017

Follow this checklist to help us incorporate your contribution quickly and easily:

  • Make sure there is a JIRA issue filed for the change (usually before you start working on it). Trivial changes like typos do not require a JIRA issue. Your pull request should address just this issue, without pulling in other changes.
  • Each commit in the pull request should have a meaningful subject line and body.
  • Format the pull request title like [BEAM-XXX] Fixes bug in ApproximateQuantiles, where you replace BEAM-XXX with the appropriate JIRA issue.
  • Write a pull request description that is detailed enough to understand what the pull request does, how, and why.
  • Run mvn clean verify to make sure basic checks pass. A more thorough check will be performed on your pull request automatically.
  • If this contribution is large, please file an Apache Individual Contributor License Agreement.

Integration tests consume a significant amount of time, and are easily
separable from the remaining tests.

Integration tests consume a significant amount of time, and are easily
separable from the remaining tests.
@tgroh
Copy link
Member Author

tgroh commented Oct 20, 2017

For your consideration.

R: @jasonkuster @kennknowles @lukecwik

common_job_properties.setPreCommit(delegate, 'mvn failsafe:integration-test -pl examples/java -am', 'Run Java Integration PreCommit')

// Maven goals for this job: The Java Examples and their dependencies
goals('''\
Copy link
Member

@kennknowles kennknowles Oct 21, 2017

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Jason made the good point that if you build an array of args and then join them on spaces, you avoid the possibility of omitting a backslash, which I have done in ~every one of my changes. Yours looks good already though :-)

clean \
compile \
test-compile \
failsafe:integration-test \
Copy link
Member

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Notably, invoking integration-test will neglect the cleanup (I don't know if we have any). I think if you add post-integration-test you are OK, but maybe just raw verify?

It is covered pretty early here: http://maven.apache.org/surefire/maven-failsafe-plugin/

--batch-mode \
--errors \
--activate-profiles release,jenkins-precommit,direct-runner,dataflow-runner,spark-runner,flink-runner,apex-runner \
--activate-profiles release,direct-runner,dataflow-runner,spark-runner,flink-runner,apex-runner \
Copy link
Member

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

These profiles are only for the examples to run against different runners. I think there should be either none or just direct-runner.

@reuvenlax
Copy link
Contributor

Do we still need this?

@tgroh
Copy link
Member Author

tgroh commented Nov 2, 2017

I don't think it's currently high-priority. Closing.

@tgroh tgroh closed this Nov 2, 2017
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

3 participants