Skip to content

Python Precommit Maven Install#1604

Closed
markflyhigh wants to merge 1 commit intoapache:masterfrom
markflyhigh:python-recommit-maven-install
Closed

Python Precommit Maven Install#1604
markflyhigh wants to merge 1 commit intoapache:masterfrom
markflyhigh:python-recommit-maven-install

Conversation

@markflyhigh
Copy link
Copy Markdown
Contributor

@markflyhigh markflyhigh commented Dec 13, 2016

Be sure to do all of the following to help us incorporate your contribution
quickly and easily:

  • Make sure the PR title is formatted like:
    [BEAM-<Jira issue #>] Description of pull request
  • Make sure tests pass via mvn clean verify. (Even better, enable
    Travis-CI on your fork and ensure the whole test matrix passes).
  • Replace <Jira issue #> in the title with the actual Jira issue
    number, if there is one.
  • If this contribution is large, please file an Apache
    Individual Contributor License Agreement.

After moving Jenkins config to DSL plugin, python-sdk didn't build in beam_Precommit_Java_MavenInstall in a period of time. Triage the issue was very difficult since both python and java builds are shown in one Jenkins branch and no way to filter them by project.

This PR is to make python precommit build shown in separate Jenkins branch for a more clear view.

@markflyhigh
Copy link
Copy Markdown
Contributor Author

+R: @jasonkuster

@jasonkuster please test this change to make sure python precommit build as expected and other build will not be affected.

@asfbot
Copy link
Copy Markdown

asfbot commented Dec 14, 2016

Refer to this link for build results (access rights to CI server needed):
https://builds.apache.org/job/beam_PreCommit_Java_MavenInstall/5867/

Build result: FAILURE

[...truncated 8544 lines...][JENKINS] Archiving /home/jenkins/jenkins-slave/workspace/beam_PreCommit_Java_MavenInstall/runners/flink/pom.xml to org.apache.beam/beam-runners-flink-parent/0.5.0-incubating-SNAPSHOT/beam-runners-flink-parent-0.5.0-incubating-SNAPSHOT.pom[JENKINS] Archiving /home/jenkins/jenkins-slave/workspace/beam_PreCommit_Java_MavenInstall/sdks/java/io/mongodb/pom.xml to org.apache.beam/beam-sdks-java-io-mongodb/0.5.0-incubating-SNAPSHOT/beam-sdks-java-io-mongodb-0.5.0-incubating-SNAPSHOT.pom[JENKINS] Archiving /home/jenkins/jenkins-slave/workspace/beam_PreCommit_Java_MavenInstall/sdks/java/io/mongodb/target/beam-sdks-java-io-mongodb-0.5.0-incubating-SNAPSHOT.jar to org.apache.beam/beam-sdks-java-io-mongodb/0.5.0-incubating-SNAPSHOT/beam-sdks-java-io-mongodb-0.5.0-incubating-SNAPSHOT.jar[JENKINS] Archiving /home/jenkins/jenkins-slave/workspace/beam_PreCommit_Java_MavenInstall/sdks/java/io/mongodb/target/beam-sdks-java-io-mongodb-0.5.0-incubating-SNAPSHOT-javadoc.jar to org.apache.beam/beam-sdks-java-io-mongodb/0.5.0-incubating-SNAPSHOT/beam-sdks-java-io-mongodb-0.5.0-incubating-SNAPSHOT-javadoc.jar[JENKINS] Archiving /home/jenkins/jenkins-slave/workspace/beam_PreCommit_Java_MavenInstall/sdks/java/io/mongodb/target/beam-sdks-java-io-mongodb-0.5.0-incubating-SNAPSHOT-sources.jar to org.apache.beam/beam-sdks-java-io-mongodb/0.5.0-incubating-SNAPSHOT/beam-sdks-java-io-mongodb-0.5.0-incubating-SNAPSHOT-sources.jar[JENKINS] Archiving /home/jenkins/jenkins-slave/workspace/beam_PreCommit_Java_MavenInstall/sdks/java/io/mongodb/target/beam-sdks-java-io-mongodb-0.5.0-incubating-SNAPSHOT-test-sources.jar to org.apache.beam/beam-sdks-java-io-mongodb/0.5.0-incubating-SNAPSHOT/beam-sdks-java-io-mongodb-0.5.0-incubating-SNAPSHOT-test-sources.jar[JENKINS] Archiving /home/jenkins/jenkins-slave/workspace/beam_PreCommit_Java_MavenInstall/sdks/java/io/mongodb/target/beam-sdks-java-io-mongodb-0.5.0-incubating-SNAPSHOT-tests.jar to org.apache.beam/beam-sdks-java-io-mongodb/0.5.0-incubating-SNAPSHOT/beam-sdks-java-io-mongodb-0.5.0-incubating-SNAPSHOT-tests.jar[JENKINS] Archiving /home/jenkins/jenkins-slave/workspace/beam_PreCommit_Java_MavenInstall/sdks/java/extensions/sorter/pom.xml to org.apache.beam/beam-sdks-java-extensions-sorter/0.5.0-incubating-SNAPSHOT/beam-sdks-java-extensions-sorter-0.5.0-incubating-SNAPSHOT.pom[JENKINS] Archiving /home/jenkins/jenkins-slave/workspace/beam_PreCommit_Java_MavenInstall/sdks/pom.xml to org.apache.beam/beam-sdks-parent/0.5.0-incubating-SNAPSHOT/beam-sdks-parent-0.5.0-incubating-SNAPSHOT.pomNo artifacts from beam_PreCommit_Java_MavenInstall » Apache Beam :: SDKs #5868 to compare, so performing full copy of artifacts[JENKINS] Archiving /home/jenkins/jenkins-slave/workspace/beam_PreCommit_Java_MavenInstall/sdks/java/extensions/join-library/pom.xml to org.apache.beam/beam-sdks-java-extensions-join-library/0.5.0-incubating-SNAPSHOT/beam-sdks-java-extensions-join-library-0.5.0-incubating-SNAPSHOT.pom[JENKINS] Archiving /home/jenkins/jenkins-slave/workspace/beam_PreCommit_Java_MavenInstall/runners/pom.xml to org.apache.beam/beam-runners-parent/0.5.0-incubating-SNAPSHOT/beam-runners-parent-0.5.0-incubating-SNAPSHOT.pomNo artifacts from beam_PreCommit_Java_MavenInstall » Apache Beam :: Runners #5868 to compare, so performing full copy of artifacts[JENKINS] Archiving /home/jenkins/jenkins-slave/workspace/beam_PreCommit_Java_MavenInstall/sdks/java/io/jdbc/pom.xml to org.apache.beam/beam-sdks-java-io-jdbc/0.5.0-incubating-SNAPSHOT/beam-sdks-java-io-jdbc-0.5.0-incubating-SNAPSHOT.pom[JENKINS] Archiving /home/jenkins/jenkins-slave/workspace/beam_PreCommit_Java_MavenInstall/sdks/java/io/jdbc/target/beam-sdks-java-io-jdbc-0.5.0-incubating-SNAPSHOT.jar to org.apache.beam/beam-sdks-java-io-jdbc/0.5.0-incubating-SNAPSHOT/beam-sdks-java-io-jdbc-0.5.0-incubating-SNAPSHOT.jar[JENKINS] Archiving /home/jenkins/jenkins-slave/workspace/beam_PreCommit_Java_MavenInstall/sdks/java/io/jdbc/target/beam-sdks-java-io-jdbc-0.5.0-incubating-SNAPSHOT-javadoc.jar to org.apache.beam/beam-sdks-java-io-jdbc/0.5.0-incubating-SNAPSHOT/beam-sdks-java-io-jdbc-0.5.0-incubating-SNAPSHOT-javadoc.jar[JENKINS] Archiving /home/jenkins/jenkins-slave/workspace/beam_PreCommit_Java_MavenInstall/sdks/java/io/jdbc/target/beam-sdks-java-io-jdbc-0.5.0-incubating-SNAPSHOT-sources.jar to org.apache.beam/beam-sdks-java-io-jdbc/0.5.0-incubating-SNAPSHOT/beam-sdks-java-io-jdbc-0.5.0-incubating-SNAPSHOT-sources.jar[JENKINS] Archiving /home/jenkins/jenkins-slave/workspace/beam_PreCommit_Java_MavenInstall/sdks/java/io/jdbc/target/beam-sdks-java-io-jdbc-0.5.0-incubating-SNAPSHOT-test-sources.jar to org.apache.beam/beam-sdks-java-io-jdbc/0.5.0-incubating-SNAPSHOT/beam-sdks-java-io-jdbc-0.5.0-incubating-SNAPSHOT-test-sources.jar[JENKINS] Archiving /home/jenkins/jenkins-slave/workspace/beam_PreCommit_Java_MavenInstall/sdks/java/io/jdbc/target/beam-sdks-java-io-jdbc-0.5.0-incubating-SNAPSHOT-tests.jar to org.apache.beam/beam-sdks-java-io-jdbc/0.5.0-incubating-SNAPSHOT/beam-sdks-java-io-jdbc-0.5.0-incubating-SNAPSHOT-tests.jar[JENKINS] Archiving /home/jenkins/jenkins-slave/workspace/beam_PreCommit_Java_MavenInstall/sdks/java/extensions/pom.xml to org.apache.beam/beam-sdks-java-extensions-parent/0.5.0-incubating-SNAPSHOT/beam-sdks-java-extensions-parent-0.5.0-incubating-SNAPSHOT.pom[JENKINS] Archiving /home/jenkins/jenkins-slave/workspace/beam_PreCommit_Java_MavenInstall/examples/pom.xml to org.apache.beam/beam-examples-parent/0.5.0-incubating-SNAPSHOT/beam-examples-parent-0.5.0-incubating-SNAPSHOT.pomchannel stoppedSetting status of b1c9f05 to FAILURE with url https://builds.apache.org/job/beam_PreCommit_Java_MavenInstall/5867/ and message: 'Build finished. 'Using context: Jenkins: Maven clean install
--none--

@markflyhigh markflyhigh force-pushed the python-recommit-maven-install branch from b1c9f05 to d8fabb2 Compare December 14, 2016 18:02
@asfbot
Copy link
Copy Markdown

asfbot commented Dec 14, 2016

Refer to this link for build results (access rights to CI server needed):
https://builds.apache.org/job/beam_PreCommit_Java_MavenInstall/5911/
--none--

@dhalperi
Copy link
Copy Markdown
Contributor

@jasonkuster any thoughts?

CC: @robertwb

@robertwb
Copy link
Copy Markdown
Contributor

robertwb commented Jan 3, 2017

Could you add a comment (or JIRA issue) as to what issue you're trying to solve here?

@asfbot
Copy link
Copy Markdown

asfbot commented Jan 3, 2017

Refer to this link for build results (access rights to CI server needed):
https://builds.apache.org/job/beam_PreCommit_Java_MavenInstall/6381/
--none--

@markflyhigh
Copy link
Copy Markdown
Contributor Author

@robertwb comment updated.

Copy link
Copy Markdown
Contributor

@jasonkuster jasonkuster left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

This is a good pass; a few comments and then we'll see if we can get this tested.

admins(['asfbot'])
useGitHubHooks()
orgWhitelist(['apache'])
whiteListTargetBranches(branchWhitelist)
Copy link
Copy Markdown
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

This should have a default. Optimally, this default would be defined outside of this method, branchWhitelist would be set to it in the method definition, and the default would be commented. Please investigate doing so.


// Sets that this is a PreCommit job.
common_job_properties.setPreCommit(delegate, 'Jenkins: Maven clean install')
common_job_properties.setPreCommit(delegate, ['master'], 'Jenkins: Maven clean install')
Copy link
Copy Markdown
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

pull ['master'] out into its own var, called something like 'build_branches' and commented. Investigate whether the standard precommit should run on any branch other than master as well.

mavenjob('beam_PreCommit_Python_MavenInstall') {
description('Runs an maven install on the python-sdk branch.')

previousNames('beam_PreCommit_MavenVerify')
Copy link
Copy Markdown
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Remove. This job no longer exists.

common_job_properties.setTopLevelJobProperties(delegate, 'python-sdk')

// Sets that this is a PreCommit job.
common_job_properties.setPreCommit(delegate, ['python-sdk'], 'Jenkins: Python PreCommit')
Copy link
Copy Markdown
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

As above, refactor ['python-sdk'] out into a commented var.

@dhalperi
Copy link
Copy Markdown
Contributor

dhalperi commented Feb 6, 2017

Is this still necessary now that Python SDK is in master?

@davorbonaci
Copy link
Copy Markdown
Member

Seems like this should be a part of the bigger effort to reorganize the jobs?

@aaltay
Copy link
Copy Markdown
Member

aaltay commented Mar 16, 2017

@markflyhigh Should this be closed?

@jasonkuster
Copy link
Copy Markdown
Contributor

@aaltay It should -- until we split the Jenkins jobs up there's no point to a separate Python precommit, and this mechanism would no longer work.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

7 participants