New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
[BEAM-7899] Fix Python Dataflow VR tests by specify sdk_location #9269
Conversation
Run Python Dataflow ValidatesRunner |
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
beam_PostCommit_Py_VR_Dataflow_PR is now failing on ImportError: No module named 'beam_runner_api_pb2'
, but that's ok.
Waiting for python 2 postcommit to pass.
@@ -70,6 +70,7 @@ task postCommitIT(dependsOn: ['installGcpTest', 'sdist']) { | |||
def testOpts = basicTestOpts + ["--attr=IT"] | |||
def cmdArgs = project.mapToArgString(["test_opts": testOpts, | |||
"worker_jar": dataflowWorkerJar, | |||
"sdk_location": "${project.buildDir}/apache-beam.tar.gz", |
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
This affects Python 2 postcommits, but that job was not broken.
How did it work?
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
The default path build/apache-beam.tar.gz
is used which is output of :sdks:python:sdist
and happens to be a dependency task of PostCommit_Py2. If you look at timeline of this job, sdks:python:sdist
is executed before postCommitIT
so when postCommitIT
runs, the tarball is ready.
run python 2 postcommit |
python2 postcommit passed https://builds.apache.org/job/beam_PostCommit_Python2_PR/55/. PTAL @udim |
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
LGTM, thanks
We forgot to explicitly set
sdk_location
for Python2 dataflow VR tests after moved them totest-suites/dataflow/py2
. The default valuebuild/apache-beam.tar.gz
is still in use which is incorrect.Following change should fix the failure.
+R: @udim
Thank you for your contribution! Follow this checklist to help us incorporate your contribution quickly and easily:
R: @username
).[BEAM-XXX] Fixes bug in ApproximateQuantiles
, where you replaceBEAM-XXX
with the appropriate JIRA issue, if applicable. This will automatically link the pull request to the issue.Post-Commit Tests Status (on master branch)
Pre-Commit Tests Status (on master branch)
See .test-infra/jenkins/README for trigger phrase, status and link of all Jenkins jobs.