Skip to content

[BEAM-7946] Changed name of sdist task in LoadTests gradle#9312

Merged
markflyhigh merged 1 commit intoapache:masterfrom
kkucharc:BEAM-7946-fix-sdist-task-dependency
Aug 13, 2019
Merged

[BEAM-7946] Changed name of sdist task in LoadTests gradle#9312
markflyhigh merged 1 commit intoapache:masterfrom
kkucharc:BEAM-7946-fix-sdist-task-dependency

Conversation

@kkucharc
Copy link
Contributor

@kkucharc kkucharc commented Aug 12, 2019

Due to failing load test jobs because of problem of finding sdist task, a task name is changed to detailed one sdks:python:sdist.


Thank you for your contribution! Follow this checklist to help us incorporate your contribution quickly and easily:

  • Choose reviewer(s) and mention them in a comment (R: @username).
  • Format the pull request title like [BEAM-XXX] Fixes bug in ApproximateQuantiles, where you replace BEAM-XXX with the appropriate JIRA issue, if applicable. This will automatically link the pull request to the issue.
  • If this contribution is large, please file an Apache Individual Contributor License Agreement.

Post-Commit Tests Status (on master branch)

Lang SDK Apex Dataflow Flink Gearpump Samza Spark
Go Build Status --- --- Build Status --- --- Build Status
Java Build Status Build Status Build Status Build Status
Build Status
Build Status
Build Status Build Status Build Status
Build Status
Python Build Status
Build Status
Build Status
Build Status
--- Build Status
Build Status
Build Status --- --- Build Status
XLang --- --- --- Build Status --- --- ---

Pre-Commit Tests Status (on master branch)

--- Java Python Go Website
Non-portable Build Status Build Status Build Status Build Status
Portable --- Build Status --- ---

See .test-infra/jenkins/README for trigger phrase, status and link of all Jenkins jobs.

@kkucharc
Copy link
Contributor Author

Run Python Load Tests Combine Dataflow Batch

@kkucharc kkucharc force-pushed the BEAM-7946-fix-sdist-task-dependency branch from f9e90e5 to ba61e69 Compare August 12, 2019 14:00
@kkucharc
Copy link
Contributor Author

Run Python Load Tests Combine Dataflow Batch

dependsOn 'sdist'
loadTestArgs +=" --sdk_location=${project.buildDir}/apache-beam.tar.gz"
dependsOn ':sdks:python:sdist'
loadTestArgs +=" --sdk_location=${project.rootDir}/sdks/python/build/apache-beam.tar.gz"
Copy link
Contributor Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

I am not sure if there is variable for this dir, but buildDir points to sdks/python/apache_beam/testing/load_tests which after changes in sdist task in no more dist dir.

Copy link
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Thank you for the fix! Sorry for missing this test when I did sdist change. There is a Gradle way to do that (instead building relative path): (e.g. test-suites/dataflow/py35/build.gradle)

  1. Declare a new dependency for this tarball file:
dependencies {
  distTarBall project(path: ":sdks:python", configuration: "distTarBall")
}
  1. Get absolute path by files(configurations.distTarBall.files).singleFile.

Copy link
Contributor Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Thank you for help :) I changed gradle according to those hints.

@kkucharc
Copy link
Contributor Author

@markflyhigh Hi, can you take a look? I created also issue to move tests to test-suites but I would like bring load tests back to life first.

@markflyhigh
Copy link
Contributor

Thank you @kkucharc! I'd also love to review your following PRs for moving this test.

@kkucharc kkucharc force-pushed the BEAM-7946-fix-sdist-task-dependency branch from ba61e69 to e62bb34 Compare August 13, 2019 09:06
@kkucharc
Copy link
Contributor Author

Run Python Load Tests Combine Dataflow Batch

Copy link
Contributor

@markflyhigh markflyhigh left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

LGTM

@markflyhigh markflyhigh merged commit c950d30 into apache:master Aug 13, 2019
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

2 participants