Skip to content

[BEAM-8240] Sets workerHarnessContainerImage in the default Environment of DataflowRunner#9629

Merged
chamikaramj merged 1 commit intoapache:masterfrom
chamikaramj:set_dataflow_env_from_container_image
Sep 23, 2019
Merged

[BEAM-8240] Sets workerHarnessContainerImage in the default Environment of DataflowRunner#9629
chamikaramj merged 1 commit intoapache:masterfrom
chamikaramj:set_dataflow_env_from_container_image

Conversation

@chamikaramj
Copy link
Contributor

Sets workerHarnessContaienrImage as the containerImage of the DockerPayload of the default environment for DataflowRunner

This is similar to change #9583 to Python SDK.


Thank you for your contribution! Follow this checklist to help us incorporate your contribution quickly and easily:

  • Choose reviewer(s) and mention them in a comment (R: @username).
  • Format the pull request title like [BEAM-XXX] Fixes bug in ApproximateQuantiles, where you replace BEAM-XXX with the appropriate JIRA issue, if applicable. This will automatically link the pull request to the issue.
  • If this contribution is large, please file an Apache Individual Contributor License Agreement.

Post-Commit Tests Status (on master branch)

Lang SDK Apex Dataflow Flink Gearpump Samza Spark
Go Build Status --- --- Build Status --- --- Build Status
Java Build Status Build Status Build Status Build Status
Build Status
Build Status
Build Status Build Status Build Status
Build Status
Python Build Status
Build Status
Build Status
Build Status
--- Build Status
Build Status
Build Status --- --- Build Status
XLang --- --- --- Build Status --- --- ---

Pre-Commit Tests Status (on master branch)

--- Java Python Go Website
Non-portable Build Status Build Status Build Status Build Status
Portable --- Build Status --- ---

See .test-infra/jenkins/README for trigger phrase, status and link of all Jenkins jobs.

@chamikaramj
Copy link
Contributor Author

R: @lukecwik

Copy link
Member

@lukecwik lukecwik left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

It would be much easier for you to test the DataflowPipelineTranslator directly since it returns the pipeline proto as part of the JobSpecification. My comments below are if you want to keep going down the path of testing within DataflowRunnerTest.

@chamikaramj chamikaramj force-pushed the set_dataflow_env_from_container_image branch from 464493a to 82e540b Compare September 23, 2019 17:45
@chamikaramj
Copy link
Contributor Author

Thanks Luke. PTAL.

@lukecwik lukecwik changed the title [BEAM-8240] Sets workerHarnessContaienrImage in the default Environment of DataflowRunner [BEAM-8240] Sets workerHarnessContainerImage in the default Environment of DataflowRunner Sep 23, 2019
Copy link
Member

@lukecwik lukecwik left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

nit: It would make more sense to place the test you added within DataflowPipelineTranslatorTest.java

Feel free to fix and then merge or merge as is.

…ayload of the default environment for DataflowRunner
@chamikaramj chamikaramj force-pushed the set_dataflow_env_from_container_image branch from 82e540b to 4299e38 Compare September 23, 2019 21:01
@chamikaramj
Copy link
Contributor Author

Moved the test.

Thanks.

@chamikaramj chamikaramj merged commit a7cf016 into apache:master Sep 23, 2019
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

2 participants