Skip to content

Remove restrictions for Python 3.7 in Dataflow runner.#8216

Merged
aaltay merged 1 commit intoapache:masterfrom
tvalentyn:allow_37_dataflow
Apr 4, 2019
Merged

Remove restrictions for Python 3.7 in Dataflow runner.#8216
aaltay merged 1 commit intoapache:masterfrom
tvalentyn:allow_37_dataflow

Conversation

@tvalentyn
Copy link
Contributor

This PR removes restrictions in Dataflow runner to launch jobs on Python 3.7. Users will still see a warning: http://go/gh/apache/beam/blob/master/sdks/python/setup.py#L172.

Thank you for your contribution! Follow this checklist to help us incorporate your contribution quickly and easily:

  • Choose reviewer(s) and mention them in a comment (R: @username).
  • Format the pull request title like [BEAM-XXX] Fixes bug in ApproximateQuantiles, where you replace BEAM-XXX with the appropriate JIRA issue, if applicable. This will automatically link the pull request to the issue.
  • If this contribution is large, please file an Apache Individual Contributor License Agreement.

Post-Commit Tests Status (on master branch)

Lang SDK Apex Dataflow Flink Gearpump Samza Spark
Go Build Status --- --- --- --- --- ---
Java Build Status Build Status Build Status Build Status
Build Status
Build Status
Build Status Build Status Build Status
Python Build Status
Build Status
--- Build Status
Build Status
Build Status --- --- ---

Pre-Commit Tests Status (on master branch)

--- Java Python Go Website
Non-portable Build Status Build Status Build Status Build Status
Portable --- Build Status --- ---

See .test-infra/jenkins/README for trigger phrase, status and link of all Jenkins jobs.

@tvalentyn tvalentyn force-pushed the allow_37_dataflow branch 3 times, most recently from 1d0fbfb to 60b1933 Compare April 3, 2019 21:51
@tvalentyn tvalentyn force-pushed the allow_37_dataflow branch from 60b1933 to 552468e Compare April 4, 2019 00:21
@tvalentyn
Copy link
Contributor Author

R: @aaltay
cc: @RobbeSneyders @Juta

if sys.version_info[0:2] in [(2, 7), (3, 5), (3, 6), (3, 7)]:
return

debug_options = pipeline_options.view_as(DebugOptions)
Copy link
Member

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Do we still need ignore_py3_minor_version experiment?

Copy link
Contributor Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

It may be helpful to force the SDK to start a Dataflow job on, say, python 3.8 when it becomes available. I don't have a strong opinion whether to keep it or not.

Copy link
Member

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Let's keep it for now, in case you want to get this PR into the release branch.

Python 3.8, probably we will need to add explicit support by changing this list anyway.

@aaltay aaltay merged commit 9342582 into apache:master Apr 4, 2019
@tvalentyn tvalentyn deleted the allow_37_dataflow branch October 23, 2019 00:45
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

2 participants