Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

[BEAM-6287] pyarrow is not supported on Windows Python 2 #7337

Merged
merged 1 commit into from Dec 26, 2018

Conversation

ihji
Copy link
Contributor

@ihji ihji commented Dec 21, 2018

Filtering out pyarrow dependency when the platform is Windows and Python version is 2. There's no pyarrow package for the given platform and version.


Follow this checklist to help us incorporate your contribution quickly and easily:

  • Format the pull request title like [BEAM-XXX] Fixes bug in ApproximateQuantiles, where you replace BEAM-XXX with the appropriate JIRA issue, if applicable. This will automatically link the pull request to the issue.
  • If this contribution is large, please file an Apache Individual Contributor License Agreement.

It will help us expedite review of your Pull Request if you tag someone (e.g. @username) to look at it.

Post-Commit Tests Status (on master branch)

Lang SDK Apex Dataflow Flink Gearpump Samza Spark
Go Build Status --- --- --- --- --- ---
Java Build Status Build Status Build Status Build Status Build Status Build Status Build Status Build Status
Python Build Status --- Build Status
Build Status
Build Status --- --- ---

@ihji
Copy link
Contributor Author

ihji commented Dec 21, 2018

R: @udim

Copy link
Member

@udim udim left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

LGTM, but please fix lint error

@ihji ihji force-pushed the dont_install_pyarrow_windows_py2 branch 3 times, most recently from 1558fea to 8c7b82b Compare December 21, 2018 23:01
@ihji ihji force-pushed the dont_install_pyarrow_windows_py2 branch from 8c7b82b to be7549c Compare December 22, 2018 00:40
@ihji
Copy link
Contributor Author

ihji commented Dec 22, 2018

confirm that installation and test work fine on Windows Python 2 👍

@ihji
Copy link
Contributor Author

ihji commented Dec 22, 2018

run python precommit

@ihji
Copy link
Contributor Author

ihji commented Dec 26, 2018

R: @chamikaramj

@chamikaramj chamikaramj merged commit dc01009 into apache:master Dec 26, 2018
@ihji ihji deleted the dont_install_pyarrow_windows_py2 branch December 27, 2018 21:59
@@ -41,7 +41,14 @@
from apache_beam.transforms import CombineGlobally
from apache_beam.transforms.combiners import Count

if not (platform.system() == 'Windows' and sys.version_info[0] == 2):
Copy link
Member

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Next time please use the more common format to handle missing modules used elsewhere in the codebase:

try:
  import pyarrow as pa
except ImportError:
  pa = None
@unittest.skipIf(pa is None, "...")

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

None yet

3 participants