Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

ARROW-13108: [Python] Pyarrow 4.0.0 crashes upon import on macOS 10.13.6 #10587

Closed
wants to merge 7 commits into from

Conversation

kszucs
Copy link
Member

@kszucs kszucs commented Jun 23, 2021

I think we have been building the macos wheels with the wrong SDK from the latest iteration.

I managed to force-install the requested sdk version, but the vcpkg build fails with an sdk mismatch.

cc @kou @xhochy

@github-actions
Copy link

@kszucs
Copy link
Member Author

kszucs commented Jun 24, 2021

I think the issue is that we link brotli and lz4 from homebrew which built with 10.15 SDK. Investigating further.

@kszucs
Copy link
Member Author

kszucs commented Jun 24, 2021

Submitted crossbow build: https://github.com/ursacomputing/crossbow/runs/2906443258
Seems like there is no sdk version mismatch warning at this time, though I still need to test the produced wheel on an older macOS.

The vcpkg seems to rebuild the dependencies, I'm also checking what can be the issue there.

@xhochy
Copy link
Member

xhochy commented Jun 24, 2021

We can built with newer SDKs but run on older macOS versions in a lot of cases in conda-forge. Thus I'm not fully sure whether the SDK is the sole issue source. We built arrow-cpp there still with the 10.9 SDK, so this has been working fine.

@kszucs kszucs changed the title ARROW-13108: [Python] Pyarrow 4.0.0 crashes upon import on macOS 10.13.6 [WIP] ARROW-13108: [Python] Pyarrow 4.0.0 crashes upon import on macOS 10.13.6 Jun 29, 2021
@kszucs
Copy link
Member Author

kszucs commented Jun 29, 2021

The solution itself works:

I'm going to defer the following two to follow-ups, because they consume a lot of time:

Copy link
Member Author

@kszucs kszucs left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

+1, merging on green

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Projects
None yet
Development

Successfully merging this pull request may close these issues.

3 participants