Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

[SPARK-47053][INFRA] Bump python libraries (pandas, pyarrow) in Docker image for release script #45110

Open
wants to merge 1 commit into
base: master
Choose a base branch
from

Conversation

HeartSaVioR
Copy link
Contributor

What changes were proposed in this pull request?

This PR proposes to bump python libraries (pandas to 2.0.3, pyarrow to 4.0.0) in Docker image for release script.

Why are the changes needed?

Without this change, release script (do-release-docker.sh) fails on docs phase. Changing this fixes the release process against branch-3.5.

Does this PR introduce any user-facing change?

No.

How was this patch tested?

Confirmed with dry-run of release script against branch-3.5.

Was this patch authored or co-authored using generative AI tooling?

No.

@HeartSaVioR
Copy link
Contributor Author

I'm now running release script with dry-run against master branch. Will update PR description once it works for master branch as well. Otherwise I'll rebase this PR against branch-3.5.

@HeartSaVioR HeartSaVioR changed the base branch from master to branch-3.5 February 15, 2024 04:46
@HeartSaVioR HeartSaVioR changed the base branch from branch-3.5 to master February 15, 2024 04:47
@HeartSaVioR
Copy link
Contributor Author

docs phase against master branch + this PR failed "before" python docs build:

Your bundle is locked to sass-embedded (1.69.7) from rubygems repository
https://rubygems.org/ or installed locally, but that version can no longer be
found in that source. That means the author of sass-embedded (1.69.7) has removed
it. You'll need to update your bundle to a version other than sass-embedded
(1.69.7) that hasn't been removed in order to install.

Rebasing this PR to master branch doesn't seem to work as expected. I'll submit a PR for branch-3.5, as cherry-pick has conflict anyway.

@HeartSaVioR HeartSaVioR changed the title [SPARK-46906][INFRA] Bump python libraries (pandas, pyarrow) in Docker image for release script [SPARK-47053][INFRA] Bump python libraries (pandas, pyarrow) in Docker image for release script Feb 15, 2024
@xinrong-meng
Copy link
Member

Thank you @HeartSaVioR !

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Projects
None yet
2 participants