Skip to content

[SPARK-48425][INFRA][FOLLOWUP] copy spark connect release tarballs #46769

Closed
cloud-fan wants to merge 1 commit intoapache:masterfrom
cloud-fan:script
Closed

[SPARK-48425][INFRA][FOLLOWUP] copy spark connect release tarballs #46769
cloud-fan wants to merge 1 commit intoapache:masterfrom
cloud-fan:script

Conversation

@cloud-fan
Copy link
Copy Markdown
Contributor

What changes were proposed in this pull request?

This is a followup of #46751 . Now the spark connect tarball is named pyspark_connect..., and we need to update the release scripts as well.

Why are the changes needed?

fix release scripts

Does this PR introduce any user-facing change?

no

How was this patch tested?

manual

Was this patch authored or co-authored using generative AI tooling?

no

@HyukjinKwon
Copy link
Copy Markdown
Member

Merged to master.

cp pyspark-* "svn-spark/${DEST_DIR_NAME}-bin/"
cp SparkR_* "svn-spark/${DEST_DIR_NAME}-bin/"
cp spark* "svn-spark/${DEST_DIR_NAME}-bin/"
cp pyspark* "svn-spark/${DEST_DIR_NAME}-bin/"
Copy link
Copy Markdown
Contributor Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

note: only pyspark tarballs have the issue, but I applied the fix to all of them so that it's more reliable.

HyukjinKwon pushed a commit that referenced this pull request May 28, 2024
### What changes were proposed in this pull request?

This is a followup of #46769 to fix a mistake. The release scripts use a base `spark` folder to build tarballs and it shouldn't be copied with the tarballs.

### Why are the changes needed?

fix mistake

### Does this PR introduce _any_ user-facing change?

no

### How was this patch tested?

manual

### Was this patch authored or co-authored using generative AI tooling?

no

Closes #46771 from cloud-fan/script.

Authored-by: Wenchen Fan <wenchen@databricks.com>
Signed-off-by: Hyukjin Kwon <gurwls223@apache.org>
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Projects

None yet

Development

Successfully merging this pull request may close these issues.

2 participants