Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

[GLUTEN-5192][VL] Copy bundle jars to dist dir #5193

Open
wants to merge 2 commits into
base: main
Choose a base branch
from

Conversation

wForget
Copy link
Member

@wForget wForget commented Mar 29, 2024

What changes were proposed in this pull request?

closes #5192

How was this patch tested?

run ./dev/package.sh after this change:

image

Copy link

#5192

PHILO-HE
PHILO-HE previously approved these changes Apr 1, 2024
Copy link
Contributor

@PHILO-HE PHILO-HE left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Looks good! Thanks! cc @ulysses-you

@@ -4,17 +4,28 @@ set -eux

CURRENT_DIR=$(cd "$(dirname "$BASH_SOURCE")"; pwd)
GLUTEN_DIR="$CURRENT_DIR/.."
THIRDPARTY_LIB="$GLUTEN_DIR/package/target/thirdparty-lib"
DISTDIR="$GLUTEN_DIR/dist"
THIRDPARTY_LIB="$DISTDIR/thirdparty-lib"
Copy link
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

I guess there are some docs should be updated

Copy link
Member Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Thanks, there seems to be no more documentation, just a commented script..

image

mvn clean package -Pbackends-velox -Prss -Pspark-3.2 -DskipTests
cp package/target/gluten-*-bundle-spark*.jar "$DISTDIR"
Copy link
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

should we use mv ? It will make binary size bigger

Copy link
Member Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

should we use mv ? It will make binary size bigger

The package/target directory is just the mvn build output directory of package module, I think we don't need to care about its size, it will be cleaned after mvn clean.

Copy link

This PR is stale because it has been open 45 days with no activity. Remove stale label or comment or this will be closed in 10 days.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
stale stale
Projects
None yet
Development

Successfully merging this pull request may close these issues.

Copy bundle jar to dist dir
3 participants