Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Request to Host Glue Spark UI Images on DockerHub #137

Open
AlJohri opened this issue Dec 28, 2022 · 0 comments
Open

Request to Host Glue Spark UI Images on DockerHub #137

AlJohri opened this issue Dec 28, 2022 · 0 comments

Comments

@AlJohri
Copy link

AlJohri commented Dec 28, 2022

Currently I need to write a bunch of code to automatically download and build this docker image because I can't pull it directly from DockerHub.

echo "glue/sparkui image not found, building image..."
TEMPD=$(mktemp -d -t "glue-sparkui-XXXX")
if [ ! -e "$TEMPD" ]; then
    echo >&2 "Failed to create temp directory"
    exit 1
fi
cd "$TEMPD"
git clone https://github.com/aws-samples/aws-glue-samples.git
(cd aws-glue-samples/utilities/Spark_UI/glue-1_0-2_0 && docker build -t glue/sparkui:2.0 .)
(cd aws-glue-samples/utilities/Spark_UI/glue-3_0 && docker build -t glue/sparkui:3.0 .)
(cd aws-glue-samples/utilities/Spark_UI/glue-4_0 && docker build -t glue/sparkui:4.0 .)
cd -
rm -rf "$TEMPD"

Can these docker images be published directly to DockerHub so I can simply docker pull them and start using immediately?

I see that the aws-glue-libs are already hosted there: https://hub.docker.com/r/amazon/aws-glue-libs

Would be great to host the Spark UI as well!

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

1 participant