Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Shrink size of spark_integration Docker container #18299

Closed
asfimport opened this issue Mar 24, 2018 · 1 comment
Closed

Shrink size of spark_integration Docker container #18299

asfimport opened this issue Mar 24, 2018 · 1 comment

Comments

@asfimport
Copy link
Collaborator

I would like to propose a few changes to the spark_integration Dockerfile:

https://github.com/apache/arrow/tree/master/dev/spark_integration

The size of the resulting image can be reduced by making the following changes:

  • consolidating all RUN commands into a single RUN layer (reducing the number of layers)

  • running apt-get clean to clear out the package cache

  • running conda clean --all to clear out cached package tarballs, abandoned package versions, and other build artifacts from all the libraries that are conda installed

    I will be submitting a PR on GitHub shortly. Generating this issue first so I can tag my PR to it.

Reporter: James Lamb / @jameslamb
Assignee: James Lamb / @jameslamb

PRs and other links:

Note: This issue was originally created as ARROW-2350. Please see the migration documentation for further details.

@asfimport
Copy link
Collaborator Author

Uwe Korn / @xhochy:
Issue resolved by pull request 1787
#1787

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Projects
None yet
Development

No branches or pull requests

1 participant