Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Image size is 756GB. #7

Closed
WantToLearnJapanese opened this issue Oct 15, 2021 · 7 comments
Closed

Image size is 756GB. #7

WantToLearnJapanese opened this issue Oct 15, 2021 · 7 comments

Comments

@WantToLearnJapanese
Copy link

The image size is 756GB with the command "make all-full CC="7.5" on the server with 40 cores and 8 Gtx2080-Ti s.

I am not sure if the image is taking really this big size, but when I tried to push it to Docker Hub, it really went 756GB. (I am pushing it now, currently, 41.48GB/756GB pushed)

@veritas9872
Copy link
Collaborator

Please use the Makefile. The image should be about 10GB when uncompressed. Check again.

@WantToLearnJapanese
Copy link
Author

Please use the Makefile. The image should be about 10GB when uncompressed. Check again.

I used the provided Makefile as I said above 'make all-full CC="7.5"'

@WantToLearnJapanese
Copy link
Author

Please use the Makefile. The image should be about 10GB when uncompressed. Check again.

I get the train image of size 9.68GB on one environment but got this 756GB train image on the other two identical environments.

@veritas9872
Copy link
Collaborator

Try the clean commands on the dev branch. The main branch has a minor bug.

@WantToLearnJapanese
Copy link
Author

WantToLearnJapanese commented Oct 15, 2021

Try the clean commands on the dev branch. The main branch has a minor bug.

I also tried the clean build with the command "make build-train-full-clean". But again got the very big-sized image.

@WantToLearnJapanese
Copy link
Author

WantToLearnJapanese commented Oct 15, 2021

  1. Finished
    branch: master
    build command: make all-full CC=7.5
    I ran du at the root on 756GB image and the total size is 9.3G. Weird.

  2. Running
    branch: dev
    build command: make all-full CC=7.5 CUDA_VERSION=10.2 MAMGA_VERSION=102

  3. Running
    branch: dev
    build command: make build-train-full-clean CC=7.5 CUDA_VERSION=10.2 MAGMA_VERSION=102

@veritas9872
Copy link
Collaborator

Great! I will close this issue as I believe that the problem is solved.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

2 participants