Skip to content

Conversation

@Yikun
Copy link
Member

@Yikun Yikun commented Oct 18, 2022

What changes were proposed in this pull request?

Remove unused apt lists cache and apply ./add-dockerfiles.sh 3.3.0

Why are the changes needed?

Clean cache to reduce docker image size.

This is also recommanded by docker community:

$ docker run --user 0:0 -ti apache/spark bash
root@5d1ca347279e:/opt/spark/work-dir# ls /var/lib/apt/lists/
auxfiles								     lock
deb.debian.org_debian_dists_bullseye-updates_InRelease			     partial
deb.debian.org_debian_dists_bullseye-updates_main_binary-arm64_Packages.lz4  security.debian.org_debian-security_dists_bullseye-security_InRelease
deb.debian.org_debian_dists_bullseye_InRelease				     security.debian.org_debian-security_dists_bullseye-security_main_binary-arm64_Packages.lz4
deb.debian.org_debian_dists_bullseye_main_binary-arm64_Packages.lz4
root@5d1ca347279e:/opt/spark/work-dir# du --max-depth=1 -h /var/lib/apt/lists/
4.0K	/var/lib/apt/lists/partial
4.0K	/var/lib/apt/lists/auxfiles
17M	/var/lib/apt/lists/

Does this PR introduce any user-facing change?

Yes in some level, image size is reduced.

How was this patch tested?

K8s CI passed

@Yikun Yikun changed the title [SPARK-40513] Cleanup apt lists cache [SPARK-40833] Cleanup apt lists cache Oct 18, 2022
@Yikun
Copy link
Member Author

Yikun commented Oct 18, 2022

cc @HyukjinKwon @zhengruifeng

@Yikun Yikun closed this in 95f5a1f Oct 19, 2022
@Yikun
Copy link
Member Author

Yikun commented Oct 19, 2022

@martin-g @HyukjinKwon @zhengruifeng Thanks! Merged.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

4 participants