Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

podman images way bigger than docker #1183

Closed
rlpowell opened this issue Nov 19, 2018 · 4 comments
Closed

podman images way bigger than docker #1183

rlpowell opened this issue Nov 19, 2018 · 4 comments
Labels
locked - please file new issue/PR

Comments

@rlpowell
Copy link

Description

On a Fedora 29 system in which all the images in podman are also in docker, and docker has way more images besides that, I see:

rlpowell@jukni> sudo du -sh /var/lib/container* /var/lib/docker*
152K    /var/lib/containerd
28G     /var/lib/containers
4.8G    /var/lib/docker
0       /var/lib/docker-engine

Steps to reproduce the issue:
I'm not sure. The images I've built on the podman side are FROM python:2.7 , mariadib:10.2 , and kristophjunge/mediawiki:1.30

Here's the complete Dockerfile for one of them, but I have no way of figuring out which image is using all the space (since "podman images" doesn't report nearly as much space used as is actually used):

FROM python:2.7

WORKDIR /srv/lojban/vlasisku
RUN apt-get update
RUN apt-get -y install sudo vim flex bison

# Download and install jbofihe
RUN git clone https://github.com/lojban/jbofihe.git

WORKDIR /srv/lojban/vlasisku/jbofihe

RUN perl config.pl --prefix=/usr/local
RUN make all
RUN make install

WORKDIR /srv/lojban/vlasisku

# Download and install all the python bits
COPY requirements.txt /tmp/
RUN pip install -r /tmp/requirements.txt
RUN pip install nose  # used to run tests, hence not really a requirement

# User setup
ARG VS_USERID
ARG VS_GROUPID

COPY sudoers /etc/sudoers.d/sampre_vs

RUN groupadd -g ${VS_GROUPID} sampre_vs
RUN useradd -p '**LOCKED**' -g sampre_vs -u ${VS_USERID} -m sampre_vs

# Basic user config
USER sampre_vs
ENV TZ America/Los_Angeles
ENV LANG en_US.UTF-8
ENV HOME /home/sampre_vs

WORKDIR /srv/lojban/vlasisku

Describe the results you received:

Almost 6x space used

Describe the results you expected:

Similar space used

Output of rpm -q buildah or apt list buildah:

rlpowell@jukni> rpm -q buildah podman
package buildah is not installed
podman-0.10.1.3-4.gitdb08685.fc29.x86_64

Output of buildah version:

rlpowell@jukni> buildah version
zsh: command not found: buildah
rlpowell@jukni> podman version
Version:       0.10.1.3
Go Version:    go1.11
OS/Arch:       linux/amd64

Output of podman version if reporting a podman build issue:

rlpowell@jukni> podman version
Version:       0.10.1.3
Go Version:    go1.11
OS/Arch:       linux/amd64

Output of cat /etc/*release:

rlpowell@jukni> cat /etc/redhat-release
Fedora release 29 (Twenty Nine)

Output of uname -a:

Linux jukni.digitalkingdom.org 4.18.18-300.fc29.x86_64 #1 SMP Mon Nov 12 03:12:14 UTC 2018 x86_64 x86_64 x86_64 GNU/Linux

Output of cat /etc/containers/storage.conf:

rlpowell@jukni> grep -v '^#' /etc/containers/storage.conf | grep -v '^\s*$'
[storage]
driver = "overlay"
runroot = "/var/run/containers/storage"
graphroot = "/var/lib/containers/storage"
[storage.options]
additionalimagestores = [
]
size = ""
override_kernel_check = "true"
mountopt = "nodev"
[storage.options.thinpool]
ostree_repo = ""
skip_mount_home = "false"
@rlpowell
Copy link
Author

Oh, also:

rlpowell@jukni> sudo podman images -a
REPOSITORY                          TAG      IMAGE ID       CREATED        SIZE
localhost/lojban/vlasisku           1        7331eb4c1fb7   11 hours ago   1.06GB
<none>                              <none>   d63134809942   11 hours ago   1.06GB
<none>                              <none>   ce265c8aaffe   11 hours ago   1.06GB
<none>                              <none>   053c9e5ebe44   11 hours ago   1.06GB
<none>                              <none>   049f716f147b   11 hours ago   1.06GB
<none>                              <none>   16c48c440b08   11 hours ago   1.06GB
<none>                              <none>   122a4f73688f   11 hours ago   1.06GB
<none>                              <none>   ea4621b5c30f   11 hours ago   1.06GB
<none>                              <none>   14b2e89a9610   11 hours ago   1.06GB
<none>                              <none>   774f6067fa41   11 hours ago   1.06GB
<none>                              <none>   b3fc5b1ef03f   11 hours ago   1.06GB
<none>                              <none>   0059be8bc932   11 hours ago   1.06GB
<none>                              <none>   7b72c26d61f6   11 hours ago   1.01GB
<none>                              <none>   e431e625acc3   11 hours ago   1.01GB
<none>                              <none>   f975438bb81e   11 hours ago   1.01GB
<none>                              <none>   bebbe1e7bb43   11 hours ago   1.01GB
<none>                              <none>   ec247aaefc16   11 hours ago   995MB
<none>                              <none>   a47c1698876d   11 hours ago   995MB
<none>                              <none>   9d60087c8397   11 hours ago   995MB
<none>                              <none>   1058534ece59   11 hours ago   992MB
<none>                              <none>   b523586af4e9   11 hours ago   951MB
<none>                              <none>   a08c777bb349   11 hours ago   935MB
docker.io/library/python            2.7      f67e752245d6   2 days ago     935MB
docker.io/kristophjunge/mediawiki   1.30     6951d2b35bde   9 months ago   1.08GB

@rlpowell
Copy link
Author

Hmmm. I seem to have fixed this by removing the last container on that list.

rlpowell@jukni> sudo podman inspect 6951d2b35bde
[
    {
        "Id": "6951d2b35bde389c82d015b8f87b4fa4bf9e416ebb17805b324c0f8564d2344c",
        "Digest": "sha256:2f3e53bf0fc1d59384507ff776be3f7cb0f7b777db60eb5cb42fa3aae8148da9",
        "RepoTags": [
            "docker.io/kristophjunge/mediawiki:1.30"
        ],
        "RepoDigests": [
            "docker.io/kristophjunge/mediawiki@sha256:2f3e53bf0fc1d59384507ff776be3f7cb0f7b777db60eb5cb42fa3aae8148da9"
        ],
        "Parent": "",
        "Comment": "",
        "Created": "2018-02-04T21:17:45.697056769Z",
        "ContainerConfig": {
            "ExposedPorts": {
                "8080/tcp": {},
                "9000/tcp": {}
            },
            "Env": [
                "PATH=/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin",
                "PHPIZE_DEPS=autoconf \t\tdpkg-dev \t\tfile \t\tg++ \t\tgcc \t\tlibc-dev \t\tmake \t\tpkg-config \t\tre2c",
                "PHP_INI_DIR=/usr/local/etc/php",
                "PHP_EXTRA_CONFIGURE_ARGS=--enable-fpm --with-fpm-user=www-data --with-fpm-group=www-data",
                "PHP_CFLAGS=-fstack-protector-strong -fpic -fpie -O2",
                "PHP_CPPFLAGS=-fstack-protector-strong -fpic -fpie -O2",
                "PHP_LDFLAGS=-Wl,-O1 -Wl,--hash-style=both -pie",
                "GPG_KEYS=1A4E8B7277C42E53DBA9C7B9BCAA30EA9C0D5763 6E4F6AB321FDC07F2C332E3AC2BF0BC433CFC8B3",
                "PHP_VERSION=7.0.27",
                "PHP_URL=https://secure.php.net/get/php-7.0.27.tar.xz/from/this/mirror",
                "PHP_ASC_URL=https://secure.php.net/get/php-7.0.27.tar.xz.asc/from/this/mirror",
                "PHP_SHA256=4b2bc823e806dbf7b62fe0b92b0d14b0c6e03f88c3fc5d96278416c54ce11f6c",
                "PHP_MD5=",
                "NODE_PATH=/usr/lib/parsoid/node_modules:/usr/lib/parsoid/src"
            ],
            "Entrypoint": [
                "/docker-entrypoint.sh"
            ],
            "Volumes": {
                "/data": {},
                "/images": {},
                "/var/cache/nginx": {}
            },
            "WorkingDir": "/var/www/mediawiki"
        },
        "Version": "17.06.1-ce",
        "Author": "Kristoph Junge <kristoph.junge@gmail.com>",
        "Architecture": "amd64",
        "Os": "linux",
        "Size": 1080671651,
        "VirtualSize": 1080671651,
        "GraphDriver": {
            "Name": "overlay",
            "Data": {
                "LowerDir": "/var/lib/containers/storage/overlay/b6a343af44223064f33b0967af3cb01ee8f6178d48919b86829ec426c0bcf422/diff:/var/lib/containers/storage/overlay/716c3c7298eb664d05bdbd07ebb2ec53677b214be2
f353cee70f471ed1eab994/diff:/var/lib/containers/storage/overlay/14ba1cc63cc355155f944d3b59896540d7355d31dc27bc8535feeb279d989514/diff:/var/lib/containers/storage/overlay/3c8b028b7891e5463ee2458e34a7b8311a9f0d37191
89ea233e582b256eb80b1/diff:/var/lib/containers/storage/overlay/fa3c5fe31893ec51e3bc7bc051bfb0379bd69577f76e96762cc574d07667a0f7/diff:/var/lib/containers/storage/overlay/74506387cc5ea9ed696d2cfbedd8cbeadb33e2007825
d1407fe9906a4a4f9b20/diff:/var/lib/containers/storage/overlay/0674d28728013754c928b122316411d7f5518ef024f8648e6b75e8b68364df43/diff:/var/lib/containers/storage/overlay/b98e1c4100487d5c99f717dd4a873d65fd1137c2e36db
f4017d39f2152d65685/diff:/var/lib/containers/storage/overlay/d54f5a2e5303b134d33d476280bd6ce0aa52cfd009af64ec1bafe4670690b656/diff:/var/lib/containers/storage/overlay/8b010bd67e0f737bf90d8a1e9cc194c768b95142773570
f173526c0989703189/diff:/var/lib/containers/storage/overlay/654491382bc2fdd47dd0a492e587c9486e77ffd788bf3af4b048b2d71b410f11/diff:/var/lib/containers/storage/overlay/271463b9d4e1711b482715dfb4e5db8072732e929fffdf2
91882b61387a842a8/diff:/var/lib/containers/storage/overlay/cfa998dd29456c451bfe7a40c474f84ca174cabe01dd86a5ab0b01b4badc27df/diff:/var/lib/containers/storage/overlay/57b9349d720aff95f48bf6d00a2256ce8036609cf55734af
c128ed0b1dc3e938/diff:/var/lib/containers/storage/overlay/6620284d9c55b9c3dca2c73b10ef9309e6ca22e35e4c60f48f23548b2881996d/diff:/var/lib/containers/storage/overlay/0e937fe6ee637683f2be8005c995c3a2c8b5d18ba3474c593
91f2f50c838a0ca/diff:/var/lib/containers/storage/overlay/9d7780973fd14f6fcce6b29906159e6ad6029b2cc01c693e7bec6065a121fd34/diff:/var/lib/containers/storage/overlay/d0fb1d1cc214ea8ae953e8dfc190d00f408ff517032ab57a1d
d9eabc43a00f2c/diff:/var/lib/containers/storage/overlay/42e7827dcfcedf6e3a65a39b6a11c8fc03222ea1cad2ef037f6f71a894c82d70/diff:/var/lib/containers/storage/overlay/26480f35bdd3f87a3d67869c04e602d23c9ffd4d00e9d418bd4
95e81caa8595d/diff:/var/lib/containers/storage/overlay/8c26d32944802e188dea3e2df636df604174f99b4df0cd05407ede1cdf4b38d4/diff:/var/lib/containers/storage/overlay/f0a2c73726769704f46f328896af860520c2662ef932a43153eb
2442aef8cff4/diff:/var/lib/containers/storage/overlay/c02674f6124e7bceb735aa0016504a3d31409bbcfcae21a3c34fd8c57850231b/diff:/var/lib/containers/storage/overlay/216510e069da006b7bda5a49318bd55fee52b3184a8da5f3c87cc
c4fbe39b5e9/diff:/var/lib/containers/storage/overlay/8f7deae0802f9703b5d422a28c8f24c837abf753c07c8d627d996213125d442a/diff:/var/lib/containers/storage/overlay/09878f4bb08b923e01e22a16178f6105906ac44f0d03c73e82f898
4301d3d836/diff:/var/lib/containers/storage/overlay/42b6ce479e3fe929572b7ad045d39743e4a6be908a328c542807351f149f2f9f/diff:/var/lib/containers/storage/overlay/8e210ce36f6aa5ef1679d38366ddd5f4eb87f7934588c75a8d96de5
168eecce2/diff:/var/lib/containers/storage/overlay/a46724b8d4dd3bc49d0b11598516c5cd25bd81661f0f8eef4939b3a794fa02d9/diff:/var/lib/containers/storage/overlay/3398449ffec436c6a1b10a3ce96c4786c98f10b95cb1941b69df3f7f
68984243/diff:/var/lib/containers/storage/overlay/b9564782966eaa9fc329c716f48c625f5459de11e3ace58de0b0c6e696fab42b/diff:/var/lib/containers/storage/overlay/db3d1b792072e22625fe9172330c5932df2ce477852d8e6355429b3cf
feec3f3/diff:/var/lib/containers/storage/overlay/ddc5217874cde9e9668a4f210e4928125771f54e5be089e1d73cb73bc15348b8/diff:/var/lib/containers/storage/overlay/879aa11af996c5eb9219d984e34941c0df25ac347d797de13f3381697e
8b4d93/diff:/var/lib/containers/storage/overlay/4bcdffd70da292293d059d2435c7056711fab2655f8b74f48ad0abe042b63687/diff",
                "MergedDir": "/var/lib/containers/storage/overlay/5ea0024c53ba7837b212e400c74d10b903cc152c4c46de3bd37d75c5420364dc/merged",
                "UpperDir": "/var/lib/containers/storage/overlay/5ea0024c53ba7837b212e400c74d10b903cc152c4c46de3bd37d75c5420364dc/diff",
                "WorkDir": "/var/lib/containers/storage/overlay/5ea0024c53ba7837b212e400c74d10b903cc152c4c46de3bd37d75c5420364dc/work"
            }
        },
        "RootFS": {
            "Type": "layers",
            "Layers": [
                "sha256:4bcdffd70da292293d059d2435c7056711fab2655f8b74f48ad0abe042b63687",
                "sha256:03e5cb5a8bb0a6b1b7e31e84adb9528cfa19eca6cae618d1c770cd94c446b634",
                "sha256:c3970b5dc6b10eaedd9d234f67129f731bd50f3a4ad783979e2e07e8cc664765",
                "sha256:afb4aa7e0a99e659217abdafd280e717dd75c3bf05a4eb9f2dce019e57bc927b",
                "sha256:17134cc05e5d61af9eb997e55b9045632662eaff6460681a7809d83341af670b",
                "sha256:7482cb3a43fc3ae5ecb9715ebc9788900b554bfe7205f56ae40093ca32182b78",
                "sha256:80f6684d6a4401e50bd1f55b2c3cabac21f308d457fa0b71ff02b9c93435ee1d",
                "sha256:5e61c6dd7d75eeec57b9d01d16fadcb6f5f0c3bc57b38f668b49584d5eb0a76f",
                "sha256:038a2d517eb6166e6b271ddd1a46eaf29bcc25d24554fc37b35104466d501f7c",
                "sha256:e4cedbe646b3f9425c01ef3e42e4cc50eb98cae8440c180df267d6e00594c3a6",
                "sha256:450c2d9b3a702c8c1bf0139d4b21d8a911627b6b4425e92581aaf25c300c8d97",
                "sha256:fc4d9d50a8ca1d2961130d296123c678c92810a9a9942474bfe848de558527f7",
                "sha256:875525184e800b4b2f20eb4d69b2fc9a31c0c459152ccd149a067591fdad33f3",
                "sha256:a5d58b842da5727f02ba583979b6f7907d05cf07a94342f0144e0c2d554bcade",
                "sha256:0a68f81cc009b405d586be2b9f978e32a0c3998731eb1d658595b6f518fb2ff2",
                "sha256:43da41c2bb5339c373dc7a9630638eac4b5b111a1444767edbde5d67d2ae8039",
                "sha256:67999825ff08f885e76345c924ed1fd1c2539698d6d617f326ce8b8214342663",
                "sha256:da0590d0a5d26d6d3e05f761c14af7214550f188aade2f89ad130b2aac6694ed",
                "sha256:313edaa24f03f7a01c081489422ff3d000552e30aaceeb281474e0e385ed54af",
                "sha256:dab9ee85f0005a42e826b228acb241338b00f6a3fd576c466e91918bf88a16b0",
                "sha256:d9c92eec1942fca1dc3d9ee91d70d04d3b04e155597ae54d086cea74043b0ff0",
                "sha256:3d64a5fda84168ed223eff9d2d7066d0ed460962774fec493035d670ddb320bf",
                "sha256:04dbe85c5e9e48b61e2e39439baaed65f9646a71c505d504d334a638c7fe938e",
                "sha256:c81a557af662373483c21e7aa1167b329e87a1f83be6d0b88bb7cf87bc713732",
                "sha256:bf479ae39d65dfe5343c7be6ab5806a5c867704fe0e06c6a3fad0321e2587d52",
                "sha256:d30ac59ab37f1aad166999fea411fed592b775a0c84497c9e3697dc81ac4baaa",
                "sha256:6e32f34836156110868644c8885f57e69a18662bb0db7f438fac14f1ad248817",
                "sha256:500d0233690f7eeb6d644606f9ca6d7175d1314b3fc8323456dc5c3f9975de82",
                "sha256:3c8d4a252d003c353461dd46c2f18caf3ea9f3dac3ea9fc55d8635e9035f1e4b",
                "sha256:00c6ed179c03a33cec158aefce75c2a47a59afce0c132b5e709461dbd1e405ee",
                "sha256:75d8132efed9cd034f4f7c2c10ef46efbdae207d2bfe8ae2c4e54a361343fc6f",
                "sha256:4a3efaf8e548397e6554d05b84bb440379bbeda7970b156f9528452ed8653366",
                "sha256:64ccdbf380d66f9e261643ba7f1e24aa7c39fe53e0977a30119e8ab18f7c4773",
                "sha256:bbfdbf06a8581f02b662ce27522ac464f1a56b0c6a0a50d2f6f268ec278caf06",
                "sha256:ec0bacfe000a7915f4e6d76a504623eb29008d11d9531faf5b1bd9dc29b97f99",
                "sha256:ad6a198cffd2d6a2d91cf064b498cb39fa7d914f4576f6dcaa311848913965fc"
            ]
        },
        "Labels": null,
        "Annotations": {},
        "ManifestType": "application/vnd.docker.distribution.manifest.v2+json",
        "User": ""
    }
]

I had to use -f to remove it; I've no idea why:

rlpowell@jukni> sudo podman container ls -a
CONTAINER ID   IMAGE                         COMMAND                  CREATED       STATUS           PORTS                     NAMES             IS INFRA
4a2e1f3ed9ef   localhost/lojban/vlasisku:1   bash -c /srv/lojban...   3 hours ago   Up 3 hours ago   0.0.0.0:12080->8080/tcp   lojban_vlasisku   false
rlpowell@jukni> sudo podman rmi 6951d2b35bde
A container associated with containers/storage, i.e. via Buildah, CRI-O, etc., may be associated with this image: 6951d2b35bde
image is in use by a container
rlpowell@jukni> sudo podman rmi -f 6951d2b35bde
6951d2b35bde389c82d015b8f87b4fa4bf9e416ebb17805b324c0f8564d2344c
rlpowell@jukni> sudo du -sh /var/lib/container* /var/lib/docker*
[sudo] password for rlpowell:
152K    /var/lib/containerd
4.3G    /var/lib/containers
4.8G    /var/lib/docker
0       /var/lib/docker-engine

@rlpowell
Copy link
Author

This and https://github.com/containers/buildah/issues/1184 are probably duplicates of some kind; one should probably be closed.

@TomSweeneyRedHat
Copy link
Member

Thanks for the reports and the heads up @rlpowell . I'm going to close this issue and we can carry on the discussion in #1184.

@github-actions github-actions bot locked as resolved and limited conversation to collaborators Sep 19, 2023
Sign up for free to subscribe to this conversation on GitHub. Already have an account? Sign in.
Assignees
No one assigned
Labels
locked - please file new issue/PR
Projects
None yet
Milestone
No milestone
Development

No branches or pull requests
2 participants
@rlpowell @TomSweeneyRedHat