Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

rootless podman stopped working after upgrading from 1.9.4 to 2.0.6 #7650

Closed
disaster123 opened this issue Sep 16, 2020 · 12 comments
Closed
Assignees
Labels
kind/bug Categorizes issue or PR as related to a bug. locked - please file new issue/PR Assist humans wanting to comment on an old issue or PR with locked comments. stale-issue

Comments

@disaster123
Copy link

Is this a BUG REPORT or FEATURE REQUEST? (leave only one on its own line)

/kind bug

Description

After upgrading from 1.9.4 to 2.0.6 i'm not able to run a container.

Steps to reproduce the issue:

  1. install podman 2.0.6~2 under debian buster

  2. run podman

podman run --log-level debug --name=nginx-autoletsencrypt --cap-add NET_ADMIN -e PUID=1000 -e PGID=1000 -e TZ=Europe/Berlin -e SUBDOMAINS -e VALIDATION=http -e DHLEVEL=2048 -e ONLY_SUBDOMAINS=false -e STAGING=false -e URL=test123.de -e EMAIL=test@test.de -v /home/podman/data/nginx-autoletsencrypt/:/config --add-host web:127.0.0.1 --add-host nginx-autoletsencrypt:127.0.0.1 linuxserver/letsencrypt

Describe the results you received:

rying to pull docker.io/linuxserver/letsencrypt...
Getting image source signatures
Copying blob 22733eb57861 done  
Copying blob aea49b5e67ba done  
Copying blob 72cfe606b752 done  
Copying blob 04f8c7ff78a7 done  
Copying blob cd9da28d5aac done  
Copying blob 624da63e836b done  
Copying blob cce2a967d26f done  
Copying config 2314eb20a0 done  
Writing manifest to image destination
Storing signatures
Error: sd-bus call: Permission denied: OCI runtime permission denied error

Describe the results you expected:

Container should start.

Additional information you deem important (e.g. issue happens only occasionally):

debug log level

INFO[0000] podman filtering at log level debug          
DEBU[0000] Called run.PersistentPreRunE(podman run --log-level debug --name=nginx-autoletsencrypt --cap-add NET_ADMIN -e PUID=1000 -e PGID=1000 -e TZ=Europe/Berlin -e SUBDOMAINS -e VALIDATION=http -e DHLEVEL=2048 -e ONLY_SUBDOMAINS=false -e STAGING=false -e URL=test123.de -e EMAIL=test@test.de -v /home/podman/data/nginx-autoletsencrypt/:/config --add-host web:127.0.0.1 --add-host nginx-autoletsencrypt:127.0.0.1 linuxserver/letsencrypt) 
DEBU[0000] Ignoring libpod.conf EventsLogger setting "/home/podman/.config/containers/containers.conf". Use "journald" if you want to change this setting and remove libpod.conf files. 
DEBU[0000] Reading configuration file "/usr/share/containers/containers.conf" 
DEBU[0000] Merged system config "/usr/share/containers/containers.conf": &{{[] [] containers-default-0.14.10 [] private enabled [CAP_AUDIT_WRITE CAP_CHOWN CAP_DAC_OVERRIDE CAP_FOWNER CAP_FSETID CAP_KILL CAP_MKNOD CAP_NET_BIND_SERVICE CAP_NET_RAW CAP_SETFCAP CAP_SETGID CAP_SETPCAP CAP_SETUID CAP_SYS_CHROOT] [] [nproc=32768:32768]  [] [] [] false [PATH=/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin TERM=xterm] false false false  private k8s-file -1 slirp4netns false 2048 private /usr/share/containers/seccomp.json 65536k private host 65536} {true systemd [PATH=/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin] [/usr/libexec/podman/conmon /usr/local/libexec/podman/conmon /usr/local/lib/podman/conmon /usr/bin/conmon /usr/sbin/conmon /usr/local/bin/conmon /usr/local/sbin/conmon /run/current-system/sw/bin/conmon] ctrl-p,ctrl-q true /run/user/1000/libpod/tmp/events/events.log file [/usr/share/containers/oci/hooks.d] docker:// /pause k8s.gcr.io/pause:3.2 /usr/libexec/podman/catatonit shm   false 2048 /usr/bin/crun map[crun:[/usr/bin/crun /usr/sbin/crun /usr/local/bin/crun /usr/local/sbin/crun /sbin/crun /bin/crun /run/current-system/sw/bin/crun] kata:[/usr/bin/kata-runtime /usr/sbin/kata-runtime /usr/local/bin/kata-runtime /usr/local/sbin/kata-runtime /sbin/kata-runtime /bin/kata-runtime /usr/bin/kata-qemu /usr/bin/kata-fc] runc:[/usr/lib/cri-o-runc/sbin/runc /usr/sbin/runc /usr/bin/runc /usr/local/bin/runc /usr/local/sbin/runc /sbin/runc /bin/runc]] missing false    map[] [] [crun runc] [crun] [kata kata-runtime kata-qemu kata-fc] {false false false false false false} /etc/containers/policy.json false 3 /home/podman/.local/share/containers/storage/libpod 10 /run/user/1000/libpod/tmp /home/podman/.local/share/containers/storage/volumes} {[/usr/libexec/cni /usr/lib/cni /usr/local/lib/cni /opt/cni/bin] podman /etc/cni/net.d/}} 
DEBU[0000] Reading configuration file "/etc/containers/containers.conf" 
DEBU[0000] Merged system config "/etc/containers/containers.conf": &{{[] [] containers-default-0.14.10 [] private enabled [CAP_AUDIT_WRITE CAP_CHOWN CAP_DAC_OVERRIDE CAP_FOWNER CAP_FSETID CAP_KILL CAP_MKNOD CAP_NET_BIND_SERVICE CAP_NET_RAW CAP_SETFCAP CAP_SETGID CAP_SETPCAP CAP_SETUID CAP_SYS_CHROOT] [] [nproc=32768:32768]  [] [] [] false [PATH=/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin TERM=xterm] false false false  private k8s-file -1 slirp4netns false 2048 private /usr/share/containers/seccomp.json 65536k private host 65536} {true systemd [PATH=/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin] [/usr/libexec/podman/conmon /usr/local/libexec/podman/conmon /usr/local/lib/podman/conmon /usr/bin/conmon /usr/sbin/conmon /usr/local/bin/conmon /usr/local/sbin/conmon /run/current-system/sw/bin/conmon] ctrl-p,ctrl-q true /run/user/1000/libpod/tmp/events/events.log file [/usr/share/containers/oci/hooks.d] docker:// /pause k8s.gcr.io/pause:3.2 /usr/libexec/podman/catatonit shm   false 2048 /usr/bin/crun map[crun:[/usr/bin/crun /usr/sbin/crun /usr/local/bin/crun /usr/local/sbin/crun /sbin/crun /bin/crun /run/current-system/sw/bin/crun] kata:[/usr/bin/kata-runtime /usr/sbin/kata-runtime /usr/local/bin/kata-runtime /usr/local/sbin/kata-runtime /sbin/kata-runtime /bin/kata-runtime /usr/bin/kata-qemu /usr/bin/kata-fc] runc:[/usr/lib/cri-o-runc/sbin/runc /usr/sbin/runc /usr/bin/runc /usr/local/bin/runc /usr/local/sbin/runc /sbin/runc /bin/runc]] missing false    map[] [] [crun runc] [crun] [kata kata-runtime kata-qemu kata-fc] {false false false false false false} /etc/containers/policy.json false 3 /home/podman/.local/share/containers/storage/libpod 10 /run/user/1000/libpod/tmp /home/podman/.local/share/containers/storage/volumes} {[/usr/libexec/cni /usr/lib/cni /usr/local/lib/cni /opt/cni/bin] podman /etc/cni/net.d/}} 
DEBU[0000] Using conmon: "/usr/libexec/podman/conmon"   
DEBU[0000] Initializing boltdb state at /home/podman/.local/share/containers/storage/libpod/bolt_state.db 
DEBU[0000] Using graph driver overlay                   
DEBU[0000] Using graph root /home/podman/.local/share/containers/storage 
DEBU[0000] Using run root /run/user/1000/containers     
DEBU[0000] Using static dir /home/podman/.local/share/containers/storage/libpod 
DEBU[0000] Using tmp dir /run/user/1000/libpod/tmp      
DEBU[0000] Using volume path /home/podman/.local/share/containers/storage/volumes 
DEBU[0000] Set libpod namespace to ""                   
DEBU[0000] Not configuring container store              
DEBU[0000] Initializing event backend file              
DEBU[0000] using runtime "/usr/lib/cri-o-runc/sbin/runc" 
DEBU[0000] using runtime "/usr/bin/crun"                
WARN[0000] Error initializing configured OCI runtime kata: no valid executable found for OCI runtime kata: invalid argument 
DEBU[0000] using runtime "/usr/bin/crun"                
INFO[0000] Setting parallel job count to 25             
INFO[0000] podman filtering at log level debug          
DEBU[0000] Called run.PersistentPreRunE(podman run --log-level debug --name=nginx-autoletsencrypt --cap-add NET_ADMIN -e PUID=1000 -e PGID=1000 -e TZ=Europe/Berlin -e SUBDOMAINS -e VALIDATION=http -e DHLEVEL=2048 -e ONLY_SUBDOMAINS=false -e STAGING=false -e URL=test123.de -e EMAIL=test@test.de -v /home/podman/data/nginx-autoletsencrypt/:/config --add-host web:127.0.0.1 --add-host nginx-autoletsencrypt:127.0.0.1 linuxserver/letsencrypt) 
DEBU[0000] Ignoring libpod.conf EventsLogger setting "/home/podman/.config/containers/containers.conf". Use "journald" if you want to change this setting and remove libpod.conf files. 
DEBU[0000] Reading configuration file "/usr/share/containers/containers.conf" 
DEBU[0000] Merged system config "/usr/share/containers/containers.conf": &{{[] [] containers-default-0.14.10 [] private enabled [CAP_AUDIT_WRITE CAP_CHOWN CAP_DAC_OVERRIDE CAP_FOWNER CAP_FSETID CAP_KILL CAP_MKNOD CAP_NET_BIND_SERVICE CAP_NET_RAW CAP_SETFCAP CAP_SETGID CAP_SETPCAP CAP_SETUID CAP_SYS_CHROOT] [] [nproc=32768:32768]  [] [] [] false [PATH=/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin TERM=xterm] false false false  private k8s-file -1 slirp4netns false 2048 private /usr/share/containers/seccomp.json 65536k private host 65536} {true systemd [PATH=/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin] [/usr/libexec/podman/conmon /usr/local/libexec/podman/conmon /usr/local/lib/podman/conmon /usr/bin/conmon /usr/sbin/conmon /usr/local/bin/conmon /usr/local/sbin/conmon /run/current-system/sw/bin/conmon] ctrl-p,ctrl-q true /run/user/1000/libpod/tmp/events/events.log file [/usr/share/containers/oci/hooks.d] docker:// /pause k8s.gcr.io/pause:3.2 /usr/libexec/podman/catatonit shm   false 2048 /usr/bin/crun map[crun:[/usr/bin/crun /usr/sbin/crun /usr/local/bin/crun /usr/local/sbin/crun /sbin/crun /bin/crun /run/current-system/sw/bin/crun] kata:[/usr/bin/kata-runtime /usr/sbin/kata-runtime /usr/local/bin/kata-runtime /usr/local/sbin/kata-runtime /sbin/kata-runtime /bin/kata-runtime /usr/bin/kata-qemu /usr/bin/kata-fc] runc:[/usr/lib/cri-o-runc/sbin/runc /usr/sbin/runc /usr/bin/runc /usr/local/bin/runc /usr/local/sbin/runc /sbin/runc /bin/runc]] missing false    map[] [] [crun runc] [crun] [kata kata-runtime kata-qemu kata-fc] {false false false false false false} /etc/containers/policy.json false 3 /home/podman/.local/share/containers/storage/libpod 10 /run/user/1000/libpod/tmp /home/podman/.local/share/containers/storage/volumes} {[/usr/libexec/cni /usr/lib/cni /usr/local/lib/cni /opt/cni/bin] podman /etc/cni/net.d/}} 
DEBU[0000] Reading configuration file "/etc/containers/containers.conf" 
DEBU[0000] Merged system config "/etc/containers/containers.conf": &{{[] [] containers-default-0.14.10 [] private enabled [CAP_AUDIT_WRITE CAP_CHOWN CAP_DAC_OVERRIDE CAP_FOWNER CAP_FSETID CAP_KILL CAP_MKNOD CAP_NET_BIND_SERVICE CAP_NET_RAW CAP_SETFCAP CAP_SETGID CAP_SETPCAP CAP_SETUID CAP_SYS_CHROOT] [] [nproc=32768:32768]  [] [] [] false [PATH=/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin TERM=xterm] false false false  private k8s-file -1 slirp4netns false 2048 private /usr/share/containers/seccomp.json 65536k private host 65536} {true systemd [PATH=/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin] [/usr/libexec/podman/conmon /usr/local/libexec/podman/conmon /usr/local/lib/podman/conmon /usr/bin/conmon /usr/sbin/conmon /usr/local/bin/conmon /usr/local/sbin/conmon /run/current-system/sw/bin/conmon] ctrl-p,ctrl-q true /run/user/1000/libpod/tmp/events/events.log file [/usr/share/containers/oci/hooks.d] docker:// /pause k8s.gcr.io/pause:3.2 /usr/libexec/podman/catatonit shm   false 2048 /usr/bin/crun map[crun:[/usr/bin/crun /usr/sbin/crun /usr/local/bin/crun /usr/local/sbin/crun /sbin/crun /bin/crun /run/current-system/sw/bin/crun] kata:[/usr/bin/kata-runtime /usr/sbin/kata-runtime /usr/local/bin/kata-runtime /usr/local/sbin/kata-runtime /sbin/kata-runtime /bin/kata-runtime /usr/bin/kata-qemu /usr/bin/kata-fc] runc:[/usr/lib/cri-o-runc/sbin/runc /usr/sbin/runc /usr/bin/runc /usr/local/bin/runc /usr/local/sbin/runc /sbin/runc /bin/runc]] missing false    map[] [] [crun runc] [crun] [kata kata-runtime kata-qemu kata-fc] {false false false false false false} /etc/containers/policy.json false 3 /home/podman/.local/share/containers/storage/libpod 10 /run/user/1000/libpod/tmp /home/podman/.local/share/containers/storage/volumes} {[/usr/libexec/cni /usr/lib/cni /usr/local/lib/cni /opt/cni/bin] podman /etc/cni/net.d/}} 
DEBU[0000] Using conmon: "/usr/libexec/podman/conmon"   
DEBU[0000] Initializing boltdb state at /home/podman/.local/share/containers/storage/libpod/bolt_state.db 
DEBU[0000] Using graph driver overlay                   
DEBU[0000] Using graph root /home/podman/.local/share/containers/storage 
DEBU[0000] Using run root /run/user/1000/containers     
DEBU[0000] Using static dir /home/podman/.local/share/containers/storage/libpod 
DEBU[0000] Using tmp dir /run/user/1000/libpod/tmp      
DEBU[0000] Using volume path /home/podman/.local/share/containers/storage/volumes 
DEBU[0000] Set libpod namespace to ""                   
DEBU[0000] [graphdriver] trying provided driver "overlay" 
DEBU[0000] overlay: mount_program=/usr/bin/fuse-overlayfs 
DEBU[0000] backingFs=xfs, projectQuotaSupported=false, useNativeDiff=false, usingMetacopy=false 
DEBU[0000] Initializing event backend file              
DEBU[0000] using runtime "/usr/bin/crun"                
WARN[0000] Error initializing configured OCI runtime kata: no valid executable found for OCI runtime kata: invalid argument 
DEBU[0000] using runtime "/usr/lib/cri-o-runc/sbin/runc" 
DEBU[0000] using runtime "/usr/bin/crun"                
INFO[0000] Setting parallel job count to 25             
DEBU[0000] parsed reference into "[overlay@/home/podman/.local/share/containers/storage+/run/user/1000/containers:overlay.mount_program=/usr/bin/fuse-overlayfs]docker.io/linuxserver/letsencrypt:latest" 
DEBU[0000] User mount /home/podman/data/nginx-autoletsencrypt/:/config options [] 
DEBU[0000] parsed reference into "[overlay@/home/podman/.local/share/containers/storage+/run/user/1000/containers:overlay.mount_program=/usr/bin/fuse-overlayfs]docker.io/linuxserver/letsencrypt:latest" 
DEBU[0000] parsed reference into "[overlay@/home/podman/.local/share/containers/storage+/run/user/1000/containers:overlay.mount_program=/usr/bin/fuse-overlayfs]@2314eb20a00ea20e1f2fffa006ab2f7552c8b8c2abe3ed142c71f0166d65d0c4" 
DEBU[0000] exporting opaque data as blob "sha256:2314eb20a00ea20e1f2fffa006ab2f7552c8b8c2abe3ed142c71f0166d65d0c4" 
DEBU[0000] parsed reference into "[overlay@/home/podman/.local/share/containers/storage+/run/user/1000/containers:overlay.mount_program=/usr/bin/fuse-overlayfs]docker.io/linuxserver/letsencrypt:latest" 
DEBU[0000] parsed reference into "[overlay@/home/podman/.local/share/containers/storage+/run/user/1000/containers:overlay.mount_program=/usr/bin/fuse-overlayfs]@2314eb20a00ea20e1f2fffa006ab2f7552c8b8c2abe3ed142c71f0166d65d0c4" 
DEBU[0000] exporting opaque data as blob "sha256:2314eb20a00ea20e1f2fffa006ab2f7552c8b8c2abe3ed142c71f0166d65d0c4" 
DEBU[0000] Image has volume at "/config"                
DEBU[0000] Adding anonymous image volume at "/config"   
DEBU[0000] using systemd mode: false                    
DEBU[0000] setting container name nginx-autoletsencrypt 
DEBU[0000] No hostname set; container's hostname will default to runtime default 
DEBU[0000] Loading seccomp profile from "/usr/share/containers/seccomp.json" 
DEBU[0000] Adding mount /proc                           
DEBU[0000] Adding mount /dev                            
DEBU[0000] Adding mount /dev/pts                        
DEBU[0000] Adding mount /dev/mqueue                     
DEBU[0000] Adding mount /sys                            
DEBU[0000] Adding mount /sys/fs/cgroup                  
DEBU[0000] Allocated lock 1 for container 9e7990975e2158265f225843aef03a8dd237984940f9764dc50b069b2816edac 
DEBU[0000] parsed reference into "[overlay@/home/podman/.local/share/containers/storage+/run/user/1000/containers:overlay.mount_program=/usr/bin/fuse-overlayfs]@2314eb20a00ea20e1f2fffa006ab2f7552c8b8c2abe3ed142c71f0166d65d0c4" 
DEBU[0000] exporting opaque data as blob "sha256:2314eb20a00ea20e1f2fffa006ab2f7552c8b8c2abe3ed142c71f0166d65d0c4" 
DEBU[0000] failed to create container nginx-autoletsencrypt(9e7990975e2158265f225843aef03a8dd237984940f9764dc50b069b2816edac): the container name "nginx-autoletsencrypt" is already in use by "cfaf5f2f45a7c688181b44a416c050be8ec5e52f1f8306e27778fdf67c798525". You have to remove that container to be able to reuse that name.: that name is already in use 
Error: error creating container storage: the container name "nginx-autoletsencrypt" is already in use by "cfaf5f2f45a7c688181b44a416c050be8ec5e52f1f8306e27778fdf67c798525". You have to remove that container to be able to reuse that name.: that name is already in use
podman@cloud1-vm137:~/podman-container-configs/nginx-autoletsencrypt-pod$ podman pod rm -a
podman@cloud1-vm137:~/podman-container-configs/nginx-autoletsencrypt-pod$ podman rm -a
cfaf5f2f45a7c688181b44a416c050be8ec5e52f1f8306e27778fdf67c798525
podman@cloud1-vm137:~/podman-container-configs/nginx-autoletsencrypt-pod$ podman run --log-level debug --name=nginx-autoletsencrypt --cap-add NET_ADMIN -e PUID=1000 -e PGID=1000 -e TZ=Europe/Berlin -e SUBDOMAINS -e VALIDATION=http -e DHLEVEL=2048 -e ONLY_SUBDOMAINS=false -e STAGING=false -e URL=test123.de -e EMAIL=test@test.de -v /home/podman/data/nginx-autoletsencrypt/:/config --add-host web:127.0.0.1 --add-host nginx-autoletsencrypt:127.0.0.1 linuxserver/letsencrypt
INFO[0000] podman filtering at log level debug          
DEBU[0000] Called run.PersistentPreRunE(podman run --log-level debug --name=nginx-autoletsencrypt --cap-add NET_ADMIN -e PUID=1000 -e PGID=1000 -e TZ=Europe/Berlin -e SUBDOMAINS -e VALIDATION=http -e DHLEVEL=2048 -e ONLY_SUBDOMAINS=false -e STAGING=false -e URL=test123.de -e EMAIL=test@test.de -v /home/podman/data/nginx-autoletsencrypt/:/config --add-host web:127.0.0.1 --add-host nginx-autoletsencrypt:127.0.0.1 linuxserver/letsencrypt) 
DEBU[0000] Ignoring libpod.conf EventsLogger setting "/home/podman/.config/containers/containers.conf". Use "journald" if you want to change this setting and remove libpod.conf files. 
DEBU[0000] Reading configuration file "/usr/share/containers/containers.conf" 
DEBU[0000] Merged system config "/usr/share/containers/containers.conf": &{{[] [] containers-default-0.14.10 [] private enabled [CAP_AUDIT_WRITE CAP_CHOWN CAP_DAC_OVERRIDE CAP_FOWNER CAP_FSETID CAP_KILL CAP_MKNOD CAP_NET_BIND_SERVICE CAP_NET_RAW CAP_SETFCAP CAP_SETGID CAP_SETPCAP CAP_SETUID CAP_SYS_CHROOT] [] [nproc=32768:32768]  [] [] [] false [PATH=/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin TERM=xterm] false false false  private k8s-file -1 slirp4netns false 2048 private /usr/share/containers/seccomp.json 65536k private host 65536} {true systemd [PATH=/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin] [/usr/libexec/podman/conmon /usr/local/libexec/podman/conmon /usr/local/lib/podman/conmon /usr/bin/conmon /usr/sbin/conmon /usr/local/bin/conmon /usr/local/sbin/conmon /run/current-system/sw/bin/conmon] ctrl-p,ctrl-q true /run/user/1000/libpod/tmp/events/events.log file [/usr/share/containers/oci/hooks.d] docker:// /pause k8s.gcr.io/pause:3.2 /usr/libexec/podman/catatonit shm   false 2048 /usr/bin/crun map[crun:[/usr/bin/crun /usr/sbin/crun /usr/local/bin/crun /usr/local/sbin/crun /sbin/crun /bin/crun /run/current-system/sw/bin/crun] kata:[/usr/bin/kata-runtime /usr/sbin/kata-runtime /usr/local/bin/kata-runtime /usr/local/sbin/kata-runtime /sbin/kata-runtime /bin/kata-runtime /usr/bin/kata-qemu /usr/bin/kata-fc] runc:[/usr/lib/cri-o-runc/sbin/runc /usr/sbin/runc /usr/bin/runc /usr/local/bin/runc /usr/local/sbin/runc /sbin/runc /bin/runc]] missing false    map[] [] [crun runc] [crun] [kata kata-runtime kata-qemu kata-fc] {false false false false false false} /etc/containers/policy.json false 3 /home/podman/.local/share/containers/storage/libpod 10 /run/user/1000/libpod/tmp /home/podman/.local/share/containers/storage/volumes} {[/usr/libexec/cni /usr/lib/cni /usr/local/lib/cni /opt/cni/bin] podman /etc/cni/net.d/}} 
DEBU[0000] Reading configuration file "/etc/containers/containers.conf" 
DEBU[0000] Merged system config "/etc/containers/containers.conf": &{{[] [] containers-default-0.14.10 [] private enabled [CAP_AUDIT_WRITE CAP_CHOWN CAP_DAC_OVERRIDE CAP_FOWNER CAP_FSETID CAP_KILL CAP_MKNOD CAP_NET_BIND_SERVICE CAP_NET_RAW CAP_SETFCAP CAP_SETGID CAP_SETPCAP CAP_SETUID CAP_SYS_CHROOT] [] [nproc=32768:32768]  [] [] [] false [PATH=/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin TERM=xterm] false false false  private k8s-file -1 slirp4netns false 2048 private /usr/share/containers/seccomp.json 65536k private host 65536} {true systemd [PATH=/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin] [/usr/libexec/podman/conmon /usr/local/libexec/podman/conmon /usr/local/lib/podman/conmon /usr/bin/conmon /usr/sbin/conmon /usr/local/bin/conmon /usr/local/sbin/conmon /run/current-system/sw/bin/conmon] ctrl-p,ctrl-q true /run/user/1000/libpod/tmp/events/events.log file [/usr/share/containers/oci/hooks.d] docker:// /pause k8s.gcr.io/pause:3.2 /usr/libexec/podman/catatonit shm   false 2048 /usr/bin/crun map[crun:[/usr/bin/crun /usr/sbin/crun /usr/local/bin/crun /usr/local/sbin/crun /sbin/crun /bin/crun /run/current-system/sw/bin/crun] kata:[/usr/bin/kata-runtime /usr/sbin/kata-runtime /usr/local/bin/kata-runtime /usr/local/sbin/kata-runtime /sbin/kata-runtime /bin/kata-runtime /usr/bin/kata-qemu /usr/bin/kata-fc] runc:[/usr/lib/cri-o-runc/sbin/runc /usr/sbin/runc /usr/bin/runc /usr/local/bin/runc /usr/local/sbin/runc /sbin/runc /bin/runc]] missing false    map[] [] [crun runc] [crun] [kata kata-runtime kata-qemu kata-fc] {false false false false false false} /etc/containers/policy.json false 3 /home/podman/.local/share/containers/storage/libpod 10 /run/user/1000/libpod/tmp /home/podman/.local/share/containers/storage/volumes} {[/usr/libexec/cni /usr/lib/cni /usr/local/lib/cni /opt/cni/bin] podman /etc/cni/net.d/}} 
DEBU[0000] Using conmon: "/usr/libexec/podman/conmon"   
DEBU[0000] Initializing boltdb state at /home/podman/.local/share/containers/storage/libpod/bolt_state.db 
DEBU[0000] Using graph driver overlay                   
DEBU[0000] Using graph root /home/podman/.local/share/containers/storage 
DEBU[0000] Using run root /run/user/1000/containers     
DEBU[0000] Using static dir /home/podman/.local/share/containers/storage/libpod 
DEBU[0000] Using tmp dir /run/user/1000/libpod/tmp      
DEBU[0000] Using volume path /home/podman/.local/share/containers/storage/volumes 
DEBU[0000] Set libpod namespace to ""                   
DEBU[0000] Not configuring container store              
DEBU[0000] Initializing event backend file              
DEBU[0000] using runtime "/usr/lib/cri-o-runc/sbin/runc" 
DEBU[0000] using runtime "/usr/bin/crun"                
WARN[0000] Error initializing configured OCI runtime kata: no valid executable found for OCI runtime kata: invalid argument 
DEBU[0000] using runtime "/usr/bin/crun"                
INFO[0000] Setting parallel job count to 25             
INFO[0000] podman filtering at log level debug          
DEBU[0000] Called run.PersistentPreRunE(podman run --log-level debug --name=nginx-autoletsencrypt --cap-add NET_ADMIN -e PUID=1000 -e PGID=1000 -e TZ=Europe/Berlin -e SUBDOMAINS -e VALIDATION=http -e DHLEVEL=2048 -e ONLY_SUBDOMAINS=false -e STAGING=false -e URL=test123.de -e EMAIL=test@test.de -v /home/podman/data/nginx-autoletsencrypt/:/config --add-host web:127.0.0.1 --add-host nginx-autoletsencrypt:127.0.0.1 linuxserver/letsencrypt) 
DEBU[0000] Ignoring libpod.conf EventsLogger setting "/home/podman/.config/containers/containers.conf". Use "journald" if you want to change this setting and remove libpod.conf files. 
DEBU[0000] Reading configuration file "/usr/share/containers/containers.conf" 
DEBU[0000] Merged system config "/usr/share/containers/containers.conf": &{{[] [] containers-default-0.14.10 [] private enabled [CAP_AUDIT_WRITE CAP_CHOWN CAP_DAC_OVERRIDE CAP_FOWNER CAP_FSETID CAP_KILL CAP_MKNOD CAP_NET_BIND_SERVICE CAP_NET_RAW CAP_SETFCAP CAP_SETGID CAP_SETPCAP CAP_SETUID CAP_SYS_CHROOT] [] [nproc=32768:32768]  [] [] [] false [PATH=/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin TERM=xterm] false false false  private k8s-file -1 slirp4netns false 2048 private /usr/share/containers/seccomp.json 65536k private host 65536} {true systemd [PATH=/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin] [/usr/libexec/podman/conmon /usr/local/libexec/podman/conmon /usr/local/lib/podman/conmon /usr/bin/conmon /usr/sbin/conmon /usr/local/bin/conmon /usr/local/sbin/conmon /run/current-system/sw/bin/conmon] ctrl-p,ctrl-q true /run/user/1000/libpod/tmp/events/events.log file [/usr/share/containers/oci/hooks.d] docker:// /pause k8s.gcr.io/pause:3.2 /usr/libexec/podman/catatonit shm   false 2048 /usr/bin/crun map[crun:[/usr/bin/crun /usr/sbin/crun /usr/local/bin/crun /usr/local/sbin/crun /sbin/crun /bin/crun /run/current-system/sw/bin/crun] kata:[/usr/bin/kata-runtime /usr/sbin/kata-runtime /usr/local/bin/kata-runtime /usr/local/sbin/kata-runtime /sbin/kata-runtime /bin/kata-runtime /usr/bin/kata-qemu /usr/bin/kata-fc] runc:[/usr/lib/cri-o-runc/sbin/runc /usr/sbin/runc /usr/bin/runc /usr/local/bin/runc /usr/local/sbin/runc /sbin/runc /bin/runc]] missing false    map[] [] [crun runc] [crun] [kata kata-runtime kata-qemu kata-fc] {false false false false false false} /etc/containers/policy.json false 3 /home/podman/.local/share/containers/storage/libpod 10 /run/user/1000/libpod/tmp /home/podman/.local/share/containers/storage/volumes} {[/usr/libexec/cni /usr/lib/cni /usr/local/lib/cni /opt/cni/bin] podman /etc/cni/net.d/}} 
DEBU[0000] Reading configuration file "/etc/containers/containers.conf" 
DEBU[0000] Merged system config "/etc/containers/containers.conf": &{{[] [] containers-default-0.14.10 [] private enabled [CAP_AUDIT_WRITE CAP_CHOWN CAP_DAC_OVERRIDE CAP_FOWNER CAP_FSETID CAP_KILL CAP_MKNOD CAP_NET_BIND_SERVICE CAP_NET_RAW CAP_SETFCAP CAP_SETGID CAP_SETPCAP CAP_SETUID CAP_SYS_CHROOT] [] [nproc=32768:32768]  [] [] [] false [PATH=/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin TERM=xterm] false false false  private k8s-file -1 slirp4netns false 2048 private /usr/share/containers/seccomp.json 65536k private host 65536} {true systemd [PATH=/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin] [/usr/libexec/podman/conmon /usr/local/libexec/podman/conmon /usr/local/lib/podman/conmon /usr/bin/conmon /usr/sbin/conmon /usr/local/bin/conmon /usr/local/sbin/conmon /run/current-system/sw/bin/conmon] ctrl-p,ctrl-q true /run/user/1000/libpod/tmp/events/events.log file [/usr/share/containers/oci/hooks.d] docker:// /pause k8s.gcr.io/pause:3.2 /usr/libexec/podman/catatonit shm   false 2048 /usr/bin/crun map[crun:[/usr/bin/crun /usr/sbin/crun /usr/local/bin/crun /usr/local/sbin/crun /sbin/crun /bin/crun /run/current-system/sw/bin/crun] kata:[/usr/bin/kata-runtime /usr/sbin/kata-runtime /usr/local/bin/kata-runtime /usr/local/sbin/kata-runtime /sbin/kata-runtime /bin/kata-runtime /usr/bin/kata-qemu /usr/bin/kata-fc] runc:[/usr/lib/cri-o-runc/sbin/runc /usr/sbin/runc /usr/bin/runc /usr/local/bin/runc /usr/local/sbin/runc /sbin/runc /bin/runc]] missing false    map[] [] [crun runc] [crun] [kata kata-runtime kata-qemu kata-fc] {false false false false false false} /etc/containers/policy.json false 3 /home/podman/.local/share/containers/storage/libpod 10 /run/user/1000/libpod/tmp /home/podman/.local/share/containers/storage/volumes} {[/usr/libexec/cni /usr/lib/cni /usr/local/lib/cni /opt/cni/bin] podman /etc/cni/net.d/}} 
DEBU[0000] Using conmon: "/usr/libexec/podman/conmon"   
DEBU[0000] Initializing boltdb state at /home/podman/.local/share/containers/storage/libpod/bolt_state.db 
DEBU[0000] Using graph driver overlay                   
DEBU[0000] Using graph root /home/podman/.local/share/containers/storage 
DEBU[0000] Using run root /run/user/1000/containers     
DEBU[0000] Using static dir /home/podman/.local/share/containers/storage/libpod 
DEBU[0000] Using tmp dir /run/user/1000/libpod/tmp      
DEBU[0000] Using volume path /home/podman/.local/share/containers/storage/volumes 
DEBU[0000] Set libpod namespace to ""                   
DEBU[0000] [graphdriver] trying provided driver "overlay" 
DEBU[0000] overlay: mount_program=/usr/bin/fuse-overlayfs 
DEBU[0000] backingFs=xfs, projectQuotaSupported=false, useNativeDiff=false, usingMetacopy=false 
DEBU[0000] Initializing event backend file              
DEBU[0000] using runtime "/usr/lib/cri-o-runc/sbin/runc" 
DEBU[0000] using runtime "/usr/bin/crun"                
WARN[0000] Error initializing configured OCI runtime kata: no valid executable found for OCI runtime kata: invalid argument 
DEBU[0000] using runtime "/usr/bin/crun"                
INFO[0000] Setting parallel job count to 25             
DEBU[0000] parsed reference into "[overlay@/home/podman/.local/share/containers/storage+/run/user/1000/containers:overlay.mount_program=/usr/bin/fuse-overlayfs]docker.io/linuxserver/letsencrypt:latest" 
DEBU[0000] User mount /home/podman/data/nginx-autoletsencrypt/:/config options [] 
DEBU[0000] parsed reference into "[overlay@/home/podman/.local/share/containers/storage+/run/user/1000/containers:overlay.mount_program=/usr/bin/fuse-overlayfs]docker.io/linuxserver/letsencrypt:latest" 
DEBU[0000] parsed reference into "[overlay@/home/podman/.local/share/containers/storage+/run/user/1000/containers:overlay.mount_program=/usr/bin/fuse-overlayfs]@2314eb20a00ea20e1f2fffa006ab2f7552c8b8c2abe3ed142c71f0166d65d0c4" 
DEBU[0000] exporting opaque data as blob "sha256:2314eb20a00ea20e1f2fffa006ab2f7552c8b8c2abe3ed142c71f0166d65d0c4" 
DEBU[0000] parsed reference into "[overlay@/home/podman/.local/share/containers/storage+/run/user/1000/containers:overlay.mount_program=/usr/bin/fuse-overlayfs]docker.io/linuxserver/letsencrypt:latest" 
DEBU[0000] parsed reference into "[overlay@/home/podman/.local/share/containers/storage+/run/user/1000/containers:overlay.mount_program=/usr/bin/fuse-overlayfs]@2314eb20a00ea20e1f2fffa006ab2f7552c8b8c2abe3ed142c71f0166d65d0c4" 
DEBU[0000] exporting opaque data as blob "sha256:2314eb20a00ea20e1f2fffa006ab2f7552c8b8c2abe3ed142c71f0166d65d0c4" 
DEBU[0000] Image has volume at "/config"                
DEBU[0000] Adding anonymous image volume at "/config"   
DEBU[0000] using systemd mode: false                    
DEBU[0000] setting container name nginx-autoletsencrypt 
DEBU[0000] No hostname set; container's hostname will default to runtime default 
DEBU[0000] Loading seccomp profile from "/usr/share/containers/seccomp.json" 
DEBU[0000] Adding mount /proc                           
DEBU[0000] Adding mount /dev                            
DEBU[0000] Adding mount /dev/pts                        
DEBU[0000] Adding mount /dev/mqueue                     
DEBU[0000] Adding mount /sys                            
DEBU[0000] Adding mount /sys/fs/cgroup                  
DEBU[0000] Allocated lock 0 for container 5f87de5bcf20d8b493521b14647e5fd6cb12c3405b8ee05b21549005562c41cd 
DEBU[0000] parsed reference into "[overlay@/home/podman/.local/share/containers/storage+/run/user/1000/containers:overlay.mount_program=/usr/bin/fuse-overlayfs]@2314eb20a00ea20e1f2fffa006ab2f7552c8b8c2abe3ed142c71f0166d65d0c4" 
DEBU[0000] exporting opaque data as blob "sha256:2314eb20a00ea20e1f2fffa006ab2f7552c8b8c2abe3ed142c71f0166d65d0c4" 
DEBU[0000] created container "5f87de5bcf20d8b493521b14647e5fd6cb12c3405b8ee05b21549005562c41cd" 
DEBU[0000] container "5f87de5bcf20d8b493521b14647e5fd6cb12c3405b8ee05b21549005562c41cd" has work directory "/home/podman/.local/share/containers/storage/overlay-containers/5f87de5bcf20d8b493521b14647e5fd6cb12c3405b8ee05b21549005562c41cd/userdata" 
DEBU[0000] container "5f87de5bcf20d8b493521b14647e5fd6cb12c3405b8ee05b21549005562c41cd" has run directory "/run/user/1000/containers/overlay-containers/5f87de5bcf20d8b493521b14647e5fd6cb12c3405b8ee05b21549005562c41cd/userdata" 
DEBU[0000] container "5f87de5bcf20d8b493521b14647e5fd6cb12c3405b8ee05b21549005562c41cd" has CgroupParent "user.slice/user-1000.slice/user@1000.service/user.slice/libpod-5f87de5bcf20d8b493521b14647e5fd6cb12c3405b8ee05b21549005562c41cd.scope" 
DEBU[0000] Not attaching to stdin                       
DEBU[0000] overlay: mount_data=lowerdir=/home/podman/.local/share/containers/storage/overlay/l/MWCKLUJ3Y7JCVYX4N3TP7WFXUS:/home/podman/.local/share/containers/storage/overlay/l/3RVS7YZYV45BX4JZKX4EJMCYAU:/home/podman/.local/share/containers/storage/overlay/l/KTM5FFU2B2DN2OFNGKOPAOEOGP:/home/podman/.local/share/containers/storage/overlay/l/TQZOM2EZQ34Y4ZDZXP7FVCC3CA:/home/podman/.local/share/containers/storage/overlay/l/VRHYZBPUQCFD5ETQYJ5OE3S7YS:/home/podman/.local/share/containers/storage/overlay/l/JUTMWQN7LTZQBMLWVKF5D2OJ2Y:/home/podman/.local/share/containers/storage/overlay/l/DOBDOAFMQRQWMEZRLNKVPSYWVI,upperdir=/home/podman/.local/share/containers/storage/overlay/e51f4b89a1b36f88248cb9c74a0f7ee69973f520da168c528ba53a5cb64e4898/diff,workdir=/home/podman/.local/share/containers/storage/overlay/e51f4b89a1b36f88248cb9c74a0f7ee69973f520da168c528ba53a5cb64e4898/work 
DEBU[0000] Made network namespace at /run/user/1000/netns/cni-710e0fce-9c5a-9c1c-1e27-cd3ebeb1a304 for container 5f87de5bcf20d8b493521b14647e5fd6cb12c3405b8ee05b21549005562c41cd 
DEBU[0000] mounted container "5f87de5bcf20d8b493521b14647e5fd6cb12c3405b8ee05b21549005562c41cd" at "/home/podman/.local/share/containers/storage/overlay/e51f4b89a1b36f88248cb9c74a0f7ee69973f520da168c528ba53a5cb64e4898/merged" 
DEBU[0000] slirp4netns command: /usr/bin/slirp4netns --disable-host-loopback --mtu 65520 --enable-sandbox --enable-seccomp -c -e 3 -r 4 --netns-type=path /run/user/1000/netns/cni-710e0fce-9c5a-9c1c-1e27-cd3ebeb1a304 tap0 
DEBU[0000] Created root filesystem for container 5f87de5bcf20d8b493521b14647e5fd6cb12c3405b8ee05b21549005562c41cd at /home/podman/.local/share/containers/storage/overlay/e51f4b89a1b36f88248cb9c74a0f7ee69973f520da168c528ba53a5cb64e4898/merged 
DEBU[0000] /etc/system-fips does not exist on host, not mounting FIPS mode secret 
DEBU[0000] Setting CGroups for container 5f87de5bcf20d8b493521b14647e5fd6cb12c3405b8ee05b21549005562c41cd to user.slice:libpod:5f87de5bcf20d8b493521b14647e5fd6cb12c3405b8ee05b21549005562c41cd 
DEBU[0000] reading hooks from /usr/share/containers/oci/hooks.d 
DEBU[0000] Created OCI spec for container 5f87de5bcf20d8b493521b14647e5fd6cb12c3405b8ee05b21549005562c41cd at /home/podman/.local/share/containers/storage/overlay-containers/5f87de5bcf20d8b493521b14647e5fd6cb12c3405b8ee05b21549005562c41cd/userdata/config.json 
DEBU[0000] /usr/libexec/podman/conmon messages will be logged to syslog 
DEBU[0000] running conmon: /usr/libexec/podman/conmon    args="[--api-version 1 -c 5f87de5bcf20d8b493521b14647e5fd6cb12c3405b8ee05b21549005562c41cd -u 5f87de5bcf20d8b493521b14647e5fd6cb12c3405b8ee05b21549005562c41cd -r /usr/bin/crun -b /home/podman/.local/share/containers/storage/overlay-containers/5f87de5bcf20d8b493521b14647e5fd6cb12c3405b8ee05b21549005562c41cd/userdata -p /run/user/1000/containers/overlay-containers/5f87de5bcf20d8b493521b14647e5fd6cb12c3405b8ee05b21549005562c41cd/userdata/pidfile -n nginx-autoletsencrypt --exit-dir /run/user/1000/libpod/tmp/exits --socket-dir-path /run/user/1000/libpod/tmp/socket -s -l k8s-file:/home/podman/.local/share/containers/storage/overlay-containers/5f87de5bcf20d8b493521b14647e5fd6cb12c3405b8ee05b21549005562c41cd/userdata/ctr.log --log-level debug --syslog --conmon-pidfile /run/user/1000/containers/overlay-containers/5f87de5bcf20d8b493521b14647e5fd6cb12c3405b8ee05b21549005562c41cd/userdata/conmon.pid --exit-command /usr/bin/podman --exit-command-arg --root --exit-command-arg /home/podman/.local/share/containers/storage --exit-command-arg --runroot --exit-command-arg /run/user/1000/containers --exit-command-arg --log-level --exit-command-arg debug --exit-command-arg --cgroup-manager --exit-command-arg systemd --exit-command-arg --tmpdir --exit-command-arg /run/user/1000/libpod/tmp --exit-command-arg --runtime --exit-command-arg /usr/bin/crun --exit-command-arg --storage-driver --exit-command-arg overlay --exit-command-arg --storage-opt --exit-command-arg overlay.mount_program=/usr/bin/fuse-overlayfs --exit-command-arg --events-backend --exit-command-arg file --exit-command-arg --syslog --exit-command-arg true --exit-command-arg container --exit-command-arg cleanup --exit-command-arg 5f87de5bcf20d8b493521b14647e5fd6cb12c3405b8ee05b21549005562c41cd]"
INFO[0000] Running conmon under slice user.slice and unitName libpod-conmon-5f87de5bcf20d8b493521b14647e5fd6cb12c3405b8ee05b21549005562c41cd.scope 
[conmon:d]: failed to write to /proc/self/oom_score_adj: Permission denied

DEBU[0000] Received: -1                                 
DEBU[0000] Cleaning up container 5f87de5bcf20d8b493521b14647e5fd6cb12c3405b8ee05b21549005562c41cd 
DEBU[0000] Tearing down network namespace at /run/user/1000/netns/cni-710e0fce-9c5a-9c1c-1e27-cd3ebeb1a304 for container 5f87de5bcf20d8b493521b14647e5fd6cb12c3405b8ee05b21549005562c41cd 
DEBU[0000] unmounted container "5f87de5bcf20d8b493521b14647e5fd6cb12c3405b8ee05b21549005562c41cd" 
DEBU[0000] ExitCode msg: "sd-bus call: permission denied: oci runtime permission denied error" 
Error: sd-bus call: Permission denied: OCI runtime permission denied error
podman@cloud1-vm137:~/podman-container-configs/nginx-autoletsencrypt-pod$ podman rm -a
5f87de5bcf20d8b493521b14647e5fd6cb12c3405b8ee05b21549005562c41cd
podman@cloud1-vm137:~/podman-container-configs/nginx-autoletsencrypt-pod$ podman run --log-level debug --name=nginx-autoletsencrypt --cap-add NET_ADMIN -e PUID=1000 -e PGID=1000 -e TZ=Europe/Berlin -e SUBDOMAINS -e VALIDATION=http -e DHLEVEL=2048 -e ONLY_SUBDOMAINS=false -e STAGING=false -e URL=test123.de -e EMAIL=test@test.de -v /home/podman/data/nginx-autoletsencrypt/:/config --add-host web:127.0.0.1 --add-host nginx-autoletsencrypt:127.0.0.1 linuxserver/letsencrypt
INFO[0000] podman filtering at log level debug          
DEBU[0000] Called run.PersistentPreRunE(podman run --log-level debug --name=nginx-autoletsencrypt --cap-add NET_ADMIN -e PUID=1000 -e PGID=1000 -e TZ=Europe/Berlin -e SUBDOMAINS -e VALIDATION=http -e DHLEVEL=2048 -e ONLY_SUBDOMAINS=false -e STAGING=false -e URL=test123.de -e EMAIL=test@test.de -v /home/podman/data/nginx-autoletsencrypt/:/config --add-host web:127.0.0.1 --add-host nginx-autoletsencrypt:127.0.0.1 linuxserver/letsencrypt) 
DEBU[0000] Ignoring libpod.conf EventsLogger setting "/home/podman/.config/containers/containers.conf". Use "journald" if you want to change this setting and remove libpod.conf files. 
DEBU[0000] Reading configuration file "/usr/share/containers/containers.conf" 
DEBU[0000] Merged system config "/usr/share/containers/containers.conf": &{{[] [] containers-default-0.14.10 [] private enabled [CAP_AUDIT_WRITE CAP_CHOWN CAP_DAC_OVERRIDE CAP_FOWNER CAP_FSETID CAP_KILL CAP_MKNOD CAP_NET_BIND_SERVICE CAP_NET_RAW CAP_SETFCAP CAP_SETGID CAP_SETPCAP CAP_SETUID CAP_SYS_CHROOT] [] [nproc=32768:32768]  [] [] [] false [PATH=/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin TERM=xterm] false false false  private k8s-file -1 slirp4netns false 2048 private /usr/share/containers/seccomp.json 65536k private host 65536} {true systemd [PATH=/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin] [/usr/libexec/podman/conmon /usr/local/libexec/podman/conmon /usr/local/lib/podman/conmon /usr/bin/conmon /usr/sbin/conmon /usr/local/bin/conmon /usr/local/sbin/conmon /run/current-system/sw/bin/conmon] ctrl-p,ctrl-q true /run/user/1000/libpod/tmp/events/events.log file [/usr/share/containers/oci/hooks.d] docker:// /pause k8s.gcr.io/pause:3.2 /usr/libexec/podman/catatonit shm   false 2048 /usr/bin/crun map[crun:[/usr/bin/crun /usr/sbin/crun /usr/local/bin/crun /usr/local/sbin/crun /sbin/crun /bin/crun /run/current-system/sw/bin/crun] kata:[/usr/bin/kata-runtime /usr/sbin/kata-runtime /usr/local/bin/kata-runtime /usr/local/sbin/kata-runtime /sbin/kata-runtime /bin/kata-runtime /usr/bin/kata-qemu /usr/bin/kata-fc] runc:[/usr/lib/cri-o-runc/sbin/runc /usr/sbin/runc /usr/bin/runc /usr/local/bin/runc /usr/local/sbin/runc /sbin/runc /bin/runc]] missing false    map[] [] [crun runc] [crun] [kata kata-runtime kata-qemu kata-fc] {false false false false false false} /etc/containers/policy.json false 3 /home/podman/.local/share/containers/storage/libpod 10 /run/user/1000/libpod/tmp /home/podman/.local/share/containers/storage/volumes} {[/usr/libexec/cni /usr/lib/cni /usr/local/lib/cni /opt/cni/bin] podman /etc/cni/net.d/}} 
DEBU[0000] Reading configuration file "/etc/containers/containers.conf" 
DEBU[0000] Merged system config "/etc/containers/containers.conf": &{{[] [] containers-default-0.14.10 [] private enabled [CAP_AUDIT_WRITE CAP_CHOWN CAP_DAC_OVERRIDE CAP_FOWNER CAP_FSETID CAP_KILL CAP_MKNOD CAP_NET_BIND_SERVICE CAP_NET_RAW CAP_SETFCAP CAP_SETGID CAP_SETPCAP CAP_SETUID CAP_SYS_CHROOT] [] [nproc=32768:32768]  [] [] [] false [PATH=/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin TERM=xterm] false false false  private k8s-file -1 slirp4netns false 2048 private /usr/share/containers/seccomp.json 65536k private host 65536} {true systemd [PATH=/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin] [/usr/libexec/podman/conmon /usr/local/libexec/podman/conmon /usr/local/lib/podman/conmon /usr/bin/conmon /usr/sbin/conmon /usr/local/bin/conmon /usr/local/sbin/conmon /run/current-system/sw/bin/conmon] ctrl-p,ctrl-q true /run/user/1000/libpod/tmp/events/events.log file [/usr/share/containers/oci/hooks.d] docker:// /pause k8s.gcr.io/pause:3.2 /usr/libexec/podman/catatonit shm   false 2048 /usr/bin/crun map[crun:[/usr/bin/crun /usr/sbin/crun /usr/local/bin/crun /usr/local/sbin/crun /sbin/crun /bin/crun /run/current-system/sw/bin/crun] kata:[/usr/bin/kata-runtime /usr/sbin/kata-runtime /usr/local/bin/kata-runtime /usr/local/sbin/kata-runtime /sbin/kata-runtime /bin/kata-runtime /usr/bin/kata-qemu /usr/bin/kata-fc] runc:[/usr/lib/cri-o-runc/sbin/runc /usr/sbin/runc /usr/bin/runc /usr/local/bin/runc /usr/local/sbin/runc /sbin/runc /bin/runc]] missing false    map[] [] [crun runc] [crun] [kata kata-runtime kata-qemu kata-fc] {false false false false false false} /etc/containers/policy.json false 3 /home/podman/.local/share/containers/storage/libpod 10 /run/user/1000/libpod/tmp /home/podman/.local/share/containers/storage/volumes} {[/usr/libexec/cni /usr/lib/cni /usr/local/lib/cni /opt/cni/bin] podman /etc/cni/net.d/}} 
DEBU[0000] Using conmon: "/usr/libexec/podman/conmon"   
DEBU[0000] Initializing boltdb state at /home/podman/.local/share/containers/storage/libpod/bolt_state.db 
DEBU[0000] Using graph driver overlay                   
DEBU[0000] Using graph root /home/podman/.local/share/containers/storage 
DEBU[0000] Using run root /run/user/1000/containers     
DEBU[0000] Using static dir /home/podman/.local/share/containers/storage/libpod 
DEBU[0000] Using tmp dir /run/user/1000/libpod/tmp      
DEBU[0000] Using volume path /home/podman/.local/share/containers/storage/volumes 
DEBU[0000] Set libpod namespace to ""                   
DEBU[0000] Not configuring container store              
DEBU[0000] Initializing event backend file              
DEBU[0000] using runtime "/usr/lib/cri-o-runc/sbin/runc" 
DEBU[0000] using runtime "/usr/bin/crun"                
WARN[0000] Error initializing configured OCI runtime kata: no valid executable found for OCI runtime kata: invalid argument 
DEBU[0000] using runtime "/usr/bin/crun"                
INFO[0000] Setting parallel job count to 25             
INFO[0000] podman filtering at log level debug          
DEBU[0000] Called run.PersistentPreRunE(podman run --log-level debug --name=nginx-autoletsencrypt --cap-add NET_ADMIN -e PUID=1000 -e PGID=1000 -e TZ=Europe/Berlin -e SUBDOMAINS -e VALIDATION=http -e DHLEVEL=2048 -e ONLY_SUBDOMAINS=false -e STAGING=false -e URL=test123.de -e EMAIL=test@test.de -v /home/podman/data/nginx-autoletsencrypt/:/config --add-host web:127.0.0.1 --add-host nginx-autoletsencrypt:127.0.0.1 linuxserver/letsencrypt) 
DEBU[0000] Ignoring libpod.conf EventsLogger setting "/home/podman/.config/containers/containers.conf". Use "journald" if you want to change this setting and remove libpod.conf files. 
DEBU[0000] Reading configuration file "/usr/share/containers/containers.conf" 
DEBU[0000] Merged system config "/usr/share/containers/containers.conf": &{{[] [] containers-default-0.14.10 [] private enabled [CAP_AUDIT_WRITE CAP_CHOWN CAP_DAC_OVERRIDE CAP_FOWNER CAP_FSETID CAP_KILL CAP_MKNOD CAP_NET_BIND_SERVICE CAP_NET_RAW CAP_SETFCAP CAP_SETGID CAP_SETPCAP CAP_SETUID CAP_SYS_CHROOT] [] [nproc=32768:32768]  [] [] [] false [PATH=/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin TERM=xterm] false false false  private k8s-file -1 slirp4netns false 2048 private /usr/share/containers/seccomp.json 65536k private host 65536} {true systemd [PATH=/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin] [/usr/libexec/podman/conmon /usr/local/libexec/podman/conmon /usr/local/lib/podman/conmon /usr/bin/conmon /usr/sbin/conmon /usr/local/bin/conmon /usr/local/sbin/conmon /run/current-system/sw/bin/conmon] ctrl-p,ctrl-q true /run/user/1000/libpod/tmp/events/events.log file [/usr/share/containers/oci/hooks.d] docker:// /pause k8s.gcr.io/pause:3.2 /usr/libexec/podman/catatonit shm   false 2048 /usr/bin/crun map[crun:[/usr/bin/crun /usr/sbin/crun /usr/local/bin/crun /usr/local/sbin/crun /sbin/crun /bin/crun /run/current-system/sw/bin/crun] kata:[/usr/bin/kata-runtime /usr/sbin/kata-runtime /usr/local/bin/kata-runtime /usr/local/sbin/kata-runtime /sbin/kata-runtime /bin/kata-runtime /usr/bin/kata-qemu /usr/bin/kata-fc] runc:[/usr/lib/cri-o-runc/sbin/runc /usr/sbin/runc /usr/bin/runc /usr/local/bin/runc /usr/local/sbin/runc /sbin/runc /bin/runc]] missing false    map[] [] [crun runc] [crun] [kata kata-runtime kata-qemu kata-fc] {false false false false false false} /etc/containers/policy.json false 3 /home/podman/.local/share/containers/storage/libpod 10 /run/user/1000/libpod/tmp /home/podman/.local/share/containers/storage/volumes} {[/usr/libexec/cni /usr/lib/cni /usr/local/lib/cni /opt/cni/bin] podman /etc/cni/net.d/}} 
DEBU[0000] Reading configuration file "/etc/containers/containers.conf" 
DEBU[0000] Merged system config "/etc/containers/containers.conf": &{{[] [] containers-default-0.14.10 [] private enabled [CAP_AUDIT_WRITE CAP_CHOWN CAP_DAC_OVERRIDE CAP_FOWNER CAP_FSETID CAP_KILL CAP_MKNOD CAP_NET_BIND_SERVICE CAP_NET_RAW CAP_SETFCAP CAP_SETGID CAP_SETPCAP CAP_SETUID CAP_SYS_CHROOT] [] [nproc=32768:32768]  [] [] [] false [PATH=/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin TERM=xterm] false false false  private k8s-file -1 slirp4netns false 2048 private /usr/share/containers/seccomp.json 65536k private host 65536} {true systemd [PATH=/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin] [/usr/libexec/podman/conmon /usr/local/libexec/podman/conmon /usr/local/lib/podman/conmon /usr/bin/conmon /usr/sbin/conmon /usr/local/bin/conmon /usr/local/sbin/conmon /run/current-system/sw/bin/conmon] ctrl-p,ctrl-q true /run/user/1000/libpod/tmp/events/events.log file [/usr/share/containers/oci/hooks.d] docker:// /pause k8s.gcr.io/pause:3.2 /usr/libexec/podman/catatonit shm   false 2048 /usr/bin/crun map[crun:[/usr/bin/crun /usr/sbin/crun /usr/local/bin/crun /usr/local/sbin/crun /sbin/crun /bin/crun /run/current-system/sw/bin/crun] kata:[/usr/bin/kata-runtime /usr/sbin/kata-runtime /usr/local/bin/kata-runtime /usr/local/sbin/kata-runtime /sbin/kata-runtime /bin/kata-runtime /usr/bin/kata-qemu /usr/bin/kata-fc] runc:[/usr/lib/cri-o-runc/sbin/runc /usr/sbin/runc /usr/bin/runc /usr/local/bin/runc /usr/local/sbin/runc /sbin/runc /bin/runc]] missing false    map[] [] [crun runc] [crun] [kata kata-runtime kata-qemu kata-fc] {false false false false false false} /etc/containers/policy.json false 3 /home/podman/.local/share/containers/storage/libpod 10 /run/user/1000/libpod/tmp /home/podman/.local/share/containers/storage/volumes} {[/usr/libexec/cni /usr/lib/cni /usr/local/lib/cni /opt/cni/bin] podman /etc/cni/net.d/}} 
DEBU[0000] Using conmon: "/usr/libexec/podman/conmon"   
DEBU[0000] Initializing boltdb state at /home/podman/.local/share/containers/storage/libpod/bolt_state.db 
DEBU[0000] Using graph driver overlay                   
DEBU[0000] Using graph root /home/podman/.local/share/containers/storage 
DEBU[0000] Using run root /run/user/1000/containers     
DEBU[0000] Using static dir /home/podman/.local/share/containers/storage/libpod 
DEBU[0000] Using tmp dir /run/user/1000/libpod/tmp      
DEBU[0000] Using volume path /home/podman/.local/share/containers/storage/volumes 
DEBU[0000] Set libpod namespace to ""                   
DEBU[0000] [graphdriver] trying provided driver "overlay" 
DEBU[0000] overlay: mount_program=/usr/bin/fuse-overlayfs 
DEBU[0000] backingFs=xfs, projectQuotaSupported=false, useNativeDiff=false, usingMetacopy=false 
DEBU[0000] Initializing event backend file              
DEBU[0000] using runtime "/usr/lib/cri-o-runc/sbin/runc" 
DEBU[0000] using runtime "/usr/bin/crun"                
WARN[0000] Error initializing configured OCI runtime kata: no valid executable found for OCI runtime kata: invalid argument 
DEBU[0000] using runtime "/usr/bin/crun"                
INFO[0000] Setting parallel job count to 25             
DEBU[0000] parsed reference into "[overlay@/home/podman/.local/share/containers/storage+/run/user/1000/containers:overlay.mount_program=/usr/bin/fuse-overlayfs]docker.io/linuxserver/letsencrypt:latest" 
DEBU[0000] User mount /home/podman/data/nginx-autoletsencrypt/:/config options [] 
DEBU[0000] parsed reference into "[overlay@/home/podman/.local/share/containers/storage+/run/user/1000/containers:overlay.mount_program=/usr/bin/fuse-overlayfs]docker.io/linuxserver/letsencrypt:latest" 
DEBU[0000] parsed reference into "[overlay@/home/podman/.local/share/containers/storage+/run/user/1000/containers:overlay.mount_program=/usr/bin/fuse-overlayfs]@2314eb20a00ea20e1f2fffa006ab2f7552c8b8c2abe3ed142c71f0166d65d0c4" 
DEBU[0000] exporting opaque data as blob "sha256:2314eb20a00ea20e1f2fffa006ab2f7552c8b8c2abe3ed142c71f0166d65d0c4" 
DEBU[0000] parsed reference into "[overlay@/home/podman/.local/share/containers/storage+/run/user/1000/containers:overlay.mount_program=/usr/bin/fuse-overlayfs]docker.io/linuxserver/letsencrypt:latest" 
DEBU[0000] parsed reference into "[overlay@/home/podman/.local/share/containers/storage+/run/user/1000/containers:overlay.mount_program=/usr/bin/fuse-overlayfs]@2314eb20a00ea20e1f2fffa006ab2f7552c8b8c2abe3ed142c71f0166d65d0c4" 
DEBU[0000] exporting opaque data as blob "sha256:2314eb20a00ea20e1f2fffa006ab2f7552c8b8c2abe3ed142c71f0166d65d0c4" 
DEBU[0000] Image has volume at "/config"                
DEBU[0000] Adding anonymous image volume at "/config"   
DEBU[0000] using systemd mode: false                    
DEBU[0000] setting container name nginx-autoletsencrypt 
DEBU[0000] No hostname set; container's hostname will default to runtime default 
DEBU[0000] Loading seccomp profile from "/usr/share/containers/seccomp.json" 
DEBU[0000] Adding mount /proc                           
DEBU[0000] Adding mount /dev                            
DEBU[0000] Adding mount /dev/pts                        
DEBU[0000] Adding mount /dev/mqueue                     
DEBU[0000] Adding mount /sys                            
DEBU[0000] Adding mount /sys/fs/cgroup                  
DEBU[0000] Allocated lock 0 for container c7ab0479af79078f908b7795a48bf215497279a24e564a4955bdd7d40b0fc77b 
DEBU[0000] parsed reference into "[overlay@/home/podman/.local/share/containers/storage+/run/user/1000/containers:overlay.mount_program=/usr/bin/fuse-overlayfs]@2314eb20a00ea20e1f2fffa006ab2f7552c8b8c2abe3ed142c71f0166d65d0c4" 
DEBU[0000] exporting opaque data as blob "sha256:2314eb20a00ea20e1f2fffa006ab2f7552c8b8c2abe3ed142c71f0166d65d0c4" 
DEBU[0000] created container "c7ab0479af79078f908b7795a48bf215497279a24e564a4955bdd7d40b0fc77b" 
DEBU[0000] container "c7ab0479af79078f908b7795a48bf215497279a24e564a4955bdd7d40b0fc77b" has work directory "/home/podman/.local/share/containers/storage/overlay-containers/c7ab0479af79078f908b7795a48bf215497279a24e564a4955bdd7d40b0fc77b/userdata" 
DEBU[0000] container "c7ab0479af79078f908b7795a48bf215497279a24e564a4955bdd7d40b0fc77b" has run directory "/run/user/1000/containers/overlay-containers/c7ab0479af79078f908b7795a48bf215497279a24e564a4955bdd7d40b0fc77b/userdata" 
DEBU[0000] container "c7ab0479af79078f908b7795a48bf215497279a24e564a4955bdd7d40b0fc77b" has CgroupParent "user.slice/user-1000.slice/user@1000.service/user.slice/libpod-c7ab0479af79078f908b7795a48bf215497279a24e564a4955bdd7d40b0fc77b.scope" 
DEBU[0000] Not attaching to stdin                       
DEBU[0000] overlay: mount_data=lowerdir=/home/podman/.local/share/containers/storage/overlay/l/MWCKLUJ3Y7JCVYX4N3TP7WFXUS:/home/podman/.local/share/containers/storage/overlay/l/3RVS7YZYV45BX4JZKX4EJMCYAU:/home/podman/.local/share/containers/storage/overlay/l/KTM5FFU2B2DN2OFNGKOPAOEOGP:/home/podman/.local/share/containers/storage/overlay/l/TQZOM2EZQ34Y4ZDZXP7FVCC3CA:/home/podman/.local/share/containers/storage/overlay/l/VRHYZBPUQCFD5ETQYJ5OE3S7YS:/home/podman/.local/share/containers/storage/overlay/l/JUTMWQN7LTZQBMLWVKF5D2OJ2Y:/home/podman/.local/share/containers/storage/overlay/l/DOBDOAFMQRQWMEZRLNKVPSYWVI,upperdir=/home/podman/.local/share/containers/storage/overlay/93855a6ac9dfb42bfbfb558c21e417acac786cf0981840e52c3b02f657a1303d/diff,workdir=/home/podman/.local/share/containers/storage/overlay/93855a6ac9dfb42bfbfb558c21e417acac786cf0981840e52c3b02f657a1303d/work 
DEBU[0000] Made network namespace at /run/user/1000/netns/cni-f6322a5b-3cca-5d26-ac9d-816a9986c66d for container c7ab0479af79078f908b7795a48bf215497279a24e564a4955bdd7d40b0fc77b 
DEBU[0000] slirp4netns command: /usr/bin/slirp4netns --disable-host-loopback --mtu 65520 --enable-sandbox --enable-seccomp -c -e 3 -r 4 --netns-type=path /run/user/1000/netns/cni-f6322a5b-3cca-5d26-ac9d-816a9986c66d tap0 
DEBU[0000] mounted container "c7ab0479af79078f908b7795a48bf215497279a24e564a4955bdd7d40b0fc77b" at "/home/podman/.local/share/containers/storage/overlay/93855a6ac9dfb42bfbfb558c21e417acac786cf0981840e52c3b02f657a1303d/merged" 
DEBU[0000] Created root filesystem for container c7ab0479af79078f908b7795a48bf215497279a24e564a4955bdd7d40b0fc77b at /home/podman/.local/share/containers/storage/overlay/93855a6ac9dfb42bfbfb558c21e417acac786cf0981840e52c3b02f657a1303d/merged 
DEBU[0000] /etc/system-fips does not exist on host, not mounting FIPS mode secret 
DEBU[0000] Setting CGroups for container c7ab0479af79078f908b7795a48bf215497279a24e564a4955bdd7d40b0fc77b to user.slice:libpod:c7ab0479af79078f908b7795a48bf215497279a24e564a4955bdd7d40b0fc77b 
DEBU[0000] reading hooks from /usr/share/containers/oci/hooks.d 
DEBU[0000] Created OCI spec for container c7ab0479af79078f908b7795a48bf215497279a24e564a4955bdd7d40b0fc77b at /home/podman/.local/share/containers/storage/overlay-containers/c7ab0479af79078f908b7795a48bf215497279a24e564a4955bdd7d40b0fc77b/userdata/config.json 
DEBU[0000] /usr/libexec/podman/conmon messages will be logged to syslog 
DEBU[0000] running conmon: /usr/libexec/podman/conmon    args="[--api-version 1 -c c7ab0479af79078f908b7795a48bf215497279a24e564a4955bdd7d40b0fc77b -u c7ab0479af79078f908b7795a48bf215497279a24e564a4955bdd7d40b0fc77b -r /usr/bin/crun -b /home/podman/.local/share/containers/storage/overlay-containers/c7ab0479af79078f908b7795a48bf215497279a24e564a4955bdd7d40b0fc77b/userdata -p /run/user/1000/containers/overlay-containers/c7ab0479af79078f908b7795a48bf215497279a24e564a4955bdd7d40b0fc77b/userdata/pidfile -n nginx-autoletsencrypt --exit-dir /run/user/1000/libpod/tmp/exits --socket-dir-path /run/user/1000/libpod/tmp/socket -s -l k8s-file:/home/podman/.local/share/containers/storage/overlay-containers/c7ab0479af79078f908b7795a48bf215497279a24e564a4955bdd7d40b0fc77b/userdata/ctr.log --log-level debug --syslog --conmon-pidfile /run/user/1000/containers/overlay-containers/c7ab0479af79078f908b7795a48bf215497279a24e564a4955bdd7d40b0fc77b/userdata/conmon.pid --exit-command /usr/bin/podman --exit-command-arg --root --exit-command-arg /home/podman/.local/share/containers/storage --exit-command-arg --runroot --exit-command-arg /run/user/1000/containers --exit-command-arg --log-level --exit-command-arg debug --exit-command-arg --cgroup-manager --exit-command-arg systemd --exit-command-arg --tmpdir --exit-command-arg /run/user/1000/libpod/tmp --exit-command-arg --runtime --exit-command-arg /usr/bin/crun --exit-command-arg --storage-driver --exit-command-arg overlay --exit-command-arg --storage-opt --exit-command-arg overlay.mount_program=/usr/bin/fuse-overlayfs --exit-command-arg --events-backend --exit-command-arg file --exit-command-arg --syslog --exit-command-arg true --exit-command-arg container --exit-command-arg cleanup --exit-command-arg c7ab0479af79078f908b7795a48bf215497279a24e564a4955bdd7d40b0fc77b]"
INFO[0000] Running conmon under slice user.slice and unitName libpod-conmon-c7ab0479af79078f908b7795a48bf215497279a24e564a4955bdd7d40b0fc77b.scope 
[conmon:d]: failed to write to /proc/self/oom_score_adj: Permission denied

DEBU[0000] Received: -1                                 
DEBU[0000] Cleaning up container c7ab0479af79078f908b7795a48bf215497279a24e564a4955bdd7d40b0fc77b 
DEBU[0000] Tearing down network namespace at /run/user/1000/netns/cni-f6322a5b-3cca-5d26-ac9d-816a9986c66d for container c7ab0479af79078f908b7795a48bf215497279a24e564a4955bdd7d40b0fc77b 
DEBU[0000] unmounted container "c7ab0479af79078f908b7795a48bf215497279a24e564a4955bdd7d40b0fc77b" 
DEBU[0000] ExitCode msg: "sd-bus call: permission denied: oci runtime permission denied error" 

Output of podman version:

Version:      2.0.6
API Version:  1
Go Version:   go1.14
Built:        Thu Jan  1 01:00:00 1970
OS/Arch:      linux/amd64

Output of podman info --debug:

host:
  arch: amd64
  buildahVersion: 1.15.1
  cgroupVersion: v2
  conmon:
    package: 'conmon: /usr/libexec/podman/conmon'
    path: /usr/libexec/podman/conmon
    version: 'conmon version 2.0.20, commit: '
  cpus: 8
  distribution:
    distribution: debian
    version: "10"
  eventLogger: file
  hostname: cloud1-vm137
  idMappings:
    gidmap:
    - container_id: 0
      host_id: 2002
      size: 1
    - container_id: 1
      host_id: 100000
      size: 65536
    uidmap:
    - container_id: 0
      host_id: 1000
      size: 1
    - container_id: 1
      host_id: 100000
      size: 65536
  kernel: 5.4.65+23-ph
  linkmode: dynamic
  memFree: 15339999232
  memTotal: 16592211968
  ociRuntime:
    name: crun
    package: 'crun: /usr/bin/crun'
    path: /usr/bin/crun
    version: |-
      crun version UNKNOWN
      commit: 3e46dd849fdf6bfa68127786e073318184641f05
      spec: 1.0.0
      +SYSTEMD +SELINUX +APPARMOR +CAP +SECCOMP +EBPF +YAJL
  os: linux
  remoteSocket:
    path: /run/user/1000/podman/podman.sock
  rootless: true
  slirp4netns:
    executable: /usr/bin/slirp4netns
    package: 'slirp4netns: /usr/bin/slirp4netns'
    version: |-
      slirp4netns version 1.1.4
      commit: b66ffa8e262507e37fca689822d23430f3357fe8
      libslirp: 4.3.1
      SLIRP_CONFIG_VERSION_MAX: 3
  swapFree: 0
  swapTotal: 0
  uptime: 9m 35.27s
registries:
  search:
  - docker.io
  - quay.io
store:
  configFile: /home/podman/.config/containers/storage.conf
  containerStore:
    number: 1
    paused: 0
    running: 0
    stopped: 1
  graphDriverName: overlay
  graphOptions:
    overlay.mount_program:
      Executable: /usr/bin/fuse-overlayfs
      Package: 'fuse-overlayfs: /usr/bin/fuse-overlayfs'
      Version: |-
        fusermount3 version: 3.4.1
        fuse-overlayfs: version 1.1.0
        FUSE library version 3.4.1
        using FUSE kernel interface version 7.27
  graphRoot: /home/podman/.local/share/containers/storage
  graphStatus:
    Backing Filesystem: xfs
    Native Overlay Diff: "false"
    Supports d_type: "true"
    Using metacopy: "false"
  imageStore:
    number: 1
  runRoot: /run/user/1000/containers
  volumePath: /home/podman/.local/share/containers/storage/volumes
version:
  APIVersion: 1
  Built: 0
  BuiltTime: Thu Jan  1 01:00:00 1970
  GitCommit: ""
  GoVersion: go1.14
  OsArch: linux/amd64
  Version: 2.0.6

Package info (e.g. output of rpm -q podman or apt list podman):

apt list podman
Listing... Done
podman/unknown 2.0.6~2 arm64
podman/unknown 2.0.6~2 armhf
podman/unknown 2.0.6~2 ppc64el

Have you tested with the latest version of Podman and have you checked the Podman Troubleshooting Guide?

Yes

@lsm5
Copy link
Member

lsm5 commented Sep 22, 2020

So, I'm unable to reproduce this locally on debian 10, but couple of pointers from @mheon:

Either:

  1. you logged into a non-root user in in such a way that pam/systemd did not make a session - e.g. via su username or similar

OR
2. the systemd user session is down or maybe never started?

@disaster123
Copy link
Author

@lsm5 yes i'm using "su - $user" - but i did the same while using 1.9.4 - i can also downgrade to 1.9.4 and it immediately starts to work again.

@lsm5
Copy link
Member

lsm5 commented Sep 22, 2020

@lsm5 yes i'm using "su - $user" - but i did the same while using 1.9.4 - i can also downgrade to 1.9.4 and it immediately starts to work again.

@mheon was this ever supposed to work and we broke it recently?

@disaster123 i'm in the process of building 2.1.0, I suggest you give that a try once it's ready as well.

@mheon
Copy link
Member

mheon commented Sep 22, 2020

I'm astonished this ever worked, honestly. I guess that it was using cgroupfs by default on v1.9.x and v2.0.x is (correctly) defaulting to systemd cgroups for cgroupsv2. You can try --cgroup-manager cgroupfs to see if it goes back to working.

I strongly suspect your systemd user session isn't running, which would be the better fix as it would actually allow cgroup delegation for the containers.

@disaster123
Copy link
Author

@mheon that would make sense. Yes --cgroup-manager cgroupfs seems to work. Is there any way to get the user session running without using ssh to switch the user? Also it seems the debian 10 systemd is too old (#6368)?

@anishp55
Copy link

@disaster123 do you have the dbus-user-session package installed in your debian?

@disaster123
Copy link
Author

yes

@disaster123
Copy link
Author

Same problem with v2.1.0 and even with ssh to user and running user session. (Error: sd-bus call: Permission denied: OCI runtime permission denied error) - i think this is related to old systemd => #6368)

@anishp55
Copy link

anishp55 commented Sep 22, 2020

if you think its because of old systemd, can you try installing a newer one from buster-backports? I am using Debian 10 with cgroupv2 and systemd as the cgroup manager for podman.

also here is a full list of packages installed on my system. this is a minimal install so it may help in tracking down what package maybe missing.

https://termbin.com/tdzo0

@edsantiago
Copy link
Collaborator

Also try (as root): loginctl enable-linger YOUR-USERNAME.

@github-actions
Copy link

A friendly reminder that this issue had no activity for 30 days.

@disaster123
Copy link
Author

no answer whether the default or fall back has changed

@github-actions github-actions bot added the locked - please file new issue/PR Assist humans wanting to comment on an old issue or PR with locked comments. label Sep 22, 2023
@github-actions github-actions bot locked as resolved and limited conversation to collaborators Sep 22, 2023
Sign up for free to subscribe to this conversation on GitHub. Already have an account? Sign in.
Labels
kind/bug Categorizes issue or PR as related to a bug. locked - please file new issue/PR Assist humans wanting to comment on an old issue or PR with locked comments. stale-issue
Projects
None yet
Development

No branches or pull requests

6 participants