Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

generate kube fails with: no matching entries in passwd file #2304

Closed
ikke-t opened this issue Feb 10, 2019 · 5 comments
Closed

generate kube fails with: no matching entries in passwd file #2304

ikke-t opened this issue Feb 10, 2019 · 5 comments
Assignees
@baude
Labels
kind/bug Categorizes issue or PR as related to a bug. locked - please file new issue/PR Assist humans wanting to comment on an old issue or PR with locked comments.

Comments

@ikke-t
Copy link

ikke-t commented Feb 10, 2019 •
edited
Loading

Is this a BUG REPORT or FEATURE REQUEST? (leave only one on its own line)

/kind bug

Description

I try saving AWX pod with four containers into yaml. podman generate kube awx fails to generate awx.yaml.

CONTAINER ID  IMAGE                                   COMMAND               CREATED       STATUS           PORTS                                                                                             NAMES
54bf6b11d14d  docker.io/ansible/awx_task:latest       /tini -- /bin/sh ...  15 hours ago  Up 15 hours ago                                                                                                    awx_task
272db09afd02  docker.io/ansible/awx_web:latest        /tini -- /bin/sh ...  15 hours ago  Up 15 hours ago                                                                                                    awx_web
2dfc08a883fb  docker.io/library/memcached:alpine      docker-entrypoint...  15 hours ago  Up 15 hours ago                                                                                                    memcached
506cb6b389db  docker.io/library/postgres:9.6          docker-entrypoint...  15 hours ago  Up 15 hours ago                                                                                                    postgres
f

Steps to reproduce the issue:

  1. generate pod

  2. add four containers into it

  3. do sudo podman generate kube awx

Describe the results you received:

no matching entries in passwd file

Describe the results you expected:

I would have expected awx.yaml file with info about 4 different containers.

Additional information you deem important (e.g. issue happens only occasionally):

Happens always.

Output of podman version:

This is on Fedora 29

$ podman version
Version:       1.0.0
Go Version:    go1.11.4
Git Commit:    "49780a1cf10d572edc4e1ea3b8a8429ce391d47d"
Built:         Mon Jan 14 22:38:17 2019
OS/Arch:       linux/amd64

Output of podman info:

host:
  BuildahVersion: 1.6-dev
  Conmon:
    package: podman-1.0.0-1.git82e8011.fc29.x86_64
    path: /usr/libexec/podman/conmon
    version: 'conmon version 1.12.0-dev, commit: 49780a1cf10d572edc4e1ea3b8a8429ce391d47d'
  Distribution:
    distribution: fedora
    version: "29"
  MemFree: 214802432
  MemTotal: 8052531200
  OCIRuntime:
    package: runc-1.0.0-67.dev.git12f6a99.fc29.x86_64
    path: /usr/bin/runc
    version: |-
      runc version 1.0.0-rc6+dev
      commit: d164d9b08bf7fc96a931403507dd16bced11b865
      spec: 1.0.1-dev
  SwapFree: 6857945088
  SwapTotal: 8199860224
  arch: amd64
  cpus: 4
  hostname: ohuska.localdomain
  kernel: 4.19.8-300.fc29.x86_64
  os: linux
  rootless: false
  uptime: 400h 54m 19.58s (Approximately 16.67 days)
insecure registries:
  registries: []
registries:
  registries:
  - docker.io
  - registry.fedoraproject.org
  - quay.io
  - registry.access.redhat.com
  - registry.centos.org
store:
  ConfigFile: /etc/containers/storage.conf
  ContainerStore:
    number: 8
  GraphDriverName: overlay
  GraphOptions: null
  GraphRoot: /var/lib/containers/storage
  GraphStatus:
    Backing Filesystem: extfs
    Native Overlay Diff: "true"
    Supports d_type: "true"
  ImageStore:
    number: 11
  RunRoot: /var/run/containers/storage

Additional environment details (AWS, VirtualBox, physical, etc.):

Fedora 29 up to date on laptop.

Here's container and pod inspect (volumes removed, as it fails too, that's another issue):

[ikke@ohuska ~]$ sudo podman inspect awx_task
[
    {
        "ID": "54bf6b11d14d6e9cf1bb49d40a93a78709b5387ebd78b62619710e60d5d07449",
        "Created": "2019-02-10T00:29:15.828118283+02:00",
        "Path": "/tini",
        "Args": [
            "--",
            "/bin/sh",
            "-c",
            "/usr/bin/launch_awx_task.sh"
        ],
        "State": {
            "OciVersion": "1.0.1-dev",
            "Status": "running",
            "Running": true,
            "Paused": false,
            "Restarting": false,
            "OOMKilled": false,
            "Dead": false,
            "Pid": 26379,
            "ExitCode": 0,
            "Error": "",
            "StartedAt": "2019-02-10T00:29:16.217945532+02:00",
            "FinishedAt": "0001-01-01T00:00:00Z"
        },
        "Image": "1921aa3ef204222856e97035e3bf837c59235d5f9d98b04cbbe2e9acc6c6cb97",
        "ImageName": "docker.io/ansible/awx_task:latest",
        "Rootfs": "",
        "ResolvConfPath": "/var/run/containers/storage/overlay-containers/54bf6b11d14d6e9cf1bb49d40a93a78709b5387ebd78b62619710e60d5d07449/userdata/resolv.conf",
        "HostnamePath": "/var/run/containers/storage/overlay-containers/54bf6b11d14d6e9cf1bb49d40a93a78709b5387ebd78b62619710e60d5d07449/userdata/hostname",
        "HostsPath": "/var/run/containers/storage/overlay-containers/54bf6b11d14d6e9cf1bb49d40a93a78709b5387ebd78b62619710e60d5d07449/userdata/hosts",
        "StaticDir": "/var/lib/containers/storage/overlay-containers/54bf6b11d14d6e9cf1bb49d40a93a78709b5387ebd78b62619710e60d5d07449/userdata",
        "LogPath": "/var/lib/containers/storage/overlay-containers/54bf6b11d14d6e9cf1bb49d40a93a78709b5387ebd78b62619710e60d5d07449/userdata/ctr.log",
        "Name": "awx_task",
        "RestartCount": 0,
        "Driver": "overlay",
        "MountLabel": "system_u:object_r:container_file_t:s0:c695,c978",
        "ProcessLabel": "system_u:system_r:container_t:s0:c695,c978",
        "AppArmorProfile": "",
        "EffectiveCaps": [
            "CAP_CHOWN",
            "CAP_DAC_OVERRIDE",
            "CAP_FSETID",
            "CAP_FOWNER",
            "CAP_MKNOD",
            "CAP_NET_RAW",
            "CAP_SETGID",
            "CAP_SETUID",
            "CAP_SETFCAP",
            "CAP_SETPCAP",
            "CAP_NET_BIND_SERVICE",
            "CAP_SYS_CHROOT",
            "CAP_KILL",
            "CAP_AUDIT_WRITE"
        ],
        "BoundingCaps": [
            "CAP_CHOWN",
            "CAP_DAC_OVERRIDE",
            "CAP_FSETID",
            "CAP_FOWNER",
            "CAP_MKNOD",
            "CAP_NET_RAW",
            "CAP_SETGID",
            "CAP_SETUID",
            "CAP_SETFCAP",
            "CAP_SETPCAP",
            "CAP_NET_BIND_SERVICE",
            "CAP_SYS_CHROOT",
            "CAP_KILL",
            "CAP_AUDIT_WRITE"
        ],
        "ExecIDs": [],
        "GraphDriver": {
            "Name": "overlay",
            "Data": {
                "LowerDir": "/var/lib/containers/storage/overlay/81df8a4544a7a66716535e9ceff215f1b8483a7a3c43d9253e196cb693f70958/diff:/var/lib/containers/storage/overlay/a33d971c65080683ff962ddebe4bd2d72c437af4a108526e719509d22d4c6fbe/diff:/var/lib/containers/storage/overlay/c227632043c9dd3fdba6df04dbb39f4a881fd79ccf0fc121aafaf214df65660a/diff:/var/lib/containers/storage/overlay/83c8a33376b4b6e2d15c26f4d743d90bff37da13aea92a4f9249e9a5f4c570e4/diff:/var/lib/containers/storage/overlay/3094f13b1b50086546a4bf6107e17cb235ca019fa594ec89fe44df1d29a1dc7b/diff:/var/lib/containers/storage/overlay/8717c4075f405fde2432f638ea3035d7733e340039dc3cb6450c340389c666d6/diff:/var/lib/containers/storage/overlay/ca729294701ecfbbeb100e474eb6c521edaacb9970a99e5b637ec5a589c2c45a/diff:/var/lib/containers/storage/overlay/62ccdbe687033449a6538159bd3e188941040cf703d41ebe4acff8b00610cdc2/diff:/var/lib/containers/storage/overlay/47600865eb5ae6d510d182a91cb5aa6351b6aa9947710ed905fdd890fff5aeb2/diff:/var/lib/containers/storage/overlay/37c207ab39d4363dd3cf116ead773dd96e044eec9ad5470d886506d8095123c2/diff:/var/lib/containers/storage/overlay/08e0d39f6b0b790117116847055b3ef8e4e9c23fda1d5fa79b5f80a0065747a0/diff:/var/lib/containers/storage/overlay/e70085b54ab8bf58d5766e6e8906838220e36a74a10edec47bf82d68f6a1a70d/diff:/var/lib/containers/storage/overlay/10fea4fcf3176c21428ac0159710e03334de9c501d8ead8b0e858ed799f08a2c/diff:/var/lib/containers/storage/overlay/37a332a22623578d7692ffa7b485ab4c739cdf74cd318073d1333d2c31b78c13/diff:/var/lib/containers/storage/overlay/ede5eed0b4fa5afaf4fab2543a93c1168898442f584d84e1b2a549a2da571d47/diff:/var/lib/containers/storage/overlay/fbb4d52e0583e47fb29eb9573ac09c2394b5ccbba1b3a0f86ba357a373d68b3e/diff:/var/lib/containers/storage/overlay/ea90f13318d0ec540b53b17e458575f739be5cc76cda6d90f9ac98e112857b4c/diff:/var/lib/containers/storage/overlay/93eb60a500d950288e110e57cb107b6c133ecdf3c8776ed9e64ddd49a95b5d9f/diff:/var/lib/containers/storage/overlay/dd3158de869d70b70f47e1e0317991df6bbbc2533a32a74dcf66127f153151a8/diff:/var/lib/containers/storage/overlay/9c73e6a727365aa4cf97153c303426b4a77c3a9703056f2ea54c1ed657526d46/diff:/var/lib/containers/storage/overlay/3ebcc6a733b6281c411e4b48333347c4da5e9367fbe94599e85043ff6d078467/diff:/var/lib/containers/storage/overlay/23b8a97b35f1791f5846f84a491386d6c4e161766513e48ce9a9701c2eebc136/diff:/var/lib/containers/storage/overlay/1a9fa7e8bc639bc80d63c1b2245d027d773f1af00dc0fc2beaff7fd13349f3f0/diff:/var/lib/containers/storage/overlay/9107762458857ecdb3bb433560aafc4b9434545716e0a5890df27adee32e0512/diff:/var/lib/containers/storage/overlay/ef2877850b98b443cc68a5a73716a5e245913ecccabe996c0a6b73b05743a6d3/diff:/var/lib/containers/storage/overlay/77a9bf52e3d09fae549e2c0cde223cbd3247c995cb3188d7c4dcd761048ccfef/diff:/var/lib/containers/storage/overlay/8169b55418f2727b24d3fb4fccec374780576f32d293e0a76b06e1aad6168705/diff:/var/lib/containers/storage/overlay/344b130bec923670f99e04bbf9093a580d885ad84c1e370331fbedb144977569/diff:/var/lib/containers/storage/overlay/bd5434a77b7cf02d4c45b419093ec280181b3f473906bfd95adaea358e08672e/diff:/var/lib/containers/storage/overlay/66e944bab2591e8876d0315af4b8fe9285e66b26b0b0cc8739cab162e244d132/diff:/var/lib/containers/storage/overlay/071d8bd765171080d01682844524be57ac9883e53079b6ac66707e192ea25956/diff",
                "MergedDir": "/var/lib/containers/storage/overlay/1cf239f735852a9b910a1f417b5584de317f338ecd37985144abc13409cb66db/merged",
                "UpperDir": "/var/lib/containers/storage/overlay/1cf239f735852a9b910a1f417b5584de317f338ecd37985144abc13409cb66db/diff",
                "WorkDir": "/var/lib/containers/storage/overlay/1cf239f735852a9b910a1f417b5584de317f338ecd37985144abc13409cb66db/work"
            }
        },
        "Mounts": [
            {
                "destination": "/proc",
                "type": "proc",
                "source": "proc",
                "options": [
                    "nosuid",
                    "noexec",
                    "nodev"
                ]
            },
            {
                "destination": "/dev",
                "type": "tmpfs",
                "source": "tmpfs",
                "options": [
                    "nosuid",
                    "strictatime",
                    "mode=755",
                    "size=65536k"
                ]
            },
            {
                "destination": "/sys",
                "type": "sysfs",
                "source": "sysfs",
                "options": [
                    "nosuid",
                    "noexec",
                    "nodev",
                    "ro"
                ]
            },
            {
                "destination": "/etc/hosts",
                "type": "bind",
                "source": "/var/run/containers/storage/overlay-containers/54bf6b11d14d6e9cf1bb49d40a93a78709b5387ebd78b62619710e60d5d07449/userdata/hosts",
                "options": [
                    "bind",
                    "private"
                ]
            },
            {
                "destination": "/dev/pts",
                "type": "devpts",
                "source": "devpts",
                "options": [
                    "nosuid",
                    "noexec",
                    "newinstance",
                    "ptmxmode=0666",
                    "mode=0620",
                    "gid=5"
                ]
            },
            {
                "destination": "/dev/mqueue",
                "type": "mqueue",
                "source": "mqueue",
                "options": [
                    "nosuid",
                    "noexec",
                    "nodev"
                ]
            },
            {
                "destination": "/dev/shm",
                "type": "bind",
                "source": "overlay-containers",
                "options": [
                    "bind",
                    "private"
                ]
            },
            {
                "destination": "/etc/hostname",
                "type": "bind",
                "source": "/var/run/containers/storage/overlay-containers/54bf6b11d14d6e9cf1bb49d40a93a78709b5387ebd78b62619710e60d5d07449/userdata/hostname",
                "options": [
                    "bind",
                    "private"
                ]
            },
            {
                "destination": "/run/.containerenv",
                "type": "bind",
                "source": "/var/run/containers/storage/overlay-containers/54bf6b11d14d6e9cf1bb49d40a93a78709b5387ebd78b62619710e60d5d07449/userdata/.containerenv",
                "options": [
                    "bind",
                    "private"
                ]
            },
            {
                "destination": "/run/secrets",
                "type": "bind",
                "source": "/var/run/containers/storage/overlay-containers/54bf6b11d14d6e9cf1bb49d40a93a78709b5387ebd78b62619710e60d5d07449/userdata/run/secrets",
                "options": [
                    "bind",
                    "private"
                ]
            },
            {
                "destination": "/etc/resolv.conf",
                "type": "bind",
                "source": "/var/run/containers/storage/overlay-containers/54bf6b11d14d6e9cf1bb49d40a93a78709b5387ebd78b62619710e60d5d07449/userdata/resolv.conf",
                "options": [
                    "bind",
                    "private"
                ]
            },
            {
                "destination": "/var/lib/nginx",
                "type": "bind",
                "source": "overlay-containers",
                "options": [
                    "private",
                    "bind",
                    "rw"
                ]
            },
            {
                "destination": "/sys/fs/cgroup",
                "type": "cgroup",
                "source": "cgroup",
                "options": [
                    "rprivate",
                    "nosuid",
                    "noexec",
                    "nodev",
                    "relatime",
                    "ro"
                ]
            },
            {
                "destination": "/var/lib/awx/projects",
                "type": "bind",
                "source": "/tmp/awx/projects",
                "options": [
                    "z",
                    "rbind",
                    "rw",
                    "rprivate"
                ]
            }
        ],
        "Dependencies": [
            "ae410db395d94e12acff64b02b4f8a611f8e5a58d6b789617420109de66d4ea9"
        ],
        "NetworkSettings": {
            "Bridge": "",
            "SandboxID": "",
            "HairpinMode": false,
            "LinkLocalIPv6Address": "",
            "LinkLocalIPv6PrefixLen": 0,
            "Ports": [],
            "SandboxKey": "",
            "SecondaryIPAddresses": null,
            "SecondaryIPv6Addresses": null,
            "EndpointID": "",
            "Gateway": "",
            "GlobalIPv6Address": "",
            "GlobalIPv6PrefixLen": 0,
            "IPAddress": "",
            "IPPrefixLen": 0,
            "IPv6Gateway": "",
            "MacAddress": ""
        },
        "ExitCommand": [
            "/usr/bin/podman",
            "--root",
            "/var/lib/containers/storage",
            "--runroot",
            "/var/run/containers/storage",
            "--log-level",
            "error",
            "--cgroup-manager",
            "systemd",
            "--tmpdir",
            "/var/run/libpod",
            "--storage-driver",
            "overlay",
            "container",
            "cleanup",
            "54bf6b11d14d6e9cf1bb49d40a93a78709b5387ebd78b62619710e60d5d07449"
        ],
        "Namespace": "",
        "IsInfra": false,
        "HostConfig": {
            "ContainerIDFile": "",
            "LogConfig": null,
            "NetworkMode": "container:ae410db395d94e12acff64b02b4f8a611f8e5a58d6b789617420109de66d4ea9",
            "PortBindings": null,
            "AutoRemove": false,
            "CapAdd": [],
            "CapDrop": [],
            "DNS": [],
            "DNSOptions": [],
            "DNSSearch": [],
            "ExtraHosts": null,
            "GroupAdd": null,
            "IpcMode": "container:ae410db395d94e12acff64b02b4f8a611f8e5a58d6b789617420109de66d4ea9",
            "Cgroup": "host",
            "OomScoreAdj": 0,
            "PidMode": "",
            "Privileged": false,
            "PublishAllPorts": false,
            "ReadonlyRootfs": false,
            "SecurityOpt": [],
            "UTSMode": "container:ae410db395d94e12acff64b02b4f8a611f8e5a58d6b789617420109de66d4ea9",
            "UsernsMode": "",
            "ShmSize": 65536000,
            "Runtime": "runc",
            "ConsoleSize": null,
            "CpuShares": null,
            "Memory": 0,
            "NanoCpus": 0,
            "CgroupParent": "",
            "BlkioWeight": null,
            "BlkioWeightDevice": null,
            "BlkioDeviceReadBps": null,
            "BlkioDeviceWriteBps": null,
            "BlkioDeviceReadIOps": null,
            "BlkioDeviceWriteIOps": null,
            "CpuPeriod": null,
            "CpuQuota": null,
            "CpuRealtimePeriod": null,
            "CpuRealtimeRuntime": null,
            "CpuSetCpus": "",
            "CpuSetMems": "",
            "Devices": null,
            "DiskQuota": 0,
            "KernelMemory": null,
            "MemoryReservation": null,
            "MemorySwap": null,
            "MemorySwappiness": null,
            "OomKillDisable": false,
            "PidsLimit": null,
            "Ulimits": [],
            "CpuCount": 0,
            "CpuPercent": 0,
            "IOMaximumIOps": 0,
            "IOMaximumBandwidth": 0,
            "Tmpfs": []
        },
        "Config": {
            "Hostname": "awx",
            "Domainname": "",
            "User": {
                "uid": 0,
                "gid": 0
            },
            "AttachStdin": false,
            "AttachStdout": false,
            "AttachStderr": false,
            "Tty": false,
            "OpenStdin": false,
            "StdinOnce": false,
            "Env": [
                "PATH=/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin",
                "TERM=xterm",
                "HOSTNAME=awx",
                "container=podman",
                "http_proxy=",
                "https_proxy=",
                "SECRET_KEY=awxsecret",
                "DATABASE_NAME=awx",
                "RABBITMQ_HOST=rabbitmq",
                "AWX_ADMIN_PASSWORD=password",
                "RABBITMQ_USER=guest",
                "RABBITMQ_PASSWORD=guest",
                "RABBITMQ_PORT=5672",
                "RABBITMQ_VHOST=awx",
                "DATABASE_USER=awx",
                "DATABASE_PORT=5432",
                "MEMCACHED_HOST=memcached",
                "MEMCACHED_PORT=11211",
                "AWX_ADMIN_USER=admin",
                "no_proxy=",
                "DATABASE_PASSWORD=awxpass",
                "DATABASE_HOST=postgres"
            ],
            "Cmd": [
                "/tini",
                "--",
                "/bin/sh",
                "-c",
                "/usr/bin/launch_awx_task.sh"
            ],
            "Image": "docker.io/ansible/awx_task:latest",
            "Volumes": null,
            "WorkingDir": "/var/lib/awx",
            "Entrypoint": "/tini --",
            "Labels": {
                "org.label-schema.build-date": "20181205",
                "org.label-schema.license": "GPLv2",
                "org.label-schema.name": "CentOS Base Image",
                "org.label-schema.schema-version": "1.0",
                "org.label-schema.vendor": "CentOS"
            },
            "Annotations": {
                "io.kubernetes.cri-o.ContainerType": "sandbox",
                "io.kubernetes.cri-o.Created": "2019-02-10T00:29:15.828118283+02:00",
                "io.kubernetes.cri-o.TTY": "false",
                "org.opencontainers.image.stopSignal": "15"
            },
            "StopSignal": 15
        }
    }
]

[ikke@ohuska ~]$ sudo podman inspect awx_web
[
    {
        "ID": "272db09afd02aa288aa603622b02054a56a48737b3e392607cf5b5116b4ba013",
        "Created": "2019-02-10T00:29:11.600831997+02:00",
        "Path": "/tini",
        "Args": [
            "--",
            "/bin/sh",
            "-c",
            "/usr/bin/launch_awx.sh"
        ],
        "State": {
            "OciVersion": "1.0.1-dev",
            "Status": "running",
            "Running": true,
            "Paused": false,
            "Restarting": false,
            "OOMKilled": false,
            "Dead": false,
            "Pid": 25658,
            "ExitCode": 0,
            "Error": "",
            "StartedAt": "2019-02-10T00:29:12.001515267+02:00",
            "FinishedAt": "0001-01-01T00:00:00Z"
        },
        "Image": "d4d006849a7dd7b5f469fa9930611db372a7c1568d2ee72660341fb48aa9c5f3",
        "ImageName": "docker.io/ansible/awx_web:latest",
        "Rootfs": "",
        "ResolvConfPath": "/var/run/containers/storage/overlay-containers/272db09afd02aa288aa603622b02054a56a48737b3e392607cf5b5116b4ba013/userdata/resolv.conf",
        "HostnamePath": "/var/run/containers/storage/overlay-containers/272db09afd02aa288aa603622b02054a56a48737b3e392607cf5b5116b4ba013/userdata/hostname",
        "HostsPath": "/var/run/containers/storage/overlay-containers/272db09afd02aa288aa603622b02054a56a48737b3e392607cf5b5116b4ba013/userdata/hosts",
        "StaticDir": "/var/lib/containers/storage/overlay-containers/272db09afd02aa288aa603622b02054a56a48737b3e392607cf5b5116b4ba013/userdata",
        "LogPath": "/var/lib/containers/storage/overlay-containers/272db09afd02aa288aa603622b02054a56a48737b3e392607cf5b5116b4ba013/userdata/ctr.log",
        "Name": "awx_web",
        "RestartCount": 0,
        "Driver": "overlay",
        "MountLabel": "system_u:object_r:container_file_t:s0:c695,c978",
        "ProcessLabel": "system_u:system_r:container_t:s0:c695,c978",
        "AppArmorProfile": "",
        "EffectiveCaps": [
            "CAP_CHOWN",
            "CAP_DAC_OVERRIDE",
            "CAP_FSETID",
            "CAP_FOWNER",
            "CAP_MKNOD",
            "CAP_NET_RAW",
            "CAP_SETGID",
            "CAP_SETUID",
            "CAP_SETFCAP",
            "CAP_SETPCAP",
            "CAP_NET_BIND_SERVICE",
            "CAP_SYS_CHROOT",
            "CAP_KILL",
            "CAP_AUDIT_WRITE"
        ],
        "BoundingCaps": [
            "CAP_CHOWN",
            "CAP_DAC_OVERRIDE",
            "CAP_FSETID",
            "CAP_FOWNER",
            "CAP_MKNOD",
            "CAP_NET_RAW",
            "CAP_SETGID",
            "CAP_SETUID",
            "CAP_SETFCAP",
            "CAP_SETPCAP",
            "CAP_NET_BIND_SERVICE",
            "CAP_SYS_CHROOT",
            "CAP_KILL",
            "CAP_AUDIT_WRITE"
        ],
        "ExecIDs": [],
        "GraphDriver": {
            "Name": "overlay",
            "Data": {
                "LowerDir": "/var/lib/containers/storage/overlay/a33d971c65080683ff962ddebe4bd2d72c437af4a108526e719509d22d4c6fbe/diff:/var/lib/containers/storage/overlay/c227632043c9dd3fdba6df04dbb39f4a881fd79ccf0fc121aafaf214df65660a/diff:/var/lib/containers/storage/overlay/83c8a33376b4b6e2d15c26f4d743d90bff37da13aea92a4f9249e9a5f4c570e4/diff:/var/lib/containers/storage/overlay/3094f13b1b50086546a4bf6107e17cb235ca019fa594ec89fe44df1d29a1dc7b/diff:/var/lib/containers/storage/overlay/8717c4075f405fde2432f638ea3035d7733e340039dc3cb6450c340389c666d6/diff:/var/lib/containers/storage/overlay/ca729294701ecfbbeb100e474eb6c521edaacb9970a99e5b637ec5a589c2c45a/diff:/var/lib/containers/storage/overlay/62ccdbe687033449a6538159bd3e188941040cf703d41ebe4acff8b00610cdc2/diff:/var/lib/containers/storage/overlay/47600865eb5ae6d510d182a91cb5aa6351b6aa9947710ed905fdd890fff5aeb2/diff:/var/lib/containers/storage/overlay/37c207ab39d4363dd3cf116ead773dd96e044eec9ad5470d886506d8095123c2/diff:/var/lib/containers/storage/overlay/08e0d39f6b0b790117116847055b3ef8e4e9c23fda1d5fa79b5f80a0065747a0/diff:/var/lib/containers/storage/overlay/e70085b54ab8bf58d5766e6e8906838220e36a74a10edec47bf82d68f6a1a70d/diff:/var/lib/containers/storage/overlay/10fea4fcf3176c21428ac0159710e03334de9c501d8ead8b0e858ed799f08a2c/diff:/var/lib/containers/storage/overlay/37a332a22623578d7692ffa7b485ab4c739cdf74cd318073d1333d2c31b78c13/diff:/var/lib/containers/storage/overlay/ede5eed0b4fa5afaf4fab2543a93c1168898442f584d84e1b2a549a2da571d47/diff:/var/lib/containers/storage/overlay/fbb4d52e0583e47fb29eb9573ac09c2394b5ccbba1b3a0f86ba357a373d68b3e/diff:/var/lib/containers/storage/overlay/ea90f13318d0ec540b53b17e458575f739be5cc76cda6d90f9ac98e112857b4c/diff:/var/lib/containers/storage/overlay/93eb60a500d950288e110e57cb107b6c133ecdf3c8776ed9e64ddd49a95b5d9f/diff:/var/lib/containers/storage/overlay/dd3158de869d70b70f47e1e0317991df6bbbc2533a32a74dcf66127f153151a8/diff:/var/lib/containers/storage/overlay/9c73e6a727365aa4cf97153c303426b4a77c3a9703056f2ea54c1ed657526d46/diff:/var/lib/containers/storage/overlay/3ebcc6a733b6281c411e4b48333347c4da5e9367fbe94599e85043ff6d078467/diff:/var/lib/containers/storage/overlay/23b8a97b35f1791f5846f84a491386d6c4e161766513e48ce9a9701c2eebc136/diff:/var/lib/containers/storage/overlay/1a9fa7e8bc639bc80d63c1b2245d027d773f1af00dc0fc2beaff7fd13349f3f0/diff:/var/lib/containers/storage/overlay/9107762458857ecdb3bb433560aafc4b9434545716e0a5890df27adee32e0512/diff:/var/lib/containers/storage/overlay/ef2877850b98b443cc68a5a73716a5e245913ecccabe996c0a6b73b05743a6d3/diff:/var/lib/containers/storage/overlay/77a9bf52e3d09fae549e2c0cde223cbd3247c995cb3188d7c4dcd761048ccfef/diff:/var/lib/containers/storage/overlay/8169b55418f2727b24d3fb4fccec374780576f32d293e0a76b06e1aad6168705/diff:/var/lib/containers/storage/overlay/344b130bec923670f99e04bbf9093a580d885ad84c1e370331fbedb144977569/diff:/var/lib/containers/storage/overlay/bd5434a77b7cf02d4c45b419093ec280181b3f473906bfd95adaea358e08672e/diff:/var/lib/containers/storage/overlay/66e944bab2591e8876d0315af4b8fe9285e66b26b0b0cc8739cab162e244d132/diff:/var/lib/containers/storage/overlay/071d8bd765171080d01682844524be57ac9883e53079b6ac66707e192ea25956/diff",
                "MergedDir": "/var/lib/containers/storage/overlay/a259dab561f47cb1003e9da58144138a61745a41ff1da1b8fb53689abb36ba8b/merged",
                "UpperDir": "/var/lib/containers/storage/overlay/a259dab561f47cb1003e9da58144138a61745a41ff1da1b8fb53689abb36ba8b/diff",
                "WorkDir": "/var/lib/containers/storage/overlay/a259dab561f47cb1003e9da58144138a61745a41ff1da1b8fb53689abb36ba8b/work"
            }
        },
        "Mounts": [
            {
                "destination": "/sys",
                "type": "sysfs",
                "source": "sysfs",
                "options": [
                    "nosuid",
                    "noexec",
                    "nodev",
                    "ro"
                ]
            },
            {
                "destination": "/dev",
                "type": "tmpfs",
                "source": "tmpfs",
                "options": [
                    "nosuid",
                    "strictatime",
                    "mode=755",
                    "size=65536k"
                ]
            },
            {
                "destination": "/proc",
                "type": "proc",
                "source": "proc",
                "options": [
                    "nosuid",
                    "noexec",
                    "nodev"
                ]
            },
            {
                "destination": "/etc/resolv.conf",
                "type": "bind",
                "source": "/var/run/containers/storage/overlay-containers/272db09afd02aa288aa603622b02054a56a48737b3e392607cf5b5116b4ba013/userdata/resolv.conf",
                "options": [
                    "bind",
                    "private"
                ]
            },
            {
                "destination": "/dev/mqueue",
                "type": "mqueue",
                "source": "mqueue",
                "options": [
                    "nosuid",
                    "noexec",
                    "nodev"
                ]
            },
            {
                "destination": "/run/secrets",
                "type": "bind",
                "source": "/var/run/containers/storage/overlay-containers/272db09afd02aa288aa603622b02054a56a48737b3e392607cf5b5116b4ba013/userdata/run/secrets",
                "options": [
                    "bind",
                    "private"
                ]
            },
            {
                "destination": "/dev/pts",
                "type": "devpts",
                "source": "devpts",
                "options": [
                    "nosuid",
                    "noexec",
                    "newinstance",
                    "ptmxmode=0666",
                    "mode=0620",
                    "gid=5"
                ]
            },
            {
                "destination": "/etc/hosts",
                "type": "bind",
                "source": "/var/run/containers/storage/overlay-containers/272db09afd02aa288aa603622b02054a56a48737b3e392607cf5b5116b4ba013/userdata/hosts",
                "options": [
                    "bind",
                    "private"
                ]
            },
            {
                "destination": "/dev/shm",
                "type": "bind",
                "source": "overlay-containers",
                "options": [
                    "bind",
                    "private"
                ]
            },
            {
                "destination": "/etc/hostname",
                "type": "bind",
                "source": "/var/run/containers/storage/overlay-containers/272db09afd02aa288aa603622b02054a56a48737b3e392607cf5b5116b4ba013/userdata/hostname",
                "options": [
                    "bind",
                    "private"
                ]
            },
            {
                "destination": "/run/.containerenv",
                "type": "bind",
                "source": "/var/run/containers/storage/overlay-containers/272db09afd02aa288aa603622b02054a56a48737b3e392607cf5b5116b4ba013/userdata/.containerenv",
                "options": [
                    "bind",
                    "private"
                ]
            },
            {
                "destination": "/sys/fs/cgroup",
                "type": "cgroup",
                "source": "cgroup",
                "options": [
                    "rprivate",
                    "nosuid",
                    "noexec",
                    "nodev",
                    "relatime",
                    "ro"
                ]
            },
            {
                "destination": "/var/lib/nginx",
                "type": "bind",
                "source": "overlay-containers",
                "options": [
                    "private",
                    "bind",
                    "rw"
                ]
            }
        ],
        "Dependencies": [
            "ae410db395d94e12acff64b02b4f8a611f8e5a58d6b789617420109de66d4ea9"
        ],
        "NetworkSettings": {
            "Bridge": "",
            "SandboxID": "",
            "HairpinMode": false,
            "LinkLocalIPv6Address": "",
            "LinkLocalIPv6PrefixLen": 0,
            "Ports": [],
            "SandboxKey": "",
            "SecondaryIPAddresses": null,
            "SecondaryIPv6Addresses": null,
            "EndpointID": "",
            "Gateway": "",
            "GlobalIPv6Address": "",
            "GlobalIPv6PrefixLen": 0,
            "IPAddress": "",
            "IPPrefixLen": 0,
            "IPv6Gateway": "",
            "MacAddress": ""
        },
        "ExitCommand": [
            "/usr/bin/podman",
            "--root",
            "/var/lib/containers/storage",
            "--runroot",
            "/var/run/containers/storage",
            "--log-level",
            "error",
            "--cgroup-manager",
            "systemd",
            "--tmpdir",
            "/var/run/libpod",
            "--storage-driver",
            "overlay",
            "container",
            "cleanup",
            "272db09afd02aa288aa603622b02054a56a48737b3e392607cf5b5116b4ba013"
        ],
        "Namespace": "",
        "IsInfra": false,
        "HostConfig": {
            "ContainerIDFile": "",
            "LogConfig": null,
            "NetworkMode": "container:ae410db395d94e12acff64b02b4f8a611f8e5a58d6b789617420109de66d4ea9",
            "PortBindings": null,
            "AutoRemove": false,
            "CapAdd": [],
            "CapDrop": [],
            "DNS": [],
            "DNSOptions": [],
            "DNSSearch": [],
            "ExtraHosts": null,
            "GroupAdd": null,
            "IpcMode": "container:ae410db395d94e12acff64b02b4f8a611f8e5a58d6b789617420109de66d4ea9",
            "Cgroup": "host",
            "OomScoreAdj": 0,
            "PidMode": "",
            "Privileged": false,
            "PublishAllPorts": false,
            "ReadonlyRootfs": false,
            "SecurityOpt": [],
            "UTSMode": "container:ae410db395d94e12acff64b02b4f8a611f8e5a58d6b789617420109de66d4ea9",
            "UsernsMode": "",
            "ShmSize": 65536000,
            "Runtime": "runc",
            "ConsoleSize": null,
            "CpuShares": null,
            "Memory": 0,
            "NanoCpus": 0,
            "CgroupParent": "",
            "BlkioWeight": null,
            "BlkioWeightDevice": null,
            "BlkioDeviceReadBps": null,
            "BlkioDeviceWriteBps": null,
            "BlkioDeviceReadIOps": null,
            "BlkioDeviceWriteIOps": null,
            "CpuPeriod": null,
            "CpuQuota": null,
            "CpuRealtimePeriod": null,
            "CpuRealtimeRuntime": null,
            "CpuSetCpus": "",
            "CpuSetMems": "",
            "Devices": null,
            "DiskQuota": 0,
            "KernelMemory": null,
            "MemoryReservation": null,
            "MemorySwap": null,
            "MemorySwappiness": null,
            "OomKillDisable": false,
            "PidsLimit": null,
            "Ulimits": [],
            "CpuCount": 0,
            "CpuPercent": 0,
            "IOMaximumIOps": 0,
            "IOMaximumBandwidth": 0,
            "Tmpfs": []
        },
        "Config": {
            "Hostname": "awxweb",
            "Domainname": "",
            "User": {
                "uid": 0,
                "gid": 0
            },
            "AttachStdin": false,
            "AttachStdout": false,
            "AttachStderr": false,
            "Tty": false,
            "OpenStdin": false,
            "StdinOnce": false,
            "Env": [
                "PATH=/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin",
                "TERM=xterm",
                "HOSTNAME=awxweb",
                "container=podman",
                "MEMCACHED_PORT=11211",
                "no_proxy=",
                "SECRET_KEY=awxsecret",
                "DATABASE_PASSWORD=awxpass",
                "DATABASE_PORT=5432",
                "DATABASE_HOST=postgres",
                "RABBITMQ_USER=guest",
                "RABBITMQ_PASSWORD=guest",
                "https_proxy=",
                "DATABASE_USER=awx",
                "AWX_ADMIN_PASSWORD=password",
                "RABBITMQ_HOST=rabbitmq",
                "RABBITMQ_VHOST=awx",
                "MEMCACHED_HOST=memcached",
                "AWX_ADMIN_USER=admin",
                "http_proxy=",
                "DATABASE_NAME=awx",
                "RABBITMQ_PORT=5672"
            ],
            "Cmd": [
                "/tini",
                "--",
                "/bin/sh",
                "-c",
                "/usr/bin/launch_awx.sh"
            ],
            "Image": "docker.io/ansible/awx_web:latest",
            "Volumes": null,
            "WorkingDir": "/var/lib/awx",
            "Entrypoint": "/tini --",
            "Labels": {
                "org.label-schema.build-date": "20181205",
                "org.label-schema.license": "GPLv2",
                "org.label-schema.name": "CentOS Base Image",
                "org.label-schema.schema-version": "1.0",
                "org.label-schema.vendor": "CentOS"
            },
            "Annotations": {
                "io.kubernetes.cri-o.ContainerType": "sandbox",
                "io.kubernetes.cri-o.Created": "2019-02-10T00:29:11.600831997+02:00",
                "io.kubernetes.cri-o.TTY": "false",
                "org.opencontainers.image.stopSignal": "15"
            },
            "StopSignal": 15
        }
    }
]

[ikke@ohuska ~]$ sudo podman inspect memcached
[
    {
        "ID": "2dfc08a883fb666cebf6dbf7e64d6696d5ef3f19ddac4af9dd56f0f7155458e2",
        "Created": "2019-02-10T00:28:54.912159071+02:00",
        "Path": "docker-entrypoint.sh",
        "Args": [
            "memcached"
        ],
        "State": {
            "OciVersion": "1.0.1-dev",
            "Status": "running",
            "Running": true,
            "Paused": false,
            "Restarting": false,
            "OOMKilled": false,
            "Dead": false,
            "Pid": 25126,
            "ExitCode": 0,
            "Error": "",
            "StartedAt": "2019-02-10T00:28:55.235771594+02:00",
            "FinishedAt": "0001-01-01T00:00:00Z"
        },
        "Image": "1b52b65cdde863123829e99dcd29bf96b15bdfb1907bd195d4aa8159337b9f86",
        "ImageName": "docker.io/library/memcached:alpine",
        "Rootfs": "",
        "ResolvConfPath": "/var/run/containers/storage/overlay-containers/2dfc08a883fb666cebf6dbf7e64d6696d5ef3f19ddac4af9dd56f0f7155458e2/userdata/resolv.conf",
        "HostnamePath": "/var/run/containers/storage/overlay-containers/2dfc08a883fb666cebf6dbf7e64d6696d5ef3f19ddac4af9dd56f0f7155458e2/userdata/hostname",
        "HostsPath": "/var/run/containers/storage/overlay-containers/2dfc08a883fb666cebf6dbf7e64d6696d5ef3f19ddac4af9dd56f0f7155458e2/userdata/hosts",
        "StaticDir": "/var/lib/containers/storage/overlay-containers/2dfc08a883fb666cebf6dbf7e64d6696d5ef3f19ddac4af9dd56f0f7155458e2/userdata",
        "LogPath": "/var/lib/containers/storage/overlay-containers/2dfc08a883fb666cebf6dbf7e64d6696d5ef3f19ddac4af9dd56f0f7155458e2/userdata/ctr.log",
        "Name": "memcached",
        "RestartCount": 0,
        "Driver": "overlay",
        "MountLabel": "system_u:object_r:container_file_t:s0:c695,c978",
        "ProcessLabel": "system_u:system_r:container_t:s0:c695,c978",
        "AppArmorProfile": "",
        "EffectiveCaps": null,
        "BoundingCaps": [
            "CAP_CHOWN",
            "CAP_DAC_OVERRIDE",
            "CAP_FSETID",
            "CAP_FOWNER",
            "CAP_MKNOD",
            "CAP_NET_RAW",
            "CAP_SETGID",
            "CAP_SETUID",
            "CAP_SETFCAP",
            "CAP_SETPCAP",
            "CAP_NET_BIND_SERVICE",
            "CAP_SYS_CHROOT",
            "CAP_KILL",
            "CAP_AUDIT_WRITE"
        ],
        "ExecIDs": [],
        "GraphDriver": {
            "Name": "overlay",
            "Data": {
                "LowerDir": "/var/lib/containers/storage/overlay/12423d56924d356609e503dfea9abf32f5c03cdcddbdf1746b109e738801e0a1/diff:/var/lib/containers/storage/overlay/fa6284a75258af00e2df66aee85c4cf63445b879ea396a57b2cc53e47b78bbb3/diff:/var/lib/containers/storage/overlay/5ce71a2634db69d0f0fb9d7880309563bf36fd9868cfe312824a03322c389b18/diff:/var/lib/containers/storage/overlay/c1a1bf7e76a7515994a147e5827b4ccbfe46780a24e6666f238ad12954952b25/diff:/var/lib/containers/storage/overlay/503e53e365f34399c4d58d8f4e23c161106cfbce4400e3d0a0357967bad69390/diff",
                "MergedDir": "/var/lib/containers/storage/overlay/78847c17f4a41149a7b0502fad6549ea44f2d9f8780ceeb76f8b7e3f755db3ea/merged",
                "UpperDir": "/var/lib/containers/storage/overlay/78847c17f4a41149a7b0502fad6549ea44f2d9f8780ceeb76f8b7e3f755db3ea/diff",
                "WorkDir": "/var/lib/containers/storage/overlay/78847c17f4a41149a7b0502fad6549ea44f2d9f8780ceeb76f8b7e3f755db3ea/work"
            }
        },
        "Mounts": [
            {
                "destination": "/proc",
                "type": "proc",
                "source": "proc",
                "options": [
                    "nosuid",
                    "noexec",
                    "nodev"
                ]
            },
            {
                "destination": "/dev",
                "type": "tmpfs",
                "source": "tmpfs",
                "options": [
                    "nosuid",
                    "strictatime",
                    "mode=755",
                    "size=65536k"
                ]
            },
            {
                "destination": "/sys",
                "type": "sysfs",
                "source": "sysfs",
                "options": [
                    "nosuid",
                    "noexec",
                    "nodev",
                    "ro"
                ]
            },
            {
                "destination": "/dev/pts",
                "type": "devpts",
                "source": "devpts",
                "options": [
                    "nosuid",
                    "noexec",
                    "newinstance",
                    "ptmxmode=0666",
                    "mode=0620",
                    "gid=5"
                ]
            },
            {
                "destination": "/dev/mqueue",
                "type": "mqueue",
                "source": "mqueue",
                "options": [
                    "nosuid",
                    "noexec",
                    "nodev"
                ]
            },
            {
                "destination": "/etc/hostname",
                "type": "bind",
                "source": "/var/run/containers/storage/overlay-containers/2dfc08a883fb666cebf6dbf7e64d6696d5ef3f19ddac4af9dd56f0f7155458e2/userdata/hostname",
                "options": [
                    "bind",
                    "private"
                ]
            },
            {
                "destination": "/run/.containerenv",
                "type": "bind",
                "source": "/var/run/containers/storage/overlay-containers/2dfc08a883fb666cebf6dbf7e64d6696d5ef3f19ddac4af9dd56f0f7155458e2/userdata/.containerenv",
                "options": [
                    "bind",
                    "private"
                ]
            },
            {
                "destination": "/run/secrets",
                "type": "bind",
                "source": "/var/run/containers/storage/overlay-containers/2dfc08a883fb666cebf6dbf7e64d6696d5ef3f19ddac4af9dd56f0f7155458e2/userdata/run/secrets",
                "options": [
                    "bind",
                    "private"
                ]
            },
            {
                "destination": "/etc/resolv.conf",
                "type": "bind",
                "source": "/var/run/containers/storage/overlay-containers/2dfc08a883fb666cebf6dbf7e64d6696d5ef3f19ddac4af9dd56f0f7155458e2/userdata/resolv.conf",
                "options": [
                    "bind",
                    "private"
                ]
            },
            {
                "destination": "/etc/hosts",
                "type": "bind",
                "source": "/var/run/containers/storage/overlay-containers/2dfc08a883fb666cebf6dbf7e64d6696d5ef3f19ddac4af9dd56f0f7155458e2/userdata/hosts",
                "options": [
                    "bind",
                    "private"
                ]
            },
            {
                "destination": "/dev/shm",
                "type": "bind",
                "source": "overlay-containers",
                "options": [
                    "bind",
                    "private"
                ]
            },
            {
                "destination": "/sys/fs/cgroup",
                "type": "cgroup",
                "source": "cgroup",
                "options": [
                    "rprivate",
                    "nosuid",
                    "noexec",
                    "nodev",
                    "relatime",
                    "ro"
                ]
            }
        ],
        "Dependencies": [
            "ae410db395d94e12acff64b02b4f8a611f8e5a58d6b789617420109de66d4ea9"
        ],
        "NetworkSettings": {
            "Bridge": "",
            "SandboxID": "",
            "HairpinMode": false,
            "LinkLocalIPv6Address": "",
            "LinkLocalIPv6PrefixLen": 0,
            "Ports": [],
            "SandboxKey": "",
            "SecondaryIPAddresses": null,
            "SecondaryIPv6Addresses": null,
            "EndpointID": "",
            "Gateway": "",
            "GlobalIPv6Address": "",
            "GlobalIPv6PrefixLen": 0,
            "IPAddress": "",
            "IPPrefixLen": 0,
            "IPv6Gateway": "",
            "MacAddress": ""
        },
        "ExitCommand": [
            "/usr/bin/podman",
            "--root",
            "/var/lib/containers/storage",
            "--runroot",
            "/var/run/containers/storage",
            "--log-level",
            "error",
            "--cgroup-manager",
            "systemd",
            "--tmpdir",
            "/var/run/libpod",
            "--storage-driver",
            "overlay",
            "container",
            "cleanup",
            "2dfc08a883fb666cebf6dbf7e64d6696d5ef3f19ddac4af9dd56f0f7155458e2"
        ],
        "Namespace": "",
        "IsInfra": false,
        "HostConfig": {
            "ContainerIDFile": "",
            "LogConfig": null,
            "NetworkMode": "container:ae410db395d94e12acff64b02b4f8a611f8e5a58d6b789617420109de66d4ea9",
            "PortBindings": null,
            "AutoRemove": false,
            "CapAdd": [],
            "CapDrop": [],
            "DNS": [],
            "DNSOptions": [],
            "DNSSearch": [],
            "ExtraHosts": null,
            "GroupAdd": [
                11211
            ],
            "IpcMode": "container:ae410db395d94e12acff64b02b4f8a611f8e5a58d6b789617420109de66d4ea9",
            "Cgroup": "host",
            "OomScoreAdj": 0,
            "PidMode": "",
            "Privileged": false,
            "PublishAllPorts": false,
            "ReadonlyRootfs": false,
            "SecurityOpt": [],
            "UTSMode": "container:ae410db395d94e12acff64b02b4f8a611f8e5a58d6b789617420109de66d4ea9",
            "UsernsMode": "",
            "ShmSize": 65536000,
            "Runtime": "runc",
            "ConsoleSize": null,
            "CpuShares": null,
            "Memory": 0,
            "NanoCpus": 0,
            "CgroupParent": "",
            "BlkioWeight": null,
            "BlkioWeightDevice": null,
            "BlkioDeviceReadBps": null,
            "BlkioDeviceWriteBps": null,
            "BlkioDeviceReadIOps": null,
            "BlkioDeviceWriteIOps": null,
            "CpuPeriod": null,
            "CpuQuota": null,
            "CpuRealtimePeriod": null,
            "CpuRealtimeRuntime": null,
            "CpuSetCpus": "",
            "CpuSetMems": "",
            "Devices": null,
            "DiskQuota": 0,
            "KernelMemory": null,
            "MemoryReservation": null,
            "MemorySwap": null,
            "MemorySwappiness": null,
            "OomKillDisable": false,
            "PidsLimit": null,
            "Ulimits": [],
            "CpuCount": 0,
            "CpuPercent": 0,
            "IOMaximumIOps": 0,
            "IOMaximumBandwidth": 0,
            "Tmpfs": []
        },
        "Config": {
            "Hostname": "2dfc08a883fb",
            "Domainname": "",
            "User": {
                "uid": 11211,
                "gid": 11211,
                "additionalGids": [
                    11211
                ]
            },
            "AttachStdin": false,
            "AttachStdout": false,
            "AttachStderr": false,
            "Tty": false,
            "OpenStdin": false,
            "StdinOnce": false,
            "Env": [
                "PATH=/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin",
                "TERM=xterm",
                "HOSTNAME=2dfc08a883fb",
                "container=podman",
                "MEMCACHED_VERSION=1.5.12",
                "MEMCACHED_SHA1=f67096ba64b0c47668bcad5b680010c4f8987d4c"
            ],
            "Cmd": [
                "docker-entrypoint.sh",
                "memcached"
            ],
            "Image": "docker.io/library/memcached:alpine",
            "Volumes": null,
            "WorkingDir": "/",
            "Entrypoint": "docker-entrypoint.sh",
            "Labels": null,
            "Annotations": {
                "io.kubernetes.cri-o.ContainerType": "sandbox",
                "io.kubernetes.cri-o.Created": "2019-02-10T00:28:54.912159071+02:00",
                "io.kubernetes.cri-o.TTY": "false",
                "org.opencontainers.image.stopSignal": "15"
            },
            "StopSignal": 15
        }
    }
]

[ikke@ohuska ~]$ sudo podman inspect rabbitmq
[
    {
        "ID": "5d4969eb242b8e82c367036df6cbf70d9ae710a774f51ae1b88e52bbe88dc495",
        "Created": "2019-02-10T00:28:53.427419107+02:00",
        "Path": "docker-entrypoint.sh",
        "Args": [
            "/bin/sh",
            "-c",
            "/launch.sh"
        ],
        "State": {
            "OciVersion": "1.0.1-dev",
            "Status": "exited",
            "Running": false,
            "Paused": false,
            "Restarting": false,
            "OOMKilled": false,
            "Dead": false,
            "Pid": 24691,
            "ExitCode": 1,
            "Error": "",
            "StartedAt": "2019-02-10T00:28:53.819457349+02:00",
            "FinishedAt": "2019-02-10T00:29:26.083465595+02:00"
        },
        "Image": "e08fe791079efd7160c79c4f0c9a214ed318677312d827a660c9816222913648",
        "ImageName": "docker.io/ansible/awx_rabbitmq:3.7.4",
        "Rootfs": "",
        "ResolvConfPath": "/var/run/containers/storage/overlay-containers/5d4969eb242b8e82c367036df6cbf70d9ae710a774f51ae1b88e52bbe88dc495/userdata/resolv.conf",
        "HostnamePath": "/var/run/containers/storage/overlay-containers/5d4969eb242b8e82c367036df6cbf70d9ae710a774f51ae1b88e52bbe88dc495/userdata/hostname",
        "HostsPath": "/var/run/containers/storage/overlay-containers/5d4969eb242b8e82c367036df6cbf70d9ae710a774f51ae1b88e52bbe88dc495/userdata/hosts",
        "StaticDir": "/var/lib/containers/storage/overlay-containers/5d4969eb242b8e82c367036df6cbf70d9ae710a774f51ae1b88e52bbe88dc495/userdata",
        "LogPath": "/var/lib/containers/storage/overlay-containers/5d4969eb242b8e82c367036df6cbf70d9ae710a774f51ae1b88e52bbe88dc495/userdata/ctr.log",
        "Name": "rabbitmq",
        "RestartCount": 0,
        "Driver": "overlay",
        "MountLabel": "system_u:object_r:container_file_t:s0:c695,c978",
        "ProcessLabel": "system_u:system_r:container_t:s0:c695,c978",
        "AppArmorProfile": "",
        "EffectiveCaps": [
            "CAP_CHOWN",
            "CAP_DAC_OVERRIDE",
            "CAP_FSETID",
            "CAP_FOWNER",
            "CAP_MKNOD",
            "CAP_NET_RAW",
            "CAP_SETGID",
            "CAP_SETUID",
            "CAP_SETFCAP",
            "CAP_SETPCAP",
            "CAP_NET_BIND_SERVICE",
            "CAP_SYS_CHROOT",
            "CAP_KILL",
            "CAP_AUDIT_WRITE"
        ],
        "BoundingCaps": [
            "CAP_CHOWN",
            "CAP_DAC_OVERRIDE",
            "CAP_FSETID",
            "CAP_FOWNER",
            "CAP_MKNOD",
            "CAP_NET_RAW",
            "CAP_SETGID",
            "CAP_SETUID",
            "CAP_SETFCAP",
            "CAP_SETPCAP",
            "CAP_NET_BIND_SERVICE",
            "CAP_SYS_CHROOT",
            "CAP_KILL",
            "CAP_AUDIT_WRITE"
        ],
        "ExecIDs": [],
        "GraphDriver": {
            "Name": "overlay",
            "Data": {
                "LowerDir": "/var/lib/containers/storage/overlay/8c6bbc4fb00a4e8e085aeb819760f0d2371dfb8a99bf1a678bc4ca9050b6572a/diff:/var/lib/containers/storage/overlay/56e552fded04fe798066a08846e8b55d25d1b508bb687694ef042b63a8a338ad/diff:/var/lib/containers/storage/overlay/1b6afacac6dea4ee6789f98623985eb2833dddc49af764323bc25fbc64e05a37/diff:/var/lib/containers/storage/overlay/ee3c990d55db356c19ed321525b1d67ff5cf9c5d295a5dea448b6ee04ec097b9/diff:/var/lib/containers/storage/overlay/2fe455e7f6d322c65901fdadee01c1b89fd220dcfb5cec456c1af2c53bf3accc/diff:/var/lib/containers/storage/overlay/92c9b25bf87bbacdf317ac64df2ec4fb0b47d35366000e0829b980ab234020a1/diff:/var/lib/containers/storage/overlay/abd89c97543f42a35a1a871ad07ac28305e921d9da79bec7f5396f698222a0be/diff:/var/lib/containers/storage/overlay/d6cba600f722a95c535543d438e00a186fc18cfad52e5a3bcb83bb7e47a75c4a/diff:/var/lib/containers/storage/overlay/52d233197623c0ff39a73335a7c72bb532b890529fa783da45d842bcf49120c2/diff:/var/lib/containers/storage/overlay/b7c5eb8e25182ce95ab9fb24c5f2f0a9b3b37d1b61379e99f07145f1757b101b/diff:/var/lib/containers/storage/overlay/4ff58ab38ce01eca73bd1a7c5061c19cb13f3d2027264ee5a2994a354a8cdaa1/diff:/var/lib/containers/storage/overlay/55a33d4b6af5b86c0ebcc446be87f121247e2a7d436493717cbcc8d12353caa8/diff:/var/lib/containers/storage/overlay/85a16a767e9480c21c49bdd145c7fd8eee51b2113fdcf171545b4bd80c264562/diff:/var/lib/containers/storage/overlay/31fec2b7917442d569f2dd9eab7b64bd05abf6a980dccf7664c3d0381c2dd385/diff:/var/lib/containers/storage/overlay/cd7100a72410606589a54b932cabd804a17f9ae5b42a1882bd56d263e02b6215/diff",
                "MergedDir": "/var/lib/containers/storage/overlay/71e4b9614342744d8a6634b37a38ac0e719ce2035fc32cd86134d1aea0982bab/merged",
                "UpperDir": "/var/lib/containers/storage/overlay/71e4b9614342744d8a6634b37a38ac0e719ce2035fc32cd86134d1aea0982bab/diff",
                "WorkDir": "/var/lib/containers/storage/overlay/71e4b9614342744d8a6634b37a38ac0e719ce2035fc32cd86134d1aea0982bab/work"
            }
        },
        "Mounts": [
            {
                "destination": "/sys",
                "type": "sysfs",
                "source": "sysfs",
                "options": [
                    "nosuid",
                    "noexec",
                    "nodev",
                    "ro"
                ]
            },
            {
                "destination": "/dev",
                "type": "tmpfs",
                "source": "tmpfs",
                "options": [
                    "nosuid",
                    "strictatime",
                    "mode=755",
                    "size=65536k"
                ]
            },
            {
                "destination": "/proc",
                "type": "proc",
                "source": "proc",
                "options": [
                    "nosuid",
                    "noexec",
                    "nodev"
                ]
            },
            {
                "destination": "/run/secrets",
                "type": "bind",
                "source": "/var/run/containers/storage/overlay-containers/5d4969eb242b8e82c367036df6cbf70d9ae710a774f51ae1b88e52bbe88dc495/userdata/run/secrets",
                "options": [
                    "bind",
                    "private"
                ]
            },
            {
                "destination": "/dev/mqueue",
                "type": "mqueue",
                "source": "mqueue",
                "options": [
                    "nosuid",
                    "noexec",
                    "nodev"
                ]
            },
            {
                "destination": "/run/.containerenv",
                "type": "bind",
                "source": "/var/run/containers/storage/overlay-containers/5d4969eb242b8e82c367036df6cbf70d9ae710a774f51ae1b88e52bbe88dc495/userdata/.containerenv",
                "options": [
                    "bind",
                    "private"
                ]
            },
            {
                "destination": "/dev/pts",
                "type": "devpts",
                "source": "devpts",
                "options": [
                    "nosuid",
                    "noexec",
                    "newinstance",
                    "ptmxmode=0666",
                    "mode=0620",
                    "gid=5"
                ]
            },
            {
                "destination": "/etc/resolv.conf",
                "type": "bind",
                "source": "/var/run/containers/storage/overlay-containers/5d4969eb242b8e82c367036df6cbf70d9ae710a774f51ae1b88e52bbe88dc495/userdata/resolv.conf",
                "options": [
                    "bind",
                    "private"
                ]
            },
            {
                "destination": "/etc/hosts",
                "type": "bind",
                "source": "/var/run/containers/storage/overlay-containers/5d4969eb242b8e82c367036df6cbf70d9ae710a774f51ae1b88e52bbe88dc495/userdata/hosts",
                "options": [
                    "bind",
                    "private"
                ]
            },
            {
                "destination": "/dev/shm",
                "type": "bind",
                "source": "overlay-containers",
                "options": [
                    "bind",
                    "private"
                ]
            },
            {
                "destination": "/etc/hostname",
                "type": "bind",
                "source": "/var/run/containers/storage/overlay-containers/5d4969eb242b8e82c367036df6cbf70d9ae710a774f51ae1b88e52bbe88dc495/userdata/hostname",
                "options": [
                    "bind",
                    "private"
                ]
            },
            {
                "destination": "/sys/fs/cgroup",
                "type": "cgroup",
                "source": "cgroup",
                "options": [
                    "rprivate",
                    "nosuid",
                    "noexec",
                    "nodev",
                    "relatime",
                    "ro"
                ]
            },
            {
                "destination": "/var/lib/rabbitmq",
                "type": "bind",
                "source": "overlay-containers",
                "options": [
                    "private",
                    "bind",
                    "rw"
                ]
            }
        ],
        "Dependencies": [
            "ae410db395d94e12acff64b02b4f8a611f8e5a58d6b789617420109de66d4ea9"
        ],
        "NetworkSettings": {
            "Bridge": "",
            "SandboxID": "",
            "HairpinMode": false,
            "LinkLocalIPv6Address": "",
            "LinkLocalIPv6PrefixLen": 0,
            "Ports": [],
            "SandboxKey": "",
            "SecondaryIPAddresses": null,
            "SecondaryIPv6Addresses": null,
            "EndpointID": "",
            "Gateway": "",
            "GlobalIPv6Address": "",
            "GlobalIPv6PrefixLen": 0,
            "IPAddress": "",
            "IPPrefixLen": 0,
            "IPv6Gateway": "",
            "MacAddress": ""
        },
        "ExitCommand": [
            "/usr/bin/podman",
            "--root",
            "/var/lib/containers/storage",
            "--runroot",
            "/var/run/containers/storage",
            "--log-level",
            "error",
            "--cgroup-manager",
            "systemd",
            "--tmpdir",
            "/var/run/libpod",
            "--storage-driver",
            "overlay",
            "container",
            "cleanup",
            "5d4969eb242b8e82c367036df6cbf70d9ae710a774f51ae1b88e52bbe88dc495"
        ],
        "Namespace": "",
        "IsInfra": false,
        "HostConfig": {
            "ContainerIDFile": "",
            "LogConfig": null,
            "NetworkMode": "container:ae410db395d94e12acff64b02b4f8a611f8e5a58d6b789617420109de66d4ea9",
            "PortBindings": null,
            "AutoRemove": false,
            "CapAdd": [],
            "CapDrop": [],
            "DNS": [],
            "DNSOptions": [],
            "DNSSearch": [],
            "ExtraHosts": null,
            "GroupAdd": [
                0,
                1,
                2,
                3,
                4,
                6,
                10,
                11,
                20,
                26,
                27
            ],
            "IpcMode": "container:ae410db395d94e12acff64b02b4f8a611f8e5a58d6b789617420109de66d4ea9",
            "Cgroup": "host",
            "OomScoreAdj": 0,
            "PidMode": "",
            "Privileged": false,
            "PublishAllPorts": false,
            "ReadonlyRootfs": false,
            "SecurityOpt": [],
            "UTSMode": "container:ae410db395d94e12acff64b02b4f8a611f8e5a58d6b789617420109de66d4ea9",
            "UsernsMode": "",
            "ShmSize": 65536000,
            "Runtime": "runc",
            "ConsoleSize": null,
            "CpuShares": null,
            "Memory": 0,
            "NanoCpus": 0,
            "CgroupParent": "",
            "BlkioWeight": null,
            "BlkioWeightDevice": null,
            "BlkioDeviceReadBps": null,
            "BlkioDeviceWriteBps": null,
            "BlkioDeviceReadIOps": null,
            "BlkioDeviceWriteIOps": null,
            "CpuPeriod": null,
            "CpuQuota": null,
            "CpuRealtimePeriod": null,
            "CpuRealtimeRuntime": null,
            "CpuSetCpus": "",
            "CpuSetMems": "",
            "Devices": null,
            "DiskQuota": 0,
            "KernelMemory": null,
            "MemoryReservation": null,
            "MemorySwap": null,
            "MemorySwappiness": null,
            "OomKillDisable": false,
            "PidsLimit": null,
            "Ulimits": [],
            "CpuCount": 0,
            "CpuPercent": 0,
            "IOMaximumIOps": 0,
            "IOMaximumBandwidth": 0,
            "Tmpfs": []
        },
        "Config": {
            "Hostname": "5d4969eb242b",
            "Domainname": "",
            "User": {
                "uid": 0,
                "gid": 0,
                "additionalGids": [
                    0,
                    1,
                    2,
                    3,
                    4,
                    6,
                    10,
                    11,
                    20,
                    26,
                    27
                ]
            },
            "AttachStdin": false,
            "AttachStdout": false,
            "AttachStderr": false,
            "Tty": false,
            "OpenStdin": false,
            "StdinOnce": false,
            "Env": [
                "PATH=/opt/rabbitmq/sbin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin",
                "TERM=xterm",
                "HOSTNAME=5d4969eb242b",
                "container=podman",
                "RABBITMQ_LOGS=-",
                "RABBITMQ_SASL_LOGS=-",
                "RABBITMQ_GITHUB_TAG=v3.7.4",
                "RABBITMQ_ERLANG_COOKIE=cookiemonster",
                "RABBITMQ_DEFAULT_PASS=guest",
                "RABBITMQ_DEFAULT_USER=guest",
                "RABBITMQ_HOME=/opt/rabbitmq",
                "RABBITMQ_GPG_KEY=0A9AF2115F4687BD29803A206B73A36E6026DFCA",
                "RABBITMQ_VERSION=3.7.4",
                "HOME=/var/lib/rabbitmq",
                "RABBITMQ_DEFAULT_VHOST=awx"
            ],
            "Cmd": [
                "docker-entrypoint.sh",
                "/bin/sh",
                "-c",
                "/launch.sh"
            ],
            "Image": "docker.io/ansible/awx_rabbitmq:3.7.4",
            "Volumes": null,
            "WorkingDir": "/",
            "Entrypoint": "docker-entrypoint.sh",
            "Labels": null,
            "Annotations": {
                "io.kubernetes.cri-o.ContainerType": "sandbox",
                "io.kubernetes.cri-o.Created": "2019-02-10T00:28:53.427419107+02:00",
                "io.kubernetes.cri-o.TTY": "false",
                "org.opencontainers.image.stopSignal": "15"
            },
            "StopSignal": 15
        }
    }
]

[ikke@ohuska ~]$ sudo podman pod inspect awx
{
     "Config": {
          "id": "9dfb2b023f35fa86d6f47404e66db3b3c3962d483d45e0be2a7fbf29ade742c2",
          "name": "awx",
          "labels": null,
          "cgroupParent": "machine.slice",
          "sharesCgroup": true,
          "sharesIpc": true,
          "sharesNet": true,
          "sharesUts": true,
          "infraConfig": {
               "makeInfraContainer": true,
               "infraPortBindings": [
                    {
                         "hostPort": 8086,
                         "containerPort": 8052,
                         "protocol": "tcp",
                         "hostIP": ""
                    }
               ]
          },
          "created": "2019-02-10T00:28:50.329155938+02:00"
     },
     "State": {
          "cgroupPath": "machine.slice/machine-libpod_pod_9dfb2b023f35fa86d6f47404e66db3b3c3962d483d45e0be2a7fbf29ade742c2.slice",
          "infraContainerID": "ae410db395d94e12acff64b02b4f8a611f8e5a58d6b789617420109de66d4ea9"
     },
     "Containers": [
          {
               "id": "272db09afd02aa288aa603622b02054a56a48737b3e392607cf5b5116b4ba013",
               "state": "running"
          },
          {
               "id": "2dfc08a883fb666cebf6dbf7e64d6696d5ef3f19ddac4af9dd56f0f7155458e2",
               "state": "running"
          },
          {
               "id": "506cb6b389db7aef50643fe9f2d5817af7b319141143f2d84981517162fc0b2a",
               "state": "running"
          },
          {
               "id": "54bf6b11d14d6e9cf1bb49d40a93a78709b5387ebd78b62619710e60d5d07449",
               "state": "running"
          },
          {
               "id": "5d4969eb242b8e82c367036df6cbf70d9ae710a774f51ae1b88e52bbe88dc495",
               "state": "exited"
          },
          {
               "id": "ae410db395d94e12acff64b02b4f8a611f8e5a58d6b789617420109de66d4ea9",
               "state": "running"
          }
     ]
}
@openshift-ci-robot openshift-ci-robot added the kind/bug Categorizes issue or PR as related to a bug. label Feb 10, 2019
@baude
Copy link
Member

baude commented Feb 10, 2019

ok, i am able to replicate ... it is something specific with the images or containers.

@baude
Copy link
Member

baude commented Feb 10, 2019

@mheon , what would case c.state.Mount to return "" when the container is running? I can see it in mounts as well.

   423:		if c.User() != "" {
   424:			// It is *possible* that
   425:			logrus.Debugf("Looking in container for user: %s", c.User())
=> 426:			u, err := lookup.GetUser(c.state.Mountpoint, c.User())
   427:			if err != nil {
   428:				return nil, errors.Wrapf(err, "lookup for user %s failed", c.User())
   429:			}
   430:			user := int64(u.Uid)
   431:			sc.RunAsUser = &user
(dlv) p  c.state.Mountpoint
""

@mheon
Copy link
Member

mheon commented Feb 10, 2019

That shouldn't be possible - definitely a bug. We might be missing a Save() on container state somewhere.

@baude
Copy link
Member

baude commented Feb 10, 2019

@mheon ok, lets discuss monday

@ikke-t ikke-t mentioned this issue Feb 10, 2019
Closed
@ikke-t
Copy link
Author

ikke-t commented Feb 11, 2019

if you want to see how pod is created, the ansible is in #2303

baude added a commit to baude/podman that referenced this issue Feb 11, 2019
@baude
lock and sync container before checking mountpoint
82ee58e 
when checking for a container's mountpoint, you must lock and sync
the container or the result may be "".

Fixes: containers#2304

Signed-off-by: baude <bbaude@redhat.com>
@baude baude mentioned this issue Feb 11, 2019
Merged
baude added a commit to baude/podman that referenced this issue Feb 11, 2019
@baude
lock and sync container before checking mountpoint
440dd8c 
when checking for a container's mountpoint, you must lock and sync
the container or the result may be "".

Fixes: containers#2304

Signed-off-by: baude <bbaude@redhat.com>
@github-actions github-actions bot added the locked - please file new issue/PR Assist humans wanting to comment on an old issue or PR with locked comments. label Sep 24, 2023
@github-actions github-actions bot locked as resolved and limited conversation to collaborators Sep 24, 2023
Sign up for free to subscribe to this conversation on GitHub. Already have an account? Sign in.
Assignees

@baude baude

Labels
kind/bug Categorizes issue or PR as related to a bug. locked - please file new issue/PR Assist humans wanting to comment on an old issue or PR with locked comments.
Projects
None yet
Milestone
No milestone
Development

No branches or pull requests
4 participants
@ikke-t @mheon @baude @openshift-ci-robot