Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Can't start new unprivileged container in Fedora 27 #1998

Closed
marcosps opened this issue Dec 5, 2017 · 17 comments
Closed

Can't start new unprivileged container in Fedora 27 #1998

marcosps opened this issue Dec 5, 2017 · 17 comments

Comments

@marcosps
Copy link
Contributor

marcosps commented Dec 5, 2017

  • Distribution: fedora
  • Distribution version: 27
  • The output of
    • lxc-start --version: 2.1.0-devel
    • lxc-checkconfig:

Kernel configuration not found at /proc/config.gz; searching...
Kernel configuration found at /boot/config-4.13.16-300.fc27.x86_64
--- Namespaces ---
Namespaces: enabled
Utsname namespace: enabled
Ipc namespace: enabled
Pid namespace: enabled
User namespace: enabled
Network namespace: enabled

--- Control groups ---
Cgroups: enabled

Cgroup v1 mount points:
/sys/fs/cgroup/systemd
/sys/fs/cgroup/memory
/sys/fs/cgroup/cpu,cpuacct
/sys/fs/cgroup/hugetlb
/sys/fs/cgroup/net_cls,net_prio
/sys/fs/cgroup/cpuset
/sys/fs/cgroup/blkio
/sys/fs/cgroup/perf_event
/sys/fs/cgroup/pids
/sys/fs/cgroup/freezer
/sys/fs/cgroup/devices

Cgroup v2 mount points:
/sys/fs/cgroup/unified

Cgroup v1 clone_children flag: enabled
Cgroup device: enabled
Cgroup sched: enabled
Cgroup cpu account: enabled
Cgroup memory controller: enabled
Cgroup cpuset: enabled

--- Misc ---
Veth pair device: enabled, not loaded
Macvlan: enabled, not loaded
Vlan: enabled, not loaded
Bridges: enabled, loaded
Advanced netfilter: enabled, not loaded
CONFIG_NF_NAT_IPV4: enabled, loaded
CONFIG_NF_NAT_IPV6: enabled, loaded
CONFIG_IP_NF_TARGET_MASQUERADE: enabled, loaded
CONFIG_IP6_NF_TARGET_MASQUERADE: enabled, not loaded
CONFIG_NETFILTER_XT_TARGET_CHECKSUM: enabled, loaded
CONFIG_NETFILTER_XT_MATCH_COMMENT: enabled, not loaded
FUSE (for use with lxcfs): enabled, loaded

--- Checkpoint/Restore ---
checkpoint restore: enabled
CONFIG_FHANDLE: enabled
CONFIG_EVENTFD: enabled
CONFIG_EPOLL: enabled
CONFIG_UNIX_DIAG: enabled
CONFIG_INET_DIAG: enabled
CONFIG_PACKET_DIAG: enabled
CONFIG_NETLINK_DIAG: enabled
File capabilities:

Note : Before booting a new kernel, you can check its configuration
usage : CONFIG=/path/to/config /usr/bin/lxc-checkconfig

  • uname -a
    Linux localhost.localdomain 4.13.16-300.fc27.x86_64 Prefix tests with lxc-test- #1 SMP Mon Nov 27 18:19:43 UTC 2017 x86_64 x86_64 x86_64 GNU/Linux

  • cat /proc/self/cgroup:
    11:devices:/user.slice
    10:freezer:/
    9:pids:/user.slice/user-1000.slice/session-2.scope
    8:perf_event:/
    7:blkio:/
    6:cpuset:/
    5:net_cls,net_prio:/
    4:hugetlb:/
    3:cpu,cpuacct:/
    2:memory:/
    1:name=systemd:/user.slice/user-1000.slice/session-2.scope
    0::/user.slice/user-1000.slice/session-2.scope

  • cat /proc/1/mounts:
    sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0
    proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0
    devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=2003156k,nr_inodes=500789,mode=755 0 0
    securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0
    tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev 0 0
    devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0
    tmpfs /run tmpfs rw,seclabel,nosuid,nodev,mode=755 0 0
    tmpfs /sys/fs/cgroup tmpfs ro,seclabel,nosuid,nodev,noexec,mode=755 0 0
    cgroup /sys/fs/cgroup/unified cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime 0 0
    cgroup /sys/fs/cgroup/systemd cgroup rw,seclabel,nosuid,nodev,noexec,relatime,xattr,name=systemd 0 0
    pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0
    cgroup /sys/fs/cgroup/memory cgroup rw,seclabel,nosuid,nodev,noexec,relatime,memory 0 0
    cgroup /sys/fs/cgroup/cpu,cpuacct cgroup rw,seclabel,nosuid,nodev,noexec,relatime,cpu,cpuacct 0 0
    cgroup /sys/fs/cgroup/hugetlb cgroup rw,seclabel,nosuid,nodev,noexec,relatime,hugetlb 0 0
    cgroup /sys/fs/cgroup/net_cls,net_prio cgroup rw,seclabel,nosuid,nodev,noexec,relatime,net_cls,net_prio 0 0
    cgroup /sys/fs/cgroup/cpuset cgroup rw,seclabel,nosuid,nodev,noexec,relatime,cpuset 0 0
    cgroup /sys/fs/cgroup/blkio cgroup rw,seclabel,nosuid,nodev,noexec,relatime,blkio 0 0
    cgroup /sys/fs/cgroup/perf_event cgroup rw,seclabel,nosuid,nodev,noexec,relatime,perf_event 0 0
    cgroup /sys/fs/cgroup/pids cgroup rw,seclabel,nosuid,nodev,noexec,relatime,pids 0 0
    cgroup /sys/fs/cgroup/freezer cgroup rw,seclabel,nosuid,nodev,noexec,relatime,freezer 0 0
    cgroup /sys/fs/cgroup/devices cgroup rw,seclabel,nosuid,nodev,noexec,relatime,devices 0 0
    configfs /sys/kernel/config configfs rw,relatime 0 0
    /dev/mapper/fedora-root / ext4 rw,seclabel,relatime,data=ordered 0 0
    selinuxfs /sys/fs/selinux selinuxfs rw,relatime 0 0
    systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=28,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=15534 0 0
    debugfs /sys/kernel/debug debugfs rw,seclabel,relatime 0 0
    mqueue /dev/mqueue mqueue rw,seclabel,relatime 0 0
    hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0
    tmpfs /tmp tmpfs rw,seclabel,nosuid,nodev 0 0
    /dev/sda1 /boot ext4 rw,seclabel,relatime,data=ordered 0 0
    /dev/mapper/fedora-home /home ext4 rw,seclabel,relatime,data=ordered 0 0
    sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0
    tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=403228k,mode=700,uid=1000,gid=1000 0 0
    fusectl /sys/fs/fuse/connections fusectl rw,relatime 0 0
    /dev/fuse /run/user/1000/doc fuse rw,nosuid,nodev,relatime,user_id=1000,group_id=1000 0 0

Issue description

After a lxc-create using download template, Fedora 27 can't start new unprivileged container.

A brief description of what failed or what could be improved:

Steps to reproduce

  1. Step one:
    lxc-create -t download -n container-ubuntu-xenial -- -d ubuntu -r xenial -a amd64
  2. Step two
    lxc-start -n container-ubuntu-xenial -l TRACE -F
  3. Step three
    This is returned:
      lxc-start container-ubuntu-xenial 20171204235933.554 INFO     lxc_confile - confile.c:set_config_idmaps:1575 - Read uid map: type u nsid 0 hostid 165536 range 65536
      lxc-start container-ubuntu-xenial 20171204235933.554 INFO     lxc_confile - confile.c:set_config_idmaps:1575 - Read uid map: type g nsid 0 hostid 165536 range 65536
      lxc-start container-ubuntu-xenial 20171204235933.554 TRACE    lxc_commands - commands.c:lxc_cmd:308 - Connection refused - Command "get_init_pid" failed to connect command socket
      lxc-start container-ubuntu-xenial 20171204235933.554 TRACE    lxc_commands - commands.c:lxc_cmd:308 - Connection refused - Command "get_cgroup" failed to connect command socket
      lxc-start container-ubuntu-xenial 20171204235933.554 TRACE    lxc_commands - commands.c:lxc_cmd:308 - Connection refused - Command "get_cgroup" failed to connect command socket
      lxc-start container-ubuntu-xenial 20171204235933.554 TRACE    lxc_commands - commands.c:lxc_cmd:308 - Connection refused - Command "get_cgroup" failed to connect command socket
      lxc-start container-ubuntu-xenial 20171204235933.554 TRACE    lxc_commands - commands.c:lxc_cmd:308 - Connection refused - Command "get_cgroup" failed to connect command socket
      lxc-start container-ubuntu-xenial 20171204235933.554 TRACE    lxc_commands - commands.c:lxc_cmd:308 - Connection refused - Command "get_cgroup" failed to connect command socket
      lxc-start container-ubuntu-xenial 20171204235933.554 TRACE    lxc_commands - commands.c:lxc_cmd:308 - Connection refused - Command "get_cgroup" failed to connect command socket
      lxc-start container-ubuntu-xenial 20171204235933.554 TRACE    lxc_commands - commands.c:lxc_cmd:308 - Connection refused - Command "get_cgroup" failed to connect command socket
      lxc-start container-ubuntu-xenial 20171204235933.554 TRACE    lxc_commands - commands.c:lxc_cmd:308 - Connection refused - Command "get_cgroup" failed to connect command socket
      lxc-start container-ubuntu-xenial 20171204235933.554 TRACE    lxc_commands - commands.c:lxc_cmd:308 - Connection refused - Command "get_cgroup" failed to connect command socket
      lxc-start container-ubuntu-xenial 20171204235933.554 TRACE    lxc_commands - commands.c:lxc_cmd:308 - Connection refused - Command "get_cgroup" failed to connect command socket
      lxc-start container-ubuntu-xenial 20171204235933.554 TRACE    lxc_commands - commands.c:lxc_cmd:308 - Connection refused - Command "get_cgroup" failed to connect command socket
      lxc-start container-ubuntu-xenial 20171204235933.555 TRACE    lxc_commands - commands.c:lxc_cmd:308 - Connection refused - Command "get_state" failed to connect command socket
      lxc-start container-ubuntu-xenial 20171204235933.555 TRACE    lxc_commands - commands.c:lxc_cmd_init:1323 - Creating abstract unix socket "/home/marcosps/.local/share/lxc/container-ubuntu-xenial/command"
      lxc-start container-ubuntu-xenial 20171204235933.555 TRACE    lxc_start - start.c:lxc_init_handler:563 - Unix domain socket 4 for command server is ready
      lxc-start container-ubuntu-xenial 20171204235933.555 INFO     lxc_lsm - lsm/lsm.c:lsm_init:48 - LSM security driver SELinux
      lxc-start container-ubuntu-xenial 20171204235933.555 TRACE    lxc_start - start.c:lxc_init:578 - initialized LSM
      lxc-start container-ubuntu-xenial 20171204235933.555 INFO     lxc_seccomp - seccomp.c:parse_config_v2:589 - processing: .reject_force_umount  # comment this to allow umount -f;  not recommended
      lxc-start container-ubuntu-xenial 20171204235933.555 INFO     lxc_seccomp - seccomp.c:parse_config_v2:765 - Adding native rule for reject_force_umount  # comment this to allow umount -f;  not recommended action 0(kill)
      lxc-start container-ubuntu-xenial 20171204235933.555 INFO     lxc_seccomp - seccomp.c:do_resolve_add_rule:415 - Setting Seccomp rule to reject force umounts
      lxc-start container-ubuntu-xenial 20171204235933.555 INFO     lxc_seccomp - seccomp.c:parse_config_v2:769 - Adding compat rule for reject_force_umount action 0(kill)
      lxc-start container-ubuntu-xenial 20171204235933.555 INFO     lxc_seccomp - seccomp.c:do_resolve_add_rule:415 - Setting Seccomp rule to reject force umounts
      lxc-start container-ubuntu-xenial 20171204235933.555 INFO     lxc_seccomp - seccomp.c:do_resolve_add_rule:415 - Setting Seccomp rule to reject force umounts
      lxc-start container-ubuntu-xenial 20171204235933.555 INFO     lxc_seccomp - seccomp.c:parse_config_v2:589 - processing: .[all]
      lxc-start container-ubuntu-xenial 20171204235933.555 INFO     lxc_seccomp - seccomp.c:parse_config_v2:589 - processing: .kexec_load errno 1
      lxc-start container-ubuntu-xenial 20171204235933.555 INFO     lxc_seccomp - seccomp.c:parse_config_v2:765 - Adding native rule for kexec_load errno 1 action 327681(errno)
      lxc-start container-ubuntu-xenial 20171204235933.555 INFO     lxc_seccomp - seccomp.c:parse_config_v2:769 - Adding compat rule for kexec_load action 327681(errno)
      lxc-start container-ubuntu-xenial 20171204235933.555 INFO     lxc_seccomp - seccomp.c:parse_config_v2:589 - processing: .open_by_handle_at errno 1
      lxc-start container-ubuntu-xenial 20171204235933.555 INFO     lxc_seccomp - seccomp.c:parse_config_v2:765 - Adding native rule for open_by_handle_at errno 1 action 327681(errno)
      lxc-start container-ubuntu-xenial 20171204235933.555 INFO     lxc_seccomp - seccomp.c:parse_config_v2:769 - Adding compat rule for open_by_handle_at action 327681(errno)
      lxc-start container-ubuntu-xenial 20171204235933.555 INFO     lxc_seccomp - seccomp.c:parse_config_v2:589 - processing: .init_module errno 1
      lxc-start container-ubuntu-xenial 20171204235933.555 INFO     lxc_seccomp - seccomp.c:parse_config_v2:765 - Adding native rule for init_module errno 1 action 327681(errno)
      lxc-start container-ubuntu-xenial 20171204235933.555 INFO     lxc_seccomp - seccomp.c:parse_config_v2:769 - Adding compat rule for init_module action 327681(errno)
      lxc-start container-ubuntu-xenial 20171204235933.555 INFO     lxc_seccomp - seccomp.c:parse_config_v2:589 - processing: .finit_module errno 1
      lxc-start container-ubuntu-xenial 20171204235933.555 INFO     lxc_seccomp - seccomp.c:parse_config_v2:765 - Adding native rule for finit_module errno 1 action 327681(errno)
      lxc-start container-ubuntu-xenial 20171204235933.555 INFO     lxc_seccomp - seccomp.c:parse_config_v2:769 - Adding compat rule for finit_module action 327681(errno)
      lxc-start container-ubuntu-xenial 20171204235933.555 INFO     lxc_seccomp - seccomp.c:parse_config_v2:589 - processing: .delete_module errno 1
      lxc-start container-ubuntu-xenial 20171204235933.555 INFO     lxc_seccomp - seccomp.c:parse_config_v2:765 - Adding native rule for delete_module errno 1 action 327681(errno)
      lxc-start container-ubuntu-xenial 20171204235933.555 INFO     lxc_seccomp - seccomp.c:parse_config_v2:769 - Adding compat rule for delete_module action 327681(errno)
      lxc-start container-ubuntu-xenial 20171204235933.555 INFO     lxc_seccomp - seccomp.c:parse_config_v2:779 - Merging in the compat Seccomp ctx into the main one
      lxc-start container-ubuntu-xenial 20171204235933.555 TRACE    lxc_start - start.c:lxc_init:584 - read seccomp policy
      lxc-start container-ubuntu-xenial 20171204235933.555 TRACE    lxc_start - start.c:lxc_serve_state_clients:350 - Set container state to STARTING
      lxc-start container-ubuntu-xenial 20171204235933.555 TRACE    lxc_start - start.c:lxc_serve_state_clients:353 - No state clients registered
      lxc-start container-ubuntu-xenial 20171204235933.555 TRACE    lxc_start - start.c:lxc_init:591 - set container state to "STARTING"
      lxc-start container-ubuntu-xenial 20171204235933.555 TRACE    lxc_start - start.c:lxc_init:619 - set environment variables
      lxc-start container-ubuntu-xenial 20171204235933.555 TRACE    lxc_start - start.c:lxc_init:625 - ran pre-start hooks
      lxc-start container-ubuntu-xenial 20171204235933.555 DEBUG    lxc_start - start.c:setup_signal_fd:278 - Set SIGCHLD handler with file descriptor: 5.
      lxc-start container-ubuntu-xenial 20171204235933.555 TRACE    lxc_start - start.c:lxc_init:636 - set up signal fd
      lxc-start container-ubuntu-xenial 20171204235933.556 DEBUG    console - console.c:lxc_console_peer_default:513 - using "/dev/tty" as peer tty device
      lxc-start container-ubuntu-xenial 20171204235933.556 DEBUG    console - console.c:lxc_console_signal_init:178 - Created signal fd 10
      lxc-start container-ubuntu-xenial 20171204235933.556 DEBUG    console - console.c:lxc_console_winsz:86 - Set window size to 190 columns and 42 rows
      lxc-start container-ubuntu-xenial 20171204235933.556 TRACE    lxc_start - start.c:lxc_init:643 - created console
      lxc-start container-ubuntu-xenial 20171204235933.556 DEBUG    lxc_conf - conf.c:chown_mapped_root:2792 - trying to chown "/dev/pts/4" to 1000
      lxc-start container-ubuntu-xenial 20171204235933.577 TRACE    lxc_conf - conf.c:lxc_ttys_shift_ids:2870 - chowned console "/dev/pts/4"
      lxc-start container-ubuntu-xenial 20171204235933.577 TRACE    lxc_start - start.c:lxc_init:649 - shifted tty ids
      lxc-start container-ubuntu-xenial 20171204235933.577 INFO     lxc_start - start.c:lxc_init:651 - container "container-ubuntu-xenial" is initialized
      lxc-start container-ubuntu-xenial 20171204235933.577 INFO     lxc_cgroup - cgroups/cgroup.c:cgroup_init:67 - cgroup driver cgroupfs initing for container-ubuntu-xenial
      lxc-start container-ubuntu-xenial 20171204235933.577 ERROR    lxc_cgfs - cgroups/cgfs.c:lxc_cgroupfs_create:909 - Could not set clone_children to 1 for cpuset hierarchy in parent cgroup.
      lxc-start container-ubuntu-xenial 20171204235933.577 ERROR    lxc_cgfs - cgroups/cgfs.c:cgroup_rmdir:209 - Permission denied - Failed to delete /sys/fs/cgroup/devices/user.slice
      lxc-start container-ubuntu-xenial 20171204235933.578 ERROR    lxc_cgfs - cgroups/cgfs.c:cgroup_rmdir:209 - Read-only file system - Failed to delete /sys/fs/cgroup/freezer/
      lxc-start container-ubuntu-xenial 20171204235933.578 ERROR    lxc_cgfs - cgroups/cgfs.c:cgroup_rmdir:209 - Permission denied - Failed to delete /sys/fs/cgroup/pids/user.slice/user-1000.slice/session-2.scope
      lxc-start container-ubuntu-xenial 20171204235933.578 ERROR    lxc_cgfs - cgroups/cgfs.c:cgroup_rmdir:209 - Read-only file system - Failed to delete /sys/fs/cgroup/perf_event/
      lxc-start container-ubuntu-xenial 20171204235933.578 ERROR    lxc_cgfs - cgroups/cgfs.c:cgroup_rmdir:209 - Read-only file system - Failed to delete /sys/fs/cgroup/blkio/
      lxc-start container-ubuntu-xenial 20171204235933.578 ERROR    lxc_cgfs - cgroups/cgfs.c:cgroup_rmdir:209 - Read-only file system - Failed to delete /sys/fs/cgroup/cpuset/
      lxc-start container-ubuntu-xenial 20171204235933.578 ERROR    lxc_cgfs - cgroups/cgfs.c:cgroup_rmdir:209 - Read-only file system - Failed to delete /sys/fs/cgroup/net_cls,net_prio/
      lxc-start container-ubuntu-xenial 20171204235933.579 ERROR    lxc_cgfs - cgroups/cgfs.c:cgroup_rmdir:209 - Read-only file system - Failed to delete /sys/fs/cgroup/hugetlb/
      lxc-start container-ubuntu-xenial 20171204235933.579 ERROR    lxc_cgfs - cgroups/cgfs.c:cgroup_rmdir:209 - Read-only file system - Failed to delete /sys/fs/cgroup/cpu,cpuacct/
      lxc-start container-ubuntu-xenial 20171204235933.579 ERROR    lxc_cgfs - cgroups/cgfs.c:cgroup_rmdir:209 - Read-only file system - Failed to delete /sys/fs/cgroup/memory/
      lxc-start container-ubuntu-xenial 20171204235933.579 ERROR    lxc_cgfs - cgroups/cgfs.c:cgroup_rmdir:209 - Permission denied - Failed to delete /sys/fs/cgroup/systemd/user.slice/user-1000.slice/session-2.scope
      lxc-start container-ubuntu-xenial 20171204235933.579 ERROR    lxc_start - start.c:lxc_spawn:1245 - Failed creating cgroups.
      lxc-start container-ubuntu-xenial 20171204235933.579 DEBUG    lxc_network - network.c:lxc_delete_network_unpriv:2306 - Cannot not guarantee safe deletion of network devices. Manual cleanup maybe needed
      lxc-start container-ubuntu-xenial 20171204235933.579 DEBUG    lxc_network - network.c:lxc_delete_network:3121 - Failed to delete network devices
      lxc-start container-ubuntu-xenial 20171204235933.579 TRACE    lxc_start - start.c:lxc_serve_state_clients:350 - Set container state to ABORTING
      lxc-start container-ubuntu-xenial 20171204235933.579 TRACE    lxc_start - start.c:lxc_serve_state_clients:353 - No state clients registered
      lxc-start container-ubuntu-xenial 20171204235933.579 ERROR    lxc_start - start.c:__lxc_start:1503 - Failed to spawn container "container-ubuntu-xenial".
      lxc-start container-ubuntu-xenial 20171204235933.579 TRACE    lxc_start - start.c:lxc_serve_state_clients:350 - Set container state to STOPPING
      lxc-start container-ubuntu-xenial 20171204235933.579 TRACE    lxc_start - start.c:lxc_serve_state_clients:353 - No state clients registered
      lxc-start container-ubuntu-xenial 20171204235933.579 TRACE    lxc_start - start.c:lxc_serve_state_clients:350 - Set container state to STOPPED
      lxc-start container-ubuntu-xenial 20171204235933.579 TRACE    lxc_start - start.c:lxc_serve_state_clients:353 - No state clients registered
      lxc-start container-ubuntu-xenial 20171205000303.833 INFO     lxc_confile - confile.c:set_config_idmaps:1575 - Read uid map: type u nsid 0 hostid 165536 range 65536
      lxc-start container-ubuntu-xenial 20171205000303.833 INFO     lxc_confile - confile.c:set_config_idmaps:1575 - Read uid map: type g nsid 0 hostid 165536 range 65536
      lxc-start container-ubuntu-xenial 20171205000303.833 TRACE    lxc_commands - commands.c:lxc_cmd:308 - Connection refused - Command "get_init_pid" failed to connect command socket
      lxc-start container-ubuntu-xenial 20171205000303.834 TRACE    lxc_commands - commands.c:lxc_cmd:308 - Connection refused - Command "get_cgroup" failed to connect command socket
      lxc-start container-ubuntu-xenial 20171205000303.834 TRACE    lxc_commands - commands.c:lxc_cmd:308 - Connection refused - Command "get_cgroup" failed to connect command socket
      lxc-start container-ubuntu-xenial 20171205000303.834 TRACE    lxc_commands - commands.c:lxc_cmd:308 - Connection refused - Command "get_cgroup" failed to connect command socket
      lxc-start container-ubuntu-xenial 20171205000303.834 TRACE    lxc_commands - commands.c:lxc_cmd:308 - Connection refused - Command "get_cgroup" failed to connect command socket
      lxc-start container-ubuntu-xenial 20171205000303.834 TRACE    lxc_commands - commands.c:lxc_cmd:308 - Connection refused - Command "get_cgroup" failed to connect command socket
      lxc-start container-ubuntu-xenial 20171205000303.834 TRACE    lxc_commands - commands.c:lxc_cmd:308 - Connection refused - Command "get_cgroup" failed to connect command socket
      lxc-start container-ubuntu-xenial 20171205000303.834 TRACE    lxc_commands - commands.c:lxc_cmd:308 - Connection refused - Command "get_cgroup" failed to connect command socket
      lxc-start container-ubuntu-xenial 20171205000303.834 TRACE    lxc_commands - commands.c:lxc_cmd:308 - Connection refused - Command "get_cgroup" failed to connect command socket
      lxc-start container-ubuntu-xenial 20171205000303.834 TRACE    lxc_commands - commands.c:lxc_cmd:308 - Connection refused - Command "get_cgroup" failed to connect command socket
      lxc-start container-ubuntu-xenial 20171205000303.834 TRACE    lxc_commands - commands.c:lxc_cmd:308 - Connection refused - Command "get_cgroup" failed to connect command socket
      lxc-start container-ubuntu-xenial 20171205000303.834 TRACE    lxc_commands - commands.c:lxc_cmd:308 - Connection refused - Command "get_cgroup" failed to connect command socket
      lxc-start container-ubuntu-xenial 20171205000303.834 TRACE    lxc_commands - commands.c:lxc_cmd:308 - Connection refused - Command "get_state" failed to connect command socket
      lxc-start container-ubuntu-xenial 20171205000303.834 TRACE    lxc_commands - commands.c:lxc_cmd_init:1323 - Creating abstract unix socket "/home/marcosps/.local/share/lxc/container-ubuntu-xenial/command"
      lxc-start container-ubuntu-xenial 20171205000303.834 TRACE    lxc_start - start.c:lxc_init_handler:563 - Unix domain socket 4 for command server is ready
      lxc-start container-ubuntu-xenial 20171205000303.834 INFO     lxc_lsm - lsm/lsm.c:lsm_init:48 - LSM security driver SELinux
      lxc-start container-ubuntu-xenial 20171205000303.834 TRACE    lxc_start - start.c:lxc_init:578 - initialized LSM
      lxc-start container-ubuntu-xenial 20171205000303.835 INFO     lxc_seccomp - seccomp.c:parse_config_v2:589 - processing: .reject_force_umount  # comment this to allow umount -f;  not recommended
      lxc-start container-ubuntu-xenial 20171205000303.835 INFO     lxc_seccomp - seccomp.c:parse_config_v2:765 - Adding native rule for reject_force_umount  # comment this to allow umount -f;  not recommended action 0(kill)
      lxc-start container-ubuntu-xenial 20171205000303.835 INFO     lxc_seccomp - seccomp.c:do_resolve_add_rule:415 - Setting Seccomp rule to reject force umounts
      lxc-start container-ubuntu-xenial 20171205000303.835 INFO     lxc_seccomp - seccomp.c:parse_config_v2:769 - Adding compat rule for reject_force_umount action 0(kill)
      lxc-start container-ubuntu-xenial 20171205000303.835 INFO     lxc_seccomp - seccomp.c:do_resolve_add_rule:415 - Setting Seccomp rule to reject force umounts
      lxc-start container-ubuntu-xenial 20171205000303.835 INFO     lxc_seccomp - seccomp.c:do_resolve_add_rule:415 - Setting Seccomp rule to reject force umounts
      lxc-start container-ubuntu-xenial 20171205000303.835 INFO     lxc_seccomp - seccomp.c:parse_config_v2:589 - processing: .[all]
      lxc-start container-ubuntu-xenial 20171205000303.835 INFO     lxc_seccomp - seccomp.c:parse_config_v2:589 - processing: .kexec_load errno 1
      lxc-start container-ubuntu-xenial 20171205000303.835 INFO     lxc_seccomp - seccomp.c:parse_config_v2:765 - Adding native rule for kexec_load errno 1 action 327681(errno)
      lxc-start container-ubuntu-xenial 20171205000303.835 INFO     lxc_seccomp - seccomp.c:parse_config_v2:769 - Adding compat rule for kexec_load action 327681(errno)
      lxc-start container-ubuntu-xenial 20171205000303.835 INFO     lxc_seccomp - seccomp.c:parse_config_v2:589 - processing: .open_by_handle_at errno 1
      lxc-start container-ubuntu-xenial 20171205000303.835 INFO     lxc_seccomp - seccomp.c:parse_config_v2:765 - Adding native rule for open_by_handle_at errno 1 action 327681(errno)
      lxc-start container-ubuntu-xenial 20171205000303.835 INFO     lxc_seccomp - seccomp.c:parse_config_v2:769 - Adding compat rule for open_by_handle_at action 327681(errno)
      lxc-start container-ubuntu-xenial 20171205000303.835 INFO     lxc_seccomp - seccomp.c:parse_config_v2:589 - processing: .init_module errno 1
      lxc-start container-ubuntu-xenial 20171205000303.835 INFO     lxc_seccomp - seccomp.c:parse_config_v2:765 - Adding native rule for init_module errno 1 action 327681(errno)
      lxc-start container-ubuntu-xenial 20171205000303.835 INFO     lxc_seccomp - seccomp.c:parse_config_v2:769 - Adding compat rule for init_module action 327681(errno)
      lxc-start container-ubuntu-xenial 20171205000303.835 INFO     lxc_seccomp - seccomp.c:parse_config_v2:589 - processing: .finit_module errno 1
      lxc-start container-ubuntu-xenial 20171205000303.835 INFO     lxc_seccomp - seccomp.c:parse_config_v2:765 - Adding native rule for finit_module errno 1 action 327681(errno)
      lxc-start container-ubuntu-xenial 20171205000303.835 INFO     lxc_seccomp - seccomp.c:parse_config_v2:769 - Adding compat rule for finit_module action 327681(errno)
      lxc-start container-ubuntu-xenial 20171205000303.835 INFO     lxc_seccomp - seccomp.c:parse_config_v2:589 - processing: .delete_module errno 1
      lxc-start container-ubuntu-xenial 20171205000303.835 INFO     lxc_seccomp - seccomp.c:parse_config_v2:765 - Adding native rule for delete_module errno 1 action 327681(errno)
      lxc-start container-ubuntu-xenial 20171205000303.835 INFO     lxc_seccomp - seccomp.c:parse_config_v2:769 - Adding compat rule for delete_module action 327681(errno)
      lxc-start container-ubuntu-xenial 20171205000303.835 INFO     lxc_seccomp - seccomp.c:parse_config_v2:779 - Merging in the compat Seccomp ctx into the main one
      lxc-start container-ubuntu-xenial 20171205000303.835 TRACE    lxc_start - start.c:lxc_init:584 - read seccomp policy
      lxc-start container-ubuntu-xenial 20171205000303.835 TRACE    lxc_start - start.c:lxc_serve_state_clients:350 - Set container state to STARTING
      lxc-start container-ubuntu-xenial 20171205000303.835 TRACE    lxc_start - start.c:lxc_serve_state_clients:353 - No state clients registered
      lxc-start container-ubuntu-xenial 20171205000303.835 TRACE    lxc_start - start.c:lxc_init:591 - set container state to "STARTING"
      lxc-start container-ubuntu-xenial 20171205000303.835 TRACE    lxc_start - start.c:lxc_init:619 - set environment variables
      lxc-start container-ubuntu-xenial 20171205000303.835 TRACE    lxc_start - start.c:lxc_init:625 - ran pre-start hooks
      lxc-start container-ubuntu-xenial 20171205000303.835 DEBUG    lxc_start - start.c:setup_signal_fd:278 - Set SIGCHLD handler with file descriptor: 5.
      lxc-start container-ubuntu-xenial 20171205000303.835 TRACE    lxc_start - start.c:lxc_init:636 - set up signal fd
      lxc-start container-ubuntu-xenial 20171205000303.836 DEBUG    console - console.c:lxc_console_peer_default:513 - using "/dev/tty" as peer tty device
      lxc-start container-ubuntu-xenial 20171205000303.836 DEBUG    console - console.c:lxc_console_signal_init:178 - Created signal fd 10
      lxc-start container-ubuntu-xenial 20171205000303.836 DEBUG    console - console.c:lxc_console_winsz:86 - Set window size to 238 columns and 51 rows
      lxc-start container-ubuntu-xenial 20171205000303.836 TRACE    lxc_start - start.c:lxc_init:643 - created console
      lxc-start container-ubuntu-xenial 20171205000303.836 DEBUG    lxc_conf - conf.c:chown_mapped_root:2792 - trying to chown "/dev/pts/4" to 1000
      lxc-start container-ubuntu-xenial 20171205000303.858 TRACE    lxc_conf - conf.c:lxc_ttys_shift_ids:2870 - chowned console "/dev/pts/4"
      lxc-start container-ubuntu-xenial 20171205000303.858 TRACE    lxc_start - start.c:lxc_init:649 - shifted tty ids
      lxc-start container-ubuntu-xenial 20171205000303.858 INFO     lxc_start - start.c:lxc_init:651 - container "container-ubuntu-xenial" is initialized
      lxc-start container-ubuntu-xenial 20171205000303.859 INFO     lxc_cgroup - cgroups/cgroup.c:cgroup_init:67 - cgroup driver cgroupfs initing for container-ubuntu-xenial
      lxc-start container-ubuntu-xenial 20171205000303.859 ERROR    lxc_cgfs - cgroups/cgfs.c:lxc_cgroupfs_create:909 - Could not set clone_children to 1 for cpuset hierarchy in parent cgroup.
      lxc-start container-ubuntu-xenial 20171205000303.859 ERROR    lxc_cgfs - cgroups/cgfs.c:cgroup_rmdir:209 - Permission denied - Failed to delete /sys/fs/cgroup/devices/user.slice
      lxc-start container-ubuntu-xenial 20171205000303.860 ERROR    lxc_cgfs - cgroups/cgfs.c:cgroup_rmdir:209 - Read-only file system - Failed to delete /sys/fs/cgroup/freezer/
      lxc-start container-ubuntu-xenial 20171205000303.860 ERROR    lxc_cgfs - cgroups/cgfs.c:cgroup_rmdir:209 - Permission denied - Failed to delete /sys/fs/cgroup/pids/user.slice/user-1000.slice/session-2.scope
      lxc-start container-ubuntu-xenial 20171205000303.860 ERROR    lxc_cgfs - cgroups/cgfs.c:cgroup_rmdir:209 - Read-only file system - Failed to delete /sys/fs/cgroup/perf_event/
      lxc-start container-ubuntu-xenial 20171205000303.860 ERROR    lxc_cgfs - cgroups/cgfs.c:cgroup_rmdir:209 - Permission denied - Failed to delete /sys/fs/cgroup/blkio//user.slice
      lxc-start container-ubuntu-xenial 20171205000303.861 ERROR    lxc_cgfs - cgroups/cgfs.c:cgroup_rmdir:209 - Permission denied - Failed to delete /sys/fs/cgroup/blkio//init.scope
      lxc-start container-ubuntu-xenial 20171205000303.861 ERROR    lxc_cgfs - cgroups/cgfs.c:cgroup_rmdir:209 - Permission denied - Failed to delete /sys/fs/cgroup/blkio//system.slice/irqbalance.service
      lxc-start container-ubuntu-xenial 20171205000303.861 ERROR    lxc_cgfs - cgroups/cgfs.c:cgroup_rmdir:209 - Permission denied - Failed to delete /sys/fs/cgroup/blkio//system.slice/lightdm.service
      lxc-start container-ubuntu-xenial 20171205000303.862 ERROR    lxc_cgfs - cgroups/cgfs.c:cgroup_rmdir:209 - Permission denied - Failed to delete /sys/fs/cgroup/blkio//system.slice/home.mount
      lxc-start container-ubuntu-xenial 20171205000303.862 ERROR    lxc_cgfs - cgroups/cgfs.c:cgroup_rmdir:209 - Permission denied - Failed to delete /sys/fs/cgroup/blkio//system.slice/var-lib-nfs-rpc_pipefs.mount
      lxc-start container-ubuntu-xenial 20171205000303.862 ERROR    lxc_cgfs - cgroups/cgfs.c:cgroup_rmdir:209 - Permission denied - Failed to delete /sys/fs/cgroup/blkio//system.slice/sys-kernel-debug.mount
      lxc-start container-ubuntu-xenial 20171205000303.863 ERROR    lxc_cgfs - cgroups/cgfs.c:cgroup_rmdir:209 - Permission denied - Failed to delete /sys/fs/cgroup/blkio//system.slice/boot.mount
      lxc-start container-ubuntu-xenial 20171205000303.863 ERROR    lxc_cgfs - cgroups/cgfs.c:cgroup_rmdir:209 - Permission denied - Failed to delete /sys/fs/cgroup/blkio//system.slice/tmp.mount
      lxc-start container-ubuntu-xenial 20171205000303.863 ERROR    lxc_cgfs - cgroups/cgfs.c:cgroup_rmdir:209 - Permission denied - Failed to delete /sys/fs/cgroup/blkio//system.slice/alsa-state.service
      lxc-start container-ubuntu-xenial 20171205000303.863 ERROR    lxc_cgfs - cgroups/cgfs.c:cgroup_rmdir:209 - Permission denied - Failed to delete /sys/fs/cgroup/blkio//system.slice/firewalld.service
      lxc-start container-ubuntu-xenial 20171205000303.864 ERROR    lxc_cgfs - cgroups/cgfs.c:cgroup_rmdir:209 - Permission denied - Failed to delete /sys/fs/cgroup/blkio//system.slice/systemd-random-seed.service
      lxc-start container-ubuntu-xenial 20171205000303.864 ERROR    lxc_cgfs - cgroups/cgfs.c:cgroup_rmdir:209 - Permission denied - Failed to delete /sys/fs/cgroup/blkio//system.slice/run-user-1000-doc.mount
      lxc-start container-ubuntu-xenial 20171205000303.864 ERROR    lxc_cgfs - cgroups/cgfs.c:cgroup_rmdir:209 - Permission denied - Failed to delete /sys/fs/cgroup/blkio//system.slice/systemd-journal-flush.service
      lxc-start container-ubuntu-xenial 20171205000303.865 ERROR    lxc_cgfs - cgroups/cgfs.c:cgroup_rmdir:209 - Permission denied - Failed to delete /sys/fs/cgroup/blkio//system.slice/fedora-readonly.service
      lxc-start container-ubuntu-xenial 20171205000303.865 ERROR    lxc_cgfs - cgroups/cgfs.c:cgroup_rmdir:209 - Permission denied - Failed to delete /sys/fs/cgroup/blkio//system.slice/systemd-user-sessions.service
      lxc-start container-ubuntu-xenial 20171205000303.865 ERROR    lxc_cgfs - cgroups/cgfs.c:cgroup_rmdir:209 - Permission denied - Failed to delete /sys/fs/cgroup/blkio//system.slice/sys-kernel-config.mount
      lxc-start container-ubuntu-xenial 20171205000303.866 ERROR    lxc_cgfs - cgroups/cgfs.c:cgroup_rmdir:209 - Permission denied - Failed to delete /sys/fs/cgroup/blkio//system.slice/dev-hugepages.mount
      lxc-start container-ubuntu-xenial 20171205000303.866 ERROR    lxc_cgfs - cgroups/cgfs.c:cgroup_rmdir:209 - Permission denied - Failed to delete /sys/fs/cgroup/blkio//system.slice/lvm2-monitor.service
      lxc-start container-ubuntu-xenial 20171205000303.866 ERROR    lxc_cgfs - cgroups/cgfs.c:cgroup_rmdir:209 - Permission denied - Failed to delete /sys/fs/cgroup/blkio//system.slice/lxc-net.service
      lxc-start container-ubuntu-xenial 20171205000303.867 ERROR    lxc_cgfs - cgroups/cgfs.c:cgroup_rmdir:209 - Permission denied - Failed to delete /sys/fs/cgroup/blkio//system.slice/upower.service
      lxc-start container-ubuntu-xenial 20171205000303.867 ERROR    lxc_cgfs - cgroups/cgfs.c:cgroup_rmdir:209 - Permission denied - Failed to delete /sys/fs/cgroup/blkio//system.slice/sys-fs-fuse-connections.mount
      lxc-start container-ubuntu-xenial 20171205000303.867 ERROR    lxc_cgfs - cgroups/cgfs.c:cgroup_rmdir:209 - Permission denied - Failed to delete /sys/fs/cgroup/blkio//system.slice/systemd-udev-settle.service
      lxc-start container-ubuntu-xenial 20171205000303.868 ERROR    lxc_cgfs - cgroups/cgfs.c:cgroup_rmdir:209 - Permission denied - Failed to delete /sys/fs/cgroup/blkio//system.slice/gssproxy.service
      lxc-start container-ubuntu-xenial 20171205000303.869 ERROR    lxc_cgfs - cgroups/cgfs.c:cgroup_rmdir:209 - Permission denied - Failed to delete /sys/fs/cgroup/blkio//system.slice/mcelog.service
      lxc-start container-ubuntu-xenial 20171205000303.869 ERROR    lxc_cgfs - cgroups/cgfs.c:cgroup_rmdir:209 - Permission denied - Failed to delete /sys/fs/cgroup/blkio//system.slice/NetworkManager.service
      lxc-start container-ubuntu-xenial 20171205000303.870 ERROR    lxc_cgfs - cgroups/cgfs.c:cgroup_rmdir:209 - Permission denied - Failed to delete /sys/fs/cgroup/blkio//system.slice/dbus.service
      lxc-start container-ubuntu-xenial 20171205000303.870 ERROR    lxc_cgfs - cgroups/cgfs.c:cgroup_rmdir:209 - Permission denied - Failed to delete /sys/fs/cgroup/blkio//system.slice/fedora-import-state.service
      lxc-start container-ubuntu-xenial 20171205000303.871 ERROR    lxc_cgfs - cgroups/cgfs.c:cgroup_rmdir:209 - Permission denied - Failed to delete /sys/fs/cgroup/blkio//system.slice/accounts-daemon.service
      lxc-start container-ubuntu-xenial 20171205000303.871 ERROR    lxc_cgfs - cgroups/cgfs.c:cgroup_rmdir:209 - Permission denied - Failed to delete /sys/fs/cgroup/blkio//system.slice/dev-mqueue.mount
      lxc-start container-ubuntu-xenial 20171205000303.872 ERROR    lxc_cgfs - cgroups/cgfs.c:cgroup_rmdir:209 - Permission denied - Failed to delete /sys/fs/cgroup/blkio//system.slice/run-user-1000.mount
      lxc-start container-ubuntu-xenial 20171205000303.872 ERROR    lxc_cgfs - cgroups/cgfs.c:cgroup_rmdir:209 - Permission denied - Failed to delete /sys/fs/cgroup/blkio//system.slice/udisks2.service
      lxc-start container-ubuntu-xenial 20171205000303.873 ERROR    lxc_cgfs - cgroups/cgfs.c:cgroup_rmdir:209 - Permission denied - Failed to delete /sys/fs/cgroup/blkio//system.slice/abrt-xorg.service
      lxc-start container-ubuntu-xenial 20171205000303.873 ERROR    lxc_cgfs - cgroups/cgfs.c:cgroup_rmdir:209 - Permission denied - Failed to delete /sys/fs/cgroup/blkio//system.slice/iscsi-shutdown.service
      lxc-start container-ubuntu-xenial 20171205000303.874 ERROR    lxc_cgfs - cgroups/cgfs.c:cgroup_rmdir:209 - Permission denied - Failed to delete /sys/fs/cgroup/blkio//system.slice/systemd-tmpfiles-setup.service
      lxc-start container-ubuntu-xenial 20171205000303.874 ERROR    lxc_cgfs - cgroups/cgfs.c:cgroup_rmdir:209 - Permission denied - Failed to delete /sys/fs/cgroup/blkio//system.slice/avahi-daemon.service
      lxc-start container-ubuntu-xenial 20171205000303.875 ERROR    lxc_cgfs - cgroups/cgfs.c:cgroup_rmdir:209 - Permission denied - Failed to delete /sys/fs/cgroup/blkio//system.slice/netcf-transaction.service
      lxc-start container-ubuntu-xenial 20171205000303.875 ERROR    lxc_cgfs - cgroups/cgfs.c:cgroup_rmdir:209 - Permission denied - Failed to delete /sys/fs/cgroup/blkio//system.slice/livesys.service
      lxc-start container-ubuntu-xenial 20171205000303.876 ERROR    lxc_cgfs - cgroups/cgfs.c:cgroup_rmdir:209 - Permission denied - Failed to delete /sys/fs/cgroup/blkio//system.slice/abrt-oops.service
      lxc-start container-ubuntu-xenial 20171205000303.876 ERROR    lxc_cgfs - cgroups/cgfs.c:cgroup_rmdir:209 - Permission denied - Failed to delete /sys/fs/cgroup/blkio//system.slice/systemd-remount-fs.service
      lxc-start container-ubuntu-xenial 20171205000303.877 ERROR    lxc_cgfs - cgroups/cgfs.c:cgroup_rmdir:209 - Permission denied - Failed to delete /sys/fs/cgroup/blkio//system.slice/system-getty.slice
      lxc-start container-ubuntu-xenial 20171205000303.877 ERROR    lxc_cgfs - cgroups/cgfs.c:cgroup_rmdir:209 - Permission denied - Failed to delete /sys/fs/cgroup/blkio//system.slice/dev-mapper-fedora\x2dswap.swap
      lxc-start container-ubuntu-xenial 20171205000303.878 ERROR    lxc_cgfs - cgroups/cgfs.c:cgroup_rmdir:209 - Permission denied - Failed to delete /sys/fs/cgroup/blkio//system.slice/dev-disk-by\x2did-dm\x2dname\x2dfedora\x2dswap.swap
      lxc-start container-ubuntu-xenial 20171205000303.879 ERROR    lxc_cgfs - cgroups/cgfs.c:cgroup_rmdir:209 - Permission denied - Failed to delete /sys/fs/cgroup/blkio//system.slice/systemd-update-utmp.service
      lxc-start container-ubuntu-xenial 20171205000303.879 ERROR    lxc_cgfs - cgroups/cgfs.c:cgroup_rmdir:209 - Permission denied - Failed to delete /sys/fs/cgroup/blkio//system.slice/system-systemd\x2dfsck.slice
      lxc-start container-ubuntu-xenial 20171205000303.880 ERROR    lxc_cgfs - cgroups/cgfs.c:cgroup_rmdir:209 - Permission denied - Failed to delete /sys/fs/cgroup/blkio//system.slice/smartd.service
      lxc-start container-ubuntu-xenial 20171205000303.880 ERROR    lxc_cgfs - cgroups/cgfs.c:cgroup_rmdir:209 - Permission denied - Failed to delete /sys/fs/cgroup/blkio//system.slice/abrtd.service
      lxc-start container-ubuntu-xenial 20171205000303.881 ERROR    lxc_cgfs - cgroups/cgfs.c:cgroup_rmdir:209 - Permission denied - Failed to delete /sys/fs/cgroup/blkio//system.slice/dev-disk-by\x2did-dm\x2duuid\x2dLVM\x2d0MC961VMuutSWV7QwKHOh1iipioWRobcOE3c18OP4m6YT6jUvy1dqwO4odESWnVv.swap
      lxc-start container-ubuntu-xenial 20171205000303.881 ERROR    lxc_cgfs - cgroups/cgfs.c:cgroup_rmdir:209 - Permission denied - Failed to delete /sys/fs/cgroup/blkio//system.slice/NetworkManager-wait-online.service
      lxc-start container-ubuntu-xenial 20171205000303.882 ERROR    lxc_cgfs - cgroups/cgfs.c:cgroup_rmdir:209 - Permission denied - Failed to delete /sys/fs/cgroup/blkio//system.slice/abrt-journal-core.service
      lxc-start container-ubuntu-xenial 20171205000303.882 ERROR    lxc_cgfs - cgroups/cgfs.c:cgroup_rmdir:209 - Permission denied - Failed to delete /sys/fs/cgroup/blkio//system.slice/ModemManager.service
      lxc-start container-ubuntu-xenial 20171205000303.883 ERROR    lxc_cgfs - cgroups/cgfs.c:cgroup_rmdir:209 - Permission denied - Failed to delete /sys/fs/cgroup/blkio//system.slice/systemd-logind.service
      lxc-start container-ubuntu-xenial 20171205000303.883 ERROR    lxc_cgfs - cgroups/cgfs.c:cgroup_rmdir:209 - Permission denied - Failed to delete /sys/fs/cgroup/blkio//system.slice/rtkit-daemon.service
      lxc-start container-ubuntu-xenial 20171205000303.884 ERROR    lxc_cgfs - cgroups/cgfs.c:cgroup_rmdir:209 - Permission denied - Failed to delete /sys/fs/cgroup/blkio//system.slice/sssd.service
      lxc-start container-ubuntu-xenial 20171205000303.884 ERROR    lxc_cgfs - cgroups/cgfs.c:cgroup_rmdir:209 - Permission denied - Failed to delete /sys/fs/cgroup/blkio//system.slice/dev-disk-by\x2duuid-fa829cce\x2d4360\x2d4f64\x2da9d6\x2d4396f7ec8b04.swap
      lxc-start container-ubuntu-xenial 20171205000303.885 ERROR    lxc_cgfs - cgroups/cgfs.c:cgroup_rmdir:209 - Permission denied - Failed to delete /sys/fs/cgroup/blkio//system.slice/libvirtd.service
      lxc-start container-ubuntu-xenial 20171205000303.885 ERROR    lxc_cgfs - cgroups/cgfs.c:cgroup_rmdir:209 - Permission denied - Failed to delete /sys/fs/cgroup/blkio//system.slice/crond.service
      lxc-start container-ubuntu-xenial 20171205000303.886 ERROR    lxc_cgfs - cgroups/cgfs.c:cgroup_rmdir:209 - Permission denied - Failed to delete /sys/fs/cgroup/blkio//system.slice/livesys-late.service
      lxc-start container-ubuntu-xenial 20171205000303.886 ERROR    lxc_cgfs - cgroups/cgfs.c:cgroup_rmdir:209 - Permission denied - Failed to delete /sys/fs/cgroup/blkio//system.slice/polkit.service
      lxc-start container-ubuntu-xenial 20171205000303.887 ERROR    lxc_cgfs - cgroups/cgfs.c:cgroup_rmdir:209 - Permission denied - Failed to delete /sys/fs/cgroup/blkio//system.slice/rpc-statd-notify.service
      lxc-start container-ubuntu-xenial 20171205000303.887 ERROR    lxc_cgfs - cgroups/cgfs.c:cgroup_rmdir:209 - Permission denied - Failed to delete /sys/fs/cgroup/blkio//system.slice/systemd-fsck-root.service
      lxc-start container-ubuntu-xenial 20171205000303.888 ERROR    lxc_cgfs - cgroups/cgfs.c:cgroup_rmdir:209 - Permission denied - Failed to delete /sys/fs/cgroup/blkio//system.slice/systemd-udevd.service
      lxc-start container-ubuntu-xenial 20171205000303.888 ERROR    lxc_cgfs - cgroups/cgfs.c:cgroup_rmdir:209 - Permission denied - Failed to delete /sys/fs/cgroup/blkio//system.slice/rsyslog.service
      lxc-start container-ubuntu-xenial 20171205000303.895 ERROR    lxc_cgfs - cgroups/cgfs.c:cgroup_rmdir:209 - Permission denied - Failed to delete /sys/fs/cgroup/blkio//system.slice/system-lvm2\x2dpvscan.slice
      lxc-start container-ubuntu-xenial 20171205000303.896 ERROR    lxc_cgfs - cgroups/cgfs.c:cgroup_rmdir:209 - Permission denied - Failed to delete /sys/fs/cgroup/blkio//system.slice/fprintd.service
      lxc-start container-ubuntu-xenial 20171205000303.896 ERROR    lxc_cgfs - cgroups/cgfs.c:cgroup_rmdir:209 - Permission denied - Failed to delete /sys/fs/cgroup/blkio//system.slice/systemd-tmpfiles-setup-dev.service
      lxc-start container-ubuntu-xenial 20171205000303.896 ERROR    lxc_cgfs - cgroups/cgfs.c:cgroup_rmdir:209 - Permission denied - Failed to delete /sys/fs/cgroup/blkio//system.slice/systemd-journald.service
      lxc-start container-ubuntu-xenial 20171205000303.897 ERROR    lxc_cgfs - cgroups/cgfs.c:cgroup_rmdir:209 - Permission denied - Failed to delete /sys/fs/cgroup/blkio//system.slice/auditd.service
      lxc-start container-ubuntu-xenial 20171205000303.897 ERROR    lxc_cgfs - cgroups/cgfs.c:cgroup_rmdir:209 - Permission denied - Failed to delete /sys/fs/cgroup/blkio//system.slice/kmod-static-nodes.service
      lxc-start container-ubuntu-xenial 20171205000303.897 ERROR    lxc_cgfs - cgroups/cgfs.c:cgroup_rmdir:209 - Permission denied - Failed to delete /sys/fs/cgroup/blkio//system.slice/dracut-shutdown.service
      lxc-start container-ubuntu-xenial 20171205000303.898 ERROR    lxc_cgfs - cgroups/cgfs.c:cgroup_rmdir:209 - Permission denied - Failed to delete /sys/fs/cgroup/blkio//system.slice/systemd-sysctl.service
      lxc-start container-ubuntu-xenial 20171205000303.898 ERROR    lxc_cgfs - cgroups/cgfs.c:cgroup_rmdir:209 - Permission denied - Failed to delete /sys/fs/cgroup/blkio//system.slice/-.mount
      lxc-start container-ubuntu-xenial 20171205000303.899 ERROR    lxc_cgfs - cgroups/cgfs.c:cgroup_rmdir:209 - Permission denied - Failed to delete /sys/fs/cgroup/blkio//system.slice/dev-fedora-swap.swap
      lxc-start container-ubuntu-xenial 20171205000303.899 ERROR    lxc_cgfs - cgroups/cgfs.c:cgroup_rmdir:209 - Permission denied - Failed to delete /sys/fs/cgroup/blkio//system.slice/dev-dm\x2d1.swap
      lxc-start container-ubuntu-xenial 20171205000303.899 ERROR    lxc_cgfs - cgroups/cgfs.c:cgroup_rmdir:209 - Permission denied - Failed to delete /sys/fs/cgroup/blkio//system.slice/systemd-udev-trigger.service
      lxc-start container-ubuntu-xenial 20171205000303.900 ERROR    lxc_cgfs - cgroups/cgfs.c:cgroup_rmdir:209 - Permission denied - Failed to delete /sys/fs/cgroup/blkio//system.slice/chronyd.service
      lxc-start container-ubuntu-xenial 20171205000303.902 ERROR    lxc_cgfs - cgroups/cgfs.c:cgroup_rmdir:209 - Permission denied - Failed to delete /sys/fs/cgroup/blkio//system.slice
      lxc-start container-ubuntu-xenial 20171205000303.902 ERROR    lxc_cgfs - cgroups/cgfs.c:cgroup_rmdir:209 - Read-only file system - Failed to delete /sys/fs/cgroup/blkio/
      lxc-start container-ubuntu-xenial 20171205000303.902 ERROR    lxc_cgfs - cgroups/cgfs.c:cgroup_rmdir:209 - Read-only file system - Failed to delete /sys/fs/cgroup/cpuset/
      lxc-start container-ubuntu-xenial 20171205000303.903 ERROR    lxc_cgfs - cgroups/cgfs.c:cgroup_rmdir:209 - Read-only file system - Failed to delete /sys/fs/cgroup/net_cls,net_prio/
      lxc-start container-ubuntu-xenial 20171205000303.903 ERROR    lxc_cgfs - cgroups/cgfs.c:cgroup_rmdir:209 - Read-only file system - Failed to delete /sys/fs/cgroup/hugetlb/
      lxc-start container-ubuntu-xenial 20171205000303.903 ERROR    lxc_cgfs - cgroups/cgfs.c:cgroup_rmdir:209 - Permission denied - Failed to delete /sys/fs/cgroup/cpu,cpuacct//user.slice
      lxc-start container-ubuntu-xenial 20171205000303.903 ERROR    lxc_cgfs - cgroups/cgfs.c:cgroup_rmdir:209 - Permission denied - Failed to delete /sys/fs/cgroup/cpu,cpuacct//init.scope
      lxc-start container-ubuntu-xenial 20171205000303.903 ERROR    lxc_cgfs - cgroups/cgfs.c:cgroup_rmdir:209 - Permission denied - Failed to delete /sys/fs/cgroup/cpu,cpuacct//system.slice/irqbalance.service
      lxc-start container-ubuntu-xenial 20171205000303.904 ERROR    lxc_cgfs - cgroups/cgfs.c:cgroup_rmdir:209 - Permission denied - Failed to delete /sys/fs/cgroup/cpu,cpuacct//system.slice/lightdm.service
      lxc-start container-ubuntu-xenial 20171205000303.904 ERROR    lxc_cgfs - cgroups/cgfs.c:cgroup_rmdir:209 - Permission denied - Failed to delete /sys/fs/cgroup/cpu,cpuacct//system.slice/home.mount
      lxc-start container-ubuntu-xenial 20171205000303.904 ERROR    lxc_cgfs - cgroups/cgfs.c:cgroup_rmdir:209 - Permission denied - Failed to delete /sys/fs/cgroup/cpu,cpuacct//system.slice/var-lib-nfs-rpc_pipefs.mount
      lxc-start container-ubuntu-xenial 20171205000303.904 ERROR    lxc_cgfs - cgroups/cgfs.c:cgroup_rmdir:209 - Permission denied - Failed to delete /sys/fs/cgroup/cpu,cpuacct//system.slice/sys-kernel-debug.mount
      lxc-start container-ubuntu-xenial 20171205000303.904 ERROR    lxc_cgfs - cgroups/cgfs.c:cgroup_rmdir:209 - Permission denied - Failed to delete /sys/fs/cgroup/cpu,cpuacct//system.slice/boot.mount
      lxc-start container-ubuntu-xenial 20171205000303.905 ERROR    lxc_cgfs - cgroups/cgfs.c:cgroup_rmdir:209 - Permission denied - Failed to delete /sys/fs/cgroup/cpu,cpuacct//system.slice/tmp.mount
      lxc-start container-ubuntu-xenial 20171205000303.905 ERROR    lxc_cgfs - cgroups/cgfs.c:cgroup_rmdir:209 - Permission denied - Failed to delete /sys/fs/cgroup/cpu,cpuacct//system.slice/alsa-state.service
      lxc-start container-ubuntu-xenial 20171205000303.905 ERROR    lxc_cgfs - cgroups/cgfs.c:cgroup_rmdir:209 - Permission denied - Failed to delete /sys/fs/cgroup/cpu,cpuacct//system.slice/firewalld.service
      lxc-start container-ubuntu-xenial 20171205000303.905 ERROR    lxc_cgfs - cgroups/cgfs.c:cgroup_rmdir:209 - Permission denied - Failed to delete /sys/fs/cgroup/cpu,cpuacct//system.slice/systemd-random-seed.service
      lxc-start container-ubuntu-xenial 20171205000303.905 ERROR    lxc_cgfs - cgroups/cgfs.c:cgroup_rmdir:209 - Permission denied - Failed to delete /sys/fs/cgroup/cpu,cpuacct//system.slice/run-user-1000-doc.mount
      lxc-start container-ubuntu-xenial 20171205000303.906 ERROR    lxc_cgfs - cgroups/cgfs.c:cgroup_rmdir:209 - Permission denied - Failed to delete /sys/fs/cgroup/cpu,cpuacct//system.slice/systemd-journal-flush.service
      lxc-start container-ubuntu-xenial 20171205000303.906 ERROR    lxc_cgfs - cgroups/cgfs.c:cgroup_rmdir:209 - Permission denied - Failed to delete /sys/fs/cgroup/cpu,cpuacct//system.slice/fedora-readonly.service
      lxc-start container-ubuntu-xenial 20171205000303.906 ERROR    lxc_cgfs - cgroups/cgfs.c:cgroup_rmdir:209 - Permission denied - Failed to delete /sys/fs/cgroup/cpu,cpuacct//system.slice/systemd-user-sessions.service
      lxc-start container-ubuntu-xenial 20171205000303.906 ERROR    lxc_cgfs - cgroups/cgfs.c:cgroup_rmdir:209 - Permission denied - Failed to delete /sys/fs/cgroup/cpu,cpuacct//system.slice/sys-kernel-config.mount
      lxc-start container-ubuntu-xenial 20171205000303.906 ERROR    lxc_cgfs - cgroups/cgfs.c:cgroup_rmdir:209 - Permission denied - Failed to delete /sys/fs/cgroup/cpu,cpuacct//system.slice/dev-hugepages.mount
      lxc-start container-ubuntu-xenial 20171205000303.907 ERROR    lxc_cgfs - cgroups/cgfs.c:cgroup_rmdir:209 - Permission denied - Failed to delete /sys/fs/cgroup/cpu,cpuacct//system.slice/lvm2-monitor.service
      lxc-start container-ubuntu-xenial 20171205000303.907 ERROR    lxc_cgfs - cgroups/cgfs.c:cgroup_rmdir:209 - Permission denied - Failed to delete /sys/fs/cgroup/cpu,cpuacct//system.slice/lxc-net.service
      lxc-start container-ubuntu-xenial 20171205000303.907 ERROR    lxc_cgfs - cgroups/cgfs.c:cgroup_rmdir:209 - Permission denied - Failed to delete /sys/fs/cgroup/cpu,cpuacct//system.slice/upower.service
      lxc-start container-ubuntu-xenial 20171205000303.907 ERROR    lxc_cgfs - cgroups/cgfs.c:cgroup_rmdir:209 - Permission denied - Failed to delete /sys/fs/cgroup/cpu,cpuacct//system.slice/sys-fs-fuse-connections.mount
      lxc-start container-ubuntu-xenial 20171205000303.909 ERROR    lxc_cgfs - cgroups/cgfs.c:cgroup_rmdir:209 - Permission denied - Failed to delete /sys/fs/cgroup/cpu,cpuacct//system.slice/systemd-udev-settle.service
      lxc-start container-ubuntu-xenial 20171205000303.909 ERROR    lxc_cgfs - cgroups/cgfs.c:cgroup_rmdir:209 - Permission denied - Failed to delete /sys/fs/cgroup/cpu,cpuacct//system.slice/gssproxy.service
      lxc-start container-ubuntu-xenial 20171205000303.909 ERROR    lxc_cgfs - cgroups/cgfs.c:cgroup_rmdir:209 - Permission denied - Failed to delete /sys/fs/cgroup/cpu,cpuacct//system.slice/mcelog.service
      lxc-start container-ubuntu-xenial 20171205000303.909 ERROR    lxc_cgfs - cgroups/cgfs.c:cgroup_rmdir:209 - Permission denied - Failed to delete /sys/fs/cgroup/cpu,cpuacct//system.slice/NetworkManager.service
      lxc-start container-ubuntu-xenial 20171205000303.909 ERROR    lxc_cgfs - cgroups/cgfs.c:cgroup_rmdir:209 - Permission denied - Failed to delete /sys/fs/cgroup/cpu,cpuacct//system.slice/dbus.service
      lxc-start container-ubuntu-xenial 20171205000303.910 ERROR    lxc_cgfs - cgroups/cgfs.c:cgroup_rmdir:209 - Permission denied - Failed to delete /sys/fs/cgroup/cpu,cpuacct//system.slice/fedora-import-state.service
      lxc-start container-ubuntu-xenial 20171205000303.910 ERROR    lxc_cgfs - cgroups/cgfs.c:cgroup_rmdir:209 - Permission denied - Failed to delete /sys/fs/cgroup/cpu,cpuacct//system.slice/accounts-daemon.service
      lxc-start container-ubuntu-xenial 20171205000303.910 ERROR    lxc_cgfs - cgroups/cgfs.c:cgroup_rmdir:209 - Permission denied - Failed to delete /sys/fs/cgroup/cpu,cpuacct//system.slice/dev-mqueue.mount
      lxc-start container-ubuntu-xenial 20171205000303.910 ERROR    lxc_cgfs - cgroups/cgfs.c:cgroup_rmdir:209 - Permission denied - Failed to delete /sys/fs/cgroup/cpu,cpuacct//system.slice/run-user-1000.mount
      lxc-start container-ubuntu-xenial 20171205000303.910 ERROR    lxc_cgfs - cgroups/cgfs.c:cgroup_rmdir:209 - Permission denied - Failed to delete /sys/fs/cgroup/cpu,cpuacct//system.slice/udisks2.service
      lxc-start container-ubuntu-xenial 20171205000303.910 ERROR    lxc_cgfs - cgroups/cgfs.c:cgroup_rmdir:209 - Permission denied - Failed to delete /sys/fs/cgroup/cpu,cpuacct//system.slice/abrt-xorg.service
      lxc-start container-ubuntu-xenial 20171205000303.911 ERROR    lxc_cgfs - cgroups/cgfs.c:cgroup_rmdir:209 - Permission denied - Failed to delete /sys/fs/cgroup/cpu,cpuacct//system.slice/iscsi-shutdown.service
      lxc-start container-ubuntu-xenial 20171205000303.911 ERROR    lxc_cgfs - cgroups/cgfs.c:cgroup_rmdir:209 - Permission denied - Failed to delete /sys/fs/cgroup/cpu,cpuacct//system.slice/systemd-tmpfiles-setup.service
      lxc-start container-ubuntu-xenial 20171205000303.911 ERROR    lxc_cgfs - cgroups/cgfs.c:cgroup_rmdir:209 - Permission denied - Failed to delete /sys/fs/cgroup/cpu,cpuacct//system.slice/avahi-daemon.service
      lxc-start container-ubuntu-xenial 20171205000303.911 ERROR    lxc_cgfs - cgroups/cgfs.c:cgroup_rmdir:209 - Permission denied - Failed to delete /sys/fs/cgroup/cpu,cpuacct//system.slice/netcf-transaction.service
      lxc-start container-ubuntu-xenial 20171205000303.911 ERROR    lxc_cgfs - cgroups/cgfs.c:cgroup_rmdir:209 - Permission denied - Failed to delete /sys/fs/cgroup/cpu,cpuacct//system.slice/livesys.service
      lxc-start container-ubuntu-xenial 20171205000303.911 ERROR    lxc_cgfs - cgroups/cgfs.c:cgroup_rmdir:209 - Permission denied - Failed to delete /sys/fs/cgroup/cpu,cpuacct//system.slice/abrt-oops.service
      lxc-start container-ubuntu-xenial 20171205000303.912 ERROR    lxc_cgfs - cgroups/cgfs.c:cgroup_rmdir:209 - Permission denied - Failed to delete /sys/fs/cgroup/cpu,cpuacct//system.slice/systemd-remount-fs.service
      lxc-start container-ubuntu-xenial 20171205000303.912 ERROR    lxc_cgfs - cgroups/cgfs.c:cgroup_rmdir:209 - Permission denied - Failed to delete /sys/fs/cgroup/cpu,cpuacct//system.slice/system-getty.slice
      lxc-start container-ubuntu-xenial 20171205000303.912 ERROR    lxc_cgfs - cgroups/cgfs.c:cgroup_rmdir:209 - Permission denied - Failed to delete /sys/fs/cgroup/cpu,cpuacct//system.slice/dev-mapper-fedora\x2dswap.swap
      lxc-start container-ubuntu-xenial 20171205000303.912 ERROR    lxc_cgfs - cgroups/cgfs.c:cgroup_rmdir:209 - Permission denied - Failed to delete /sys/fs/cgroup/cpu,cpuacct//system.slice/dev-disk-by\x2did-dm\x2dname\x2dfedora\x2dswap.swap
      lxc-start container-ubuntu-xenial 20171205000303.912 ERROR    lxc_cgfs - cgroups/cgfs.c:cgroup_rmdir:209 - Permission denied - Failed to delete /sys/fs/cgroup/cpu,cpuacct//system.slice/systemd-update-utmp.service
      lxc-start container-ubuntu-xenial 20171205000303.913 ERROR    lxc_cgfs - cgroups/cgfs.c:cgroup_rmdir:209 - Permission denied - Failed to delete /sys/fs/cgroup/cpu,cpuacct//system.slice/system-systemd\x2dfsck.slice
      lxc-start container-ubuntu-xenial 20171205000303.913 ERROR    lxc_cgfs - cgroups/cgfs.c:cgroup_rmdir:209 - Permission denied - Failed to delete /sys/fs/cgroup/cpu,cpuacct//system.slice/smartd.service
      lxc-start container-ubuntu-xenial 20171205000303.913 ERROR    lxc_cgfs - cgroups/cgfs.c:cgroup_rmdir:209 - Permission denied - Failed to delete /sys/fs/cgroup/cpu,cpuacct//system.slice/abrtd.service
      lxc-start container-ubuntu-xenial 20171205000303.913 ERROR    lxc_cgfs - cgroups/cgfs.c:cgroup_rmdir:209 - Permission denied - Failed to delete /sys/fs/cgroup/cpu,cpuacct//system.slice/dev-disk-by\x2did-dm\x2duuid\x2dLVM\x2d0MC961VMuutSWV7QwKHOh1iipioWRobcOE3c18OP4m6YT6jUvy1dqwO4odESWnVv.swap
      lxc-start container-ubuntu-xenial 20171205000303.913 ERROR    lxc_cgfs - cgroups/cgfs.c:cgroup_rmdir:209 - Permission denied - Failed to delete /sys/fs/cgroup/cpu,cpuacct//system.slice/NetworkManager-wait-online.service
      lxc-start container-ubuntu-xenial 20171205000303.913 ERROR    lxc_cgfs - cgroups/cgfs.c:cgroup_rmdir:209 - Permission denied - Failed to delete /sys/fs/cgroup/cpu,cpuacct//system.slice/abrt-journal-core.service
      lxc-start container-ubuntu-xenial 20171205000303.914 ERROR    lxc_cgfs - cgroups/cgfs.c:cgroup_rmdir:209 - Permission denied - Failed to delete /sys/fs/cgroup/cpu,cpuacct//system.slice/ModemManager.service
      lxc-start container-ubuntu-xenial 20171205000303.914 ERROR    lxc_cgfs - cgroups/cgfs.c:cgroup_rmdir:209 - Permission denied - Failed to delete /sys/fs/cgroup/cpu,cpuacct//system.slice/systemd-logind.service
      lxc-start container-ubuntu-xenial 20171205000303.914 ERROR    lxc_cgfs - cgroups/cgfs.c:cgroup_rmdir:209 - Permission denied - Failed to delete /sys/fs/cgroup/cpu,cpuacct//system.slice/rtkit-daemon.service
      lxc-start container-ubuntu-xenial 20171205000303.914 ERROR    lxc_cgfs - cgroups/cgfs.c:cgroup_rmdir:209 - Permission denied - Failed to delete /sys/fs/cgroup/cpu,cpuacct//system.slice/sssd.service
      lxc-start container-ubuntu-xenial 20171205000303.914 ERROR    lxc_cgfs - cgroups/cgfs.c:cgroup_rmdir:209 - Permission denied - Failed to delete /sys/fs/cgroup/cpu,cpuacct//system.slice/dev-disk-by\x2duuid-fa829cce\x2d4360\x2d4f64\x2da9d6\x2d4396f7ec8b04.swap
      lxc-start container-ubuntu-xenial 20171205000303.915 ERROR    lxc_cgfs - cgroups/cgfs.c:cgroup_rmdir:209 - Permission denied - Failed to delete /sys/fs/cgroup/cpu,cpuacct//system.slice/libvirtd.service
      lxc-start container-ubuntu-xenial 20171205000303.915 ERROR    lxc_cgfs - cgroups/cgfs.c:cgroup_rmdir:209 - Permission denied - Failed to delete /sys/fs/cgroup/cpu,cpuacct//system.slice/crond.service
      lxc-start container-ubuntu-xenial 20171205000303.916 ERROR    lxc_cgfs - cgroups/cgfs.c:cgroup_rmdir:209 - Permission denied - Failed to delete /sys/fs/cgroup/cpu,cpuacct//system.slice/livesys-late.service
      lxc-start container-ubuntu-xenial 20171205000303.917 ERROR    lxc_cgfs - cgroups/cgfs.c:cgroup_rmdir:209 - Permission denied - Failed to delete /sys/fs/cgroup/cpu,cpuacct//system.slice/polkit.service
      lxc-start container-ubuntu-xenial 20171205000303.917 ERROR    lxc_cgfs - cgroups/cgfs.c:cgroup_rmdir:209 - Permission denied - Failed to delete /sys/fs/cgroup/cpu,cpuacct//system.slice/rpc-statd-notify.service
      lxc-start container-ubuntu-xenial 20171205000303.917 ERROR    lxc_cgfs - cgroups/cgfs.c:cgroup_rmdir:209 - Permission denied - Failed to delete /sys/fs/cgroup/cpu,cpuacct//system.slice/systemd-fsck-root.service
      lxc-start container-ubuntu-xenial 20171205000303.917 ERROR    lxc_cgfs - cgroups/cgfs.c:cgroup_rmdir:209 - Permission denied - Failed to delete /sys/fs/cgroup/cpu,cpuacct//system.slice/systemd-udevd.service
      lxc-start container-ubuntu-xenial 20171205000303.917 ERROR    lxc_cgfs - cgroups/cgfs.c:cgroup_rmdir:209 - Permission denied - Failed to delete /sys/fs/cgroup/cpu,cpuacct//system.slice/rsyslog.service
      lxc-start container-ubuntu-xenial 20171205000303.917 ERROR    lxc_cgfs - cgroups/cgfs.c:cgroup_rmdir:209 - Permission denied - Failed to delete /sys/fs/cgroup/cpu,cpuacct//system.slice/system-lvm2\x2dpvscan.slice
      lxc-start container-ubuntu-xenial 20171205000303.918 ERROR    lxc_cgfs - cgroups/cgfs.c:cgroup_rmdir:209 - Permission denied - Failed to delete /sys/fs/cgroup/cpu,cpuacct//system.slice/fprintd.service
      lxc-start container-ubuntu-xenial 20171205000303.918 ERROR    lxc_cgfs - cgroups/cgfs.c:cgroup_rmdir:209 - Permission denied - Failed to delete /sys/fs/cgroup/cpu,cpuacct//system.slice/systemd-tmpfiles-setup-dev.service
      lxc-start container-ubuntu-xenial 20171205000303.918 ERROR    lxc_cgfs - cgroups/cgfs.c:cgroup_rmdir:209 - Permission denied - Failed to delete /sys/fs/cgroup/cpu,cpuacct//system.slice/systemd-journald.service
      lxc-start container-ubuntu-xenial 20171205000303.918 ERROR    lxc_cgfs - cgroups/cgfs.c:cgroup_rmdir:209 - Permission denied - Failed to delete /sys/fs/cgroup/cpu,cpuacct//system.slice/auditd.service
      lxc-start container-ubuntu-xenial 20171205000303.918 ERROR    lxc_cgfs - cgroups/cgfs.c:cgroup_rmdir:209 - Permission denied - Failed to delete /sys/fs/cgroup/cpu,cpuacct//system.slice/kmod-static-nodes.service
      lxc-start container-ubuntu-xenial 20171205000303.921 ERROR    lxc_cgfs - cgroups/cgfs.c:cgroup_rmdir:209 - Permission denied - Failed to delete /sys/fs/cgroup/cpu,cpuacct//system.slice/dracut-shutdown.service
      lxc-start container-ubuntu-xenial 20171205000303.921 ERROR    lxc_cgfs - cgroups/cgfs.c:cgroup_rmdir:209 - Permission denied - Failed to delete /sys/fs/cgroup/cpu,cpuacct//system.slice/systemd-sysctl.service
      lxc-start container-ubuntu-xenial 20171205000303.921 ERROR    lxc_cgfs - cgroups/cgfs.c:cgroup_rmdir:209 - Permission denied - Failed to delete /sys/fs/cgroup/cpu,cpuacct//system.slice/-.mount
      lxc-start container-ubuntu-xenial 20171205000303.921 ERROR    lxc_cgfs - cgroups/cgfs.c:cgroup_rmdir:209 - Permission denied - Failed to delete /sys/fs/cgroup/cpu,cpuacct//system.slice/dev-fedora-swap.swap
      lxc-start container-ubuntu-xenial 20171205000303.922 ERROR    lxc_cgfs - cgroups/cgfs.c:cgroup_rmdir:209 - Permission denied - Failed to delete /sys/fs/cgroup/cpu,cpuacct//system.slice/dev-dm\x2d1.swap
      lxc-start container-ubuntu-xenial 20171205000303.922 ERROR    lxc_cgfs - cgroups/cgfs.c:cgroup_rmdir:209 - Permission denied - Failed to delete /sys/fs/cgroup/cpu,cpuacct//system.slice/systemd-udev-trigger.service
      lxc-start container-ubuntu-xenial 20171205000303.922 ERROR    lxc_cgfs - cgroups/cgfs.c:cgroup_rmdir:209 - Permission denied - Failed to delete /sys/fs/cgroup/cpu,cpuacct//system.slice/chronyd.service
      lxc-start container-ubuntu-xenial 20171205000303.922 ERROR    lxc_cgfs - cgroups/cgfs.c:cgroup_rmdir:209 - Permission denied - Failed to delete /sys/fs/cgroup/cpu,cpuacct//system.slice
      lxc-start container-ubuntu-xenial 20171205000303.922 ERROR    lxc_cgfs - cgroups/cgfs.c:cgroup_rmdir:209 - Read-only file system - Failed to delete /sys/fs/cgroup/cpu,cpuacct/
      lxc-start container-ubuntu-xenial 20171205000303.923 ERROR    lxc_cgfs - cgroups/cgfs.c:cgroup_rmdir:209 - Permission denied - Failed to delete /sys/fs/cgroup/memory//user.slice
      lxc-start container-ubuntu-xenial 20171205000303.923 ERROR    lxc_cgfs - cgroups/cgfs.c:cgroup_rmdir:209 - Permission denied - Failed to delete /sys/fs/cgroup/memory//init.scope
      lxc-start container-ubuntu-xenial 20171205000303.923 ERROR    lxc_cgfs - cgroups/cgfs.c:cgroup_rmdir:209 - Permission denied - Failed to delete /sys/fs/cgroup/memory//system.slice/irqbalance.service
      lxc-start container-ubuntu-xenial 20171205000303.924 ERROR    lxc_cgfs - cgroups/cgfs.c:cgroup_rmdir:209 - Permission denied - Failed to delete /sys/fs/cgroup/memory//system.slice/lightdm.service
      lxc-start container-ubuntu-xenial 20171205000303.924 ERROR    lxc_cgfs - cgroups/cgfs.c:cgroup_rmdir:209 - Permission denied - Failed to delete /sys/fs/cgroup/memory//system.slice/home.mount
      lxc-start container-ubuntu-xenial 20171205000303.924 ERROR    lxc_cgfs - cgroups/cgfs.c:cgroup_rmdir:209 - Permission denied - Failed to delete /sys/fs/cgroup/memory//system.slice/var-lib-nfs-rpc_pipefs.mount
      lxc-start container-ubuntu-xenial 20171205000303.925 ERROR    lxc_cgfs - cgroups/cgfs.c:cgroup_rmdir:209 - Permission denied - Failed to delete /sys/fs/cgroup/memory//system.slice/sys-kernel-debug.mount
      lxc-start container-ubuntu-xenial 20171205000303.925 ERROR    lxc_cgfs - cgroups/cgfs.c:cgroup_rmdir:209 - Permission denied - Failed to delete /sys/fs/cgroup/memory//system.slice/boot.mount
      lxc-start container-ubuntu-xenial 20171205000303.925 ERROR    lxc_cgfs - cgroups/cgfs.c:cgroup_rmdir:209 - Permission denied - Failed to delete /sys/fs/cgroup/memory//system.slice/tmp.mount
      lxc-start container-ubuntu-xenial 20171205000303.926 ERROR    lxc_cgfs - cgroups/cgfs.c:cgroup_rmdir:209 - Permission denied - Failed to delete /sys/fs/cgroup/memory//system.slice/alsa-state.service
      lxc-start container-ubuntu-xenial 20171205000303.926 ERROR    lxc_cgfs - cgroups/cgfs.c:cgroup_rmdir:209 - Permission denied - Failed to delete /sys/fs/cgroup/memory//system.slice/firewalld.service
      lxc-start container-ubuntu-xenial 20171205000303.926 ERROR    lxc_cgfs - cgroups/cgfs.c:cgroup_rmdir:209 - Permission denied - Failed to delete /sys/fs/cgroup/memory//system.slice/systemd-random-seed.service
      lxc-start container-ubuntu-xenial 20171205000303.926 ERROR    lxc_cgfs - cgroups/cgfs.c:cgroup_rmdir:209 - Permission denied - Failed to delete /sys/fs/cgroup/memory//system.slice/run-user-1000-doc.mount
      lxc-start container-ubuntu-xenial 20171205000303.927 ERROR    lxc_cgfs - cgroups/cgfs.c:cgroup_rmdir:209 - Permission denied - Failed to delete /sys/fs/cgroup/memory//system.slice/systemd-journal-flush.service
      lxc-start container-ubuntu-xenial 20171205000303.927 ERROR    lxc_cgfs - cgroups/cgfs.c:cgroup_rmdir:209 - Permission denied - Failed to delete /sys/fs/cgroup/memory//system.slice/fedora-readonly.service
      lxc-start container-ubuntu-xenial 20171205000303.927 ERROR    lxc_cgfs - cgroups/cgfs.c:cgroup_rmdir:209 - Permission denied - Failed to delete /sys/fs/cgroup/memory//system.slice/systemd-user-sessions.service
      lxc-start container-ubuntu-xenial 20171205000303.928 ERROR    lxc_cgfs - cgroups/cgfs.c:cgroup_rmdir:209 - Permission denied - Failed to delete /sys/fs/cgroup/memory//system.slice/sys-kernel-config.mount
      lxc-start container-ubuntu-xenial 20171205000303.928 ERROR    lxc_cgfs - cgroups/cgfs.c:cgroup_rmdir:209 - Permission denied - Failed to delete /sys/fs/cgroup/memory//system.slice/dev-hugepages.mount
      lxc-start container-ubuntu-xenial 20171205000303.928 ERROR    lxc_cgfs - cgroups/cgfs.c:cgroup_rmdir:209 - Permission denied - Failed to delete /sys/fs/cgroup/memory//system.slice/lvm2-monitor.service
      lxc-start container-ubuntu-xenial 20171205000303.929 ERROR    lxc_cgfs - cgroups/cgfs.c:cgroup_rmdir:209 - Permission denied - Failed to delete /sys/fs/cgroup/memory//system.slice/lxc-net.service
      lxc-start container-ubuntu-xenial 20171205000303.929 ERROR    lxc_cgfs - cgroups/cgfs.c:cgroup_rmdir:209 - Permission denied - Failed to delete /sys/fs/cgroup/memory//system.slice/upower.service
      lxc-start container-ubuntu-xenial 20171205000303.929 ERROR    lxc_cgfs - cgroups/cgfs.c:cgroup_rmdir:209 - Permission denied - Failed to delete /sys/fs/cgroup/memory//system.slice/sys-fs-fuse-connections.mount
      lxc-start container-ubuntu-xenial 20171205000303.930 ERROR    lxc_cgfs - cgroups/cgfs.c:cgroup_rmdir:209 - Permission denied - Failed to delete /sys/fs/cgroup/memory//system.slice/systemd-udev-settle.service
      lxc-start container-ubuntu-xenial 20171205000303.930 ERROR    lxc_cgfs - cgroups/cgfs.c:cgroup_rmdir:209 - Permission denied - Failed to delete /sys/fs/cgroup/memory//system.slice/gssproxy.service
      lxc-start container-ubuntu-xenial 20171205000303.930 ERROR    lxc_cgfs - cgroups/cgfs.c:cgroup_rmdir:209 - Permission denied - Failed to delete /sys/fs/cgroup/memory//system.slice/mcelog.service
      lxc-start container-ubuntu-xenial 20171205000303.931 ERROR    lxc_cgfs - cgroups/cgfs.c:cgroup_rmdir:209 - Permission denied - Failed to delete /sys/fs/cgroup/memory//system.slice/NetworkManager.service
      lxc-start container-ubuntu-xenial 20171205000303.931 ERROR    lxc_cgfs - cgroups/cgfs.c:cgroup_rmdir:209 - Permission denied - Failed to delete /sys/fs/cgroup/memory//system.slice/dbus.service
      lxc-start container-ubuntu-xenial 20171205000303.931 ERROR    lxc_cgfs - cgroups/cgfs.c:cgroup_rmdir:209 - Permission denied - Failed to delete /sys/fs/cgroup/memory//system.slice/fedora-import-state.service
      lxc-start container-ubuntu-xenial 20171205000303.932 ERROR    lxc_cgfs - cgroups/cgfs.c:cgroup_rmdir:209 - Permission denied - Failed to delete /sys/fs/cgroup/memory//system.slice/accounts-daemon.service
      lxc-start container-ubuntu-xenial 20171205000303.932 ERROR    lxc_cgfs - cgroups/cgfs.c:cgroup_rmdir:209 - Permission denied - Failed to delete /sys/fs/cgroup/memory//system.slice/dev-mqueue.mount
      lxc-start container-ubuntu-xenial 20171205000303.932 ERROR    lxc_cgfs - cgroups/cgfs.c:cgroup_rmdir:209 - Permission denied - Failed to delete /sys/fs/cgroup/memory//system.slice/run-user-1000.mount
      lxc-start container-ubuntu-xenial 20171205000303.933 ERROR    lxc_cgfs - cgroups/cgfs.c:cgroup_rmdir:209 - Permission denied - Failed to delete /sys/fs/cgroup/memory//system.slice/udisks2.service
      lxc-start container-ubuntu-xenial 20171205000303.933 ERROR    lxc_cgfs - cgroups/cgfs.c:cgroup_rmdir:209 - Permission denied - Failed to delete /sys/fs/cgroup/memory//system.slice/abrt-xorg.service
      lxc-start container-ubuntu-xenial 20171205000303.933 ERROR    lxc_cgfs - cgroups/cgfs.c:cgroup_rmdir:209 - Permission denied - Failed to delete /sys/fs/cgroup/memory//system.slice/iscsi-shutdown.service
      lxc-start container-ubuntu-xenial 20171205000303.934 ERROR    lxc_cgfs - cgroups/cgfs.c:cgroup_rmdir:209 - Permission denied - Failed to delete /sys/fs/cgroup/memory//system.slice/systemd-tmpfiles-setup.service
      lxc-start container-ubuntu-xenial 20171205000303.934 ERROR    lxc_cgfs - cgroups/cgfs.c:cgroup_rmdir:209 - Permission denied - Failed to delete /sys/fs/cgroup/memory//system.slice/avahi-daemon.service
      lxc-start container-ubuntu-xenial 20171205000303.934 ERROR    lxc_cgfs - cgroups/cgfs.c:cgroup_rmdir:209 - Permission denied - Failed to delete /sys/fs/cgroup/memory//system.slice/netcf-transaction.service
      lxc-start container-ubuntu-xenial 20171205000303.935 ERROR    lxc_cgfs - cgroups/cgfs.c:cgroup_rmdir:209 - Permission denied - Failed to delete /sys/fs/cgroup/memory//system.slice/livesys.service
      lxc-start container-ubuntu-xenial 20171205000303.935 ERROR    lxc_cgfs - cgroups/cgfs.c:cgroup_rmdir:209 - Permission denied - Failed to delete /sys/fs/cgroup/memory//system.slice/abrt-oops.service
      lxc-start container-ubuntu-xenial 20171205000303.935 ERROR    lxc_cgfs - cgroups/cgfs.c:cgroup_rmdir:209 - Permission denied - Failed to delete /sys/fs/cgroup/memory//system.slice/systemd-remount-fs.service
      lxc-start container-ubuntu-xenial 20171205000303.935 ERROR    lxc_cgfs - cgroups/cgfs.c:cgroup_rmdir:209 - Permission denied - Failed to delete /sys/fs/cgroup/memory//system.slice/system-getty.slice
      lxc-start container-ubuntu-xenial 20171205000303.936 ERROR    lxc_cgfs - cgroups/cgfs.c:cgroup_rmdir:209 - Permission denied - Failed to delete /sys/fs/cgroup/memory//system.slice/dev-mapper-fedora\x2dswap.swap
      lxc-start container-ubuntu-xenial 20171205000303.936 ERROR    lxc_cgfs - cgroups/cgfs.c:cgroup_rmdir:209 - Permission denied - Failed to delete /sys/fs/cgroup/memory//system.slice/dev-disk-by\x2did-dm\x2dname\x2dfedora\x2dswap.swap
      lxc-start container-ubuntu-xenial 20171205000303.936 ERROR    lxc_cgfs - cgroups/cgfs.c:cgroup_rmdir:209 - Permission denied - Failed to delete /sys/fs/cgroup/memory//system.slice/systemd-update-utmp.service
      lxc-start container-ubuntu-xenial 20171205000303.937 ERROR    lxc_cgfs - cgroups/cgfs.c:cgroup_rmdir:209 - Permission denied - Failed to delete /sys/fs/cgroup/memory//system.slice/system-systemd\x2dfsck.slice
      lxc-start container-ubuntu-xenial 20171205000303.937 ERROR    lxc_cgfs - cgroups/cgfs.c:cgroup_rmdir:209 - Permission denied - Failed to delete /sys/fs/cgroup/memory//system.slice/smartd.service
      lxc-start container-ubuntu-xenial 20171205000303.937 ERROR    lxc_cgfs - cgroups/cgfs.c:cgroup_rmdir:209 - Permission denied - Failed to delete /sys/fs/cgroup/memory//system.slice/abrtd.service
      lxc-start container-ubuntu-xenial 20171205000303.938 ERROR    lxc_cgfs - cgroups/cgfs.c:cgroup_rmdir:209 - Permission denied - Failed to delete /sys/fs/cgroup/memory//system.slice/dev-disk-by\x2did-dm\x2duuid\x2dLVM\x2d0MC961VMuutSWV7QwKHOh1iipioWRobcOE3c18OP4m6YT6jUvy1dqwO4odESWnVv.swap
      lxc-start container-ubuntu-xenial 20171205000303.938 ERROR    lxc_cgfs - cgroups/cgfs.c:cgroup_rmdir:209 - Permission denied - Failed to delete /sys/fs/cgroup/memory//system.slice/NetworkManager-wait-online.service
      lxc-start container-ubuntu-xenial 20171205000303.938 ERROR    lxc_cgfs - cgroups/cgfs.c:cgroup_rmdir:209 - Permission denied - Failed to delete /sys/fs/cgroup/memory//system.slice/abrt-journal-core.service
      lxc-start container-ubuntu-xenial 20171205000303.942 ERROR    lxc_cgfs - cgroups/cgfs.c:cgroup_rmdir:209 - Permission denied - Failed to delete /sys/fs/cgroup/memory//system.slice/ModemManager.service
      lxc-start container-ubuntu-xenial 20171205000303.943 ERROR    lxc_cgfs - cgroups/cgfs.c:cgroup_rmdir:209 - Permission denied - Failed to delete /sys/fs/cgroup/memory//system.slice/systemd-logind.service
      lxc-start container-ubuntu-xenial 20171205000303.943 ERROR    lxc_cgfs - cgroups/cgfs.c:cgroup_rmdir:209 - Permission denied - Failed to delete /sys/fs/cgroup/memory//system.slice/rtkit-daemon.service
      lxc-start container-ubuntu-xenial 20171205000303.943 ERROR    lxc_cgfs - cgroups/cgfs.c:cgroup_rmdir:209 - Permission denied - Failed to delete /sys/fs/cgroup/memory//system.slice/sssd.service
      lxc-start container-ubuntu-xenial 20171205000303.944 ERROR    lxc_cgfs - cgroups/cgfs.c:cgroup_rmdir:209 - Permission denied - Failed to delete /sys/fs/cgroup/memory//system.slice/dev-disk-by\x2duuid-fa829cce\x2d4360\x2d4f64\x2da9d6\x2d4396f7ec8b04.swap
      lxc-start container-ubuntu-xenial 20171205000303.945 ERROR    lxc_cgfs - cgroups/cgfs.c:cgroup_rmdir:209 - Permission denied - Failed to delete /sys/fs/cgroup/memory//system.slice/libvirtd.service
      lxc-start container-ubuntu-xenial 20171205000303.945 ERROR    lxc_cgfs - cgroups/cgfs.c:cgroup_rmdir:209 - Permission denied - Failed to delete /sys/fs/cgroup/memory//system.slice/crond.service
      lxc-start container-ubuntu-xenial 20171205000303.946 ERROR    lxc_cgfs - cgroups/cgfs.c:cgroup_rmdir:209 - Permission denied - Failed to delete /sys/fs/cgroup/memory//system.slice/livesys-late.service
      lxc-start container-ubuntu-xenial 20171205000303.946 ERROR    lxc_cgfs - cgroups/cgfs.c:cgroup_rmdir:209 - Permission denied - Failed to delete /sys/fs/cgroup/memory//system.slice/polkit.service
      lxc-start container-ubuntu-xenial 20171205000303.946 ERROR    lxc_cgfs - cgroups/cgfs.c:cgroup_rmdir:209 - Permission denied - Failed to delete /sys/fs/cgroup/memory//system.slice/rpc-statd-notify.service
      lxc-start container-ubuntu-xenial 20171205000303.947 ERROR    lxc_cgfs - cgroups/cgfs.c:cgroup_rmdir:209 - Permission denied - Failed to delete /sys/fs/cgroup/memory//system.slice/systemd-fsck-root.service
      lxc-start container-ubuntu-xenial 20171205000303.947 ERROR    lxc_cgfs - cgroups/cgfs.c:cgroup_rmdir:209 - Permission denied - Failed to delete /sys/fs/cgroup/memory//system.slice/systemd-udevd.service
      lxc-start container-ubuntu-xenial 20171205000303.947 ERROR    lxc_cgfs - cgroups/cgfs.c:cgroup_rmdir:209 - Permission denied - Failed to delete /sys/fs/cgroup/memory//system.slice/rsyslog.service
      lxc-start container-ubuntu-xenial 20171205000303.947 ERROR    lxc_cgfs - cgroups/cgfs.c:cgroup_rmdir:209 - Permission denied - Failed to delete /sys/fs/cgroup/memory//system.slice/system-lvm2\x2dpvscan.slice
      lxc-start container-ubuntu-xenial 20171205000303.948 ERROR    lxc_cgfs - cgroups/cgfs.c:cgroup_rmdir:209 - Permission denied - Failed to delete /sys/fs/cgroup/memory//system.slice/fprintd.service
      lxc-start container-ubuntu-xenial 20171205000303.948 ERROR    lxc_cgfs - cgroups/cgfs.c:cgroup_rmdir:209 - Permission denied - Failed to delete /sys/fs/cgroup/memory//system.slice/systemd-tmpfiles-setup-dev.service
      lxc-start container-ubuntu-xenial 20171205000303.949 ERROR    lxc_cgfs - cgroups/cgfs.c:cgroup_rmdir:209 - Permission denied - Failed to delete /sys/fs/cgroup/memory//system.slice/systemd-journald.service
      lxc-start container-ubuntu-xenial 20171205000303.949 ERROR    lxc_cgfs - cgroups/cgfs.c:cgroup_rmdir:209 - Permission denied - Failed to delete /sys/fs/cgroup/memory//system.slice/auditd.service
      lxc-start container-ubuntu-xenial 20171205000303.949 ERROR    lxc_cgfs - cgroups/cgfs.c:cgroup_rmdir:209 - Permission denied - Failed to delete /sys/fs/cgroup/memory//system.slice/kmod-static-nodes.service
      lxc-start container-ubuntu-xenial 20171205000303.950 ERROR    lxc_cgfs - cgroups/cgfs.c:cgroup_rmdir:209 - Permission denied - Failed to delete /sys/fs/cgroup/memory//system.slice/dracut-shutdown.service
      lxc-start container-ubuntu-xenial 20171205000303.950 ERROR    lxc_cgfs - cgroups/cgfs.c:cgroup_rmdir:209 - Permission denied - Failed to delete /sys/fs/cgroup/memory//system.slice/systemd-sysctl.service
      lxc-start container-ubuntu-xenial 20171205000303.951 ERROR    lxc_cgfs - cgroups/cgfs.c:cgroup_rmdir:209 - Permission denied - Failed to delete /sys/fs/cgroup/memory//system.slice/-.mount
      lxc-start container-ubuntu-xenial 20171205000303.951 ERROR    lxc_cgfs - cgroups/cgfs.c:cgroup_rmdir:209 - Permission denied - Failed to delete /sys/fs/cgroup/memory//system.slice/dev-fedora-swap.swap
      lxc-start container-ubuntu-xenial 20171205000303.951 ERROR    lxc_cgfs - cgroups/cgfs.c:cgroup_rmdir:209 - Permission denied - Failed to delete /sys/fs/cgroup/memory//system.slice/dev-dm\x2d1.swap
      lxc-start container-ubuntu-xenial 20171205000303.952 ERROR    lxc_cgfs - cgroups/cgfs.c:cgroup_rmdir:209 - Permission denied - Failed to delete /sys/fs/cgroup/memory//system.slice/systemd-udev-trigger.service
      lxc-start container-ubuntu-xenial 20171205000303.952 ERROR    lxc_cgfs - cgroups/cgfs.c:cgroup_rmdir:209 - Permission denied - Failed to delete /sys/fs/cgroup/memory//system.slice/chronyd.service
      lxc-start container-ubuntu-xenial 20171205000303.952 ERROR    lxc_cgfs - cgroups/cgfs.c:cgroup_rmdir:209 - Permission denied - Failed to delete /sys/fs/cgroup/memory//system.slice
      lxc-start container-ubuntu-xenial 20171205000303.952 ERROR    lxc_cgfs - cgroups/cgfs.c:cgroup_rmdir:209 - Read-only file system - Failed to delete /sys/fs/cgroup/memory/
      lxc-start container-ubuntu-xenial 20171205000303.952 ERROR    lxc_cgfs - cgroups/cgfs.c:cgroup_rmdir:209 - Permission denied - Failed to delete /sys/fs/cgroup/systemd/user.slice/user-1000.slice/session-2.scope
      lxc-start container-ubuntu-xenial 20171205000303.952 ERROR    lxc_start - start.c:lxc_spawn:1245 - Failed creating cgroups.
      lxc-start container-ubuntu-xenial 20171205000303.952 DEBUG    lxc_network - network.c:lxc_delete_network_unpriv:2306 - Cannot not guarantee safe deletion of network devices. Manual cleanup maybe needed
      lxc-start container-ubuntu-xenial 20171205000303.952 DEBUG    lxc_network - network.c:lxc_delete_network:3121 - Failed to delete network devices
      lxc-start container-ubuntu-xenial 20171205000303.952 TRACE    lxc_start - start.c:lxc_serve_state_clients:350 - Set container state to ABORTING
      lxc-start container-ubuntu-xenial 20171205000303.952 TRACE    lxc_start - start.c:lxc_serve_state_clients:353 - No state clients registered
      lxc-start container-ubuntu-xenial 20171205000303.952 ERROR    lxc_start - start.c:__lxc_start:1503 - Failed to spawn container "container-ubuntu-xenial".
      lxc-start container-ubuntu-xenial 20171205000303.952 TRACE    lxc_start - start.c:lxc_serve_state_clients:350 - Set container state to STOPPING
      lxc-start container-ubuntu-xenial 20171205000303.952 TRACE    lxc_start - start.c:lxc_serve_state_clients:353 - No state clients registered
      lxc-start container-ubuntu-xenial 20171205000303.952 TRACE    lxc_start - start.c:lxc_serve_state_clients:350 - Set container state to STOPPED
      lxc-start container-ubuntu-xenial 20171205000303.952 TRACE    lxc_start - start.c:lxc_serve_state_clients:353 - No state clients registered
      lxc-start container-ubuntu-xenial 20171205000440.966 INFO     lxc_confile - confile.c:set_config_idmaps:1575 - Read uid map: type u nsid 0 hostid 165536 range 65536
      lxc-start container-ubuntu-xenial 20171205000440.966 INFO     lxc_confile - confile.c:set_config_idmaps:1575 - Read uid map: type g nsid 0 hostid 165536 range 65536
      lxc-start container-ubuntu-xenial 20171205000440.966 TRACE    lxc_commands - commands.c:lxc_cmd:308 - Connection refused - Command "get_init_pid" failed to connect command socket
      lxc-start container-ubuntu-xenial 20171205000440.966 TRACE    lxc_commands - commands.c:lxc_cmd:308 - Connection refused - Command "get_cgroup" failed to connect command socket
      lxc-start container-ubuntu-xenial 20171205000440.966 TRACE    lxc_commands - commands.c:lxc_cmd:308 - Connection refused - Command "get_cgroup" failed to connect command socket
      lxc-start container-ubuntu-xenial 20171205000440.967 TRACE    lxc_commands - commands.c:lxc_cmd:308 - Connection refused - Command "get_cgroup" failed to connect command socket
      lxc-start container-ubuntu-xenial 20171205000440.967 TRACE    lxc_commands - commands.c:lxc_cmd:308 - Connection refused - Command "get_cgroup" failed to connect command socket
      lxc-start container-ubuntu-xenial 20171205000440.967 TRACE    lxc_commands - commands.c:lxc_cmd:308 - Connection refused - Command "get_cgroup" failed to connect command socket
      lxc-start container-ubuntu-xenial 20171205000440.967 TRACE    lxc_commands - commands.c:lxc_cmd:308 - Connection refused - Command "get_cgroup" failed to connect command socket
      lxc-start container-ubuntu-xenial 20171205000440.967 TRACE    lxc_commands - commands.c:lxc_cmd:308 - Connection refused - Command "get_cgroup" failed to connect command socket
      lxc-start container-ubuntu-xenial 20171205000440.967 TRACE    lxc_commands - commands.c:lxc_cmd:308 - Connection refused - Command "get_cgroup" failed to connect command socket
      lxc-start container-ubuntu-xenial 20171205000440.967 TRACE    lxc_commands - commands.c:lxc_cmd:308 - Connection refused - Command "get_cgroup" failed to connect command socket
      lxc-start container-ubuntu-xenial 20171205000440.967 TRACE    lxc_commands - commands.c:lxc_cmd:308 - Connection refused - Command "get_cgroup" failed to connect command socket
      lxc-start container-ubuntu-xenial 20171205000440.967 TRACE    lxc_commands - commands.c:lxc_cmd:308 - Connection refused - Command "get_cgroup" failed to connect command socket
      lxc-start container-ubuntu-xenial 20171205000440.967 TRACE    lxc_commands - commands.c:lxc_cmd:308 - Connection refused - Command "get_state" failed to connect command socket
      lxc-start container-ubuntu-xenial 20171205000440.967 TRACE    lxc_commands - commands.c:lxc_cmd_init:1323 - Creating abstract unix socket "/home/marcosps/.local/share/lxc/container-ubuntu-xenial/command"
      lxc-start container-ubuntu-xenial 20171205000440.967 TRACE    lxc_start - start.c:lxc_init_handler:563 - Unix domain socket 4 for command server is ready
      lxc-start container-ubuntu-xenial 20171205000440.967 INFO     lxc_lsm - lsm/lsm.c:lsm_init:48 - LSM security driver SELinux
      lxc-start container-ubuntu-xenial 20171205000440.967 TRACE    lxc_start - start.c:lxc_init:578 - initialized LSM
      lxc-start container-ubuntu-xenial 20171205000440.967 INFO     lxc_seccomp - seccomp.c:parse_config_v2:589 - processing: .reject_force_umount  # comment this to allow umount -f;  not recommended
      lxc-start container-ubuntu-xenial 20171205000440.967 INFO     lxc_seccomp - seccomp.c:parse_config_v2:765 - Adding native rule for reject_force_umount  # comment this to allow umount -f;  not recommended action 0(kill)
      lxc-start container-ubuntu-xenial 20171205000440.967 INFO     lxc_seccomp - seccomp.c:do_resolve_add_rule:415 - Setting Seccomp rule to reject force umounts
      lxc-start container-ubuntu-xenial 20171205000440.967 INFO     lxc_seccomp - seccomp.c:parse_config_v2:769 - Adding compat rule for reject_force_umount action 0(kill)
      lxc-start container-ubuntu-xenial 20171205000440.967 INFO     lxc_seccomp - seccomp.c:do_resolve_add_rule:415 - Setting Seccomp rule to reject force umounts
      lxc-start container-ubuntu-xenial 20171205000440.967 INFO     lxc_seccomp - seccomp.c:do_resolve_add_rule:415 - Setting Seccomp rule to reject force umounts
      lxc-start container-ubuntu-xenial 20171205000440.967 INFO     lxc_seccomp - seccomp.c:parse_config_v2:589 - processing: .[all]
      lxc-start container-ubuntu-xenial 20171205000440.967 INFO     lxc_seccomp - seccomp.c:parse_config_v2:589 - processing: .kexec_load errno 1
      lxc-start container-ubuntu-xenial 20171205000440.967 INFO     lxc_seccomp - seccomp.c:parse_config_v2:765 - Adding native rule for kexec_load errno 1 action 327681(errno)
      lxc-start container-ubuntu-xenial 20171205000440.967 INFO     lxc_seccomp - seccomp.c:parse_config_v2:769 - Adding compat rule for kexec_load action 327681(errno)
      lxc-start container-ubuntu-xenial 20171205000440.967 INFO     lxc_seccomp - seccomp.c:parse_config_v2:589 - processing: .open_by_handle_at errno 1
      lxc-start container-ubuntu-xenial 20171205000440.967 INFO     lxc_seccomp - seccomp.c:parse_config_v2:765 - Adding native rule for open_by_handle_at errno 1 action 327681(errno)
      lxc-start container-ubuntu-xenial 20171205000440.967 INFO     lxc_seccomp - seccomp.c:parse_config_v2:769 - Adding compat rule for open_by_handle_at action 327681(errno)
      lxc-start container-ubuntu-xenial 20171205000440.967 INFO     lxc_seccomp - seccomp.c:parse_config_v2:589 - processing: .init_module errno 1
      lxc-start container-ubuntu-xenial 20171205000440.967 INFO     lxc_seccomp - seccomp.c:parse_config_v2:765 - Adding native rule for init_module errno 1 action 327681(errno)
      lxc-start container-ubuntu-xenial 20171205000440.967 INFO     lxc_seccomp - seccomp.c:parse_config_v2:769 - Adding compat rule for init_module action 327681(errno)
      lxc-start container-ubuntu-xenial 20171205000440.967 INFO     lxc_seccomp - seccomp.c:parse_config_v2:589 - processing: .finit_module errno 1
      lxc-start container-ubuntu-xenial 20171205000440.967 INFO     lxc_seccomp - seccomp.c:parse_config_v2:765 - Adding native rule for finit_module errno 1 action 327681(errno)
      lxc-start container-ubuntu-xenial 20171205000440.967 INFO     lxc_seccomp - seccomp.c:parse_config_v2:769 - Adding compat rule for finit_module action 327681(errno)
      lxc-start container-ubuntu-xenial 20171205000440.967 INFO     lxc_seccomp - seccomp.c:parse_config_v2:589 - processing: .delete_module errno 1
      lxc-start container-ubuntu-xenial 20171205000440.967 INFO     lxc_seccomp - seccomp.c:parse_config_v2:765 - Adding native rule for delete_module errno 1 action 327681(errno)
      lxc-start container-ubuntu-xenial 20171205000440.967 INFO     lxc_seccomp - seccomp.c:parse_config_v2:769 - Adding compat rule for delete_module action 327681(errno)
      lxc-start container-ubuntu-xenial 20171205000440.967 INFO     lxc_seccomp - seccomp.c:parse_config_v2:779 - Merging in the compat Seccomp ctx into the main one
      lxc-start container-ubuntu-xenial 20171205000440.967 TRACE    lxc_start - start.c:lxc_init:584 - read seccomp policy
      lxc-start container-ubuntu-xenial 20171205000440.967 TRACE    lxc_start - start.c:lxc_serve_state_clients:350 - Set container state to STARTING
      lxc-start container-ubuntu-xenial 20171205000440.967 TRACE    lxc_start - start.c:lxc_serve_state_clients:353 - No state clients registered
      lxc-start container-ubuntu-xenial 20171205000440.967 TRACE    lxc_start - start.c:lxc_init:591 - set container state to "STARTING"
      lxc-start container-ubuntu-xenial 20171205000440.967 TRACE    lxc_start - start.c:lxc_init:619 - set environment variables
      lxc-start container-ubuntu-xenial 20171205000440.967 TRACE    lxc_start - start.c:lxc_init:625 - ran pre-start hooks
      lxc-start container-ubuntu-xenial 20171205000440.967 DEBUG    lxc_start - start.c:setup_signal_fd:278 - Set SIGCHLD handler with file descriptor: 5.
      lxc-start container-ubuntu-xenial 20171205000440.967 TRACE    lxc_start - start.c:lxc_init:636 - set up signal fd
      lxc-start container-ubuntu-xenial 20171205000440.969 DEBUG    console - console.c:lxc_console_peer_default:513 - using "/dev/tty" as peer tty device
      lxc-start container-ubuntu-xenial 20171205000440.969 DEBUG    console - console.c:lxc_console_signal_init:178 - Created signal fd 11
      lxc-start container-ubuntu-xenial 20171205000440.969 DEBUG    console - console.c:lxc_console_winsz:86 - Set window size to 238 columns and 51 rows
      lxc-start container-ubuntu-xenial 20171205000440.969 TRACE    lxc_start - start.c:lxc_init:643 - created console
      lxc-start container-ubuntu-xenial 20171205000440.969 DEBUG    lxc_conf - conf.c:chown_mapped_root:2792 - trying to chown "/dev/pts/4" to 1000
      lxc-start container-ubuntu-xenial 20171205000440.987 TRACE    lxc_conf - conf.c:lxc_ttys_shift_ids:2870 - chowned console "/dev/pts/4"
      lxc-start container-ubuntu-xenial 20171205000440.987 TRACE    lxc_start - start.c:lxc_init:649 - shifted tty ids
      lxc-start container-ubuntu-xenial 20171205000440.987 INFO     lxc_start - start.c:lxc_init:651 - container "container-ubuntu-xenial" is initialized
      lxc-start container-ubuntu-xenial 20171205000440.987 INFO     lxc_cgroup - cgroups/cgroup.c:cgroup_init:67 - cgroup driver cgroupfs initing for container-ubuntu-xenial
      lxc-start container-ubuntu-xenial 20171205000440.988 ERROR    lxc_cgfs - cgroups/cgfs.c:lxc_cgroupfs_create:909 - Could not set clone_children to 1 for cpuset hierarchy in parent cgroup.
      lxc-start container-ubuntu-xenial 20171205000440.988 ERROR    lxc_cgfs - cgroups/cgfs.c:cgroup_rmdir:209 - Permission denied - Failed to delete /sys/fs/cgroup/devices/user.slice
      lxc-start container-ubuntu-xenial 20171205000440.988 ERROR    lxc_cgfs - cgroups/cgfs.c:cgroup_rmdir:209 - Read-only file system - Failed to delete /sys/fs/cgroup/freezer/
      lxc-start container-ubuntu-xenial 20171205000440.988 ERROR    lxc_cgfs - cgroups/cgfs.c:cgroup_rmdir:209 - Permission denied - Failed to delete /sys/fs/cgroup/pids/user.slice/user-1000.slice/session-2.scope
      lxc-start container-ubuntu-xenial 20171205000440.988 ERROR    lxc_cgfs - cgroups/cgfs.c:cgroup_rmdir:209 - Read-only file system - Failed to delete /sys/fs/cgroup/perf_event/
      lxc-start container-ubuntu-xenial 20171205000440.989 ERROR    lxc_cgfs - cgroups/cgfs.c:cgroup_rmdir:209 - Permission denied - Failed to delete /sys/fs/cgroup/blkio//user.slice
      lxc-start container-ubuntu-xenial 20171205000440.989 ERROR    lxc_cgfs - cgroups/cgfs.c:cgroup_rmdir:209 - Permission denied - Failed to delete /sys/fs/cgroup/blkio//init.scope
      lxc-start container-ubuntu-xenial 20171205000440.989 ERROR    lxc_cgfs - cgroups/cgfs.c:cgroup_rmdir:209 - Permission denied - Failed to delete /sys/fs/cgroup/blkio//system.slice/irqbalance.service
      lxc-start container-ubuntu-xenial 20171205000440.989 ERROR    lxc_cgfs - cgroups/cgfs.c:cgroup_rmdir:209 - Permission denied - Failed to delete /sys/fs/cgroup/blkio//system.slice/lightdm.service
      lxc-start container-ubuntu-xenial 20171205000440.990 ERROR    lxc_cgfs - cgroups/cgfs.c:cgroup_rmdir:209 - Permission denied - Failed to delete /sys/fs/cgroup/blkio//system.slice/home.mount
      lxc-start container-ubuntu-xenial 20171205000440.990 ERROR    lxc_cgfs - cgroups/cgfs.c:cgroup_rmdir:209 - Permission denied - Failed to delete /sys/fs/cgroup/blkio//system.slice/var-lib-nfs-rpc_pipefs.mount
      lxc-start container-ubuntu-xenial 20171205000440.990 ERROR    lxc_cgfs - cgroups/cgfs.c:cgroup_rmdir:209 - Permission denied - Failed to delete /sys/fs/cgroup/blkio//system.slice/sys-kernel-debug.mount
      lxc-start container-ubuntu-xenial 20171205000440.990 ERROR    lxc_cgfs - cgroups/cgfs.c:cgroup_rmdir:209 - Permission denied - Failed to delete /sys/fs/cgroup/blkio//system.slice/boot.mount
      lxc-start container-ubuntu-xenial 20171205000440.991 ERROR    lxc_cgfs - cgroups/cgfs.c:cgroup_rmdir:209 - Permission denied - Failed to delete /sys/fs/cgroup/blkio//system.slice/tmp.mount
      lxc-start container-ubuntu-xenial 20171205000440.991 ERROR    lxc_cgfs - cgroups/cgfs.c:cgroup_rmdir:209 - Permission denied - Failed to delete /sys/fs/cgroup/blkio//system.slice/alsa-state.service
      lxc-start container-ubuntu-xenial 20171205000440.991 ERROR    lxc_cgfs - cgroups/cgfs.c:cgroup_rmdir:209 - Permission denied - Failed to delete /sys/fs/cgroup/blkio//system.slice/firewalld.service
      lxc-start container-ubuntu-xenial 20171205000440.991 ERROR    lxc_cgfs - cgroups/cgfs.c:cgroup_rmdir:209 - Permission denied - Failed to delete /sys/fs/cgroup/blkio//system.slice/systemd-random-seed.service
      lxc-start container-ubuntu-xenial 20171205000440.992 ERROR    lxc_cgfs - cgroups/cgfs.c:cgroup_rmdir:209 - Permission denied - Failed to delete /sys/fs/cgroup/blkio//system.slice/run-user-1000-doc.mount
      lxc-start container-ubuntu-xenial 20171205000440.992 ERROR    lxc_cgfs - cgroups/cgfs.c:cgroup_rmdir:209 - Permission denied - Failed to delete /sys/fs/cgroup/blkio//system.slice/systemd-journal-flush.service
      lxc-start container-ubuntu-xenial 20171205000440.992 ERROR    lxc_cgfs - cgroups/cgfs.c:cgroup_rmdir:209 - Permission denied - Failed to delete /sys/fs/cgroup/blkio//system.slice/fedora-readonly.service
      lxc-start container-ubuntu-xenial 20171205000440.992 ERROR    lxc_cgfs - cgroups/cgfs.c:cgroup_rmdir:209 - Permission denied - Failed to delete /sys/fs/cgroup/blkio//system.slice/systemd-user-sessions.service
      lxc-start container-ubuntu-xenial 20171205000440.993 ERROR    lxc_cgfs - cgroups/cgfs.c:cgroup_rmdir:209 - Permission denied - Failed to delete /sys/fs/cgroup/blkio//system.slice/sys-kernel-config.mount
      lxc-start container-ubuntu-xenial 20171205000440.993 ERROR    lxc_cgfs - cgroups/cgfs.c:cgroup_rmdir:209 - Permission denied - Failed to delete /sys/fs/cgroup/blkio//system.slice/dev-hugepages.mount
      lxc-start container-ubuntu-xenial 20171205000440.993 ERROR    lxc_cgfs - cgroups/cgfs.c:cgroup_rmdir:209 - Permission denied - Failed to delete /sys/fs/cgroup/blkio//system.slice/lvm2-monitor.service
      lxc-start container-ubuntu-xenial 20171205000440.994 ERROR    lxc_cgfs - cgroups/cgfs.c:cgroup_rmdir:209 - Permission denied - Failed to delete /sys/fs/cgroup/blkio//system.slice/lxc-net.service
      lxc-start container-ubuntu-xenial 20171205000440.994 ERROR    lxc_cgfs - cgroups/cgfs.c:cgroup_rmdir:209 - Permission denied - Failed to delete /sys/fs/cgroup/blkio//system.slice/upower.service
      lxc-start container-ubuntu-xenial 20171205000440.994 ERROR    lxc_cgfs - cgroups/cgfs.c:cgroup_rmdir:209 - Permission denied - Failed to delete /sys/fs/cgroup/blkio//system.slice/sys-fs-fuse-connections.mount
      lxc-start container-ubuntu-xenial 20171205000440.994 ERROR    lxc_cgfs - cgroups/cgfs.c:cgroup_rmdir:209 - Permission denied - Failed to delete /sys/fs/cgroup/blkio//system.slice/systemd-udev-settle.service
      lxc-start container-ubuntu-xenial 20171205000440.995 ERROR    lxc_cgfs - cgroups/cgfs.c:cgroup_rmdir:209 - Permission denied - Failed to delete /sys/fs/cgroup/blkio//system.slice/gssproxy.service
      lxc-start container-ubuntu-xenial 20171205000440.995 ERROR    lxc_cgfs - cgroups/cgfs.c:cgroup_rmdir:209 - Permission denied - Failed to delete /sys/fs/cgroup/blkio//system.slice/mcelog.service
      lxc-start container-ubuntu-xenial 20171205000440.995 ERROR    lxc_cgfs - cgroups/cgfs.c:cgroup_rmdir:209 - Permission denied - Failed to delete /sys/fs/cgroup/blkio//system.slice/NetworkManager.service
      lxc-start container-ubuntu-xenial 20171205000440.995 ERROR    lxc_cgfs - cgroups/cgfs.c:cgroup_rmdir:209 - Permission denied - Failed to delete /sys/fs/cgroup/blkio//system.slice/dbus.service
      lxc-start container-ubuntu-xenial 20171205000440.996 ERROR    lxc_cgfs - cgroups/cgfs.c:cgroup_rmdir:209 - Permission denied - Failed to delete /sys/fs/cgroup/blkio//system.slice/fedora-import-state.service
      lxc-start container-ubuntu-xenial 20171205000440.996 ERROR    lxc_cgfs - cgroups/cgfs.c:cgroup_rmdir:209 - Permission denied - Failed to delete /sys/fs/cgroup/blkio//system.slice/accounts-daemon.service
      lxc-start container-ubuntu-xenial 20171205000440.996 ERROR    lxc_cgfs - cgroups/cgfs.c:cgroup_rmdir:209 - Permission denied - Failed to delete /sys/fs/cgroup/blkio//system.slice/dev-mqueue.mount
      lxc-start container-ubuntu-xenial 20171205000440.996 ERROR    lxc_cgfs - cgroups/cgfs.c:cgroup_rmdir:209 - Permission denied - Failed to delete /sys/fs/cgroup/blkio//system.slice/run-user-1000.mount
      lxc-start container-ubuntu-xenial 20171205000440.996 ERROR    lxc_cgfs - cgroups/cgfs.c:cgroup_rmdir:209 - Permission denied - Failed to delete /sys/fs/cgroup/blkio//system.slice/udisks2.service
      lxc-start container-ubuntu-xenial 20171205000440.997 ERROR    lxc_cgfs - cgroups/cgfs.c:cgroup_rmdir:209 - Permission denied - Failed to delete /sys/fs/cgroup/blkio//system.slice/abrt-xorg.service
      lxc-start container-ubuntu-xenial 20171205000440.997 ERROR    lxc_cgfs - cgroups/cgfs.c:cgroup_rmdir:209 - Permission denied - Failed to delete /sys/fs/cgroup/blkio//system.slice/iscsi-shutdown.service
      lxc-start container-ubuntu-xenial 20171205000440.997 ERROR    lxc_cgfs - cgroups/cgfs.c:cgroup_rmdir:209 - Permission denied - Failed to delete /sys/fs/cgroup/blkio//system.slice/systemd-tmpfiles-setup.service
      lxc-start container-ubuntu-xenial 20171205000440.997 ERROR    lxc_cgfs - cgroups/cgfs.c:cgroup_rmdir:209 - Permission denied - Failed to delete /sys/fs/cgroup/blkio//system.slice/avahi-daemon.service
      lxc-start container-ubuntu-xenial 20171205000440.998 ERROR    lxc_cgfs - cgroups/cgfs.c:cgroup_rmdir:209 - Permission denied - Failed to delete /sys/fs/cgroup/blkio//system.slice/netcf-transaction.service
      lxc-start container-ubuntu-xenial 20171205000440.998 ERROR    lxc_cgfs - cgroups/cgfs.c:cgroup_rmdir:209 - Permission denied - Failed to delete /sys/fs/cgroup/blkio//system.slice/livesys.service
      lxc-start container-ubuntu-xenial 20171205000440.998 ERROR    lxc_cgfs - cgroups/cgfs.c:cgroup_rmdir:209 - Permission denied - Failed to delete /sys/fs/cgroup/blkio//system.slice/abrt-oops.service
      lxc-start container-ubuntu-xenial 20171205000440.998 ERROR    lxc_cgfs - cgroups/cgfs.c:cgroup_rmdir:209 - Permission denied - Failed to delete /sys/fs/cgroup/blkio//system.slice/systemd-remount-fs.service
      lxc-start container-ubuntu-xenial 20171205000440.999 ERROR    lxc_cgfs - cgroups/cgfs.c:cgroup_rmdir:209 - Permission denied - Failed to delete /sys/fs/cgroup/blkio//system.slice/system-getty.slice
      lxc-start container-ubuntu-xenial 20171205000440.999 ERROR    lxc_cgfs - cgroups/cgfs.c:cgroup_rmdir:209 - Permission denied - Failed to delete /sys/fs/cgroup/blkio//system.slice/dev-mapper-fedora\x2dswap.swap
      lxc-start container-ubuntu-xenial 20171205000440.999 ERROR    lxc_cgfs - cgroups/cgfs.c:cgroup_rmdir:209 - Permission denied - Failed to delete /sys/fs/cgroup/blkio//system.slice/dev-disk-by\x2did-dm\x2dname\x2dfedora\x2dswap.swap
      lxc-start container-ubuntu-xenial 20171205000440.999 ERROR    lxc_cgfs - cgroups/cgfs.c:cgroup_rmdir:209 - Permission denied - Failed to delete /sys/fs/cgroup/blkio//system.slice/systemd-update-utmp.service
      lxc-start container-ubuntu-xenial 20171205000441.496 ERROR    lxc_cgfs - cgroups/cgfs.c:cgroup_rmdir:209 - Permission denied - Failed to delete /sys/fs/cgroup/blkio//system.slice/system-systemd\x2dfsck.slice
      lxc-start container-ubuntu-xenial 20171205000441.286 ERROR    lxc_cgfs - cgroups/cgfs.c:cgroup_rmdir:209 - Permission denied - Failed to delete /sys/fs/cgroup/blkio//system.slice/smartd.service
      lxc-start container-ubuntu-xenial 20171205000441.522 ERROR    lxc_cgfs - cgroups/cgfs.c:cgroup_rmdir:209 - Permission denied - Failed to delete /sys/fs/cgroup/blkio//system.slice/abrtd.service
      lxc-start container-ubuntu-xenial 20171205000441.771 ERROR    lxc_cgfs - cgroups/cgfs.c:cgroup_rmdir:209 - Permission denied - Failed to delete /sys/fs/cgroup/blkio//system.slice/dev-disk-by\x2did-dm\x2duuid\x2dLVM\x2d0MC961VMuutSWV7QwKHOh1iipioWRobcOE3c18OP4m6YT6jUvy1dqwO4odESWnVv.swap
      lxc-start container-ubuntu-xenial 20171205000441.100 ERROR    lxc_cgfs - cgroups/cgfs.c:cgroup_rmdir:209 - Permission denied - Failed to delete /sys/fs/cgroup/blkio//system.slice/NetworkManager-wait-online.service
      lxc-start container-ubuntu-xenial 20171205000441.123 ERROR    lxc_cgfs - cgroups/cgfs.c:cgroup_rmdir:209 - Permission denied - Failed to delete /sys/fs/cgroup/blkio//system.slice/abrt-journal-core.service
      lxc-start container-ubuntu-xenial 20171205000441.145 ERROR    lxc_cgfs - cgroups/cgfs.c:cgroup_rmdir:209 - Permission denied - Failed to delete /sys/fs/cgroup/blkio//system.slice/ModemManager.service
      lxc-start container-ubuntu-xenial 20171205000441.169 ERROR    lxc_cgfs - cgroups/cgfs.c:cgroup_rmdir:209 - Permission denied - Failed to delete /sys/fs/cgroup/blkio//system.slice/systemd-logind.service
      lxc-start container-ubuntu-xenial 20171205000441.192 ERROR    lxc_cgfs - cgroups/cgfs.c:cgroup_rmdir:209 - Permission denied - Failed to delete /sys/fs/cgroup/blkio//system.slice/rtkit-daemon.service
      lxc-start container-ubuntu-xenial 20171205000441.215 ERROR    lxc_cgfs - cgroups/cgfs.c:cgroup_rmdir:209 - Permission denied - Failed to delete /sys/fs/cgroup/blkio//system.slice/sssd.service
      lxc-start container-ubuntu-xenial 20171205000441.238 ERROR    lxc_cgfs - cgroups/cgfs.c:cgroup_rmdir:209 - Permission denied - Failed to delete /sys/fs/cgroup/blkio//system.slice/dev-disk-by\x2duuid-fa829cce\x2d4360\x2d4f64\x2da9d6\x2d4396f7ec8b04.swap
      lxc-start container-ubuntu-xenial 20171205000441.262 ERROR    lxc_cgfs - cgroups/cgfs.c:cgroup_rmdir:209 - Permission denied - Failed to delete /sys/fs/cgroup/blkio//system.slice/libvirtd.service
      lxc-start container-ubuntu-xenial 20171205000441.285 ERROR    lxc_cgfs - cgroups/cgfs.c:cgroup_rmdir:209 - Permission denied - Failed to delete /sys/fs/cgroup/blkio//system.slice/crond.service
      lxc-start container-ubuntu-xenial 20171205000441.309 ERROR    lxc_cgfs - cgroups/cgfs.c:cgroup_rmdir:209 - Permission denied - Failed to delete /sys/fs/cgroup/blkio//system.slice/livesys-late.service
      lxc-start container-ubuntu-xenial 20171205000441.332 ERROR    lxc_cgfs - cgroups/cgfs.c:cgroup_rmdir:209 - Permission denied - Failed to delete /sys/fs/cgroup/blkio//system.slice/polkit.service
      lxc-start container-ubuntu-xenial 20171205000441.356 ERROR    lxc_cgfs - cgroups/cgfs.c:cgroup_rmdir:209 - Permission denied - Failed to delete /sys/fs/cgroup/blkio//system.slice/rpc-statd-notify.service
      lxc-start container-ubuntu-xenial 20171205000441.382 ERROR    lxc_cgfs - cgroups/cgfs.c:cgroup_rmdir:209 - Permission denied - Failed to delete /sys/fs/cgroup/blkio//system.slice/systemd-fsck-root.service
      lxc-start container-ubuntu-xenial 20171205000441.406 ERROR    lxc_cgfs - cgroups/cgfs.c:cgroup_rmdir:209 - Permission denied - Failed to delete /sys/fs/cgroup/blkio//system.slice/systemd-udevd.service
      lxc-start container-ubuntu-xenial 20171205000441.430 ERROR    lxc_cgfs - cgroups/cgfs.c:cgroup_rmdir:209 - Permission denied - Failed to delete /sys/fs/cgroup/blkio//system.slice/rsyslog.service
      lxc-start container-ubuntu-xenial 20171205000441.455 ERROR    lxc_cgfs - cgroups/cgfs.c:cgroup_rmdir:209 - Permission denied - Failed to delete /sys/fs/cgroup/blkio//system.slice/system-lvm2\x2dpvscan.slice
      lxc-start container-ubuntu-xenial 20171205000441.479 ERROR    lxc_cgfs - cgroups/cgfs.c:cgroup_rmdir:209 - Permission denied - Failed to delete /sys/fs/cgroup/blkio//system.slice/systemd-tmpfiles-setup-dev.service
      lxc-start container-ubuntu-xenial 20171205000441.502 ERROR    lxc_cgfs - cgroups/cgfs.c:cgroup_rmdir:209 - Permission denied - Failed to delete /sys/fs/cgroup/blkio//system.slice/systemd-journald.service
      lxc-start container-ubuntu-xenial 20171205000441.526 ERROR    lxc_cgfs - cgroups/cgfs.c:cgroup_rmdir:209 - Permission denied - Failed to delete /sys/fs/cgroup/blkio//system.slice/auditd.service
      lxc-start container-ubuntu-xenial 20171205000441.549 ERROR    lxc_cgfs - cgroups/cgfs.c:cgroup_rmdir:209 - Permission denied - Failed to delete /sys/fs/cgroup/blkio//system.slice/kmod-static-nodes.service
      lxc-start container-ubuntu-xenial 20171205000441.572 ERROR    lxc_cgfs - cgroups/cgfs.c:cgroup_rmdir:209 - Permission denied - Failed to delete /sys/fs/cgroup/blkio//system.slice/dracut-shutdown.service
      lxc-start container-ubuntu-xenial 20171205000441.595 ERROR    lxc_cgfs - cgroups/cgfs.c:cgroup_rmdir:209 - Permission denied - Failed to delete /sys/fs/cgroup/blkio//system.slice/systemd-sysctl.service
      lxc-start container-ubuntu-xenial 20171205000441.618 ERROR    lxc_cgfs - cgroups/cgfs.c:cgroup_rmdir:209 - Permission denied - Failed to delete /sys/fs/cgroup/blkio//system.slice/-.mount
      lxc-start container-ubuntu-xenial 20171205000441.641 ERROR    lxc_cgfs - cgroups/cgfs.c:cgroup_rmdir:209 - Permission denied - Failed to delete /sys/fs/cgroup/blkio//system.slice/dev-fedora-swap.swap
      lxc-start container-ubuntu-xenial 20171205000441.664 ERROR    lxc_cgfs - cgroups/cgfs.c:cgroup_rmdir:209 - Permission denied - Failed to delete /sys/fs/cgroup/blkio//system.slice/dev-dm\x2d1.swap
      lxc-start container-ubuntu-xenial 20171205000441.692 ERROR    lxc_cgfs - cgroups/cgfs.c:cgroup_rmdir:209 - Permission denied - Failed to delete /sys/fs/cgroup/blkio//system.slice/systemd-udev-trigger.service
      lxc-start container-ubuntu-xenial 20171205000441.716 ERROR    lxc_cgfs - cgroups/cgfs.c:cgroup_rmdir:209 - Permission denied - Failed to delete /sys/fs/cgroup/blkio//system.slice/chronyd.service
      lxc-start container-ubuntu-xenial 20171205000441.719 ERROR    lxc_cgfs - cgroups/cgfs.c:cgroup_rmdir:209 - Permission denied - Failed to delete /sys/fs/cgroup/blkio//system.slice
      lxc-start container-ubuntu-xenial 20171205000441.726 ERROR    lxc_cgfs - cgroups/cgfs.c:cgroup_rmdir:209 - Read-only file system - Failed to delete /sys/fs/cgroup/blkio/
      lxc-start container-ubuntu-xenial 20171205000441.742 ERROR    lxc_cgfs - cgroups/cgfs.c:cgroup_rmdir:209 - Read-only file system - Failed to delete /sys/fs/cgroup/cpuset/
      lxc-start container-ubuntu-xenial 20171205000441.754 ERROR    lxc_cgfs - cgroups/cgfs.c:cgroup_rmdir:209 - Read-only file system - Failed to delete /sys/fs/cgroup/net_cls,net_prio/
      lxc-start container-ubuntu-xenial 20171205000441.765 ERROR    lxc_cgfs - cgroups/cgfs.c:cgroup_rmdir:209 - Read-only file system - Failed to delete /sys/fs/cgroup/hugetlb/
      lxc-start container-ubuntu-xenial 20171205000441.785 ERROR    lxc_cgfs - cgroups/cgfs.c:cgroup_rmdir:209 - Permission denied - Failed to delete /sys/fs/cgroup/cpu,cpuacct//user.slice
      lxc-start container-ubuntu-xenial 20171205000441.802 ERROR    lxc_cgfs - cgroups/cgfs.c:cgroup_rmdir:209 - Permission denied - Failed to delete /sys/fs/cgroup/cpu,cpuacct//init.scope
      lxc-start container-ubuntu-xenial 20171205000441.825 ERROR    lxc_cgfs - cgroups/cgfs.c:cgroup_rmdir:209 - Permission denied - Failed to delete /sys/fs/cgroup/cpu,cpuacct//system.slice/irqbalance.service
      lxc-start container-ubuntu-xenial 20171205000441.858 ERROR    lxc_cgfs - cgroups/cgfs.c:cgroup_rmdir:209 - Permission denied - Failed to delete /sys/fs/cgroup/cpu,cpuacct//system.slice/lightdm.service
      lxc-start container-ubuntu-xenial 20171205000441.878 ERROR    lxc_cgfs - cgroups/cgfs.c:cgroup_rmdir:209 - Permission denied - Failed to delete /sys/fs/cgroup/cpu,cpuacct//system.slice/home.mount
      lxc-start container-ubuntu-xenial 20171205000441.893 ERROR    lxc_cgfs - cgroups/cgfs.c:cgroup_rmdir:209 - Permission denied - Failed to delete /sys/fs/cgroup/cpu,cpuacct//system.slice/var-lib-nfs-rpc_pipefs.mount
      lxc-start container-ubuntu-xenial 20171205000441.908 ERROR    lxc_cgfs - cgroups/cgfs.c:cgroup_rmdir:209 - Permission denied - Failed to delete /sys/fs/cgroup/cpu,cpuacct//system.slice/sys-kernel-debug.mount
      lxc-start container-ubuntu-xenial 20171205000441.922 ERROR    lxc_cgfs - cgroups/cgfs.c:cgroup_rmdir:209 - Permission denied - Failed to delete /sys/fs/cgroup/cpu,cpuacct//system.slice/boot.mount
      lxc-start container-ubuntu-xenial 20171205000441.936 ERROR    lxc_cgfs - cgroups/cgfs.c:cgroup_rmdir:209 - Permission denied - Failed to delete /sys/fs/cgroup/cpu,cpuacct//system.slice/tmp.mount
      lxc-start container-ubuntu-xenial 20171205000441.951 ERROR    lxc_cgfs - cgroups/cgfs.c:cgroup_rmdir:209 - Permission denied - Failed to delete /sys/fs/cgroup/cpu,cpuacct//system.slice/alsa-state.service
      lxc-start container-ubuntu-xenial 20171205000441.966 ERROR    lxc_cgfs - cgroups/cgfs.c:cgroup_rmdir:209 - Permission denied - Failed to delete /sys/fs/cgroup/cpu,cpuacct//system.slice/firewalld.service
      lxc-start container-ubuntu-xenial 20171205000441.980 ERROR    lxc_cgfs - cgroups/cgfs.c:cgroup_rmdir:209 - Permission denied - Failed to delete /sys/fs/cgroup/cpu,cpuacct//system.slice/systemd-random-seed.service
      lxc-start container-ubuntu-xenial 20171205000441.994 ERROR    lxc_cgfs - cgroups/cgfs.c:cgroup_rmdir:209 - Permission denied - Failed to delete /sys/fs/cgroup/cpu,cpuacct//system.slice/run-user-1000-doc.mount
      lxc-start container-ubuntu-xenial 20171205000441.100 ERROR    lxc_cgfs - cgroups/cgfs.c:cgroup_rmdir:209 - Permission denied - Failed to delete /sys/fs/cgroup/cpu,cpuacct//system.slice/systemd-journal-flush.service
      lxc-start container-ubuntu-xenial 20171205000441.102 ERROR    lxc_cgfs - cgroups/cgfs.c:cgroup_rmdir:209 - Permission denied - Failed to delete /sys/fs/cgroup/cpu,cpuacct//system.slice/fedora-readonly.service
      lxc-start container-ubuntu-xenial 20171205000441.103 ERROR    lxc_cgfs - cgroups/cgfs.c:cgroup_rmdir:209 - Permission denied - Failed to delete /sys/fs/cgroup/cpu,cpuacct//system.slice/systemd-user-sessions.service
      lxc-start container-ubuntu-xenial 20171205000441.105 ERROR    lxc_cgfs - cgroups/cgfs.c:cgroup_rmdir:209 - Permission denied - Failed to delete /sys/fs/cgroup/cpu,cpuacct//system.slice/sys-kernel-config.mount
      lxc-start container-ubuntu-xenial 20171205000441.106 ERROR    lxc_cgfs - cgroups/cgfs.c:cgroup_rmdir:209 - Permission denied - Failed to delete /sys/fs/cgroup/cpu,cpuacct//system.slice/dev-hugepages.mount
      lxc-start container-ubuntu-xenial 20171205000441.108 ERROR    lxc_cgfs - cgroups/cgfs.c:cgroup_rmdir:209 - Permission denied - Failed to delete /sys/fs/cgroup/cpu,cpuacct//system.slice/lvm2-monitor.service
      lxc-start container-ubuntu-xenial 20171205000441.109 ERROR    lxc_cgfs - cgroups/cgfs.c:cgroup_rmdir:209 - Permission denied - Failed to delete /sys/fs/cgroup/cpu,cpuacct//system.slice/lxc-net.service
      lxc-start container-ubuntu-xenial 20171205000441.111 ERROR    lxc_cgfs - cgroups/cgfs.c:cgroup_rmdir:209 - Permission denied - Failed to delete /sys/fs/cgroup/cpu,cpuacct//system.slice/upower.service
      lxc-start container-ubuntu-xenial 20171205000441.112 ERROR    lxc_cgfs - cgroups/cgfs.c:cgroup_rmdir:209 - Permission denied - Failed to delete /sys/fs/cgroup/cpu,cpuacct//system.slice/sys-fs-fuse-connections.mount
      lxc-start container-ubuntu-xenial 20171205000441.114 ERROR    lxc_cgfs - cgroups/cgfs.c:cgroup_rmdir:209 - Permission denied - Failed to delete /sys/fs/cgroup/cpu,cpuacct//system.slice/systemd-udev-settle.service
      lxc-start container-ubuntu-xenial 20171205000441.115 ERROR    lxc_cgfs - cgroups/cgfs.c:cgroup_rmdir:209 - Permission denied - Failed to delete /sys/fs/cgroup/cpu,cpuacct//system.slice/gssproxy.service
      lxc-start container-ubuntu-xenial 20171205000441.117 ERROR    lxc_cgfs - cgroups/cgfs.c:cgroup_rmdir:209 - Permission denied - Failed to delete /sys/fs/cgroup/cpu,cpuacct//system.slice/mcelog.service
      lxc-start container-ubuntu-xenial 20171205000441.118 ERROR    lxc_cgfs - cgroups/cgfs.c:cgroup_rmdir:209 - Permission denied - Failed to delete /sys/fs/cgroup/cpu,cpuacct//system.slice/NetworkManager.service
      lxc-start container-ubuntu-xenial 20171205000441.120 ERROR    lxc_cgfs - cgroups/cgfs.c:cgroup_rmdir:209 - Permission denied - Failed to delete /sys/fs/cgroup/cpu,cpuacct//system.slice/dbus.service
      lxc-start container-ubuntu-xenial 20171205000441.122 ERROR    lxc_cgfs - cgroups/cgfs.c:cgroup_rmdir:209 - Permission denied - Failed to delete /sys/fs/cgroup/cpu,cpuacct//system.slice/fedora-import-state.service
      lxc-start container-ubuntu-xenial 20171205000441.123 ERROR    lxc_cgfs - cgroups/cgfs.c:cgroup_rmdir:209 - Permission denied - Failed to delete /sys/fs/cgroup/cpu,cpuacct//system.slice/accounts-daemon.service
      lxc-start container-ubuntu-xenial 20171205000441.125 ERROR    lxc_cgfs - cgroups/cgfs.c:cgroup_rmdir:209 - Permission denied - Failed to delete /sys/fs/cgroup/cpu,cpuacct//system.slice/dev-mqueue.mount
      lxc-start container-ubuntu-xenial 20171205000441.126 ERROR    lxc_cgfs - cgroups/cgfs.c:cgroup_rmdir:209 - Permission denied - Failed to delete /sys/fs/cgroup/cpu,cpuacct//system.slice/run-user-1000.mount
      lxc-start container-ubuntu-xenial 20171205000441.128 ERROR    lxc_cgfs - cgroups/cgfs.c:cgroup_rmdir:209 - Permission denied - Failed to delete /sys/fs/cgroup/cpu,cpuacct//system.slice/udisks2.service
      lxc-start container-ubuntu-xenial 20171205000441.129 ERROR    lxc_cgfs - cgroups/cgfs.c:cgroup_rmdir:209 - Permission denied - Failed to delete /sys/fs/cgroup/cpu,cpuacct//system.slice/abrt-xorg.service
      lxc-start container-ubuntu-xenial 20171205000441.131 ERROR    lxc_cgfs - cgroups/cgfs.c:cgroup_rmdir:209 - Permission denied - Failed to delete /sys/fs/cgroup/cpu,cpuacct//system.slice/iscsi-shutdown.service
      lxc-start container-ubuntu-xenial 20171205000441.132 ERROR    lxc_cgfs - cgroups/cgfs.c:cgroup_rmdir:209 - Permission denied - Failed to delete /sys/fs/cgroup/cpu,cpuacct//system.slice/systemd-tmpfiles-setup.service
      lxc-start container-ubuntu-xenial 20171205000441.134 ERROR    lxc_cgfs - cgroups/cgfs.c:cgroup_rmdir:209 - Permission denied - Failed to delete /sys/fs/cgroup/cpu,cpuacct//system.slice/avahi-daemon.service
      lxc-start container-ubuntu-xenial 20171205000441.135 ERROR    lxc_cgfs - cgroups/cgfs.c:cgroup_rmdir:209 - Permission denied - Failed to delete /sys/fs/cgroup/cpu,cpuacct//system.slice/netcf-transaction.service
      lxc-start container-ubuntu-xenial 20171205000441.136 ERROR    lxc_cgfs - cgroups/cgfs.c:cgroup_rmdir:209 - Permission denied - Failed to delete /sys/fs/cgroup/cpu,cpuacct//system.slice/livesys.service
      lxc-start container-ubuntu-xenial 20171205000441.138 ERROR    lxc_cgfs - cgroups/cgfs.c:cgroup_rmdir:209 - Permission denied - Failed to delete /sys/fs/cgroup/cpu,cpuacct//system.slice/abrt-oops.service
      lxc-start container-ubuntu-xenial 20171205000441.139 ERROR    lxc_cgfs - cgroups/cgfs.c:cgroup_rmdir:209 - Permission denied - Failed to delete /sys/fs/cgroup/cpu,cpuacct//system.slice/systemd-remount-fs.service
      lxc-start container-ubuntu-xenial 20171205000441.141 ERROR    lxc_cgfs - cgroups/cgfs.c:cgroup_rmdir:209 - Permission denied - Failed to delete /sys/fs/cgroup/cpu,cpuacct//system.slice/system-getty.slice
      lxc-start container-ubuntu-xenial 20171205000441.142 ERROR    lxc_cgfs - cgroups/cgfs.c:cgroup_rmdir:209 - Permission denied - Failed to delete /sys/fs/cgroup/cpu,cpuacct//system.slice/dev-mapper-fedora\x2dswap.swap
      lxc-start container-ubuntu-xenial 20171205000441.144 ERROR    lxc_cgfs - cgroups/cgfs.c:cgroup_rmdir:209 - Permission denied - Failed to delete /sys/fs/cgroup/cpu,cpuacct//system.slice/dev-disk-by\x2did-dm\x2dname\x2dfedora\x2dswap.swap
      lxc-start container-ubuntu-xenial 20171205000441.145 ERROR    lxc_cgfs - cgroups/cgfs.c:cgroup_rmdir:209 - Permission denied - Failed to delete /sys/fs/cgroup/cpu,cpuacct//system.slice/systemd-update-utmp.service
      lxc-start container-ubuntu-xenial 20171205000441.147 ERROR    lxc_cgfs - cgroups/cgfs.c:cgroup_rmdir:209 - Permission denied - Failed to delete /sys/fs/cgroup/cpu,cpuacct//system.slice/system-systemd\x2dfsck.slice
      lxc-start container-ubuntu-xenial 20171205000441.148 ERROR    lxc_cgfs - cgroups/cgfs.c:cgroup_rmdir:209 - Permission denied - Failed to delete /sys/fs/cgroup/cpu,cpuacct//system.slice/smartd.service
      lxc-start container-ubuntu-xenial 20171205000441.150 ERROR    lxc_cgfs - cgroups/cgfs.c:cgroup_rmdir:209 - Permission denied - Failed to delete /sys/fs/cgroup/cpu,cpuacct//system.slice/abrtd.service
      lxc-start container-ubuntu-xenial 20171205000441.151 ERROR    lxc_cgfs - cgroups/cgfs.c:cgroup_rmdir:209 - Permission denied - Failed to delete /sys/fs/cgroup/cpu,cpuacct//system.slice/dev-disk-by\x2did-dm\x2duuid\x2dLVM\x2d0MC961VMuutSWV7QwKHOh1iipioWRobcOE3c18OP4m6YT6jUvy1dqwO4odESWnVv.swap
      lxc-start container-ubuntu-xenial 20171205000441.153 ERROR    lxc_cgfs - cgroups/cgfs.c:cgroup_rmdir:209 - Permission denied - Failed to delete /sys/fs/cgroup/cpu,cpuacct//system.slice/NetworkManager-wait-online.service
      lxc-start container-ubuntu-xenial 20171205000441.154 ERROR    lxc_cgfs - cgroups/cgfs.c:cgroup_rmdir:209 - Permission denied - Failed to delete /sys/fs/cgroup/cpu,cpuacct//system.slice/abrt-journal-core.service
      lxc-start container-ubuntu-xenial 20171205000441.156 ERROR    lxc_cgfs - cgroups/cgfs.c:cgroup_rmdir:209 - Permission denied - Failed to delete /sys/fs/cgroup/cpu,cpuacct//system.slice/ModemManager.service
      lxc-start container-ubuntu-xenial 20171205000441.157 ERROR    lxc_cgfs - cgroups/cgfs.c:cgroup_rmdir:209 - Permission denied - Failed to delete /sys/fs/cgroup/cpu,cpuacct//system.slice/systemd-logind.service
      lxc-start container-ubuntu-xenial 20171205000441.159 ERROR    lxc_cgfs - cgroups/cgfs.c:cgroup_rmdir:209 - Permission denied - Failed to delete /sys/fs/cgroup/cpu,cpuacct//system.slice/rtkit-daemon.service
      lxc-start container-ubuntu-xenial 20171205000441.160 ERROR    lxc_cgfs - cgroups/cgfs.c:cgroup_rmdir:209 - Permission denied - Failed to delete /sys/fs/cgroup/cpu,cpuacct//system.slice/sssd.service
      lxc-start container-ubuntu-xenial 20171205000441.162 ERROR    lxc_cgfs - cgroups/cgfs.c:cgroup_rmdir:209 - Permission denied - Failed to delete /sys/fs/cgroup/cpu,cpuacct//system.slice/dev-disk-by\x2duuid-fa829cce\x2d4360\x2d4f64\x2da9d6\x2d4396f7ec8b04.swap
      lxc-start container-ubuntu-xenial 20171205000441.163 ERROR    lxc_cgfs - cgroups/cgfs.c:cgroup_rmdir:209 - Permission denied - Failed to delete /sys/fs/cgroup/cpu,cpuacct//system.slice/libvirtd.service
      lxc-start container-ubuntu-xenial 20171205000441.165 ERROR    lxc_cgfs - cgroups/cgfs.c:cgroup_rmdir:209 - Permission denied - Failed to delete /sys/fs/cgroup/cpu,cpuacct//system.slice/crond.service
      lxc-start container-ubuntu-xenial 20171205000441.166 ERROR    lxc_cgfs - cgroups/cgfs.c:cgroup_rmdir:209 - Permission denied - Failed to delete /sys/fs/cgroup/cpu,cpuacct//system.slice/livesys-late.service
      lxc-start container-ubuntu-xenial 20171205000441.168 ERROR    lxc_cgfs - cgroups/cgfs.c:cgroup_rmdir:209 - Permission denied - Failed to delete /sys/fs/cgroup/cpu,cpuacct//system.slice/polkit.service
      lxc-start container-ubuntu-xenial 20171205000441.169 ERROR    lxc_cgfs - cgroups/cgfs.c:cgroup_rmdir:209 - Permission denied - Failed to delete /sys/fs/cgroup/cpu,cpuacct//system.slice/rpc-statd-notify.service
      lxc-start container-ubuntu-xenial 20171205000441.171 ERROR    lxc_cgfs - cgroups/cgfs.c:cgroup_rmdir:209 - Permission denied - Failed to delete /sys/fs/cgroup/cpu,cpuacct//system.slice/systemd-fsck-root.service
      lxc-start container-ubuntu-xenial 20171205000441.172 ERROR    lxc_cgfs - cgroups/cgfs.c:cgroup_rmdir:209 - Permission denied - Failed to delete /sys/fs/cgroup/cpu,cpuacct//system.slice/systemd-udevd.service
      lxc-start container-ubuntu-xenial 20171205000441.173 ERROR    lxc_cgfs - cgroups/cgfs.c:cgroup_rmdir:209 - Permission denied - Failed to delete /sys/fs/cgroup/cpu,cpuacct//system.slice/rsyslog.service
      lxc-start container-ubuntu-xenial 20171205000441.175 ERROR    lxc_cgfs - cgroups/cgfs.c:cgroup_rmdir:209 - Permission denied - Failed to delete /sys/fs/cgroup/cpu,cpuacct//system.slice/system-lvm2\x2dpvscan.slice
      lxc-start container-ubuntu-xenial 20171205000441.177 ERROR    lxc_cgfs - cgroups/cgfs.c:cgroup_rmdir:209 - Permission denied - Failed to delete /sys/fs/cgroup/cpu,cpuacct//system.slice/systemd-tmpfiles-setup-dev.service
      lxc-start container-ubuntu-xenial 20171205000441.178 ERROR    lxc_cgfs - cgroups/cgfs.c:cgroup_rmdir:209 - Permission denied - Failed to delete /sys/fs/cgroup/cpu,cpuacct//system.slice/systemd-journald.service
      lxc-start container-ubuntu-xenial 20171205000441.179 ERROR    lxc_cgfs - cgroups/cgfs.c:cgroup_rmdir:209 - Permission denied - Failed to delete /sys/fs/cgroup/cpu,cpuacct//system.slice/auditd.service
      lxc-start container-ubuntu-xenial 20171205000441.181 ERROR    lxc_cgfs - cgroups/cgfs.c:cgroup_rmdir:209 - Permission denied - Failed to delete /sys/fs/cgroup/cpu,cpuacct//system.slice/kmod-static-nodes.service
      lxc-start container-ubuntu-xenial 20171205000441.182 ERROR    lxc_cgfs - cgroups/cgfs.c:cgroup_rmdir:209 - Permission denied - Failed to delete /sys/fs/cgroup/cpu,cpuacct//system.slice/dracut-shutdown.service
      lxc-start container-ubuntu-xenial 20171205000441.184 ERROR    lxc_cgfs - cgroups/cgfs.c:cgroup_rmdir:209 - Permission denied - Failed to delete /sys/fs/cgroup/cpu,cpuacct//system.slice/systemd-sysctl.service
      lxc-start container-ubuntu-xenial 20171205000441.185 ERROR    lxc_cgfs - cgroups/cgfs.c:cgroup_rmdir:209 - Permission denied - Failed to delete /sys/fs/cgroup/cpu,cpuacct//system.slice/-.mount
      lxc-start container-ubuntu-xenial 20171205000441.187 ERROR    lxc_cgfs - cgroups/cgfs.c:cgroup_rmdir:209 - Permission denied - Failed to delete /sys/fs/cgroup/cpu,cpuacct//system.slice/dev-fedora-swap.swap
      lxc-start container-ubuntu-xenial 20171205000441.188 ERROR    lxc_cgfs - cgroups/cgfs.c:cgroup_rmdir:209 - Permission denied - Failed to delete /sys/fs/cgroup/cpu,cpuacct//system.slice/dev-dm\x2d1.swap
      lxc-start container-ubuntu-xenial 20171205000441.190 ERROR    lxc_cgfs - cgroups/cgfs.c:cgroup_rmdir:209 - Permission denied - Failed to delete /sys/fs/cgroup/cpu,cpuacct//system.slice/systemd-udev-trigger.service
      lxc-start container-ubuntu-xenial 20171205000441.191 ERROR    lxc_cgfs - cgroups/cgfs.c:cgroup_rmdir:209 - Permission denied - Failed to delete /sys/fs/cgroup/cpu,cpuacct//system.slice/chronyd.service
      lxc-start container-ubuntu-xenial 20171205000441.192 ERROR    lxc_cgfs - cgroups/cgfs.c:cgroup_rmdir:209 - Permission denied - Failed to delete /sys/fs/cgroup/cpu,cpuacct//system.slice
      lxc-start container-ubuntu-xenial 20171205000441.192 ERROR    lxc_cgfs - cgroups/cgfs.c:cgroup_rmdir:209 - Read-only file system - Failed to delete /sys/fs/cgroup/cpu,cpuacct/
      lxc-start container-ubuntu-xenial 20171205000441.196 ERROR    lxc_cgfs - cgroups/cgfs.c:cgroup_rmdir:209 - Permission denied - Failed to delete /sys/fs/cgroup/memory//user.slice
      lxc-start container-ubuntu-xenial 20171205000441.198 ERROR    lxc_cgfs - cgroups/cgfs.c:cgroup_rmdir:209 - Permission denied - Failed to delete /sys/fs/cgroup/memory//init.scope
      lxc-start container-ubuntu-xenial 20171205000441.202 ERROR    lxc_cgfs - cgroups/cgfs.c:cgroup_rmdir:209 - Permission denied - Failed to delete /sys/fs/cgroup/memory//system.slice/irqbalance.service
      lxc-start container-ubuntu-xenial 20171205000441.204 ERROR    lxc_cgfs - cgroups/cgfs.c:cgroup_rmdir:209 - Permission denied - Failed to delete /sys/fs/cgroup/memory//system.slice/lightdm.service
      lxc-start container-ubuntu-xenial 20171205000441.206 ERROR    lxc_cgfs - cgroups/cgfs.c:cgroup_rmdir:209 - Permission denied - Failed to delete /sys/fs/cgroup/memory//system.slice/home.mount
      lxc-start container-ubuntu-xenial 20171205000441.209 ERROR    lxc_cgfs - cgroups/cgfs.c:cgroup_rmdir:209 - Permission denied - Failed to delete /sys/fs/cgroup/memory//system.slice/var-lib-nfs-rpc_pipefs.mount
      lxc-start container-ubuntu-xenial 20171205000441.211 ERROR    lxc_cgfs - cgroups/cgfs.c:cgroup_rmdir:209 - Permission denied - Failed to delete /sys/fs/cgroup/memory//system.slice/sys-kernel-debug.mount
      lxc-start container-ubuntu-xenial 20171205000441.213 ERROR    lxc_cgfs - cgroups/cgfs.c:cgroup_rmdir:209 - Permission denied - Failed to delete /sys/fs/cgroup/memory//system.slice/boot.mount
      lxc-start container-ubuntu-xenial 20171205000441.216 ERROR    lxc_cgfs - cgroups/cgfs.c:cgroup_rmdir:209 - Permission denied - Failed to delete /sys/fs/cgroup/memory//system.slice/tmp.mount
      lxc-start container-ubuntu-xenial 20171205000441.218 ERROR    lxc_cgfs - cgroups/cgfs.c:cgroup_rmdir:209 - Permission denied - Failed to delete /sys/fs/cgroup/memory//system.slice/alsa-state.service
      lxc-start container-ubuntu-xenial 20171205000441.220 ERROR    lxc_cgfs - cgroups/cgfs.c:cgroup_rmdir:209 - Permission denied - Failed to delete /sys/fs/cgroup/memory//system.slice/firewalld.service
      lxc-start container-ubuntu-xenial 20171205000441.223 ERROR    lxc_cgfs - cgroups/cgfs.c:cgroup_rmdir:209 - Permission denied - Failed to delete /sys/fs/cgroup/memory//system.slice/systemd-random-seed.service
      lxc-start container-ubuntu-xenial 20171205000441.225 ERROR    lxc_cgfs - cgroups/cgfs.c:cgroup_rmdir:209 - Permission denied - Failed to delete /sys/fs/cgroup/memory//system.slice/run-user-1000-doc.mount
      lxc-start container-ubuntu-xenial 20171205000441.228 ERROR    lxc_cgfs - cgroups/cgfs.c:cgroup_rmdir:209 - Permission denied - Failed to delete /sys/fs/cgroup/memory//system.slice/systemd-journal-flush.service
      lxc-start container-ubuntu-xenial 20171205000441.230 ERROR    lxc_cgfs - cgroups/cgfs.c:cgroup_rmdir:209 - Permission denied - Failed to delete /sys/fs/cgroup/memory//system.slice/fedora-readonly.service
      lxc-start container-ubuntu-xenial 20171205000441.232 ERROR    lxc_cgfs - cgroups/cgfs.c:cgroup_rmdir:209 - Permission denied - Failed to delete /sys/fs/cgroup/memory//system.slice/systemd-user-sessions.service
      lxc-start container-ubuntu-xenial 20171205000441.235 ERROR    lxc_cgfs - cgroups/cgfs.c:cgroup_rmdir:209 - Permission denied - Failed to delete /sys/fs/cgroup/memory//system.slice/sys-kernel-config.mount
      lxc-start container-ubuntu-xenial 20171205000441.237 ERROR    lxc_cgfs - cgroups/cgfs.c:cgroup_rmdir:209 - Permission denied - Failed to delete /sys/fs/cgroup/memory//system.slice/dev-hugepages.mount
      lxc-start container-ubuntu-xenial 20171205000441.239 ERROR    lxc_cgfs - cgroups/cgfs.c:cgroup_rmdir:209 - Permission denied - Failed to delete /sys/fs/cgroup/memory//system.slice/lvm2-monitor.service
      lxc-start container-ubuntu-xenial 20171205000441.242 ERROR    lxc_cgfs - cgroups/cgfs.c:cgroup_rmdir:209 - Permission denied - Failed to delete /sys/fs/cgroup/memory//system.slice/lxc-net.service
      lxc-start container-ubuntu-xenial 20171205000441.244 ERROR    lxc_cgfs - cgroups/cgfs.c:cgroup_rmdir:209 - Permission denied - Failed to delete /sys/fs/cgroup/memory//system.slice/upower.service
      lxc-start container-ubuntu-xenial 20171205000441.246 ERROR    lxc_cgfs - cgroups/cgfs.c:cgroup_rmdir:209 - Permission denied - Failed to delete /sys/fs/cgroup/memory//system.slice/sys-fs-fuse-connections.mount
      lxc-start container-ubuntu-xenial 20171205000441.249 ERROR    lxc_cgfs - cgroups/cgfs.c:cgroup_rmdir:209 - Permission denied - Failed to delete /sys/fs/cgroup/memory//system.slice/systemd-udev-settle.service
      lxc-start container-ubuntu-xenial 20171205000441.251 ERROR    lxc_cgfs - cgroups/cgfs.c:cgroup_rmdir:209 - Permission denied - Failed to delete /sys/fs/cgroup/memory//system.slice/gssproxy.service
      lxc-start container-ubuntu-xenial 20171205000441.253 ERROR    lxc_cgfs - cgroups/cgfs.c:cgroup_rmdir:209 - Permission denied - Failed to delete /sys/fs/cgroup/memory//system.slice/mcelog.service
      lxc-start container-ubuntu-xenial 20171205000441.256 ERROR    lxc_cgfs - cgroups/cgfs.c:cgroup_rmdir:209 - Permission denied - Failed to delete /sys/fs/cgroup/memory//system.slice/NetworkManager.service
      lxc-start container-ubuntu-xenial 20171205000441.258 ERROR    lxc_cgfs - cgroups/cgfs.c:cgroup_rmdir:209 - Permission denied - Failed to delete /sys/fs/cgroup/memory//system.slice/dbus.service
      lxc-start container-ubuntu-xenial 20171205000441.260 ERROR    lxc_cgfs - cgroups/cgfs.c:cgroup_rmdir:209 - Permission denied - Failed to delete /sys/fs/cgroup/memory//system.slice/fedora-import-state.service
      lxc-start container-ubuntu-xenial 20171205000441.263 ERROR    lxc_cgfs - cgroups/cgfs.c:cgroup_rmdir:209 - Permission denied - Failed to delete /sys/fs/cgroup/memory//system.slice/accounts-daemon.service
      lxc-start container-ubuntu-xenial 20171205000441.265 ERROR    lxc_cgfs - cgroups/cgfs.c:cgroup_rmdir:209 - Permission denied - Failed to delete /sys/fs/cgroup/memory//system.slice/dev-mqueue.mount
      lxc-start container-ubuntu-xenial 20171205000441.268 ERROR    lxc_cgfs - cgroups/cgfs.c:cgroup_rmdir:209 - Permission denied - Failed to delete /sys/fs/cgroup/memory//system.slice/run-user-1000.mount
      lxc-start container-ubuntu-xenial 20171205000441.270 ERROR    lxc_cgfs - cgroups/cgfs.c:cgroup_rmdir:209 - Permission denied - Failed to delete /sys/fs/cgroup/memory//system.slice/udisks2.service
      lxc-start container-ubuntu-xenial 20171205000441.272 ERROR    lxc_cgfs - cgroups/cgfs.c:cgroup_rmdir:209 - Permission denied - Failed to delete /sys/fs/cgroup/memory//system.slice/abrt-xorg.service
      lxc-start container-ubuntu-xenial 20171205000441.275 ERROR    lxc_cgfs - cgroups/cgfs.c:cgroup_rmdir:209 - Permission denied - Failed to delete /sys/fs/cgroup/memory//system.slice/iscsi-shutdown.service
      lxc-start container-ubuntu-xenial 20171205000441.277 ERROR    lxc_cgfs - cgroups/cgfs.c:cgroup_rmdir:209 - Permission denied - Failed to delete /sys/fs/cgroup/memory//system.slice/systemd-tmpfiles-setup.service
      lxc-start container-ubuntu-xenial 20171205000441.280 ERROR    lxc_cgfs - cgroups/cgfs.c:cgroup_rmdir:209 - Permission denied - Failed to delete /sys/fs/cgroup/memory//system.slice/avahi-daemon.service
      lxc-start container-ubuntu-xenial 20171205000441.282 ERROR    lxc_cgfs - cgroups/cgfs.c:cgroup_rmdir:209 - Permission denied - Failed to delete /sys/fs/cgroup/memory//system.slice/netcf-transaction.service
      lxc-start container-ubuntu-xenial 20171205000441.285 ERROR    lxc_cgfs - cgroups/cgfs.c:cgroup_rmdir:209 - Permission denied - Failed to delete /sys/fs/cgroup/memory//system.slice/livesys.service
      lxc-start container-ubuntu-xenial 20171205000441.287 ERROR    lxc_cgfs - cgroups/cgfs.c:cgroup_rmdir:209 - Permission denied - Failed to delete /sys/fs/cgroup/memory//system.slice/abrt-oops.service
      lxc-start container-ubuntu-xenial 20171205000441.290 ERROR    lxc_cgfs - cgroups/cgfs.c:cgroup_rmdir:209 - Permission denied - Failed to delete /sys/fs/cgroup/memory//system.slice/systemd-remount-fs.service
      lxc-start container-ubuntu-xenial 20171205000441.292 ERROR    lxc_cgfs - cgroups/cgfs.c:cgroup_rmdir:209 - Permission denied - Failed to delete /sys/fs/cgroup/memory//system.slice/system-getty.slice
      lxc-start container-ubuntu-xenial 20171205000441.295 ERROR    lxc_cgfs - cgroups/cgfs.c:cgroup_rmdir:209 - Permission denied - Failed to delete /sys/fs/cgroup/memory//system.slice/dev-mapper-fedora\x2dswap.swap
      lxc-start container-ubuntu-xenial 20171205000441.297 ERROR    lxc_cgfs - cgroups/cgfs.c:cgroup_rmdir:209 - Permission denied - Failed to delete /sys/fs/cgroup/memory//system.slice/dev-disk-by\x2did-dm\x2dname\x2dfedora\x2dswap.swap
      lxc-start container-ubuntu-xenial 20171205000441.299 ERROR    lxc_cgfs - cgroups/cgfs.c:cgroup_rmdir:209 - Permission denied - Failed to delete /sys/fs/cgroup/memory//system.slice/systemd-update-utmp.service
      lxc-start container-ubuntu-xenial 20171205000441.302 ERROR    lxc_cgfs - cgroups/cgfs.c:cgroup_rmdir:209 - Permission denied - Failed to delete /sys/fs/cgroup/memory//system.slice/system-systemd\x2dfsck.slice
      lxc-start container-ubuntu-xenial 20171205000441.304 ERROR    lxc_cgfs - cgroups/cgfs.c:cgroup_rmdir:209 - Permission denied - Failed to delete /sys/fs/cgroup/memory//system.slice/smartd.service
      lxc-start container-ubuntu-xenial 20171205000441.307 ERROR    lxc_cgfs - cgroups/cgfs.c:cgroup_rmdir:209 - Permission denied - Failed to delete /sys/fs/cgroup/memory//system.slice/abrtd.service
      lxc-start container-ubuntu-xenial 20171205000441.309 ERROR    lxc_cgfs - cgroups/cgfs.c:cgroup_rmdir:209 - Permission denied - Failed to delete /sys/fs/cgroup/memory//system.slice/dev-disk-by\x2did-dm\x2duuid\x2dLVM\x2d0MC961VMuutSWV7QwKHOh1iipioWRobcOE3c18OP4m6YT6jUvy1dqwO4odESWnVv.swap
      lxc-start container-ubuntu-xenial 20171205000441.312 ERROR    lxc_cgfs - cgroups/cgfs.c:cgroup_rmdir:209 - Permission denied - Failed to delete /sys/fs/cgroup/memory//system.slice/NetworkManager-wait-online.service
      lxc-start container-ubuntu-xenial 20171205000441.314 ERROR    lxc_cgfs - cgroups/cgfs.c:cgroup_rmdir:209 - Permission denied - Failed to delete /sys/fs/cgroup/memory//system.slice/abrt-journal-core.service
      lxc-start container-ubuntu-xenial 20171205000441.316 ERROR    lxc_cgfs - cgroups/cgfs.c:cgroup_rmdir:209 - Permission denied - Failed to delete /sys/fs/cgroup/memory//system.slice/ModemManager.service
      lxc-start container-ubuntu-xenial 20171205000441.319 ERROR    lxc_cgfs - cgroups/cgfs.c:cgroup_rmdir:209 - Permission denied - Failed to delete /sys/fs/cgroup/memory//system.slice/systemd-logind.service
      lxc-start container-ubuntu-xenial 20171205000441.321 ERROR    lxc_cgfs - cgroups/cgfs.c:cgroup_rmdir:209 - Permission denied - Failed to delete /sys/fs/cgroup/memory//system.slice/rtkit-daemon.service
      lxc-start container-ubuntu-xenial 20171205000441.324 ERROR    lxc_cgfs - cgroups/cgfs.c:cgroup_rmdir:209 - Permission denied - Failed to delete /sys/fs/cgroup/memory//system.slice/sssd.service
      lxc-start container-ubuntu-xenial 20171205000441.327 ERROR    lxc_cgfs - cgroups/cgfs.c:cgroup_rmdir:209 - Permission denied - Failed to delete /sys/fs/cgroup/memory//system.slice/dev-disk-by\x2duuid-fa829cce\x2d4360\x2d4f64\x2da9d6\x2d4396f7ec8b04.swap
      lxc-start container-ubuntu-xenial 20171205000441.330 ERROR    lxc_cgfs - cgroups/cgfs.c:cgroup_rmdir:209 - Permission denied - Failed to delete /sys/fs/cgroup/memory//system.slice/libvirtd.service
      lxc-start container-ubuntu-xenial 20171205000441.332 ERROR    lxc_cgfs - cgroups/cgfs.c:cgroup_rmdir:209 - Permission denied - Failed to delete /sys/fs/cgroup/memory//system.slice/crond.service
      lxc-start container-ubuntu-xenial 20171205000441.337 ERROR    lxc_cgfs - cgroups/cgfs.c:cgroup_rmdir:209 - Permission denied - Failed to delete /sys/fs/cgroup/memory//system.slice/livesys-late.service
      lxc-start container-ubuntu-xenial 20171205000441.341 ERROR    lxc_cgfs - cgroups/cgfs.c:cgroup_rmdir:209 - Permission denied - Failed to delete /sys/fs/cgroup/memory//system.slice/polkit.service
      lxc-start container-ubuntu-xenial 20171205000441.343 ERROR    lxc_cgfs - cgroups/cgfs.c:cgroup_rmdir:209 - Permission denied - Failed to delete /sys/fs/cgroup/memory//system.slice/rpc-statd-notify.service
      lxc-start container-ubuntu-xenial 20171205000441.346 ERROR    lxc_cgfs - cgroups/cgfs.c:cgroup_rmdir:209 - Permission denied - Failed to delete /sys/fs/cgroup/memory//system.slice/systemd-fsck-root.service
      lxc-start container-ubuntu-xenial 20171205000441.348 ERROR    lxc_cgfs - cgroups/cgfs.c:cgroup_rmdir:209 - Permission denied - Failed to delete /sys/fs/cgroup/memory//system.slice/systemd-udevd.service
      lxc-start container-ubuntu-xenial 20171205000441.351 ERROR    lxc_cgfs - cgroups/cgfs.c:cgroup_rmdir:209 - Permission denied - Failed to delete /sys/fs/cgroup/memory//system.slice/rsyslog.service
      lxc-start container-ubuntu-xenial 20171205000441.353 ERROR    lxc_cgfs - cgroups/cgfs.c:cgroup_rmdir:209 - Permission denied - Failed to delete /sys/fs/cgroup/memory//system.slice/system-lvm2\x2dpvscan.slice
      lxc-start container-ubuntu-xenial 20171205000441.356 ERROR    lxc_cgfs - cgroups/cgfs.c:cgroup_rmdir:209 - Permission denied - Failed to delete /sys/fs/cgroup/memory//system.slice/systemd-tmpfiles-setup-dev.service
      lxc-start container-ubuntu-xenial 20171205000441.358 ERROR    lxc_cgfs - cgroups/cgfs.c:cgroup_rmdir:209 - Permission denied - Failed to delete /sys/fs/cgroup/memory//system.slice/systemd-journald.service
      lxc-start container-ubuntu-xenial 20171205000441.360 ERROR    lxc_cgfs - cgroups/cgfs.c:cgroup_rmdir:209 - Permission denied - Failed to delete /sys/fs/cgroup/memory//system.slice/auditd.service
      lxc-start container-ubuntu-xenial 20171205000441.363 ERROR    lxc_cgfs - cgroups/cgfs.c:cgroup_rmdir:209 - Permission denied - Failed to delete /sys/fs/cgroup/memory//system.slice/kmod-static-nodes.service
      lxc-start container-ubuntu-xenial 20171205000441.365 ERROR    lxc_cgfs - cgroups/cgfs.c:cgroup_rmdir:209 - Permission denied - Failed to delete /sys/fs/cgroup/memory//system.slice/dracut-shutdown.service
      lxc-start container-ubuntu-xenial 20171205000441.368 ERROR    lxc_cgfs - cgroups/cgfs.c:cgroup_rmdir:209 - Permission denied - Failed to delete /sys/fs/cgroup/memory//system.slice/systemd-sysctl.service
      lxc-start container-ubuntu-xenial 20171205000441.370 ERROR    lxc_cgfs - cgroups/cgfs.c:cgroup_rmdir:209 - Permission denied - Failed to delete /sys/fs/cgroup/memory//system.slice/-.mount
      lxc-start container-ubuntu-xenial 20171205000441.372 ERROR    lxc_cgfs - cgroups/cgfs.c:cgroup_rmdir:209 - Permission denied - Failed to delete /sys/fs/cgroup/memory//system.slice/dev-fedora-swap.swap
      lxc-start container-ubuntu-xenial 20171205000441.375 ERROR    lxc_cgfs - cgroups/cgfs.c:cgroup_rmdir:209 - Permission denied - Failed to delete /sys/fs/cgroup/memory//system.slice/dev-dm\x2d1.swap
      lxc-start container-ubuntu-xenial 20171205000441.377 ERROR    lxc_cgfs - cgroups/cgfs.c:cgroup_rmdir:209 - Permission denied - Failed to delete /sys/fs/cgroup/memory//system.slice/systemd-udev-trigger.service
      lxc-start container-ubuntu-xenial 20171205000441.379 ERROR    lxc_cgfs - cgroups/cgfs.c:cgroup_rmdir:209 - Permission denied - Failed to delete /sys/fs/cgroup/memory//system.slice/chronyd.service
      lxc-start container-ubuntu-xenial 20171205000441.380 ERROR    lxc_cgfs - cgroups/cgfs.c:cgroup_rmdir:209 - Permission denied - Failed to delete /sys/fs/cgroup/memory//system.slice
      lxc-start container-ubuntu-xenial 20171205000441.380 ERROR    lxc_cgfs - cgroups/cgfs.c:cgroup_rmdir:209 - Read-only file system - Failed to delete /sys/fs/cgroup/memory/
      lxc-start container-ubuntu-xenial 20171205000441.381 ERROR    lxc_cgfs - cgroups/cgfs.c:cgroup_rmdir:209 - Permission denied - Failed to delete /sys/fs/cgroup/systemd/user.slice/user-1000.slice/session-2.scope
      lxc-start container-ubuntu-xenial 20171205000441.382 ERROR    lxc_start - start.c:lxc_spawn:1245 - Failed creating cgroups.
      lxc-start container-ubuntu-xenial 20171205000441.382 DEBUG    lxc_network - network.c:lxc_delete_network_unpriv:2306 - Cannot not guarantee safe deletion of network devices. Manual cleanup maybe needed
      lxc-start container-ubuntu-xenial 20171205000441.382 DEBUG    lxc_network - network.c:lxc_delete_network:3121 - Failed to delete network devices
      lxc-start container-ubuntu-xenial 20171205000441.382 TRACE    lxc_start - start.c:lxc_serve_state_clients:350 - Set container state to ABORTING
      lxc-start container-ubuntu-xenial 20171205000441.382 TRACE    lxc_start - start.c:lxc_serve_state_clients:353 - No state clients registered
      lxc-start container-ubuntu-xenial 20171205000441.383 ERROR    lxc_start - start.c:__lxc_start:1503 - Failed to spawn container "container-ubuntu-xenial".
      lxc-start container-ubuntu-xenial 20171205000441.383 TRACE    lxc_start - start.c:lxc_serve_state_clients:350 - Set container state to STOPPING
      lxc-start container-ubuntu-xenial 20171205000441.383 TRACE    lxc_start - start.c:lxc_serve_state_clients:353 - No state clients registered
      lxc-start container-ubuntu-xenial 20171205000441.383 TRACE    lxc_start - start.c:lxc_serve_state_clients:350 - Set container state to STOPPED
      lxc-start container-ubuntu-xenial 20171205000441.383 TRACE    lxc_start - start.c:lxc_serve_state_clients:353 - No state clients registered
      lxc-start container-ubuntu-xenial 20171205000552.987 TRACE    lxc_commands - commands.c:lxc_cmd:308 - Connection refused - Command "get_init_pid" failed to connect command socket
      lxc-start container-ubuntu-xenial 20171205000552.987 TRACE    lxc_commands - commands.c:lxc_cmd:308 - Connection refused - Command "get_cgroup" failed to connect command socket
      lxc-start container-ubuntu-xenial 20171205000552.987 TRACE    lxc_commands - commands.c:lxc_cmd:308 - Connection refused - Command "get_state" failed to connect command socket

Information to attach

dmesg shows nothing.
Container configs:
cat ~/.config/lxc/default.conf
lxc.include = /etc/lxc/default.conf
lxc.idmap = u 0 165536 65536
lxc.idmap = g 0 165536 65536

cat /etc/lxc/default.conf
lxc.net.0.type = veth
lxc.net.0.link = virbr0
lxc.net.0.flags = up
lxc.net.0.hwaddr = 00:16:3e:xx:xx:xx

OBS: In fedora wiki they instruct users to set link to virbr0 instead of lxcbr0, and to start libvirtd and lxc.service.

If lxc-start is executed by root, this is returned:
Executing '/sbin/init' with no configuration file may crash the host

@marcosps
Copy link
Contributor Author

marcosps commented Dec 5, 2017

I'll try to check this issue next week, but for now I think opening a bug is good so others can check this out too :)

@brauner
Copy link
Member

brauner commented Dec 5, 2017

Right, I forgot to comment on this one. Fedora 27 comes with selinux enabled by default and a specific profile. All cgroups mounts in the cgroup filesystem carry a seclabel option indicating that the filesystem supports selinux labels via xattrs. If you want to be able to run unprivileged container you need to take care to configure selinux correctly. As a starting point you should figure out what labels the cgroup mounts carry and what restrictions they bring. This is however very likely unrelated to liblxc itself so closing. In case the container needs to carry a specific selinux label you can use the lxc.selinux.context configuration key.

@brauner brauner closed this as completed Dec 5, 2017
@marcosps
Copy link
Contributor Author

marcosps commented Dec 5, 2017

@brauner in this case, disabling selinux should be enough to start containers? I tried here and it returned the same errors. Still checking why is this happening, so I don't know if some config is still necessary or this should be enough.

Meanwhile, running as root worked out of the box!

@marcosps
Copy link
Contributor Author

investigating more, it seems this issue has the same root cause that #1678 , related to cgroup configuration when starting an unprivileged container, while starting a container as root works as expected.

@brauner
Copy link
Member

brauner commented Dec 21, 2017

Here are the output of lxc-ls with cgfsng debug enabled. While the unprivileged start fails in cgfsng, root user prints a handful of hierarchies. Does it help to debug this problem further @brauner ?

root_cgfsng_output.txt
user_cgfsng_output.txt

The problem is that when you want to run containers as an unprivileged use liblxc you or your administrator need to make sure to place you in writable cgroups. When you are root liblxc can do it by itself obviously. liblxc expects at least the freezer cgroup to be writable. We ship a pam module with lxcfs that does this for you on login. If you don't have this module you need a script like this:


printf '\n\033[42mCreating cgroup hierarchy\033[m\n\n' &&
for d in /sys/fs/cgroup/*; do
        f=$(basename $d)
        echo "looking at $f"
        if [ "$f" = "cpuset" ]; then
                echo 1 | sudo tee -a $d/cgroup.clone_children;
        elif [ "$f" = "memory" ]; then
                echo 1 | sudo tee -a $d/memory.use_hierarchy;
        fi
        sudo mkdir -p $d/$USER
        sudo chown -R $USER $d/$USER
        # add current process to cgroup
       echo $PPID > $d/$USER/tasks
done

(Doesn't place you in a writable cgroup for the unified hierarchy though. But that isn't required.)

@marcosps
Copy link
Contributor Author

@brauner that worked like a charm, thanks!

For now, Fedora would need libcgroup-pam in order to make it work out of the box?

@brauner
Copy link
Member

brauner commented Jan 19, 2018

Haven't heard of libcgroup-pam yet. Doesn't Fedora ship lxcfs + libpam-cgfs?

@marcosps
Copy link
Contributor Author

I found libcgroup-pam in fedora repositories, but it seems this is a wrapper around libcg: https://www.rpmfind.net/linux/RPM/fedora/27/x86_64/l/libcgroup-pam-0.41-13.fc27.x86_64.html

So far I didn't find any references to lxcfs and libpam-cgfs in fedora repositories. So, back to blackboard...

@jafd
Copy link

jafd commented Jan 23, 2018

If this issue is clearly not yet resolved, why is it closed?

@brauner
Copy link
Member

brauner commented Jan 24, 2018

@jafd, the root cause of the problem is that unprivileged users on most systems will not be placed into writable cgroups at login time. lxc requires only the freezer hierarchy currently. But creating writable cgroups for unprivileged users at login time is not lxc's job. In fact, it's not even possible for lxc to do it since it requires (root) privileges an unprivileged user doesn't have. So if you want to run unprivileged containers as an unprivileged user you either need to have your system manager/init system create writable cgroups for your unprivileged user at login time or you need to convince Fedora to include https://github.com/lxc/lxcfs and specifically the pam module https://github.com/lxc/lxcfs/blob/master/pam/pam_cgfs.c to be shipped as a package which would allow you to do this for you.

@laolux
Copy link

laolux commented Jan 30, 2018

@brauner , I have an unprivileged container which I can use as unprivileged user if I use (as root) a script provided by stgraber in issue #1678. Now I would like to get rid of that script and instead use the pam module pam_cgfs from lxcfs. So I made a fedora rpm from lxcfs and installed it (will share it if I get it to work). Then I placed session optional pam_cgfs.so -c freezer,memory,name=systemd,unified in /etc/pam.d/postlogin. However this does not work, I still need to use the aforementioned script. Any ideas of what I am missing? Using Fedora 27 and Gnome on wayland. Thanks a lot.

@brauner
Copy link
Member

brauner commented Apr 10, 2018

@laolux, sorry totally missed your ping. I'm not sure how exactly pam modules are enabled on Fedora. Do you see anything interesting dmesg output, e.g. that the pam module failed or something?

@laolux
Copy link

laolux commented Apr 24, 2018

@brauner Thanks for the reply. I was on vacation, so took a bit longer. The pam module does not seem to fail. If I remove the pam_cgfs.so, then I get an error in journalctl, but if it's there, then I get the following line in journactl:
Apr 23 11:37:57 host.name audit[1623]: USER_START pid=1623 uid=0 auid=1000 ses=2 subj=system_u:system_r:xdm_t:s0-s0:c0.c1023 msg='op=PAM:session_open grantors=pam_selinux,pam_loginuid,pam_selinux,pam_keyinit,pam_namespace,pam_keyinit,,pam_limits,pam_systemd,pam_unix,pam_gnome_keyring,pam_cgfs acct="laolux" exe="/usr/libexec/gdm-session-worker" hostname=host.name addr=? terminal=/dev/tty2 res=success'
So to me it seems like it's loaded and that laolux should be able to start unprivileged containers on tty2 (graphical user interface) and corresponding terminal windows.
However, I cannot start my containers, unless I use the aforementioned script by stgraber.
dmesg gives no output regarding cfgs or lxc and only one trivial line for PAM.
Could it be that the pam module only gives the permissions to the gui, but not the subsequent terminal windows?

@jafd
Copy link

jafd commented Apr 24, 2018

Could it be that the pam module only gives the permissions to the gui, but not the subsequent terminal windows?

Could it be that the permission is granted to a wrong parent? I was under impression that when you move a process into a namespace, its subsequent children will inherit it. Not sure about existing children.

@brauner
Copy link
Member

brauner commented Apr 24, 2018

Can you show

cat /proc/self/cgroup

after you logged in?

@laolux
Copy link

laolux commented Apr 26, 2018

cat /proc/self/cgroup yields

11:blkio:/
10:cpuset:/
9:pids:/user.slice/user-1000.slice/user@1000.service
8:devices:/user.slice
7:net_cls,net_prio:/
6:hugetlb:/
5:memory:/
4:freezer:/
3:cpu,cpuacct:/
2:perf_event:/
1:name=systemd:/user.slice/user-1000.slice/user@1000.service/gnome-terminal-server.service
0::/user.slice/user-1000.slice/user@1000.service/gnome-terminal-server.service

I get the same result when I remove the pam_cgfs.so.

Maybe I loaded the cgfs module at the wrong time? I currently use

session	optional	pam_cgfs.so -c freezer,memory,name=systemd,unified

in /etc/pam.d/postlogin as well as in etc/pam.d/postlogin-ac. Where is it on your systems?

@jafd
Copy link

jafd commented Jul 6, 2018

Try running lxc commands from anything else than gnome-terminal. I'm using that as a workaround, but still wondering why cgroup under gnome-terminal-server break it. :(

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Development

No branches or pull requests

4 participants