Memory limits no longer being applied

I noticed today that containers are showing the hosts ram as available and not the memory limit set for the container. Disk and CPU limits are still working.


If I manually apply the limits via lxc config set cname limits.memory 512MB, it works and htop shows the correct ram, but when the container is rebooted, it reverts back to the host’s ram amount even though it’s config is set to 512MB.

Tried to fix by: rebooting host, creating new containers and going through Memory and CPU limits not showing as applied (3.15?) / Problems with lxc memory limits

Host info:

Name    Version    Rev    Tracking       Publisher   Notes
core    16-2.44.1  8935   latest/stable  canonical✓  core
core18  20200311   1705   latest/stable  canonical✓  base
lxd     4.0.0      14594  latest/stable  canonical✓  -
root      1797  0.0  0.0 384808  2052 ?        Sl   20:20   0:00 lxcfs --enable-loadavg /var/snap/lxd/common/var/lib/lxcfs -p /var/snap/lxd/common/lxcfs.pid

Cgroup memory limit inside container

root@db01:~# cat /sys/fs/cgroup/memory/memory.limit_in_bytes
9223372036854771712

Mounts inside the container

root@db01:~# cat /proc/mounts
pool1/containers/pod-fe892926-7f53-11ea-bbf7-080027ca2ca5 / zfs rw,xattr,posixacl 0 0
none /dev tmpfs rw,relatime,size=492k,mode=755,uid=1327680,gid=1327680 0 0
proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0
sysfs /sys sysfs rw,relatime 0 0
udev /dev/fuse devtmpfs rw,nosuid,relatime,size=2006396k,nr_inodes=501599,mode=755 0 0
udev /dev/net/tun devtmpfs rw,nosuid,relatime,size=2006396k,nr_inodes=501599,mode=755 0 0
binfmt_misc /proc/sys/fs/binfmt_misc binfmt_misc rw,relatime 0 0
fusectl /sys/fs/fuse/connections fusectl rw,relatime 0 0
pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0
configfs /sys/kernel/config configfs rw,relatime 0 0
debugfs /sys/kernel/debug debugfs rw,relatime 0 0
securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0
sysfs /sys/kernel/tracing sysfs rw,nosuid,nodev,noexec,relatime 0 0
mqueue /dev/mqueue mqueue rw,relatime 0 0
tmpfs /dev/.lxd-mounts tmpfs rw,relatime,size=100k,mode=711 0 0
lxcfs /proc/cpuinfo fuse.lxcfs rw,nosuid,nodev,relatime,user_id=0,group_id=0,allow_other 0 0
lxcfs /proc/diskstats fuse.lxcfs rw,nosuid,nodev,relatime,user_id=0,group_id=0,allow_other 0 0
lxcfs /proc/loadavg fuse.lxcfs rw,nosuid,nodev,relatime,user_id=0,group_id=0,allow_other 0 0
lxcfs /proc/meminfo fuse.lxcfs rw,nosuid,nodev,relatime,user_id=0,group_id=0,allow_other 0 0
lxcfs /proc/stat fuse.lxcfs rw,nosuid,nodev,relatime,user_id=0,group_id=0,allow_other 0 0
lxcfs /proc/swaps fuse.lxcfs rw,nosuid,nodev,relatime,user_id=0,group_id=0,allow_other 0 0
lxcfs /proc/uptime fuse.lxcfs rw,nosuid,nodev,relatime,user_id=0,group_id=0,allow_other 0 0
lxcfs /sys/devices/system/cpu/online fuse.lxcfs rw,nosuid,nodev,relatime,user_id=0,group_id=0,allow_other 0 0
udev /dev/full devtmpfs rw,nosuid,relatime,size=2006396k,nr_inodes=501599,mode=755 0 0
udev /dev/null devtmpfs rw,nosuid,relatime,size=2006396k,nr_inodes=501599,mode=755 0 0
udev /dev/random devtmpfs rw,nosuid,relatime,size=2006396k,nr_inodes=501599,mode=755 0 0
udev /dev/tty devtmpfs rw,nosuid,relatime,size=2006396k,nr_inodes=501599,mode=755 0 0
udev /dev/urandom devtmpfs rw,nosuid,relatime,size=2006396k,nr_inodes=501599,mode=755 0 0
udev /dev/zero devtmpfs rw,nosuid,relatime,size=2006396k,nr_inodes=501599,mode=755 0 0
devpts /dev/console devpts rw,relatime,gid=5,mode=620,ptmxmode=666 0 0
none /proc/sys/kernel/random/boot_id tmpfs ro,nosuid,nodev,noexec,relatime,size=492k,mode=755,uid=1327680,gid=1327680 0 0
devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=1327685,mode=620,ptmxmode=666,max=1024 0 0
devpts /dev/ptmx devpts rw,nosuid,noexec,relatime,gid=1327685,mode=620,ptmxmode=666,max=1024 0 0
tmpfs /dev/shm tmpfs rw,nosuid,nodev,uid=1327680,gid=1327680 0 0
tmpfs /run tmpfs rw,nosuid,nodev,mode=755,uid=1327680,gid=1327680 0 0
tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k,uid=1327680,gid=1327680 0 0
tmpfs /sys/fs/cgroup tmpfs ro,nosuid,nodev,noexec,mode=755,uid=1327680,gid=1327680 0 0
cgroup /sys/fs/cgroup/unified cgroup2 rw,nosuid,nodev,noexec,relatime 0 0
cgroup /sys/fs/cgroup/systemd cgroup rw,nosuid,nodev,noexec,relatime,xattr,name=systemd 0 0
cgroup /sys/fs/cgroup/cpu,cpuacct cgroup rw,nosuid,nodev,noexec,relatime,cpu,cpuacct 0 0
cgroup /sys/fs/cgroup/net_cls,net_prio cgroup rw,nosuid,nodev,noexec,relatime,net_cls,net_prio 0 0
cgroup /sys/fs/cgroup/devices cgroup rw,nosuid,nodev,noexec,relatime,devices 0 0
cgroup /sys/fs/cgroup/perf_event cgroup rw,nosuid,nodev,noexec,relatime,perf_event 0 0
cgroup /sys/fs/cgroup/hugetlb cgroup rw,nosuid,nodev,noexec,relatime,hugetlb 0 0
cgroup /sys/fs/cgroup/pids cgroup rw,nosuid,nodev,noexec,relatime,pids 0 0
cgroup /sys/fs/cgroup/cpuset cgroup rw,nosuid,nodev,noexec,relatime,cpuset,clone_children 0 0
cgroup /sys/fs/cgroup/freezer cgroup rw,nosuid,nodev,noexec,relatime,freezer 0 0
cgroup /sys/fs/cgroup/memory cgroup rw,nosuid,nodev,noexec,relatime,memory 0 0
cgroup /sys/fs/cgroup/blkio cgroup rw,nosuid,nodev,noexec,relatime,blkio 0 0
cgroup /sys/fs/cgroup/rdma cgroup rw,nosuid,nodev,noexec,relatime,rdma 0 0

Container info:

architecture: x86_64
config:
  image.architecture: amd64
  image.description: Ubuntu bionic amd64 (20200402_07:42)
  image.os: Ubuntu
  image.release: bionic
  image.serial: "20200402_07:42"
  image.type: squashfs
  limits.cpu: "2"
  limits.memory: 512MB
  security.devlxd: "false"
  security.idmap.isolated: "true"
  security.nesting: "false"
  security.privileged: "false"
  user.network-config: |
    #cloud-config
    version: 1
    config:
    - type: physical
      name: eth0
      subnets:
        - type: static
          address: 192.168.1.180/24
          gateway: 192.168.1.254
          dns_nameservers:
            - 1.1.1.1
            - 8.8.8.8
  user.user-data: |
    #cloud-config
    preserve_hostname: false
    hostname: db01.pingly.com
    chpasswd:
      list: |
        root:root
      expire: True

    users:
      - name: ark-agent
        shell: /bin/false
        no_create_home: true
        uid: "3000"
  volatile.base_image: 5f6884b0ebbbf559d03390354cb262e3908e2af2e27362e9ddb9805925f017d3
  volatile.eth0.host_name: p2
  volatile.idmap.base: "1327680"
  volatile.idmap.current: '[{"Isuid":true,"Isgid":false,"Hostid":1327680,"Nsid":0,"Maprange":65536},{"Isuid":false,"Isgid":true,"Hostid":1327680,"Nsid":0,"Maprange":65536}]'
  volatile.idmap.next: '[{"Isuid":true,"Isgid":false,"Hostid":1327680,"Nsid":0,"Maprange":65536},{"Isuid":false,"Isgid":true,"Hostid":1327680,"Nsid":0,"Maprange":65536}]'
  volatile.last_state.idmap: '[{"Isuid":true,"Isgid":false,"Hostid":1327680,"Nsid":0,"Maprange":65536},{"Isuid":false,"Isgid":true,"Hostid":1327680,"Nsid":0,"Maprange":65536}]'
  volatile.last_state.power: RUNNING
devices:
  eth0:
    host_name: p2
    hwaddr: 00:16:3e:8d:72:43
    name: eth0
    nictype: bridged
    parent: br0
    security.mac_filtering: "true"
    type: nic
  root:
    path: /
    pool: pool1
    size: 3GB
    type: disk
ephemeral: false
profiles:
- default
stateful: false
description: ""

Looks like something cleared the limit… Does changing it to another value cause it to behave fine again?

I wonder what would have caused this though… systemd in theory could have done it but that’s not a behavior I’ve seen in a long time.

If I do lxc config set cname limits.memory 1GB on a running container it changes the memory and it shows correct in htop, but when I reboot the container, it goes back to the host’s memory value.

Confirmed here, digging into it now.

root@sateda:~# lxc config set bionic limits.memory 512MB
root@sateda:~# lxc exec bionic -- free -m
              total        used        free      shared  buff/cache   available
Mem:            488          42         394           0          51         446
Swap:             0           0           0
root@sateda:~# lxc restart bionic
root@sateda:~# lxc exec bionic -- free -m
              total        used        free      shared  buff/cache   available
Mem:          16012          39       15953           0          19       15972
Swap:             0           0           0
root@sateda:~# grep cgroup /var/snap/lxd/common/lxd/logs/bionic/lxc.conf 
lxc.mount.auto = proc:rw sys:rw cgroup:mixed
lxc.cgroup.memory.limit_in_bytes = 512000000
lxc.cgroup.memory.soft_limit_in_bytes = 460800000
lxc.cgroup.pids.max = 500
root@sateda:~# lxc config set bionic raw.lxc lxc.log.level=trace
root@sateda:~# lxc restart bionic
root@sateda:~# lxc info --show-log bionic
Name: bionic
Location: none
Remote: unix://
Architecture: x86_64
Created: 2020/04/15 18:20 UTC
Status: Running
Type: container
Profiles: default
Pid: 1674708
Ips:
  lo:	inet	127.0.0.1
  lo:	inet6	::1
Resources:
  Processes: 36
  Disk usage:
    root: 478.81MB
  CPU usage:
    CPU usage (in seconds): 3
  Memory usage:
    Memory (current): 115.65MB
  Network usage:
    lo:
      Bytes received: 2.05kB
      Bytes sent: 2.05kB
      Packets received: 28
      Packets sent: 28
    sit0:
      Bytes received: 0B
      Bytes sent: 0B
      Packets received: 0
      Packets sent: 0

Log:

lxc bionic 20200415210853.886 TRACE    commands - commands.c:lxc_cmd:286 - Connection refused - Command "get_state" failed to connect command socket
lxc bionic 20200415210853.886 TRACE    start - start.c:lxc_init_handler:703 - Created anonymous pair {3,7} of unix sockets
lxc bionic 20200415210853.886 TRACE    commands - commands.c:lxc_cmd_init:1582 - Created abstract unix socket "/var/snap/lxd/common/lxd/containers/bionic/command"
lxc bionic 20200415210853.886 TRACE    start - start.c:lxc_init_handler:715 - Unix domain socket 9 for command server is ready
lxc bionic 20200415210853.887 INFO     lxccontainer - lxccontainer.c:do_lxcapi_start:972 - Set process title to [lxc monitor] /var/snap/lxd/common/lxd/containers bionic
lxc bionic 20200415210853.888 DEBUG    lxccontainer - lxccontainer.c:wait_on_daemonized_start:830 - First child 1674688 exited
lxc bionic 20200415210853.888 INFO     start - start.c:lxc_check_inherited:277 - Closed inherited fd 4
lxc bionic 20200415210853.888 INFO     start - start.c:lxc_check_inherited:277 - Closed inherited fd 5
lxc bionic 20200415210853.888 INFO     start - start.c:lxc_check_inherited:277 - Closed inherited fd 6
lxc bionic 20200415210853.888 TRACE    start - start.c:lxc_start:2068 - Doing lxc_start
lxc bionic 20200415210853.888 INFO     lsm - lsm/lsm.c:lsm_init:29 - LSM security driver AppArmor
lxc bionic 20200415210853.888 TRACE    start - start.c:lxc_init:738 - Initialized LSM
lxc bionic 20200415210853.888 TRACE    start - start.c:lxc_serve_state_clients:427 - Set container state to STARTING
lxc bionic 20200415210853.888 TRACE    start - start.c:lxc_serve_state_clients:430 - No state clients registered
lxc bionic 20200415210853.888 TRACE    start - start.c:lxc_init:744 - Set container state to "STARTING"
lxc bionic 20200415210853.888 TRACE    start - start.c:lxc_init:800 - Set environment variables
lxc bionic 20200415210853.888 INFO     conf - conf.c:run_script_argv:342 - Executing script "/proc/899953/exe callhook /var/snap/lxd/common/lxd 75 start" for container "bionic"
lxc bionic 20200415210853.888 TRACE    conf - conf.c:run_script_argv:385 - Set environment variable: LXC_HOOK_TYPE=pre-start
lxc bionic 20200415210853.888 TRACE    conf - conf.c:run_script_argv:390 - Set environment variable: LXC_HOOK_SECTION=lxc
lxc bionic 20200415210853.955 TRACE    start - start.c:lxc_init:805 - Ran pre-start hooks
lxc bionic 20200415210853.956 TRACE    start - start.c:setup_signal_fd:320 - Created signal file descriptor 5
lxc bionic 20200415210853.956 TRACE    start - start.c:lxc_init:814 - Set up signal fd
lxc bionic 20200415210853.956 DEBUG    terminal - terminal.c:lxc_terminal_peer_default:655 - No such device - The process does not have a controlling terminal
lxc bionic 20200415210853.956 DEBUG    terminal - terminal.c:lxc_terminal_create_log_file:827 - Using "/var/snap/lxd/common/lxd/logs/bionic/console.log" as terminal log file
lxc bionic 20200415210853.956 TRACE    terminal - terminal.c:lxc_terminal_create_ringbuf:808 - Allocated 131072 byte terminal ringbuffer
lxc bionic 20200415210853.956 TRACE    start - start.c:lxc_init:822 - Created console
lxc bionic 20200415210853.956 TRACE    terminal - terminal.c:lxc_terminal_map_ids:1176 - Chowned terminal "/dev/pts/0"
lxc bionic 20200415210853.956 TRACE    start - start.c:lxc_init:829 - Chowned console
lxc bionic 20200415210853.956 TRACE    cgfsng - cgroups/cgfsng.c:lxc_cgfsng_print_basecg_debuginfo:939 - basecginfo is:
lxc bionic 20200415210853.956 TRACE    cgfsng - cgroups/cgfsng.c:lxc_cgfsng_print_basecg_debuginfo:940 - 12:rdma:/
11:freezer:/
10:pids:/
9:devices:/
8:hugetlb:/
7:cpu,cpuacct:/
6:memory:/
5:blkio:/
4:perf_event:/
3:net_cls,net_prio:/
2:cpuset:/
1:name=systemd:/init.scope
0::/init.scope

lxc bionic 20200415210853.956 TRACE    cgfsng - cgroups/cgfsng.c:lxc_cgfsng_print_basecg_debuginfo:943 - kernel subsystem 0: rdma
lxc bionic 20200415210853.956 TRACE    cgfsng - cgroups/cgfsng.c:lxc_cgfsng_print_basecg_debuginfo:943 - kernel subsystem 1: freezer
lxc bionic 20200415210853.956 TRACE    cgfsng - cgroups/cgfsng.c:lxc_cgfsng_print_basecg_debuginfo:943 - kernel subsystem 2: pids
lxc bionic 20200415210853.956 TRACE    cgfsng - cgroups/cgfsng.c:lxc_cgfsng_print_basecg_debuginfo:943 - kernel subsystem 3: devices
lxc bionic 20200415210853.956 TRACE    cgfsng - cgroups/cgfsng.c:lxc_cgfsng_print_basecg_debuginfo:943 - kernel subsystem 4: hugetlb
lxc bionic 20200415210853.956 TRACE    cgfsng - cgroups/cgfsng.c:lxc_cgfsng_print_basecg_debuginfo:943 - kernel subsystem 5: cpu
lxc bionic 20200415210853.956 TRACE    cgfsng - cgroups/cgfsng.c:lxc_cgfsng_print_basecg_debuginfo:943 - kernel subsystem 6: cpuacct
lxc bionic 20200415210853.956 TRACE    cgfsng - cgroups/cgfsng.c:lxc_cgfsng_print_basecg_debuginfo:943 - kernel subsystem 7: memory
lxc bionic 20200415210853.956 TRACE    cgfsng - cgroups/cgfsng.c:lxc_cgfsng_print_basecg_debuginfo:943 - kernel subsystem 8: blkio
lxc bionic 20200415210853.956 TRACE    cgfsng - cgroups/cgfsng.c:lxc_cgfsng_print_basecg_debuginfo:943 - kernel subsystem 9: perf_event
lxc bionic 20200415210853.956 TRACE    cgfsng - cgroups/cgfsng.c:lxc_cgfsng_print_basecg_debuginfo:943 - kernel subsystem 10: net_cls
lxc bionic 20200415210853.956 TRACE    cgfsng - cgroups/cgfsng.c:lxc_cgfsng_print_basecg_debuginfo:943 - kernel subsystem 11: net_prio
lxc bionic 20200415210853.956 TRACE    cgfsng - cgroups/cgfsng.c:lxc_cgfsng_print_basecg_debuginfo:943 - kernel subsystem 12: cpuset
lxc bionic 20200415210853.956 TRACE    cgfsng - cgroups/cgfsng.c:lxc_cgfsng_print_basecg_debuginfo:943 - kernel subsystem 13: cgroup2
lxc bionic 20200415210853.956 TRACE    cgfsng - cgroups/cgfsng.c:lxc_cgfsng_print_basecg_debuginfo:946 - named subsystem 0: name=systemd
lxc bionic 20200415210853.957 TRACE    cgfsng - cgroups/cgfsng.c:cg_hybrid_init:3134 - No controllers are enabled for delegation in the unified hierarchy
lxc bionic 20200415210853.957 TRACE    cgfsng - cgroups/cgfsng.c:cg_hybrid_init:3152 - Writable cgroup hierarchies:
lxc bionic 20200415210853.957 TRACE    cgfsng - cgroups/cgfsng.c:lxc_cgfsng_print_hierarchies:920 -   Hierarchies:
lxc bionic 20200415210853.957 TRACE    cgfsng - cgroups/cgfsng.c:lxc_cgfsng_print_hierarchies:925 -   0: base_cgroup: /
lxc bionic 20200415210853.957 TRACE    cgfsng - cgroups/cgfsng.c:lxc_cgfsng_print_hierarchies:926 -       mountpoint:  /sys/fs/cgroup/unified
lxc bionic 20200415210853.957 TRACE    cgfsng - cgroups/cgfsng.c:lxc_cgfsng_print_hierarchies:927 -       controllers:
lxc bionic 20200415210853.957 TRACE    cgfsng - cgroups/cgfsng.c:lxc_cgfsng_print_hierarchies:925 -   1: base_cgroup: /
lxc bionic 20200415210853.957 TRACE    cgfsng - cgroups/cgfsng.c:lxc_cgfsng_print_hierarchies:926 -       mountpoint:  /sys/fs/cgroup/systemd
lxc bionic 20200415210853.957 TRACE    cgfsng - cgroups/cgfsng.c:lxc_cgfsng_print_hierarchies:927 -       controllers:
lxc bionic 20200415210853.957 TRACE    cgfsng - cgroups/cgfsng.c:lxc_cgfsng_print_hierarchies:929 -       0: name=systemd
lxc bionic 20200415210853.957 TRACE    cgfsng - cgroups/cgfsng.c:lxc_cgfsng_print_hierarchies:925 -   2: base_cgroup: /
lxc bionic 20200415210853.957 TRACE    cgfsng - cgroups/cgfsng.c:lxc_cgfsng_print_hierarchies:926 -       mountpoint:  /sys/fs/cgroup/cpuset
lxc bionic 20200415210853.957 TRACE    cgfsng - cgroups/cgfsng.c:lxc_cgfsng_print_hierarchies:927 -       controllers:
lxc bionic 20200415210853.957 TRACE    cgfsng - cgroups/cgfsng.c:lxc_cgfsng_print_hierarchies:929 -       0: cpuset
lxc bionic 20200415210853.957 TRACE    cgfsng - cgroups/cgfsng.c:lxc_cgfsng_print_hierarchies:925 -   3: base_cgroup: /
lxc bionic 20200415210853.957 TRACE    cgfsng - cgroups/cgfsng.c:lxc_cgfsng_print_hierarchies:926 -       mountpoint:  /sys/fs/cgroup/net_cls,net_prio
lxc bionic 20200415210853.957 TRACE    cgfsng - cgroups/cgfsng.c:lxc_cgfsng_print_hierarchies:927 -       controllers:
lxc bionic 20200415210853.957 TRACE    cgfsng - cgroups/cgfsng.c:lxc_cgfsng_print_hierarchies:929 -       0: net_cls
lxc bionic 20200415210853.957 TRACE    cgfsng - cgroups/cgfsng.c:lxc_cgfsng_print_hierarchies:929 -       1: net_prio
lxc bionic 20200415210853.957 TRACE    cgfsng - cgroups/cgfsng.c:lxc_cgfsng_print_hierarchies:925 -   4: base_cgroup: /
lxc bionic 20200415210853.957 TRACE    cgfsng - cgroups/cgfsng.c:lxc_cgfsng_print_hierarchies:926 -       mountpoint:  /sys/fs/cgroup/perf_event
lxc bionic 20200415210853.957 TRACE    cgfsng - cgroups/cgfsng.c:lxc_cgfsng_print_hierarchies:927 -       controllers:
lxc bionic 20200415210853.957 TRACE    cgfsng - cgroups/cgfsng.c:lxc_cgfsng_print_hierarchies:929 -       0: perf_event
lxc bionic 20200415210853.957 TRACE    cgfsng - cgroups/cgfsng.c:lxc_cgfsng_print_hierarchies:925 -   5: base_cgroup: /
lxc bionic 20200415210853.957 TRACE    cgfsng - cgroups/cgfsng.c:lxc_cgfsng_print_hierarchies:926 -       mountpoint:  /sys/fs/cgroup/blkio
lxc bionic 20200415210853.957 TRACE    cgfsng - cgroups/cgfsng.c:lxc_cgfsng_print_hierarchies:927 -       controllers:
lxc bionic 20200415210853.957 TRACE    cgfsng - cgroups/cgfsng.c:lxc_cgfsng_print_hierarchies:929 -       0: blkio
lxc bionic 20200415210853.957 TRACE    cgfsng - cgroups/cgfsng.c:lxc_cgfsng_print_hierarchies:925 -   6: base_cgroup: /
lxc bionic 20200415210853.957 TRACE    cgfsng - cgroups/cgfsng.c:lxc_cgfsng_print_hierarchies:926 -       mountpoint:  /sys/fs/cgroup/memory
lxc bionic 20200415210853.957 TRACE    cgfsng - cgroups/cgfsng.c:lxc_cgfsng_print_hierarchies:927 -       controllers:
lxc bionic 20200415210853.957 TRACE    cgfsng - cgroups/cgfsng.c:lxc_cgfsng_print_hierarchies:929 -       0: memory
lxc bionic 20200415210853.957 TRACE    cgfsng - cgroups/cgfsng.c:lxc_cgfsng_print_hierarchies:925 -   7: base_cgroup: /
lxc bionic 20200415210853.957 TRACE    cgfsng - cgroups/cgfsng.c:lxc_cgfsng_print_hierarchies:926 -       mountpoint:  /sys/fs/cgroup/cpu,cpuacct
lxc bionic 20200415210853.957 TRACE    cgfsng - cgroups/cgfsng.c:lxc_cgfsng_print_hierarchies:927 -       controllers:
lxc bionic 20200415210853.957 TRACE    cgfsng - cgroups/cgfsng.c:lxc_cgfsng_print_hierarchies:929 -       0: cpu
lxc bionic 20200415210853.957 TRACE    cgfsng - cgroups/cgfsng.c:lxc_cgfsng_print_hierarchies:929 -       1: cpuacct
lxc bionic 20200415210853.957 TRACE    cgfsng - cgroups/cgfsng.c:lxc_cgfsng_print_hierarchies:925 -   8: base_cgroup: /
lxc bionic 20200415210853.957 TRACE    cgfsng - cgroups/cgfsng.c:lxc_cgfsng_print_hierarchies:926 -       mountpoint:  /sys/fs/cgroup/hugetlb
lxc bionic 20200415210853.957 TRACE    cgfsng - cgroups/cgfsng.c:lxc_cgfsng_print_hierarchies:927 -       controllers:
lxc bionic 20200415210853.957 TRACE    cgfsng - cgroups/cgfsng.c:lxc_cgfsng_print_hierarchies:929 -       0: hugetlb
lxc bionic 20200415210853.957 TRACE    cgfsng - cgroups/cgfsng.c:lxc_cgfsng_print_hierarchies:925 -   9: base_cgroup: /
lxc bionic 20200415210853.957 TRACE    cgfsng - cgroups/cgfsng.c:lxc_cgfsng_print_hierarchies:926 -       mountpoint:  /sys/fs/cgroup/devices
lxc bionic 20200415210853.957 TRACE    cgfsng - cgroups/cgfsng.c:lxc_cgfsng_print_hierarchies:927 -       controllers:
lxc bionic 20200415210853.957 TRACE    cgfsng - cgroups/cgfsng.c:lxc_cgfsng_print_hierarchies:929 -       0: devices
lxc bionic 20200415210853.957 TRACE    cgfsng - cgroups/cgfsng.c:lxc_cgfsng_print_hierarchies:925 -   10: base_cgroup: /
lxc bionic 20200415210853.957 TRACE    cgfsng - cgroups/cgfsng.c:lxc_cgfsng_print_hierarchies:926 -       mountpoint:  /sys/fs/cgroup/pids
lxc bionic 20200415210853.957 TRACE    cgfsng - cgroups/cgfsng.c:lxc_cgfsng_print_hierarchies:927 -       controllers:
lxc bionic 20200415210853.957 TRACE    cgfsng - cgroups/cgfsng.c:lxc_cgfsng_print_hierarchies:929 -       0: pids
lxc bionic 20200415210853.957 TRACE    cgfsng - cgroups/cgfsng.c:lxc_cgfsng_print_hierarchies:925 -   11: base_cgroup: /
lxc bionic 20200415210853.957 TRACE    cgfsng - cgroups/cgfsng.c:lxc_cgfsng_print_hierarchies:926 -       mountpoint:  /sys/fs/cgroup/freezer
lxc bionic 20200415210853.957 TRACE    cgfsng - cgroups/cgfsng.c:lxc_cgfsng_print_hierarchies:927 -       controllers:
lxc bionic 20200415210853.957 TRACE    cgfsng - cgroups/cgfsng.c:lxc_cgfsng_print_hierarchies:929 -       0: freezer
lxc bionic 20200415210853.957 TRACE    cgfsng - cgroups/cgfsng.c:lxc_cgfsng_print_hierarchies:925 -   12: base_cgroup: /
lxc bionic 20200415210853.957 TRACE    cgfsng - cgroups/cgfsng.c:lxc_cgfsng_print_hierarchies:926 -       mountpoint:  /sys/fs/cgroup/rdma
lxc bionic 20200415210853.957 TRACE    cgfsng - cgroups/cgfsng.c:lxc_cgfsng_print_hierarchies:927 -       controllers:
lxc bionic 20200415210853.957 TRACE    cgfsng - cgroups/cgfsng.c:lxc_cgfsng_print_hierarchies:929 -       0: rdma
lxc bionic 20200415210853.957 TRACE    cgroup - cgroups/cgroup.c:cgroup_init:40 - Initialized cgroup driver cgfsng
lxc bionic 20200415210853.957 TRACE    cgroup - cgroups/cgroup.c:cgroup_init:45 - Running with hybrid cgroup layout
lxc bionic 20200415210853.957 TRACE    start - start.c:lxc_init:836 - Initialized cgroup driver
lxc bionic 20200415210853.957 TRACE    seccomp - seccomp.c:get_new_ctx:469 - Added arch 2 to main seccomp context
lxc bionic 20200415210853.957 TRACE    seccomp - seccomp.c:get_new_ctx:477 - Removed native arch from main seccomp context
lxc bionic 20200415210853.957 TRACE    seccomp - seccomp.c:get_new_ctx:469 - Added arch 3 to main seccomp context
lxc bionic 20200415210853.957 TRACE    seccomp - seccomp.c:get_new_ctx:477 - Removed native arch from main seccomp context
lxc bionic 20200415210853.957 TRACE    seccomp - seccomp.c:get_new_ctx:482 - Arch 4 already present in main seccomp context
lxc bionic 20200415210853.957 INFO     seccomp - seccomp.c:parse_config_v2:770 - Processing "reject_force_umount  # comment this to allow umount -f;  not recommended"
lxc bionic 20200415210853.957 INFO     seccomp - seccomp.c:do_resolve_add_rule:516 - Set seccomp rule to reject force umounts
lxc bionic 20200415210853.957 INFO     seccomp - seccomp.c:parse_config_v2:967 - Added native rule for arch 0 for reject_force_umount action 0(kill)
lxc bionic 20200415210853.957 INFO     seccomp - seccomp.c:do_resolve_add_rule:516 - Set seccomp rule to reject force umounts
lxc bionic 20200415210853.957 INFO     seccomp - seccomp.c:parse_config_v2:976 - Added compat rule for arch 1073741827 for reject_force_umount action 0(kill)
lxc bionic 20200415210853.957 INFO     seccomp - seccomp.c:do_resolve_add_rule:516 - Set seccomp rule to reject force umounts
lxc bionic 20200415210853.957 INFO     seccomp - seccomp.c:parse_config_v2:986 - Added compat rule for arch 1073741886 for reject_force_umount action 0(kill)
lxc bionic 20200415210853.957 INFO     seccomp - seccomp.c:do_resolve_add_rule:516 - Set seccomp rule to reject force umounts
lxc bionic 20200415210853.957 INFO     seccomp - seccomp.c:parse_config_v2:996 - Added native rule for arch -1073741762 for reject_force_umount action 0(kill)
lxc bionic 20200415210853.957 INFO     seccomp - seccomp.c:parse_config_v2:770 - Processing "[all]"
lxc bionic 20200415210853.957 INFO     seccomp - seccomp.c:parse_config_v2:770 - Processing "kexec_load errno 38"
lxc bionic 20200415210853.957 INFO     seccomp - seccomp.c:parse_config_v2:967 - Added native rule for arch 0 for kexec_load action 327718(errno)
lxc bionic 20200415210853.957 INFO     seccomp - seccomp.c:parse_config_v2:976 - Added compat rule for arch 1073741827 for kexec_load action 327718(errno)
lxc bionic 20200415210853.957 INFO     seccomp - seccomp.c:parse_config_v2:986 - Added compat rule for arch 1073741886 for kexec_load action 327718(errno)
lxc bionic 20200415210853.957 INFO     seccomp - seccomp.c:parse_config_v2:996 - Added native rule for arch -1073741762 for kexec_load action 327718(errno)
lxc bionic 20200415210853.957 INFO     seccomp - seccomp.c:parse_config_v2:770 - Processing "open_by_handle_at errno 38"
lxc bionic 20200415210853.957 INFO     seccomp - seccomp.c:parse_config_v2:967 - Added native rule for arch 0 for open_by_handle_at action 327718(errno)
lxc bionic 20200415210853.957 INFO     seccomp - seccomp.c:parse_config_v2:976 - Added compat rule for arch 1073741827 for open_by_handle_at action 327718(errno)
lxc bionic 20200415210853.957 INFO     seccomp - seccomp.c:parse_config_v2:986 - Added compat rule for arch 1073741886 for open_by_handle_at action 327718(errno)
lxc bionic 20200415210853.957 INFO     seccomp - seccomp.c:parse_config_v2:996 - Added native rule for arch -1073741762 for open_by_handle_at action 327718(errno)
lxc bionic 20200415210853.957 INFO     seccomp - seccomp.c:parse_config_v2:770 - Processing "init_module errno 38"
lxc bionic 20200415210853.957 INFO     seccomp - seccomp.c:parse_config_v2:967 - Added native rule for arch 0 for init_module action 327718(errno)
lxc bionic 20200415210853.957 INFO     seccomp - seccomp.c:parse_config_v2:976 - Added compat rule for arch 1073741827 for init_module action 327718(errno)
lxc bionic 20200415210853.957 INFO     seccomp - seccomp.c:parse_config_v2:986 - Added compat rule for arch 1073741886 for init_module action 327718(errno)
lxc bionic 20200415210853.957 INFO     seccomp - seccomp.c:parse_config_v2:996 - Added native rule for arch -1073741762 for init_module action 327718(errno)
lxc bionic 20200415210853.957 INFO     seccomp - seccomp.c:parse_config_v2:770 - Processing "finit_module errno 38"
lxc bionic 20200415210853.957 INFO     seccomp - seccomp.c:parse_config_v2:967 - Added native rule for arch 0 for finit_module action 327718(errno)
lxc bionic 20200415210853.957 INFO     seccomp - seccomp.c:parse_config_v2:976 - Added compat rule for arch 1073741827 for finit_module action 327718(errno)
lxc bionic 20200415210853.957 INFO     seccomp - seccomp.c:parse_config_v2:986 - Added compat rule for arch 1073741886 for finit_module action 327718(errno)
lxc bionic 20200415210853.957 INFO     seccomp - seccomp.c:parse_config_v2:996 - Added native rule for arch -1073741762 for finit_module action 327718(errno)
lxc bionic 20200415210853.957 INFO     seccomp - seccomp.c:parse_config_v2:770 - Processing "delete_module errno 38"
lxc bionic 20200415210853.957 INFO     seccomp - seccomp.c:parse_config_v2:967 - Added native rule for arch 0 for delete_module action 327718(errno)
lxc bionic 20200415210853.957 INFO     seccomp - seccomp.c:parse_config_v2:976 - Added compat rule for arch 1073741827 for delete_module action 327718(errno)
lxc bionic 20200415210853.957 INFO     seccomp - seccomp.c:parse_config_v2:986 - Added compat rule for arch 1073741886 for delete_module action 327718(errno)
lxc bionic 20200415210853.957 INFO     seccomp - seccomp.c:parse_config_v2:996 - Added native rule for arch -1073741762 for delete_module action 327718(errno)
lxc bionic 20200415210853.957 INFO     seccomp - seccomp.c:parse_config_v2:1000 - Merging compat seccomp contexts into main context
lxc bionic 20200415210853.957 TRACE    seccomp - seccomp.c:parse_config_v2:1010 - Merged first compat seccomp context into main context
lxc bionic 20200415210853.957 TRACE    seccomp - seccomp.c:parse_config_v2:1026 - Merged second compat seccomp context into main context
lxc bionic 20200415210853.957 TRACE    start - start.c:lxc_init:841 - Read seccomp policy
lxc bionic 20200415210853.957 TRACE    start - start.c:lxc_init:848 - Initialized LSM
lxc bionic 20200415210853.958 INFO     start - start.c:lxc_init:850 - Container "bionic" is initialized
lxc bionic 20200415210853.958 TRACE    cgfsng - cgroups/cgfsng.c:cg_legacy_handle_cpuset_hierarchy:551 - "cgroup.clone_children" was already set to "1"
lxc bionic 20200415210853.958 ERROR    cgfsng - cgroups/cgfsng.c:mkdir_eexist_on_last:1143 - File exists - Failed to create directory "/sys/fs/cgroup/cpuset//lxc.monitor.bionic"
lxc bionic 20200415210853.958 INFO     cgfsng - cgroups/cgfsng.c:cgfsng_monitor_create:1277 - The monitor process uses "lxc.monitor.bionic" as cgroup
lxc bionic 20200415210853.958 DEBUG    storage - storage/storage.c:get_storage_by_name:211 - Detected rootfs type "dir"
lxc bionic 20200415210853.959 TRACE    cgfsng - cgroups/cgfsng.c:cg_legacy_handle_cpuset_hierarchy:551 - "cgroup.clone_children" was already set to "1"
lxc bionic 20200415210853.959 ERROR    cgfsng - cgroups/cgfsng.c:mkdir_eexist_on_last:1143 - File exists - Failed to create directory "/sys/fs/cgroup/cpuset//lxc.payload.bionic"
lxc bionic 20200415210853.959 INFO     cgfsng - cgroups/cgfsng.c:cgfsng_payload_create:1356 - The container process uses "lxc.payload.bionic" as cgroup
lxc bionic 20200415210853.960 TRACE    start - start.c:lxc_spawn:1648 - Cloned child process 1674708
lxc bionic 20200415210853.960 ERROR    utils - utils.c:lxc_can_use_pidfd:1834 - Kernel does not support pidfds
lxc bionic 20200415210853.960 INFO     start - start.c:lxc_spawn:1664 - Cloned CLONE_NEWUSER
lxc bionic 20200415210853.960 INFO     start - start.c:lxc_spawn:1664 - Cloned CLONE_NEWNS
lxc bionic 20200415210853.960 INFO     start - start.c:lxc_spawn:1664 - Cloned CLONE_NEWPID
lxc bionic 20200415210853.960 INFO     start - start.c:lxc_spawn:1664 - Cloned CLONE_NEWUTS
lxc bionic 20200415210853.960 INFO     start - start.c:lxc_spawn:1664 - Cloned CLONE_NEWIPC
lxc bionic 20200415210853.960 DEBUG    start - start.c:lxc_try_preserve_namespaces:166 - Preserved user namespace via fd 30
lxc bionic 20200415210853.960 DEBUG    start - start.c:lxc_try_preserve_namespaces:166 - Preserved mnt namespace via fd 31
lxc bionic 20200415210853.960 DEBUG    start - start.c:lxc_try_preserve_namespaces:166 - Preserved pid namespace via fd 32
lxc bionic 20200415210853.960 DEBUG    start - start.c:lxc_try_preserve_namespaces:166 - Preserved uts namespace via fd 33
lxc bionic 20200415210853.960 DEBUG    start - start.c:lxc_try_preserve_namespaces:166 - Preserved ipc namespace via fd 34
lxc bionic 20200415210853.960 DEBUG    conf - conf.c:lxc_map_ids:2719 - No newuidmap and newgidmap binary found. Trying to write directly with euid 0
lxc bionic 20200415210853.960 TRACE    conf - conf.c:lxc_map_ids:2785 - Wrote mapping "0 8000000 1000000
"
lxc bionic 20200415210853.960 TRACE    conf - conf.c:lxc_map_ids:2785 - Wrote mapping "0 8000000 1000000
"
lxc bionic 20200415210854.178 INFO     start - start.c:do_start:1098 - Unshared CLONE_NEWNET
lxc bionic 20200415210854.179 WARN     cgfsng - cgroups/cgfsng.c:cgfsng_setup_limits_legacy:2713 - Invalid argument - Ignoring legacy cgroup limits on pure cgroup2 system
lxc bionic 20200415210854.182 TRACE    conf - conf.c:get_minimal_idmap:4025 - Allocated minimal idmapping for ns uid 0 and ns gid 0
lxc bionic 20200415210854.188 TRACE    conf - conf.c:userns_exec_1:4091 - Establishing uid mapping for "1674723" in new user namespace: nsuid 0 - hostid 8000000 - range 1000000
lxc bionic 20200415210854.188 TRACE    conf - conf.c:userns_exec_1:4091 - Establishing uid mapping for "1674723" in new user namespace: nsuid 1000000 - hostid 0 - range 1
lxc bionic 20200415210854.188 TRACE    conf - conf.c:userns_exec_1:4091 - Establishing gid mapping for "1674723" in new user namespace: nsuid 0 - hostid 8000000 - range 1000000
lxc bionic 20200415210854.188 TRACE    conf - conf.c:userns_exec_1:4091 - Establishing gid mapping for "1674723" in new user namespace: nsuid 1000000 - hostid 0 - range 1
lxc bionic 20200415210854.189 DEBUG    conf - conf.c:lxc_map_ids:2719 - No newuidmap and newgidmap binary found. Trying to write directly with euid 0
lxc bionic 20200415210854.189 TRACE    conf - conf.c:lxc_map_ids:2785 - Wrote mapping "0 8000000 1000000
1000000 0 1
"
lxc bionic 20200415210854.190 TRACE    conf - conf.c:lxc_map_ids:2785 - Wrote mapping "0 8000000 1000000
1000000 0 1
"
lxc bionic 20200415210854.190 TRACE    conf - conf.c:run_userns_fn:3857 - Calling function "chown_cgroup_wrapper"
lxc bionic 20200415210854.191 NOTICE   utils - utils.c:lxc_setgroups:1366 - Dropped additional groups
lxc bionic 20200415210854.198 DEBUG    start - start.c:lxc_spawn:1737 - Preserved net namespace via fd 4
lxc bionic 20200415210854.204 TRACE    start - start.c:lxc_spawn:1744 - Allocated new network namespace id
lxc bionic 20200415210854.205 NOTICE   utils - utils.c:lxc_setgroups:1366 - Dropped additional groups
lxc bionic 20200415210854.205 NOTICE   utils - utils.c:lxc_switch_uid_gid:1344 - Switched to gid 0
lxc bionic 20200415210854.205 NOTICE   utils - utils.c:lxc_switch_uid_gid:1353 - Switched to uid 0
lxc bionic 20200415210854.206 INFO     start - start.c:do_start:1211 - Unshared CLONE_NEWCGROUP
lxc bionic 20200415210854.209 TRACE    conf - conf.c:remount_all_slave:3094 - Remounted all mount table entries as MS_SLAVE
lxc bionic 20200415210854.210 DEBUG    storage - storage/storage.c:get_storage_by_name:211 - Detected rootfs type "dir"
lxc bionic 20200415210854.210 TRACE    dir - storage/dir.c:dir_mount:166 - Mounted "/var/snap/lxd/common/lxd/containers/bionic/rootfs" on "/var/snap/lxd/common/lxc/" with options "(null)", mount flags "0", and propagation flags "0"
lxc bionic 20200415210854.210 DEBUG    conf - conf.c:lxc_mount_rootfs:1260 - Mounted rootfs "/var/snap/lxd/common/lxd/containers/bionic/rootfs" onto "/var/snap/lxd/common/lxc/" with options "(null)"
lxc bionic 20200415210854.211 INFO     conf - conf.c:setup_utsname:751 - Set hostname to "bionic"
lxc bionic 20200415210854.211 INFO     conf - conf.c:mount_autodev:1059 - Preparing "/dev"
lxc bionic 20200415210854.211 DEBUG    conf - conf.c:mount_autodev:1065 - Using mount options: size=500000,mode=755
lxc bionic 20200415210854.212 TRACE    conf - conf.c:mount_autodev:1085 - Mounted tmpfs on "/var/snap/lxd/common/lxc//dev"
lxc bionic 20200415210854.212 INFO     conf - conf.c:mount_autodev:1108 - Prepared "/dev"
lxc bionic 20200415210854.215 DEBUG    conf - conf.c:mount_entry:1861 - Remounting "/dev/fuse" on "/var/snap/lxd/common/lxc//dev/fuse" to respect bind or remount options
lxc bionic 20200415210854.216 DEBUG    conf - conf.c:mount_entry:1880 - Flags for "/dev/fuse" were 4098, required extra flags are 2
lxc bionic 20200415210854.216 DEBUG    conf - conf.c:mount_entry:1924 - Mounted "/dev/fuse" on "/var/snap/lxd/common/lxc//dev/fuse" with filesystem type "none"
lxc bionic 20200415210854.216 DEBUG    conf - conf.c:mount_entry:1861 - Remounting "/dev/net/tun" on "/var/snap/lxd/common/lxc//dev/net/tun" to respect bind or remount options
lxc bionic 20200415210854.216 DEBUG    conf - conf.c:mount_entry:1880 - Flags for "/dev/net/tun" were 4098, required extra flags are 2
lxc bionic 20200415210854.216 DEBUG    conf - conf.c:mount_entry:1924 - Mounted "/dev/net/tun" on "/var/snap/lxd/common/lxc//dev/net/tun" with filesystem type "none"
lxc bionic 20200415210854.217 DEBUG    conf - conf.c:mount_entry:1861 - Remounting "/proc/sys/fs/binfmt_misc" on "/var/snap/lxd/common/lxc//proc/sys/fs/binfmt_misc" to respect bind or remount options
lxc bionic 20200415210854.217 DEBUG    conf - conf.c:mount_entry:1880 - Flags for "/proc/sys/fs/binfmt_misc" were 4096, required extra flags are 0
lxc bionic 20200415210854.217 DEBUG    conf - conf.c:mount_entry:1888 - Mountflags already were 20480, skipping remount
lxc bionic 20200415210854.217 DEBUG    conf - conf.c:mount_entry:1924 - Mounted "/proc/sys/fs/binfmt_misc" on "/var/snap/lxd/common/lxc//proc/sys/fs/binfmt_misc" with filesystem type "none"
lxc bionic 20200415210854.218 DEBUG    conf - conf.c:mount_entry:1861 - Remounting "/sys/firmware/efi/efivars" on "/var/snap/lxd/common/lxc//sys/firmware/efi/efivars" to respect bind or remount options
lxc bionic 20200415210854.218 DEBUG    conf - conf.c:mount_entry:1880 - Flags for "/sys/firmware/efi/efivars" were 4110, required extra flags are 14
lxc bionic 20200415210854.218 DEBUG    conf - conf.c:mount_entry:1924 - Mounted "/sys/firmware/efi/efivars" on "/var/snap/lxd/common/lxc//sys/firmware/efi/efivars" with filesystem type "none"
lxc bionic 20200415210854.219 DEBUG    conf - conf.c:mount_entry:1861 - Remounting "/sys/fs/fuse/connections" on "/var/snap/lxd/common/lxc//sys/fs/fuse/connections" to respect bind or remount options
lxc bionic 20200415210854.219 DEBUG    conf - conf.c:mount_entry:1880 - Flags for "/sys/fs/fuse/connections" were 4096, required extra flags are 0
lxc bionic 20200415210854.219 DEBUG    conf - conf.c:mount_entry:1888 - Mountflags already were 20480, skipping remount
lxc bionic 20200415210854.219 DEBUG    conf - conf.c:mount_entry:1924 - Mounted "/sys/fs/fuse/connections" on "/var/snap/lxd/common/lxc//sys/fs/fuse/connections" with filesystem type "none"
lxc bionic 20200415210854.219 DEBUG    conf - conf.c:mount_entry:1861 - Remounting "/sys/fs/pstore" on "/var/snap/lxd/common/lxc//sys/fs/pstore" to respect bind or remount options
lxc bionic 20200415210854.219 DEBUG    conf - conf.c:mount_entry:1880 - Flags for "/sys/fs/pstore" were 4110, required extra flags are 14
lxc bionic 20200415210854.220 DEBUG    conf - conf.c:mount_entry:1924 - Mounted "/sys/fs/pstore" on "/var/snap/lxd/common/lxc//sys/fs/pstore" with filesystem type "none"
lxc bionic 20200415210854.220 DEBUG    conf - conf.c:mount_entry:1861 - Remounting "/sys/kernel/config" on "/var/snap/lxd/common/lxc//sys/kernel/config" to respect bind or remount options
lxc bionic 20200415210854.220 DEBUG    conf - conf.c:mount_entry:1880 - Flags for "/sys/kernel/config" were 4096, required extra flags are 0
lxc bionic 20200415210854.220 DEBUG    conf - conf.c:mount_entry:1888 - Mountflags already were 20480, skipping remount
lxc bionic 20200415210854.220 DEBUG    conf - conf.c:mount_entry:1924 - Mounted "/sys/kernel/config" on "/var/snap/lxd/common/lxc//sys/kernel/config" with filesystem type "none"
lxc bionic 20200415210854.221 DEBUG    conf - conf.c:mount_entry:1861 - Remounting "/sys/kernel/debug" on "/var/snap/lxd/common/lxc//sys/kernel/debug" to respect bind or remount options
lxc bionic 20200415210854.221 DEBUG    conf - conf.c:mount_entry:1880 - Flags for "/sys/kernel/debug" were 4096, required extra flags are 0
lxc bionic 20200415210854.221 DEBUG    conf - conf.c:mount_entry:1888 - Mountflags already were 20480, skipping remount
lxc bionic 20200415210854.221 DEBUG    conf - conf.c:mount_entry:1924 - Mounted "/sys/kernel/debug" on "/var/snap/lxd/common/lxc//sys/kernel/debug" with filesystem type "none"
lxc bionic 20200415210854.221 DEBUG    conf - conf.c:mount_entry:1861 - Remounting "/sys/kernel/security" on "/var/snap/lxd/common/lxc//sys/kernel/security" to respect bind or remount options
lxc bionic 20200415210854.221 DEBUG    conf - conf.c:mount_entry:1880 - Flags for "/sys/kernel/security" were 4110, required extra flags are 14
lxc bionic 20200415210854.221 DEBUG    conf - conf.c:mount_entry:1924 - Mounted "/sys/kernel/security" on "/var/snap/lxd/common/lxc//sys/kernel/security" with filesystem type "none"
lxc bionic 20200415210854.222 DEBUG    conf - conf.c:mount_entry:1861 - Remounting "/sys/kernel/tracing" on "/var/snap/lxd/common/lxc//sys/kernel/tracing" to respect bind or remount options
lxc bionic 20200415210854.222 DEBUG    conf - conf.c:mount_entry:1880 - Flags for "/sys/kernel/tracing" were 4110, required extra flags are 14
lxc bionic 20200415210854.222 DEBUG    conf - conf.c:mount_entry:1924 - Mounted "/sys/kernel/tracing" on "/var/snap/lxd/common/lxc//sys/kernel/tracing" with filesystem type "none"
lxc bionic 20200415210854.222 DEBUG    conf - conf.c:mount_entry:1861 - Remounting "/dev/mqueue" on "/var/snap/lxd/common/lxc//dev/mqueue" to respect bind or remount options
lxc bionic 20200415210854.222 DEBUG    conf - conf.c:mount_entry:1880 - Flags for "/dev/mqueue" were 4096, required extra flags are 0
lxc bionic 20200415210854.223 DEBUG    conf - conf.c:mount_entry:1888 - Mountflags already were 20480, skipping remount
lxc bionic 20200415210854.223 DEBUG    conf - conf.c:mount_entry:1924 - Mounted "/dev/mqueue" on "/var/snap/lxd/common/lxc//dev/mqueue" with filesystem type "none"
lxc bionic 20200415210854.223 DEBUG    conf - conf.c:mount_entry:1861 - Remounting "/var/snap/lxd/common/lxd/devlxd" on "/var/snap/lxd/common/lxc//dev/lxd" to respect bind or remount options
lxc bionic 20200415210854.223 DEBUG    conf - conf.c:mount_entry:1880 - Flags for "/var/snap/lxd/common/lxd/devlxd" were 4096, required extra flags are 0
lxc bionic 20200415210854.223 DEBUG    conf - conf.c:mount_entry:1888 - Mountflags already were 4096, skipping remount
lxc bionic 20200415210854.223 DEBUG    conf - conf.c:mount_entry:1924 - Mounted "/var/snap/lxd/common/lxd/devlxd" on "/var/snap/lxd/common/lxc//dev/lxd" with filesystem type "none"
lxc bionic 20200415210854.224 DEBUG    conf - conf.c:mount_entry:1861 - Remounting "/var/snap/lxd/common/lxd/shmounts/bionic" on "/var/snap/lxd/common/lxc//dev/.lxd-mounts" to respect bind or remount options
lxc bionic 20200415210854.224 DEBUG    conf - conf.c:mount_entry:1880 - Flags for "/var/snap/lxd/common/lxd/shmounts/bionic" were 4096, required extra flags are 0
lxc bionic 20200415210854.224 DEBUG    conf - conf.c:mount_entry:1888 - Mountflags already were 4096, skipping remount
lxc bionic 20200415210854.224 DEBUG    conf - conf.c:mount_entry:1924 - Mounted "/var/snap/lxd/common/lxd/shmounts/bionic" on "/var/snap/lxd/common/lxc//dev/.lxd-mounts" with filesystem type "none"
lxc bionic 20200415210854.224 INFO     conf - conf.c:run_script_argv:342 - Executing script "/snap/lxd/current/lxcfs/lxc.mount.hook" for container "bionic"
lxc bionic 20200415210854.224 TRACE    conf - conf.c:run_script_argv:385 - Set environment variable: LXC_HOOK_TYPE=mount
lxc bionic 20200415210854.224 TRACE    conf - conf.c:run_script_argv:390 - Set environment variable: LXC_HOOK_SECTION=lxc
lxc bionic 20200415210854.549 INFO     conf - conf.c:lxc_fill_autodev:1152 - Populating "/dev"
lxc bionic 20200415210854.550 DEBUG    conf - conf.c:lxc_fill_autodev:1218 - Bind mounted host device node "/dev/full" onto "/var/snap/lxd/common/lxc//dev/full"
lxc bionic 20200415210854.550 DEBUG    conf - conf.c:lxc_fill_autodev:1218 - Bind mounted host device node "/dev/null" onto "/var/snap/lxd/common/lxc//dev/null"
lxc bionic 20200415210854.551 DEBUG    conf - conf.c:lxc_fill_autodev:1218 - Bind mounted host device node "/dev/random" onto "/var/snap/lxd/common/lxc//dev/random"
lxc bionic 20200415210854.551 DEBUG    conf - conf.c:lxc_fill_autodev:1218 - Bind mounted host device node "/dev/tty" onto "/var/snap/lxd/common/lxc//dev/tty"
lxc bionic 20200415210854.551 DEBUG    conf - conf.c:lxc_fill_autodev:1218 - Bind mounted host device node "/dev/urandom" onto "/var/snap/lxd/common/lxc//dev/urandom"
lxc bionic 20200415210854.551 DEBUG    conf - conf.c:lxc_fill_autodev:1218 - Bind mounted host device node "/dev/zero" onto "/var/snap/lxd/common/lxc//dev/zero"
lxc bionic 20200415210854.551 INFO     conf - conf.c:lxc_fill_autodev:1222 - Populated "/dev"
lxc bionic 20200415210854.552 DEBUG    conf - conf.c:lxc_setup_dev_console:1618 - Mounted pts device "/dev/pts/0" onto "/var/snap/lxd/common/lxc//dev/console"
lxc bionic 20200415210854.552 INFO     utils - utils.c:lxc_mount_proc_if_needed:1200 - I am 1, /proc/self points to "1"
lxc bionic 20200415210854.814 TRACE    conf - conf.c:lxc_pivot_root:1427 - pivot_root("/var/snap/lxd/common/lxc/") successful
lxc bionic 20200415210854.816 DEBUG    conf - conf.c:lxc_setup_devpts:1521 - Mount new devpts instance with options "gid=5,newinstance,ptmxmode=0666,mode=0620,max=1024"
lxc bionic 20200415210854.816 DEBUG    conf - conf.c:lxc_setup_devpts:1536 - Created dummy "/dev/ptmx" file as bind mount target
lxc bionic 20200415210854.817 DEBUG    conf - conf.c:lxc_setup_devpts:1541 - Bind mounted "/dev/pts/ptmx" to "/dev/ptmx"
lxc bionic 20200415210854.817 INFO     conf - conf.c:lxc_setup_ttys:900 - Finished setting up 0 /dev/tty<N> device(s)
lxc bionic 20200415210854.817 INFO     conf - conf.c:setup_personality:1572 - Set personality to "0x0"
lxc bionic 20200415210854.817 DEBUG    conf - conf.c:setup_caps:2338 - Capabilities have been setup
lxc bionic 20200415210854.817 NOTICE   conf - conf.c:lxc_setup:3433 - The container "bionic" is set up
lxc bionic 20200415210854.818 INFO     lsm - lsm/lsm.c:lsm_process_label_set_at:157 - Set AppArmor label to "lxd-bionic_</var/snap/lxd/common/lxd>//&:lxd-bionic_<var-snap-lxd-common-lxd>:"
lxc bionic 20200415210854.818 INFO     apparmor - lsm/apparmor.c:apparmor_process_label_set:1185 - Changed AppArmor profile to lxd-bionic_</var/snap/lxd/common/lxd>//&:lxd-bionic_<var-snap-lxd-common-lxd>:
lxc bionic 20200415210854.825 WARN     cgfsng - cgroups/cgfsng.c:cgfsng_setup_limits_legacy:2713 - Invalid argument - Ignoring legacy cgroup limits on pure cgroup2 system
lxc bionic 20200415210854.825 TRACE    start - start.c:lxc_spawn:1790 - Set up legacy device cgroup controller limits
lxc bionic 20200415210854.825 TRACE    start - start.c:lxc_spawn:1796 - Set up cgroup2 device controller limits
lxc bionic 20200415210854.825 DEBUG    start - start.c:lxc_spawn:1808 - Preserved cgroup namespace via fd 13
lxc bionic 20200415210854.825 TRACE    start - start.c:lxc_spawn:1813 - Finished setting up cgroups
lxc bionic 20200415210854.826 NOTICE   start - start.c:start:2041 - Exec'ing "/sbin/init"
lxc bionic 20200415210854.841 TRACE    confile_utils - confile_utils.c:lxc_log_configured_netdevs:242 - container has no networks configured
lxc bionic 20200415210854.841 NOTICE   start - start.c:post_start:2052 - Started "/sbin/init" with pid "1674708"
lxc bionic 20200415210854.841 TRACE    start - start.c:lxc_serve_state_socket_pair:492 - Sent container state "RUNNING" to 7
lxc bionic 20200415210854.841 TRACE    start - start.c:lxc_serve_state_clients:427 - Set container state to RUNNING
lxc bionic 20200415210854.841 TRACE    start - start.c:lxc_serve_state_clients:430 - No state clients registered
lxc bionic 20200415210854.841 TRACE    lxccontainer - lxccontainer.c:wait_on_daemonized_start:856 - Container is in "RUNNING" state
lxc bionic 20200415210854.842 TRACE    start - start.c:lxc_poll:581 - Mainloop is ready
lxc bionic 20200415210854.842 NOTICE   start - start.c:signal_handler:394 - Received 17 from pid 1674723 instead of container init 1674708
lxc bionic 20200415210854.843 TRACE    commands - commands.c:lxc_cmd_accept:1555 - Accepted new client as fd 14 on command server fd 9
lxc bionic 20200415210854.850 TRACE    commands - commands.c:lxc_cmd_fd_cleanup:1467 - Closing client fd 14 for command "get_state"
lxc bionic 20200415210854.856 TRACE    commands - commands.c:lxc_cmd_accept:1555 - Accepted new client as fd 14 on command server fd 9
lxc bionic 20200415210854.875 TRACE    commands - commands.c:lxc_cmd_fd_cleanup:1467 - Closing client fd 14 for command "get_state"
lxc bionic 20200415210854.949 TRACE    commands - commands.c:lxc_cmd_accept:1555 - Accepted new client as fd 14 on command server fd 9
lxc bionic 20200415210854.952 TRACE    commands - commands.c:lxc_cmd_fd_cleanup:1467 - Closing client fd 14 for command "get_state"
lxc bionic 20200415210854.952 TRACE    commands - commands.c:lxc_cmd_accept:1555 - Accepted new client as fd 14 on command server fd 9
lxc bionic 20200415210854.952 TRACE    commands - commands.c:lxc_cmd_fd_cleanup:1467 - Closing client fd 14 for command "get_state"
lxc bionic 20200415210854.953 TRACE    commands - commands.c:lxc_cmd_accept:1555 - Accepted new client as fd 14 on command server fd 9
lxc bionic 20200415210854.953 TRACE    commands - commands.c:lxc_cmd_fd_cleanup:1467 - Closing client fd 14 for command "get_state"
lxc bionic 20200415210854.958 TRACE    commands - commands.c:lxc_cmd_accept:1555 - Accepted new client as fd 14 on command server fd 9
lxc bionic 20200415210854.959 TRACE    commands - commands.c:lxc_cmd_fd_cleanup:1467 - Closing client fd 14 for command "get_cgroup"
lxc bionic 20200415210859.452 TRACE    commands - commands.c:lxc_cmd_accept:1555 - Accepted new client as fd 14 on command server fd 9
lxc bionic 20200415210859.453 TRACE    commands - commands.c:lxc_cmd_fd_cleanup:1467 - Closing client fd 14 for command "get_state"
lxc bionic 20200415210859.477 TRACE    commands - commands.c:lxc_cmd_accept:1555 - Accepted new client as fd 14 on command server fd 9
lxc bionic 20200415210859.477 TRACE    commands - commands.c:lxc_cmd_fd_cleanup:1467 - Closing client fd 14 for command "get_state"
lxc bionic 20200415210859.477 TRACE    commands - commands.c:lxc_cmd_accept:1555 - Accepted new client as fd 14 on command server fd 9
lxc bionic 20200415210859.478 TRACE    commands - commands.c:lxc_cmd_fd_cleanup:1467 - Closing client fd 14 for command "get_state"
lxc bionic 20200415210859.478 TRACE    commands - commands.c:lxc_cmd_accept:1555 - Accepted new client as fd 14 on command server fd 9
lxc bionic 20200415210859.478 TRACE    commands - commands.c:lxc_cmd_fd_cleanup:1467 - Closing client fd 14 for command "get_init_pid"
lxc bionic 20200415210859.478 TRACE    commands - commands.c:lxc_cmd_accept:1555 - Accepted new client as fd 14 on command server fd 9
lxc bionic 20200415210859.479 TRACE    commands - commands.c:lxc_cmd_fd_cleanup:1467 - Closing client fd 14 for command "get_state"
lxc bionic 20200415210859.483 TRACE    commands - commands.c:lxc_cmd_accept:1555 - Accepted new client as fd 14 on command server fd 9
lxc bionic 20200415210859.483 TRACE    commands - commands.c:lxc_cmd_fd_cleanup:1467 - Closing client fd 14 for command "get_cgroup"
lxc bionic 20200415210859.484 TRACE    commands - commands.c:lxc_cmd_accept:1555 - Accepted new client as fd 14 on command server fd 9
lxc bionic 20200415210859.484 TRACE    commands - commands.c:lxc_cmd_fd_cleanup:1467 - Closing client fd 14 for command "get_state"
lxc bionic 20200415210859.487 TRACE    commands - commands.c:lxc_cmd_accept:1555 - Accepted new client as fd 14 on command server fd 9
lxc bionic 20200415210859.487 TRACE    commands - commands.c:lxc_cmd_fd_cleanup:1467 - Closing client fd 14 for command "get_cgroup"
lxc bionic 20200415210859.488 TRACE    commands - commands.c:lxc_cmd_accept:1555 - Accepted new client as fd 14 on command server fd 9
lxc bionic 20200415210859.492 TRACE    commands - commands.c:lxc_cmd_fd_cleanup:1467 - Closing client fd 14 for command "get_state"
lxc bionic 20200415210859.492 TRACE    commands - commands.c:lxc_cmd_accept:1555 - Accepted new client as fd 14 on command server fd 9
lxc bionic 20200415210859.492 TRACE    commands - commands.c:lxc_cmd_fd_cleanup:1467 - Closing client fd 14 for command "get_cgroup"
lxc bionic 20200415210859.492 TRACE    commands - commands.c:lxc_cmd_accept:1555 - Accepted new client as fd 14 on command server fd 9
lxc bionic 20200415210859.493 TRACE    commands - commands.c:lxc_cmd_fd_cleanup:1467 - Closing client fd 14 for command "get_state"
lxc bionic 20200415210859.496 TRACE    commands - commands.c:lxc_cmd_accept:1555 - Accepted new client as fd 14 on command server fd 9
lxc bionic 20200415210859.497 TRACE    commands - commands.c:lxc_cmd_fd_cleanup:1467 - Closing client fd 14 for command "get_cgroup"
lxc bionic 20200415210859.497 TRACE    commands - commands.c:lxc_cmd_accept:1555 - Accepted new client as fd 14 on command server fd 9
lxc bionic 20200415210859.497 TRACE    commands - commands.c:lxc_cmd_fd_cleanup:1467 - Closing client fd 14 for command "get_init_pid"
lxc bionic 20200415210859.923 TRACE    commands - commands.c:lxc_cmd_accept:1555 - Accepted new client as fd 14 on command server fd 9
lxc bionic 20200415210859.923 TRACE    commands - commands.c:lxc_cmd_fd_cleanup:1467 - Closing client fd 14 for command "get_init_pid"
lxc bionic 20200415210859.924 TRACE    commands - commands.c:lxc_cmd_accept:1555 - Accepted new client as fd 14 on command server fd 9
lxc bionic 20200415210859.924 TRACE    commands - commands.c:lxc_cmd_fd_cleanup:1467 - Closing client fd 14 for command "get_state"
lxc bionic 20200415210859.959 TRACE    commands - commands.c:lxc_cmd_accept:1555 - Accepted new client as fd 14 on command server fd 9
lxc bionic 20200415210859.959 TRACE    commands - commands.c:lxc_cmd_fd_cleanup:1467 - Closing client fd 14 for command "get_cgroup"
lxc bionic 20200415210859.959 TRACE    commands - commands.c:lxc_cmd_accept:1555 - Accepted new client as fd 14 on command server fd 9
lxc bionic 20200415210859.960 TRACE    commands - commands.c:lxc_cmd_fd_cleanup:1467 - Closing client fd 14 for command "get_state"
lxc bionic 20200415210859.962 TRACE    commands - commands.c:lxc_cmd_accept:1555 - Accepted new client as fd 14 on command server fd 9
lxc bionic 20200415210859.963 TRACE    commands - commands.c:lxc_cmd_fd_cleanup:1467 - Closing client fd 14 for command "get_cgroup"

@brauner

root@sateda:~# lxc info --show-log bionic | grep Ignoring.*cgroup
lxc bionic 20200415210854.179 WARN     cgfsng - cgroups/cgfsng.c:cgfsng_setup_limits_legacy:2713 - Invalid argument - Ignoring legacy cgroup limits on pure cgroup2 system
lxc bionic 20200415210854.825 WARN     cgfsng - cgroups/cgfsng.c:cgfsng_setup_limits_legacy:2713 - Invalid argument - Ignoring legacy cgroup limits on pure cgroup2 system

This is most definitely NOT a cgroup2 only system.

So that’s a regression in a recent LXC bugfix we’ve included in a recent set of cherry-picks.

git cherry-pick 16ccd6eb26191c9c14a108bf3ed9ad9435466575  # cgroups: ignore legacy limits on pure cgroup2 systems

Specifically

@brauner is looking at it, we’ll have a fix for this in tonight’s stable update.

Wow great! Thank you for such a fast response. I’ll confirm on my end too and post results when snap updates.

Much appreciated!

The fix is now in stable.

Confirmed, fixed on this end after snap update and container restart: lxd 4.0.0 rev 14611

Thanks again for your help and fast fix!

Thanks for the report and sorry for the regression.