Container won't start after system update (Arch Linux)

jjb2018 · October 31, 2020, 1:24am

Hi folks,

I have just done a full system update (pacman -Syu) on my server, and now my LXC containers will not start. Here’s the tail end of the DEBUG log file where things go wrong …

lxc-start zoneminder 20201031011110.730 DEBUG    start - start.c:lxc_spawn:1773 - Preserved net namespace via fd 5
lxc-start zoneminder 20201031011110.777 INFO     network - network.c:instantiate_veth:285 - Retrieved mtu 1500 from br0
lxc-start zoneminder 20201031011110.781 INFO     network - network.c:instantiate_veth:333 - Attached "vethEa7leO" to bridge "br0"
lxc-start zoneminder 20201031011110.782 DEBUG    network - network.c:instantiate_veth:449 - Instantiated veth tunnel "vethEa7leO <--> vethxYpEx6"
lxc-start zoneminder 20201031011110.783 NOTICE   utils - utils.c:lxc_setgroups:1413 - Dropped additional groups
lxc-start zoneminder 20201031011110.783 NOTICE   utils - utils.c:lxc_switch_uid_gid:1391 - Switched to gid 0
lxc-start zoneminder 20201031011110.783 NOTICE   utils - utils.c:lxc_switch_uid_gid:1400 - Switched to uid 0
lxc-start zoneminder 20201031011110.783 INFO     start - start.c:do_start:1198 - Unshared CLONE_NEWCGROUP
lxc-start zoneminder 20201031011110.784 INFO     conf - conf.c:setup_utsname:752 - Set hostname to "zoneminder"
lxc-start zoneminder 20201031011110.283 DEBUG    network - network.c:lxc_network_setup_in_child_namespaces_common:3510 - Network device "eth0" has been setup
lxc-start zoneminder 20201031011110.283 INFO     network - network.c:lxc_setup_network_in_child_namespaces:3532 - Network has been setup
lxc-start zoneminder 20201031011110.283 INFO     conf - conf.c:mount_autodev:1059 - Preparing "/dev"
lxc-start zoneminder 20201031011110.283 DEBUG    conf - conf.c:mount_autodev:1062 - Using mount options: size=500000,mode=755
lxc-start zoneminder 20201031011110.283 INFO     conf - conf.c:mount_autodev:1109 - Prepared "/dev"
lxc-start zoneminder 20201031011110.283 DEBUG    conf - conf.c:mount_entry:1944 - Remounting "/sys/fs/fuse/connections" on "/usr/lib/lxc/rootfs/sys/fs/fuse/connections" to respect bind or remount options
lxc-start zoneminder 20201031011110.283 DEBUG    conf - conf.c:mount_entry:1963 - Flags for "/sys/fs/fuse/connections" were 4110, required extra flags are 14
lxc-start zoneminder 20201031011110.283 DEBUG    conf - conf.c:mount_entry:2007 - Mounted "/sys/fs/fuse/connections" on "/usr/lib/lxc/rootfs/sys/fs/fuse/connections" with filesystem type "none"
lxc-start zoneminder 20201031011110.283 INFO     conf - conf.c:lxc_fill_autodev:1152 - Populating "/dev"
lxc-start zoneminder 20201031011110.284 DEBUG    conf - conf.c:lxc_fill_autodev:1162 - Created device node "full"
lxc-start zoneminder 20201031011110.284 DEBUG    conf - conf.c:lxc_fill_autodev:1162 - Created device node "null"
lxc-start zoneminder 20201031011110.284 DEBUG    conf - conf.c:lxc_fill_autodev:1162 - Created device node "random"
lxc-start zoneminder 20201031011110.284 DEBUG    conf - conf.c:lxc_fill_autodev:1162 - Created device node "tty"
lxc-start zoneminder 20201031011110.284 DEBUG    conf - conf.c:lxc_fill_autodev:1162 - Created device node "urandom"
lxc-start zoneminder 20201031011110.284 DEBUG    conf - conf.c:lxc_fill_autodev:1162 - Created device node "zero"
lxc-start zoneminder 20201031011110.284 INFO     conf - conf.c:lxc_fill_autodev:1220 - Populated "/dev"
lxc-start zoneminder 20201031011110.284 INFO     utils - utils.c:lxc_mount_proc_if_needed:1247 - I am 1, /proc/self points to "1"
lxc-start zoneminder 20201031011110.284 ERROR    conf - conf.c:lxc_setup_dev_console:1668 - Invalid argument - Failed to mount 42(/dev/pts/4) on "size=500000,mode=755"
lxc-start zoneminder 20201031011110.284 ERROR    conf - conf.c:lxc_setup:3397 - Failed to setup console
lxc-start zoneminder 20201031011110.284 ERROR    start - start.c:do_start:1218 - Failed to setup container "zoneminder"
lxc-start zoneminder 20201031011110.284 ERROR    sync - sync.c:__sync_wait:36 - An error occurred in another process (expected sequence number 5)
lxc-start zoneminder 20201031011110.284 DEBUG    network - network.c:lxc_delete_network:3665 - Deleted network devices
lxc-start zoneminder 20201031011110.284 ERROR    start - start.c:__lxc_start:1999 - Failed to spawn container "zoneminder"
lxc-start zoneminder 20201031011110.284 WARN     start - start.c:lxc_abort:1012 - No such process - Failed to send SIGKILL via pidfd 42 for process 74630
lxc-start zoneminder 20201031011110.284 DEBUG    conf - conf.c:idmaptool_on_path_and_privileged:2734 - The binary "/usr/bin/newuidmap" has CAP_SETUID in its CAP_EFFECTIVE and CAP_PERMITTED sets
lxc-start zoneminder 20201031011110.284 DEBUG    conf - conf.c:idmaptool_on_path_and_privileged:2740 - The binary "/usr/bin/newgidmap" has CAP_SETGID in its CAP_EFFECTIVE and CAP_PERMITTED sets
lxc-start zoneminder 20201031011110.284 DEBUG    conf - conf.c:lxc_map_ids:2795 - Functional newuidmap and newgidmap binary found
lxc-start zoneminder 20201031011110.289 NOTICE   utils - utils.c:lxc_setgroups:1413 - Dropped additional groups
lxc-start zoneminder 20201031011110.363 ERROR    lxc_start - tools/lxc_start.c:main:308 - The container failed to start
lxc-start zoneminder 20201031011110.363 ERROR    lxc_start - tools/lxc_start.c:main:313 - Additional information can be obtained by setting the --logfile and --logpriority options

For info:
This is an unprivileged container run by root.
LXC version: 1:4.0.5-1
Linux Kernel verison: 5.4.73-1-lts

Any help would be much appreciated.

Thanks,
Justin

stgraber · October 31, 2020, 3:55am

@brauner

stgraber · October 31, 2020, 3:55am

@jjb2018 can you show the lxc.conf for that container?

jjb2018 · October 31, 2020, 9:24am

Hi Stephane - thanks for the response! Here is the container config …

# Template used to create this container: /usr/share/lxc/templates/lxc-download
# Parameters passed to the template: --dist archlinux --release current --arch amd64
# Template script checksum (SHA-1): 1ba3a6d6544626d6e64c7b8f1a51f6022c5e5f8f
# For additional config options, please look at lxc.container.conf(5)

# Uncomment the following line to support nesting containers:
#lxc.include = /usr/share/lxc/config/nesting.conf
# (Be aware this has security implications)


# Distribution configuration
lxc.include = /usr/share/lxc/config/common.conf
lxc.include = /usr/share/lxc/config/userns.conf
lxc.arch = x86_64

# Container specific configuration
lxc.idmap = u 0 100000 65536
lxc.idmap = g 0 100000 65536
lxc.rootfs.path = zfs:zfsdata/lxcstore/zoneminder
lxc.uts.name = zoneminder

# Network configuration
#lxc.net.0.type = empty
lxc.net.0.type = veth
lxc.net.0.link = br0
lxc.net.0.flags = up

lxc.start.auto = 1
lxc.start.order = 0
lxc.start.delay = 0
lxc.group = onboot

jjb2018 · November 1, 2020, 7:17pm

I rebooted the server and got another DEBUG log file from trying to start a container. Here’s the full log …

[justin@IXTREME ~]$ sudo cat /zfsdata/scratch/lxc_debug.log 
lxc-start zoneminder 20201101000816.189 INFO     confile - confile.c:set_config_idmaps:2012 - Read uid map: type u nsid 0 hostid 100000 range 65536
lxc-start zoneminder 20201101000816.189 INFO     confile - confile.c:set_config_idmaps:2012 - Read uid map: type g nsid 0 hostid 100000 range 65536
lxc-start zoneminder 20201101000816.189 INFO     lxccontainer - lxccontainer.c:do_lxcapi_start:979 - Set process title to [lxc monitor] /zfsdata/lxcstore zoneminder
lxc-start zoneminder 20201101000816.189 DEBUG    lxccontainer - lxccontainer.c:wait_on_daemonized_start:840 - First child 70685 exited
lxc-start zoneminder 20201101000816.189 INFO     lsm - lsm/lsm.c:lsm_init:40 - Initialized LSM security driver nop
lxc-start zoneminder 20201101000816.190 DEBUG    terminal - terminal.c:lxc_terminal_peer_default:665 - No such device - The process does not have a controlling terminal
lxc-start zoneminder 20201101000816.190 INFO     seccomp - seccomp.c:parse_config_v2:795 - Processing "reject_force_umount  # comment this to allow umount -f;  not recommended"
lxc-start zoneminder 20201101000816.190 INFO     seccomp - seccomp.c:do_resolve_add_rule:517 - Set seccomp rule to reject force umounts
lxc-start zoneminder 20201101000816.190 INFO     seccomp - seccomp.c:parse_config_v2:990 - Added native rule for arch 0 for reject_force_umount action 0(kill)
lxc-start zoneminder 20201101000816.190 INFO     seccomp - seccomp.c:do_resolve_add_rule:517 - Set seccomp rule to reject force umounts
lxc-start zoneminder 20201101000816.190 INFO     seccomp - seccomp.c:parse_config_v2:999 - Added compat rule for arch 1073741827 for reject_force_umount action 0(kill)
lxc-start zoneminder 20201101000816.190 INFO     seccomp - seccomp.c:do_resolve_add_rule:517 - Set seccomp rule to reject force umounts
lxc-start zoneminder 20201101000816.190 INFO     seccomp - seccomp.c:parse_config_v2:1009 - Added compat rule for arch 1073741886 for reject_force_umount action 0(kill)
lxc-start zoneminder 20201101000816.190 INFO     seccomp - seccomp.c:do_resolve_add_rule:517 - Set seccomp rule to reject force umounts
lxc-start zoneminder 20201101000816.190 INFO     seccomp - seccomp.c:parse_config_v2:1019 - Added native rule for arch -1073741762 for reject_force_umount action 0(kill)
lxc-start zoneminder 20201101000816.190 INFO     seccomp - seccomp.c:parse_config_v2:795 - Processing "[all]"
lxc-start zoneminder 20201101000816.190 INFO     seccomp - seccomp.c:parse_config_v2:795 - Processing "kexec_load errno 1"
lxc-start zoneminder 20201101000816.190 INFO     seccomp - seccomp.c:parse_config_v2:990 - Added native rule for arch 0 for kexec_load action 327681(errno)
lxc-start zoneminder 20201101000816.190 INFO     seccomp - seccomp.c:parse_config_v2:999 - Added compat rule for arch 1073741827 for kexec_load action 327681(errno)
lxc-start zoneminder 20201101000816.190 INFO     seccomp - seccomp.c:parse_config_v2:1009 - Added compat rule for arch 1073741886 for kexec_load action 327681(errno)
lxc-start zoneminder 20201101000816.190 INFO     seccomp - seccomp.c:parse_config_v2:1019 - Added native rule for arch -1073741762 for kexec_load action 327681(errno)
lxc-start zoneminder 20201101000816.190 INFO     seccomp - seccomp.c:parse_config_v2:795 - Processing "open_by_handle_at errno 1"
lxc-start zoneminder 20201101000816.190 INFO     seccomp - seccomp.c:parse_config_v2:990 - Added native rule for arch 0 for open_by_handle_at action 327681(errno)
lxc-start zoneminder 20201101000816.190 INFO     seccomp - seccomp.c:parse_config_v2:999 - Added compat rule for arch 1073741827 for open_by_handle_at action 327681(errno)
lxc-start zoneminder 20201101000816.190 INFO     seccomp - seccomp.c:parse_config_v2:1009 - Added compat rule for arch 1073741886 for open_by_handle_at action 327681(errno)
lxc-start zoneminder 20201101000816.190 INFO     seccomp - seccomp.c:parse_config_v2:1019 - Added native rule for arch -1073741762 for open_by_handle_at action 327681(errno)
lxc-start zoneminder 20201101000816.190 INFO     seccomp - seccomp.c:parse_config_v2:795 - Processing "init_module errno 1"
lxc-start zoneminder 20201101000816.190 INFO     seccomp - seccomp.c:parse_config_v2:990 - Added native rule for arch 0 for init_module action 327681(errno)
lxc-start zoneminder 20201101000816.190 INFO     seccomp - seccomp.c:parse_config_v2:999 - Added compat rule for arch 1073741827 for init_module action 327681(errno)
lxc-start zoneminder 20201101000816.190 INFO     seccomp - seccomp.c:parse_config_v2:1009 - Added compat rule for arch 1073741886 for init_module action 327681(errno)
lxc-start zoneminder 20201101000816.190 INFO     seccomp - seccomp.c:parse_config_v2:1019 - Added native rule for arch -1073741762 for init_module action 327681(errno)
lxc-start zoneminder 20201101000816.190 INFO     seccomp - seccomp.c:parse_config_v2:795 - Processing "finit_module errno 1"
lxc-start zoneminder 20201101000816.190 INFO     seccomp - seccomp.c:parse_config_v2:990 - Added native rule for arch 0 for finit_module action 327681(errno)
lxc-start zoneminder 20201101000816.191 INFO     seccomp - seccomp.c:parse_config_v2:999 - Added compat rule for arch 1073741827 for finit_module action 327681(errno)
lxc-start zoneminder 20201101000816.191 INFO     seccomp - seccomp.c:parse_config_v2:1009 - Added compat rule for arch 1073741886 for finit_module action 327681(errno)
lxc-start zoneminder 20201101000816.191 INFO     seccomp - seccomp.c:parse_config_v2:1019 - Added native rule for arch -1073741762 for finit_module action 327681(errno)
lxc-start zoneminder 20201101000816.191 INFO     seccomp - seccomp.c:parse_config_v2:795 - Processing "delete_module errno 1"
lxc-start zoneminder 20201101000816.191 INFO     seccomp - seccomp.c:parse_config_v2:990 - Added native rule for arch 0 for delete_module action 327681(errno)
lxc-start zoneminder 20201101000816.191 INFO     seccomp - seccomp.c:parse_config_v2:999 - Added compat rule for arch 1073741827 for delete_module action 327681(errno)
lxc-start zoneminder 20201101000816.191 INFO     seccomp - seccomp.c:parse_config_v2:1009 - Added compat rule for arch 1073741886 for delete_module action 327681(errno)
lxc-start zoneminder 20201101000816.191 INFO     seccomp - seccomp.c:parse_config_v2:1019 - Added native rule for arch -1073741762 for delete_module action 327681(errno)
lxc-start zoneminder 20201101000816.191 INFO     seccomp - seccomp.c:parse_config_v2:1025 - Merging compat seccomp contexts into main context
lxc-start zoneminder 20201101000816.191 INFO     start - start.c:lxc_init:837 - Container "zoneminder" is initialized
lxc-start zoneminder 20201101000816.261 WARN     cgfsng - cgroups/cgfsng.c:mkdir_eexist_on_last:1152 - File exists - Failed to create directory "/sys/fs/cgroup/cpuset//lxc.monitor.zoneminder"
lxc-start zoneminder 20201101000816.261 INFO     cgfsng - cgroups/cgfsng.c:cgfsng_monitor_create:1368 - The monitor process uses "lxc.monitor.zoneminder" as cgroup
lxc-start zoneminder 20201101000816.261 DEBUG    storage - storage/storage.c:get_storage_by_name:211 - Detected rootfs type "zfs"
lxc-start zoneminder 20201101000816.261 INFO     start - start.c:__lxc_start:1985 - Unshared CLONE_NEWNS
lxc-start zoneminder 20201101000816.262 DEBUG    storage - storage/storage.c:get_storage_by_name:211 - Detected rootfs type "zfs"
lxc-start zoneminder 20201101000816.264 DEBUG    conf - conf.c:lxc_mount_rootfs:1260 - Mounted rootfs "zfsdata/lxcstore/zoneminder" onto "/usr/lib/lxc/rootfs" with options "(null)"
lxc-start zoneminder 20201101000816.264 INFO     start - start.c:__lxc_start:1993 - Set up container rootfs as host root
lxc-start zoneminder 20201101000816.264 WARN     cgfsng - cgroups/cgfsng.c:mkdir_eexist_on_last:1152 - File exists - Failed to create directory "/sys/fs/cgroup/cpuset//lxc.payload.zoneminder"
lxc-start zoneminder 20201101000816.265 INFO     cgfsng - cgroups/cgfsng.c:cgfsng_payload_create:1471 - The container process uses "lxc.payload.zoneminder" as cgroup
lxc-start zoneminder 20201101000816.265 INFO     start - start.c:lxc_spawn:1700 - Cloned CLONE_NEWUSER
lxc-start zoneminder 20201101000816.265 INFO     start - start.c:lxc_spawn:1700 - Cloned CLONE_NEWNS
lxc-start zoneminder 20201101000816.265 INFO     start - start.c:lxc_spawn:1700 - Cloned CLONE_NEWPID
lxc-start zoneminder 20201101000816.265 INFO     start - start.c:lxc_spawn:1700 - Cloned CLONE_NEWUTS
lxc-start zoneminder 20201101000816.265 INFO     start - start.c:lxc_spawn:1700 - Cloned CLONE_NEWIPC
lxc-start zoneminder 20201101000816.265 DEBUG    start - start.c:lxc_try_preserve_namespaces:166 - Preserved user namespace via fd 31
lxc-start zoneminder 20201101000816.265 DEBUG    start - start.c:lxc_try_preserve_namespaces:166 - Preserved mnt namespace via fd 32
lxc-start zoneminder 20201101000816.265 DEBUG    start - start.c:lxc_try_preserve_namespaces:166 - Preserved pid namespace via fd 33
lxc-start zoneminder 20201101000816.265 DEBUG    start - start.c:lxc_try_preserve_namespaces:166 - Preserved uts namespace via fd 34
lxc-start zoneminder 20201101000816.265 DEBUG    start - start.c:lxc_try_preserve_namespaces:166 - Preserved ipc namespace via fd 35
lxc-start zoneminder 20201101000816.265 DEBUG    conf - conf.c:idmaptool_on_path_and_privileged:2734 - The binary "/usr/bin/newuidmap" has CAP_SETUID in its CAP_EFFECTIVE and CAP_PERMITTED sets
lxc-start zoneminder 20201101000816.265 DEBUG    conf - conf.c:idmaptool_on_path_and_privileged:2740 - The binary "/usr/bin/newgidmap" has CAP_SETGID in its CAP_EFFECTIVE and CAP_PERMITTED sets
lxc-start zoneminder 20201101000816.265 DEBUG    conf - conf.c:lxc_map_ids:2795 - Functional newuidmap and newgidmap binary found
lxc-start zoneminder 20201101000816.273 INFO     start - start.c:do_start:1085 - Unshared CLONE_NEWNET
lxc-start zoneminder 20201101000816.273 DEBUG    conf - conf.c:idmaptool_on_path_and_privileged:2734 - The binary "/usr/bin/newuidmap" has CAP_SETUID in its CAP_EFFECTIVE and CAP_PERMITTED sets
lxc-start zoneminder 20201101000816.273 DEBUG    conf - conf.c:idmaptool_on_path_and_privileged:2740 - The binary "/usr/bin/newgidmap" has CAP_SETGID in its CAP_EFFECTIVE and CAP_PERMITTED sets
lxc-start zoneminder 20201101000816.273 DEBUG    conf - conf.c:lxc_map_ids:2795 - Functional newuidmap and newgidmap binary found
lxc-start zoneminder 20201101000816.281 NOTICE   utils - utils.c:lxc_setgroups:1413 - Dropped additional groups
lxc-start zoneminder 20201101000816.281 WARN     cgfsng - cgroups/cgfsng.c:fchowmodat:1570 - No such file or directory - Failed to fchownat(17, memory.oom.group, 65536, 0, AT_EMPTY_PATH | AT_SYMLINK_NOFOLLOW )
lxc-start zoneminder 20201101000816.281 DEBUG    start - start.c:lxc_spawn:1773 - Preserved net namespace via fd 7
lxc-start zoneminder 20201101000816.285 INFO     network - network.c:instantiate_veth:285 - Retrieved mtu 1500 from br0
lxc-start zoneminder 20201101000816.286 INFO     network - network.c:instantiate_veth:333 - Attached "vethrIYE6Y" to bridge "br0"
lxc-start zoneminder 20201101000816.286 DEBUG    network - network.c:instantiate_veth:449 - Instantiated veth tunnel "vethrIYE6Y <--> veth5kBOqO"
lxc-start zoneminder 20201101000816.286 NOTICE   utils - utils.c:lxc_setgroups:1413 - Dropped additional groups
lxc-start zoneminder 20201101000816.286 NOTICE   utils - utils.c:lxc_switch_uid_gid:1391 - Switched to gid 0
lxc-start zoneminder 20201101000816.286 NOTICE   utils - utils.c:lxc_switch_uid_gid:1400 - Switched to uid 0
lxc-start zoneminder 20201101000816.286 INFO     start - start.c:do_start:1198 - Unshared CLONE_NEWCGROUP
lxc-start zoneminder 20201101000816.286 INFO     conf - conf.c:setup_utsname:752 - Set hostname to "zoneminder"
lxc-start zoneminder 20201101000816.361 DEBUG    network - network.c:lxc_network_setup_in_child_namespaces_common:3510 - Network device "eth0" has been setup
lxc-start zoneminder 20201101000816.361 INFO     network - network.c:lxc_setup_network_in_child_namespaces:3532 - Network has been setup
lxc-start zoneminder 20201101000816.361 INFO     conf - conf.c:mount_autodev:1059 - Preparing "/dev"
lxc-start zoneminder 20201101000816.361 DEBUG    conf - conf.c:mount_autodev:1062 - Using mount options: size=500000,mode=755
lxc-start zoneminder 20201101000816.361 INFO     conf - conf.c:mount_autodev:1109 - Prepared "/dev"
lxc-start zoneminder 20201101000816.361 DEBUG    conf - conf.c:mount_entry:1944 - Remounting "/sys/fs/fuse/connections" on "/usr/lib/lxc/rootfs/sys/fs/fuse/connections" to respect bind or remount options
lxc-start zoneminder 20201101000816.361 DEBUG    conf - conf.c:mount_entry:1963 - Flags for "/sys/fs/fuse/connections" were 4110, required extra flags are 14
lxc-start zoneminder 20201101000816.361 DEBUG    conf - conf.c:mount_entry:2007 - Mounted "/sys/fs/fuse/connections" on "/usr/lib/lxc/rootfs/sys/fs/fuse/connections" with filesystem type "none"
lxc-start zoneminder 20201101000816.361 INFO     conf - conf.c:lxc_fill_autodev:1152 - Populating "/dev"
lxc-start zoneminder 20201101000816.361 DEBUG    conf - conf.c:lxc_fill_autodev:1162 - Created device node "full"
lxc-start zoneminder 20201101000816.361 DEBUG    conf - conf.c:lxc_fill_autodev:1162 - Created device node "null"
lxc-start zoneminder 20201101000816.361 DEBUG    conf - conf.c:lxc_fill_autodev:1162 - Created device node "random"
lxc-start zoneminder 20201101000816.362 DEBUG    conf - conf.c:lxc_fill_autodev:1162 - Created device node "tty"
lxc-start zoneminder 20201101000816.362 DEBUG    conf - conf.c:lxc_fill_autodev:1162 - Created device node "urandom"
lxc-start zoneminder 20201101000816.362 DEBUG    conf - conf.c:lxc_fill_autodev:1162 - Created device node "zero"
lxc-start zoneminder 20201101000816.362 INFO     conf - conf.c:lxc_fill_autodev:1220 - Populated "/dev"
lxc-start zoneminder 20201101000816.362 INFO     utils - utils.c:lxc_mount_proc_if_needed:1247 - I am 1, /proc/self points to "1"
lxc-start zoneminder 20201101000816.362 ERROR    conf - conf.c:lxc_setup_dev_console:1643 - No such file or directory - Failed to unmount "/usr/lib/lxc/rootfs/dev/console"
lxc-start zoneminder 20201101000816.362 ERROR    conf - conf.c:lxc_setup_boot_id:3193 - No such file or directory - Failed to generate random data for uuid
lxc-start zoneminder 20201101000816.362 DEBUG    conf - conf.c:lxc_setup_devpts_child:1546 - Mount new devpts instance with options "gid=5,newinstance,ptmxmode=0666,mode=0620,max=1024"
lxc-start zoneminder 20201101000816.363 DEBUG    conf - conf.c:lxc_setup_devpts_child:1574 - Created dummy "/dev/ptmx" file as bind mount target
lxc-start zoneminder 20201101000816.363 DEBUG    conf - conf.c:lxc_setup_devpts_child:1579 - Bind mounted "/dev/pts/ptmx" to "/dev/ptmx"
lxc-start zoneminder 20201101000816.363 DEBUG    conf - conf.c:lxc_allocate_ttys:939 - Created tty "/dev/pts/0" with ptx fd 32 and pty fd 33
lxc-start zoneminder 20201101000816.363 DEBUG    conf - conf.c:lxc_allocate_ttys:939 - Created tty "/dev/pts/1" with ptx fd 34 and pty fd 35
lxc-start zoneminder 20201101000816.363 DEBUG    conf - conf.c:lxc_allocate_ttys:939 - Created tty "/dev/pts/2" with ptx fd 36 and pty fd 37
lxc-start zoneminder 20201101000816.363 DEBUG    conf - conf.c:lxc_allocate_ttys:939 - Created tty "/dev/pts/3" with ptx fd 38 and pty fd 39
lxc-start zoneminder 20201101000816.363 INFO     conf - conf.c:lxc_allocate_ttys:956 - Finished creating 4 tty devices
lxc-start zoneminder 20201101000816.363 DEBUG    conf - conf.c:lxc_setup_ttys:894 - Bind mounted "/dev/pts/0" onto "/dev/tty1"
lxc-start zoneminder 20201101000816.363 DEBUG    conf - conf.c:lxc_setup_ttys:894 - Bind mounted "/dev/pts/1" onto "/dev/tty2"
lxc-start zoneminder 20201101000816.363 DEBUG    conf - conf.c:lxc_setup_ttys:894 - Bind mounted "/dev/pts/2" onto "/dev/tty3"
lxc-start zoneminder 20201101000816.363 DEBUG    conf - conf.c:lxc_setup_ttys:894 - Bind mounted "/dev/pts/3" onto "/dev/tty4"
lxc-start zoneminder 20201101000816.363 INFO     conf - conf.c:lxc_setup_ttys:901 - Finished setting up 4 /dev/tty<N> device(s)
lxc-start zoneminder 20201101000816.363 INFO     conf - conf.c:setup_personality:1610 - Set personality to "0x0"
lxc-start zoneminder 20201101000816.363 DEBUG    conf - conf.c:setup_caps:2421 - Capabilities have been setup
lxc-start zoneminder 20201101000816.363 NOTICE   conf - conf.c:lxc_setup:3445 - The container "zoneminder" is set up
lxc-start zoneminder 20201101000816.364 DEBUG    start - start.c:lxc_spawn:1849 - Preserved cgroup namespace via fd 13
lxc-start zoneminder 20201101000816.364 ERROR    utils - utils.c:open_devnull:1277 - No such file or directory - Can't open /dev/null
lxc-start zoneminder 20201101000816.364 WARN     utils - utils.c:fix_stdio_permissions:1886 - No such file or directory - Failed to open "/dev/null"
lxc-start zoneminder 20201101000816.364 WARN     start - start.c:do_start:1358 - Failed to ajust stdio permissions
lxc-start zoneminder 20201101000816.364 NOTICE   start - start.c:start:2086 - Exec'ing "/sbin/init"
lxc-start zoneminder 20201101000816.367 NOTICE   start - start.c:post_start:2097 - Started "/sbin/init" with pid "70688"
lxc-start zoneminder 20201101000816.367 NOTICE   start - start.c:signal_handler:404 - Received 17 from pid 70689 instead of container init 70688
lxc-start zoneminder 20201101101147.191 DEBUG    start - start.c:signal_handler:422 - Container init process 70688 exited
lxc-start zoneminder 20201101101147.191 DEBUG    start - start.c:__lxc_start:2038 - Unknown exit status for container "zoneminder" init 9
lxc-start zoneminder 20201101101147.191 INFO     error - error.c:lxc_error_set_and_log:33 - Child <70688> ended on signal (9)
lxc-start zoneminder 20201101101147.331 INFO     network - network.c:lxc_delete_network_priv:3232 - Removed interface "vethrIYE6Y" from "br0"
lxc-start zoneminder 20201101101147.331 DEBUG    network - network.c:lxc_delete_network:3665 - Deleted network devices
lxc-start zoneminder 20201101101147.331 DEBUG    conf - conf.c:idmaptool_on_path_and_privileged:2734 - The binary "/usr/bin/newuidmap" has CAP_SETUID in its CAP_EFFECTIVE and CAP_PERMITTED sets
lxc-start zoneminder 20201101101147.331 DEBUG    conf - conf.c:idmaptool_on_path_and_privileged:2740 - The binary "/usr/bin/newgidmap" has CAP_SETGID in its CAP_EFFECTIVE and CAP_PERMITTED sets
lxc-start zoneminder 20201101101147.331 DEBUG    conf - conf.c:lxc_map_ids:2795 - Functional newuidmap and newgidmap binary found
lxc-start zoneminder 20201101101147.339 NOTICE   utils - utils.c:lxc_setgroups:1413 - Dropped additional groups
[justin@IXTREME ~]$

So there seems to be an issue with creating or mounting /dev/null inside the container … at least that’s how my untrained eye interprets the log. I have no idea what could cause this. Anybody got any ideas? This was all working perfectly a few days ago and then after a system update I’ve now got this issue. Here’s a list of the most recent package files in the pacman cache 30th Oct …

[justin@IXTREME ~]$ find /var/cache/pacman/pkg -type f -newermt '2020-10-30' -ls
  2757961    308 -rw-r--r--   1 root     root       313979 Oct 30 18:00 /var/cache/pacman/pkg/python-jinja-2.11.2-2-any.pkg.tar.zst
  2757914    788 -rw-r--r--   1 root     root       803587 Oct 30 18:02 /var/cache/pacman/pkg/nvidia-settings-455.38-1-x86_64.pkg.tar.zst
  2757779    492 -rw-r--r--   1 root     root       499908 Oct 30 21:17 /var/cache/pacman/pkg/libhandy-1.0.1-1-x86_64.pkg.tar.zst
  2757928   8896 -rw-r--r--   1 root     root      9108626 Oct 30 12:31 /var/cache/pacman/pkg/samba-4.13.1-1-x86_64.pkg.tar.zst
  2756496    212 -rw-r--r--   1 root     root       214542 Oct 31 13:20 /var/cache/pacman/pkg/mtools-4.0.25-1-x86_64.pkg.tar.zst
  2756493     28 -rw-r--r--   1 root     root        24612 Oct 31 11:52 /var/cache/pacman/pkg/egl-wayland-1.1.5+2+g9c9c4c6-1-x86_64.pkg.tar.zst
  2756494    400 -rw-r--r--   1 root     root       405752 Oct 31 13:16 /var/cache/pacman/pkg/libpulse-13.99.3-1-x86_64.pkg.tar.zst
  2756498     64 -rw-r--r--   1 root     root        62448 Oct 31 13:16 /var/cache/pacman/pkg/pulseaudio-bluetooth-13.99.3-1-x86_64.pkg.tar.zst
  2756495    232 -rw-r--r--   1 root     root       233481 Oct 31 08:00 /var/cache/pacman/pkg/libzip-1.7.3-1-x86_64.pkg.tar.zst
  2757763   7136 -rw-r--r--   1 root     root      7306473 Oct 30 12:31 /var/cache/pacman/pkg/smbclient-4.13.1-1-x86_64.pkg.tar.zst
  2757948     48 -rw-r--r--   1 root     root        46455 Oct 30 17:58 /var/cache/pacman/pkg/confuse-3.3-2-x86_64.pkg.tar.zst
  2754312      8 -rw-r--r--   1 root     root         6577 Oct 31 13:47 /var/cache/pacman/pkg/pacman-mirrorlist-20201031-1-any.pkg.tar.zst
  2756497   1220 -rw-r--r--   1 root     root      1245797 Oct 31 13:16 /var/cache/pacman/pkg/pulseaudio-13.99.3-1-x86_64.pkg.tar.zst
  2757686  85420 -rw-r--r--   1 root     root     87468955 Oct 30 17:52 /var/cache/pacman/pkg/nvidia-utils-455.38-1-x86_64.pkg.tar.zst
  2757913  18112 -rw-r--r--   1 root     root     18543198 Oct 30 18:03 /var/cache/pacman/pkg/nvidia-lts-1:455.38-1-x86_64.pkg.tar.zst
  2757916  15920 -rw-r--r--   1 root     root     16298473 Oct 30 17:52 /var/cache/pacman/pkg/opencl-nvidia-455.38-1-x86_64.pkg.tar.zst
  2757836   1136 -rw-r--r--   1 root     root      1161133 Oct 30 10:42 /var/cache/pacman/pkg/meson-0.56.0-1-any.pkg.tar.zst
  2757809   1116 -rw-r--r--   1 root     root      1142264 Oct 30 21:12 /var/cache/pacman/pkg/pipewire-0.3.14-1-x86_64.pkg.tar.zst
  2757821   5828 -rw-r--r--   1 root     root      5966745 Oct 30 09:48 /var/cache/pacman/pkg/git-2.29.2-1-x86_64.pkg.tar.zst
  2756487     24 -rw-r--r--   1 root     root        22988 Oct 31 13:16 /var/cache/pacman/pkg/alsa-card-profiles-13.99.3-1-x86_64.pkg.tar.zst
  2757984    328 -rw-r--r--   1 root     root       332213 Oct 30 12:18 /var/cache/pacman/pkg/tmux-3.1_c-1-x86_64.pkg.tar.zst
  2757908     80 -rw-r--r--   1 root     root        78975 Oct 30 18:02 /var/cache/pacman/pkg/libxnvctrl-455.38-1-x86_64.pkg.tar.zst
[justin@IXTREME ~]$

Could any of these have an impact on LXC?

stgraber · November 1, 2020, 7:44pm

What does ls -lh /dev look like on the system?

The error suggests that /dev/null itself didn’t exist which seems very bizarre.

jjb2018 · November 1, 2020, 8:11pm

/dev/null is there as expected …

[justin@IXTREME ~]$ sudo find /dev -iname null -ls
[sudo] password for justin:
     2051      0 crw-rw-rw-   1 root     root       1,   3 Oct 31 23:30 /dev/null
[justin@IXTREME ~]$

brauner · November 2, 2020, 10:57am

So, do the failures to start only happen when the containers are autostarted during boot?

brauner · November 2, 2020, 10:59am

And if you revert only LXC do the errors disappear?

jjb2018 · November 2, 2020, 12:45pm

Hi - I can confirm that downgrading LXC only from 4.0.5 to 4.0.4 resolves the problem. Here’s a log of what I did …

[justin@IXTREME ~]$ sudo systemctl stop lxc
[justin@IXTREME ~]$ find /var/cache/pacman/pkg -type f -iname lxc*.zst
/var/cache/pacman/pkg/lxc-1:4.0.5-1-x86_64.pkg.tar.zst
/var/cache/pacman/pkg/lxc-1:4.0.4-1-x86_64.pkg.tar.zst
[justin@IXTREME ~]$ sudo pacman -U /var/cache/pacman/pkg/lxc-1:4.0.4-1-x86_64.pkg.tar.zst
loading packages...
warning: downgrading package lxc (1:4.0.5-1 => 1:4.0.4-1)
resolving dependencies...
looking for conflicting packages...

Packages (1) lxc-1:4.0.4-1

Total Installed Size:  18.18 MiB
Net Upgrade Size:      -0.26 MiB

:: Proceed with installation? [Y/n] 
(1/1) checking keys in keyring                                                                                         [########################################################################] 100%
(1/1) checking package integrity                                                                                       [########################################################################] 100%
(1/1) loading package files                                                                                            [########################################################################] 100%
(1/1) checking for file conflicts                                                                                      [########################################################################] 100%
(1/1) checking available disk space                                                                                    [########################################################################] 100%
:: Processing package changes...
(1/1) downgrading lxc                                                                                                  [########################################################################] 100%
:: Running post-transaction hooks...
(1/3) Reloading system manager configuration...
(2/3) Creating temporary files...
(3/3) Arming ConditionNeedsUpdate...
[justin@IXTREME ~]$ sudo systemctl start lxc
[justin@IXTREME ~]$ sudo systemctl status lxc
● lxc.service - LXC Container Initialization and Autoboot Code
     Loaded: loaded (/usr/lib/systemd/system/lxc.service; enabled; vendor preset: disabled)
     Active: active (exited) since Mon 2020-11-02 12:38:11 GMT; 3s ago
       Docs: man:lxc-autostart
             man:lxc
    Process: 3944158 ExecStartPre=/usr/lib/lxc/lxc-apparmor-load (code=exited, status=0/SUCCESS)
    Process: 3944159 ExecStart=/usr/lib/lxc/lxc-containers start (code=exited, status=0/SUCCESS)
   Main PID: 3944159 (code=exited, status=0/SUCCESS)

Nov 02 12:38:11 IXTREME systemd[1]: Starting LXC Container Initialization and Autoboot Code...
Nov 02 12:38:11 IXTREME systemd[1]: Finished LXC Container Initialization and Autoboot Code.
[justin@IXTREME ~]$ sudo lxc-ls -f
NAME       STATE   AUTOSTART GROUPS IPV4          IPV6 UNPRIVILEGED 
arch-base  STOPPED 0         -      -             -    true         
nginx      STOPPED 0         -      -             -    true         
subsonic2  STOPPED 0         -      -             -    true         
tomcat2    STOPPED 0         -      -             -    true         
zoneminder RUNNING 1         onboot 192.168.1.163 -    true         
[justin@IXTREME ~]$

The container (zoneminder) starts up without a problem. Here’s the DEBUG log from LXC when starting the container …

[justin@IXTREME ~]$ sudo cat /zfsdata/scratch/lxc_debug.log 
lxc-start zoneminder 20201101000816.189 INFO     confile - confile.c:set_config_idmaps:2012 - Read uid map: type u nsid 0 hostid 100000 range 65536
lxc-start zoneminder 20201101000816.189 INFO     confile - confile.c:set_config_idmaps:2012 - Read uid map: type g nsid 0 hostid 100000 range 65536
lxc-start zoneminder 20201101000816.189 INFO     lxccontainer - lxccontainer.c:do_lxcapi_start:979 - Set process title to [lxc monitor] /zfsdata/lxcstore zoneminder
lxc-start zoneminder 20201101000816.189 DEBUG    lxccontainer - lxccontainer.c:wait_on_daemonized_start:840 - First child 70685 exited
lxc-start zoneminder 20201101000816.189 INFO     lsm - lsm/lsm.c:lsm_init:40 - Initialized LSM security driver nop
lxc-start zoneminder 20201101000816.190 DEBUG    terminal - terminal.c:lxc_terminal_peer_default:665 - No such device - The process does not have a controlling terminal
lxc-start zoneminder 20201101000816.190 INFO     seccomp - seccomp.c:parse_config_v2:795 - Processing "reject_force_umount  # comment this to allow umount -f;  not recommended"
lxc-start zoneminder 20201101000816.190 INFO     seccomp - seccomp.c:do_resolve_add_rule:517 - Set seccomp rule to reject force umounts
lxc-start zoneminder 20201101000816.190 INFO     seccomp - seccomp.c:parse_config_v2:990 - Added native rule for arch 0 for reject_force_umount action 0(kill)
lxc-start zoneminder 20201101000816.190 INFO     seccomp - seccomp.c:do_resolve_add_rule:517 - Set seccomp rule to reject force umounts
lxc-start zoneminder 20201101000816.190 INFO     seccomp - seccomp.c:parse_config_v2:999 - Added compat rule for arch 1073741827 for reject_force_umount action 0(kill)
lxc-start zoneminder 20201101000816.190 INFO     seccomp - seccomp.c:do_resolve_add_rule:517 - Set seccomp rule to reject force umounts
lxc-start zoneminder 20201101000816.190 INFO     seccomp - seccomp.c:parse_config_v2:1009 - Added compat rule for arch 1073741886 for reject_force_umount action 0(kill)
lxc-start zoneminder 20201101000816.190 INFO     seccomp - seccomp.c:do_resolve_add_rule:517 - Set seccomp rule to reject force umounts
lxc-start zoneminder 20201101000816.190 INFO     seccomp - seccomp.c:parse_config_v2:1019 - Added native rule for arch -1073741762 for reject_force_umount action 0(kill)
lxc-start zoneminder 20201101000816.190 INFO     seccomp - seccomp.c:parse_config_v2:795 - Processing "[all]"
lxc-start zoneminder 20201101000816.190 INFO     seccomp - seccomp.c:parse_config_v2:795 - Processing "kexec_load errno 1"
lxc-start zoneminder 20201101000816.190 INFO     seccomp - seccomp.c:parse_config_v2:990 - Added native rule for arch 0 for kexec_load action 327681(errno)
lxc-start zoneminder 20201101000816.190 INFO     seccomp - seccomp.c:parse_config_v2:999 - Added compat rule for arch 1073741827 for kexec_load action 327681(errno)
lxc-start zoneminder 20201101000816.190 INFO     seccomp - seccomp.c:parse_config_v2:1009 - Added compat rule for arch 1073741886 for kexec_load action 327681(errno)
lxc-start zoneminder 20201101000816.190 INFO     seccomp - seccomp.c:parse_config_v2:1019 - Added native rule for arch -1073741762 for kexec_load action 327681(errno)
lxc-start zoneminder 20201101000816.190 INFO     seccomp - seccomp.c:parse_config_v2:795 - Processing "open_by_handle_at errno 1"
lxc-start zoneminder 20201101000816.190 INFO     seccomp - seccomp.c:parse_config_v2:990 - Added native rule for arch 0 for open_by_handle_at action 327681(errno)
lxc-start zoneminder 20201101000816.190 INFO     seccomp - seccomp.c:parse_config_v2:999 - Added compat rule for arch 1073741827 for open_by_handle_at action 327681(errno)
lxc-start zoneminder 20201101000816.190 INFO     seccomp - seccomp.c:parse_config_v2:1009 - Added compat rule for arch 1073741886 for open_by_handle_at action 327681(errno)
lxc-start zoneminder 20201101000816.190 INFO     seccomp - seccomp.c:parse_config_v2:1019 - Added native rule for arch -1073741762 for open_by_handle_at action 327681(errno)
lxc-start zoneminder 20201101000816.190 INFO     seccomp - seccomp.c:parse_config_v2:795 - Processing "init_module errno 1"
lxc-start zoneminder 20201101000816.190 INFO     seccomp - seccomp.c:parse_config_v2:990 - Added native rule for arch 0 for init_module action 327681(errno)
lxc-start zoneminder 20201101000816.190 INFO     seccomp - seccomp.c:parse_config_v2:999 - Added compat rule for arch 1073741827 for init_module action 327681(errno)
lxc-start zoneminder 20201101000816.190 INFO     seccomp - seccomp.c:parse_config_v2:1009 - Added compat rule for arch 1073741886 for init_module action 327681(errno)
lxc-start zoneminder 20201101000816.190 INFO     seccomp - seccomp.c:parse_config_v2:1019 - Added native rule for arch -1073741762 for init_module action 327681(errno)
lxc-start zoneminder 20201101000816.190 INFO     seccomp - seccomp.c:parse_config_v2:795 - Processing "finit_module errno 1"
lxc-start zoneminder 20201101000816.190 INFO     seccomp - seccomp.c:parse_config_v2:990 - Added native rule for arch 0 for finit_module action 327681(errno)
lxc-start zoneminder 20201101000816.191 INFO     seccomp - seccomp.c:parse_config_v2:999 - Added compat rule for arch 1073741827 for finit_module action 327681(errno)
lxc-start zoneminder 20201101000816.191 INFO     seccomp - seccomp.c:parse_config_v2:1009 - Added compat rule for arch 1073741886 for finit_module action 327681(errno)
lxc-start zoneminder 20201101000816.191 INFO     seccomp - seccomp.c:parse_config_v2:1019 - Added native rule for arch -1073741762 for finit_module action 327681(errno)
lxc-start zoneminder 20201101000816.191 INFO     seccomp - seccomp.c:parse_config_v2:795 - Processing "delete_module errno 1"
lxc-start zoneminder 20201101000816.191 INFO     seccomp - seccomp.c:parse_config_v2:990 - Added native rule for arch 0 for delete_module action 327681(errno)
lxc-start zoneminder 20201101000816.191 INFO     seccomp - seccomp.c:parse_config_v2:999 - Added compat rule for arch 1073741827 for delete_module action 327681(errno)
lxc-start zoneminder 20201101000816.191 INFO     seccomp - seccomp.c:parse_config_v2:1009 - Added compat rule for arch 1073741886 for delete_module action 327681(errno)
lxc-start zoneminder 20201101000816.191 INFO     seccomp - seccomp.c:parse_config_v2:1019 - Added native rule for arch -1073741762 for delete_module action 327681(errno)
lxc-start zoneminder 20201101000816.191 INFO     seccomp - seccomp.c:parse_config_v2:1025 - Merging compat seccomp contexts into main context
lxc-start zoneminder 20201101000816.191 INFO     start - start.c:lxc_init:837 - Container "zoneminder" is initialized
lxc-start zoneminder 20201101000816.261 WARN     cgfsng - cgroups/cgfsng.c:mkdir_eexist_on_last:1152 - File exists - Failed to create directory "/sys/fs/cgroup/cpuset//lxc.monitor.zoneminder"
lxc-start zoneminder 20201101000816.261 INFO     cgfsng - cgroups/cgfsng.c:cgfsng_monitor_create:1368 - The monitor process uses "lxc.monitor.zoneminder" as cgroup
lxc-start zoneminder 20201101000816.261 DEBUG    storage - storage/storage.c:get_storage_by_name:211 - Detected rootfs type "zfs"
lxc-start zoneminder 20201101000816.261 INFO     start - start.c:__lxc_start:1985 - Unshared CLONE_NEWNS
lxc-start zoneminder 20201101000816.262 DEBUG    storage - storage/storage.c:get_storage_by_name:211 - Detected rootfs type "zfs"
lxc-start zoneminder 20201101000816.264 DEBUG    conf - conf.c:lxc_mount_rootfs:1260 - Mounted rootfs "zfsdata/lxcstore/zoneminder" onto "/usr/lib/lxc/rootfs" with options "(null)"
lxc-start zoneminder 20201101000816.264 INFO     start - start.c:__lxc_start:1993 - Set up container rootfs as host root
lxc-start zoneminder 20201101000816.264 WARN     cgfsng - cgroups/cgfsng.c:mkdir_eexist_on_last:1152 - File exists - Failed to create directory "/sys/fs/cgroup/cpuset//lxc.payload.zoneminder"
lxc-start zoneminder 20201101000816.265 INFO     cgfsng - cgroups/cgfsng.c:cgfsng_payload_create:1471 - The container process uses "lxc.payload.zoneminder" as cgroup
lxc-start zoneminder 20201101000816.265 INFO     start - start.c:lxc_spawn:1700 - Cloned CLONE_NEWUSER
lxc-start zoneminder 20201101000816.265 INFO     start - start.c:lxc_spawn:1700 - Cloned CLONE_NEWNS
lxc-start zoneminder 20201101000816.265 INFO     start - start.c:lxc_spawn:1700 - Cloned CLONE_NEWPID
lxc-start zoneminder 20201101000816.265 INFO     start - start.c:lxc_spawn:1700 - Cloned CLONE_NEWUTS
lxc-start zoneminder 20201101000816.265 INFO     start - start.c:lxc_spawn:1700 - Cloned CLONE_NEWIPC
lxc-start zoneminder 20201101000816.265 DEBUG    start - start.c:lxc_try_preserve_namespaces:166 - Preserved user namespace via fd 31
lxc-start zoneminder 20201101000816.265 DEBUG    start - start.c:lxc_try_preserve_namespaces:166 - Preserved mnt namespace via fd 32
lxc-start zoneminder 20201101000816.265 DEBUG    start - start.c:lxc_try_preserve_namespaces:166 - Preserved pid namespace via fd 33
lxc-start zoneminder 20201101000816.265 DEBUG    start - start.c:lxc_try_preserve_namespaces:166 - Preserved uts namespace via fd 34
lxc-start zoneminder 20201101000816.265 DEBUG    start - start.c:lxc_try_preserve_namespaces:166 - Preserved ipc namespace via fd 35
lxc-start zoneminder 20201101000816.265 DEBUG    conf - conf.c:idmaptool_on_path_and_privileged:2734 - The binary "/usr/bin/newuidmap" has CAP_SETUID in its CAP_EFFECTIVE and CAP_PERMITTED sets
lxc-start zoneminder 20201101000816.265 DEBUG    conf - conf.c:idmaptool_on_path_and_privileged:2740 - The binary "/usr/bin/newgidmap" has CAP_SETGID in its CAP_EFFECTIVE and CAP_PERMITTED sets
lxc-start zoneminder 20201101000816.265 DEBUG    conf - conf.c:lxc_map_ids:2795 - Functional newuidmap and newgidmap binary found
lxc-start zoneminder 20201101000816.273 INFO     start - start.c:do_start:1085 - Unshared CLONE_NEWNET
lxc-start zoneminder 20201101000816.273 DEBUG    conf - conf.c:idmaptool_on_path_and_privileged:2734 - The binary "/usr/bin/newuidmap" has CAP_SETUID in its CAP_EFFECTIVE and CAP_PERMITTED sets
lxc-start zoneminder 20201101000816.273 DEBUG    conf - conf.c:idmaptool_on_path_and_privileged:2740 - The binary "/usr/bin/newgidmap" has CAP_SETGID in its CAP_EFFECTIVE and CAP_PERMITTED sets
lxc-start zoneminder 20201101000816.273 DEBUG    conf - conf.c:lxc_map_ids:2795 - Functional newuidmap and newgidmap binary found
lxc-start zoneminder 20201101000816.281 NOTICE   utils - utils.c:lxc_setgroups:1413 - Dropped additional groups
lxc-start zoneminder 20201101000816.281 WARN     cgfsng - cgroups/cgfsng.c:fchowmodat:1570 - No such file or directory - Failed to fchownat(17, memory.oom.group, 65536, 0, AT_EMPTY_PATH | AT_SYMLINK_NOFOLLOW )
lxc-start zoneminder 20201101000816.281 DEBUG    start - start.c:lxc_spawn:1773 - Preserved net namespace via fd 7
lxc-start zoneminder 20201101000816.285 INFO     network - network.c:instantiate_veth:285 - Retrieved mtu 1500 from br0
lxc-start zoneminder 20201101000816.286 INFO     network - network.c:instantiate_veth:333 - Attached "vethrIYE6Y" to bridge "br0"
lxc-start zoneminder 20201101000816.286 DEBUG    network - network.c:instantiate_veth:449 - Instantiated veth tunnel "vethrIYE6Y <--> veth5kBOqO"
lxc-start zoneminder 20201101000816.286 NOTICE   utils - utils.c:lxc_setgroups:1413 - Dropped additional groups
lxc-start zoneminder 20201101000816.286 NOTICE   utils - utils.c:lxc_switch_uid_gid:1391 - Switched to gid 0
lxc-start zoneminder 20201101000816.286 NOTICE   utils - utils.c:lxc_switch_uid_gid:1400 - Switched to uid 0
lxc-start zoneminder 20201101000816.286 INFO     start - start.c:do_start:1198 - Unshared CLONE_NEWCGROUP
lxc-start zoneminder 20201101000816.286 INFO     conf - conf.c:setup_utsname:752 - Set hostname to "zoneminder"
lxc-start zoneminder 20201101000816.361 DEBUG    network - network.c:lxc_network_setup_in_child_namespaces_common:3510 - Network device "eth0" has been setup
lxc-start zoneminder 20201101000816.361 INFO     network - network.c:lxc_setup_network_in_child_namespaces:3532 - Network has been setup
lxc-start zoneminder 20201101000816.361 INFO     conf - conf.c:mount_autodev:1059 - Preparing "/dev"
lxc-start zoneminder 20201101000816.361 DEBUG    conf - conf.c:mount_autodev:1062 - Using mount options: size=500000,mode=755
lxc-start zoneminder 20201101000816.361 INFO     conf - conf.c:mount_autodev:1109 - Prepared "/dev"
lxc-start zoneminder 20201101000816.361 DEBUG    conf - conf.c:mount_entry:1944 - Remounting "/sys/fs/fuse/connections" on "/usr/lib/lxc/rootfs/sys/fs/fuse/connections" to respect bind or remount options
lxc-start zoneminder 20201101000816.361 DEBUG    conf - conf.c:mount_entry:1963 - Flags for "/sys/fs/fuse/connections" were 4110, required extra flags are 14
lxc-start zoneminder 20201101000816.361 DEBUG    conf - conf.c:mount_entry:2007 - Mounted "/sys/fs/fuse/connections" on "/usr/lib/lxc/rootfs/sys/fs/fuse/connections" with filesystem type "none"
lxc-start zoneminder 20201101000816.361 INFO     conf - conf.c:lxc_fill_autodev:1152 - Populating "/dev"
lxc-start zoneminder 20201101000816.361 DEBUG    conf - conf.c:lxc_fill_autodev:1162 - Created device node "full"
lxc-start zoneminder 20201101000816.361 DEBUG    conf - conf.c:lxc_fill_autodev:1162 - Created device node "null"
lxc-start zoneminder 20201101000816.361 DEBUG    conf - conf.c:lxc_fill_autodev:1162 - Created device node "random"
lxc-start zoneminder 20201101000816.362 DEBUG    conf - conf.c:lxc_fill_autodev:1162 - Created device node "tty"
lxc-start zoneminder 20201101000816.362 DEBUG    conf - conf.c:lxc_fill_autodev:1162 - Created device node "urandom"
lxc-start zoneminder 20201101000816.362 DEBUG    conf - conf.c:lxc_fill_autodev:1162 - Created device node "zero"
lxc-start zoneminder 20201101000816.362 INFO     conf - conf.c:lxc_fill_autodev:1220 - Populated "/dev"
lxc-start zoneminder 20201101000816.362 INFO     utils - utils.c:lxc_mount_proc_if_needed:1247 - I am 1, /proc/self points to "1"
lxc-start zoneminder 20201101000816.362 ERROR    conf - conf.c:lxc_setup_dev_console:1643 - No such file or directory - Failed to unmount "/usr/lib/lxc/rootfs/dev/console"
lxc-start zoneminder 20201101000816.362 ERROR    conf - conf.c:lxc_setup_boot_id:3193 - No such file or directory - Failed to generate random data for uuid
lxc-start zoneminder 20201101000816.362 DEBUG    conf - conf.c:lxc_setup_devpts_child:1546 - Mount new devpts instance with options "gid=5,newinstance,ptmxmode=0666,mode=0620,max=1024"
lxc-start zoneminder 20201101000816.363 DEBUG    conf - conf.c:lxc_setup_devpts_child:1574 - Created dummy "/dev/ptmx" file as bind mount target
lxc-start zoneminder 20201101000816.363 DEBUG    conf - conf.c:lxc_setup_devpts_child:1579 - Bind mounted "/dev/pts/ptmx" to "/dev/ptmx"
lxc-start zoneminder 20201101000816.363 DEBUG    conf - conf.c:lxc_allocate_ttys:939 - Created tty "/dev/pts/0" with ptx fd 32 and pty fd 33
lxc-start zoneminder 20201101000816.363 DEBUG    conf - conf.c:lxc_allocate_ttys:939 - Created tty "/dev/pts/1" with ptx fd 34 and pty fd 35
lxc-start zoneminder 20201101000816.363 DEBUG    conf - conf.c:lxc_allocate_ttys:939 - Created tty "/dev/pts/2" with ptx fd 36 and pty fd 37
lxc-start zoneminder 20201101000816.363 DEBUG    conf - conf.c:lxc_allocate_ttys:939 - Created tty "/dev/pts/3" with ptx fd 38 and pty fd 39
lxc-start zoneminder 20201101000816.363 INFO     conf - conf.c:lxc_allocate_ttys:956 - Finished creating 4 tty devices
lxc-start zoneminder 20201101000816.363 DEBUG    conf - conf.c:lxc_setup_ttys:894 - Bind mounted "/dev/pts/0" onto "/dev/tty1"
lxc-start zoneminder 20201101000816.363 DEBUG    conf - conf.c:lxc_setup_ttys:894 - Bind mounted "/dev/pts/1" onto "/dev/tty2"
lxc-start zoneminder 20201101000816.363 DEBUG    conf - conf.c:lxc_setup_ttys:894 - Bind mounted "/dev/pts/2" onto "/dev/tty3"
lxc-start zoneminder 20201101000816.363 DEBUG    conf - conf.c:lxc_setup_ttys:894 - Bind mounted "/dev/pts/3" onto "/dev/tty4"
lxc-start zoneminder 20201101000816.363 INFO     conf - conf.c:lxc_setup_ttys:901 - Finished setting up 4 /dev/tty<N> device(s)
lxc-start zoneminder 20201101000816.363 INFO     conf - conf.c:setup_personality:1610 - Set personality to "0x0"
lxc-start zoneminder 20201101000816.363 DEBUG    conf - conf.c:setup_caps:2421 - Capabilities have been setup
lxc-start zoneminder 20201101000816.363 NOTICE   conf - conf.c:lxc_setup:3445 - The container "zoneminder" is set up
lxc-start zoneminder 20201101000816.364 DEBUG    start - start.c:lxc_spawn:1849 - Preserved cgroup namespace via fd 13
lxc-start zoneminder 20201101000816.364 ERROR    utils - utils.c:open_devnull:1277 - No such file or directory - Can't open /dev/null
lxc-start zoneminder 20201101000816.364 WARN     utils - utils.c:fix_stdio_permissions:1886 - No such file or directory - Failed to open "/dev/null"
lxc-start zoneminder 20201101000816.364 WARN     start - start.c:do_start:1358 - Failed to ajust stdio permissions
lxc-start zoneminder 20201101000816.364 NOTICE   start - start.c:start:2086 - Exec'ing "/sbin/init"
lxc-start zoneminder 20201101000816.367 NOTICE   start - start.c:post_start:2097 - Started "/sbin/init" with pid "70688"
lxc-start zoneminder 20201101000816.367 NOTICE   start - start.c:signal_handler:404 - Received 17 from pid 70689 instead of container init 70688
lxc-start zoneminder 20201101101147.191 DEBUG    start - start.c:signal_handler:422 - Container init process 70688 exited
lxc-start zoneminder 20201101101147.191 DEBUG    start - start.c:__lxc_start:2038 - Unknown exit status for container "zoneminder" init 9
lxc-start zoneminder 20201101101147.191 INFO     error - error.c:lxc_error_set_and_log:33 - Child <70688> ended on signal (9)
lxc-start zoneminder 20201101101147.331 INFO     network - network.c:lxc_delete_network_priv:3232 - Removed interface "vethrIYE6Y" from "br0"
lxc-start zoneminder 20201101101147.331 DEBUG    network - network.c:lxc_delete_network:3665 - Deleted network devices
lxc-start zoneminder 20201101101147.331 DEBUG    conf - conf.c:idmaptool_on_path_and_privileged:2734 - The binary "/usr/bin/newuidmap" has CAP_SETUID in its CAP_EFFECTIVE and CAP_PERMITTED sets
lxc-start zoneminder 20201101101147.331 DEBUG    conf - conf.c:idmaptool_on_path_and_privileged:2740 - The binary "/usr/bin/newgidmap" has CAP_SETGID in its CAP_EFFECTIVE and CAP_PERMITTED sets
lxc-start zoneminder 20201101101147.331 DEBUG    conf - conf.c:lxc_map_ids:2795 - Functional newuidmap and newgidmap binary found
lxc-start zoneminder 20201101101147.339 NOTICE   utils - utils.c:lxc_setgroups:1413 - Dropped additional groups
lxc-start zoneminder 20201102123458.475 INFO     confile - confile.c:set_config_idmaps:2012 - Read uid map: type u nsid 0 hostid 100000 range 65536
lxc-start zoneminder 20201102123458.475 INFO     confile - confile.c:set_config_idmaps:2012 - Read uid map: type g nsid 0 hostid 100000 range 65536
lxc-start zoneminder 20201102123458.476 INFO     lxccontainer - lxccontainer.c:do_lxcapi_start:969 - Set process title to [lxc monitor] /zfsdata/lxcstore zoneminder
lxc-start zoneminder 20201102123458.476 DEBUG    lxccontainer - lxccontainer.c:wait_on_daemonized_start:830 - First child 3938799 exited
lxc-start zoneminder 20201102123458.476 INFO     lsm - lsm/lsm.c:lsm_init:30 - LSM security driver nop
lxc-start zoneminder 20201102123458.476 DEBUG    terminal - terminal.c:lxc_terminal_peer_default:655 - No such device - The process does not have a controlling terminal
lxc-start zoneminder 20201102123458.477 INFO     seccomp - seccomp.c:parse_config_v2:790 - Processing "reject_force_umount  # comment this to allow umount -f;  not recommended"
lxc-start zoneminder 20201102123458.477 INFO     seccomp - seccomp.c:do_resolve_add_rule:517 - Set seccomp rule to reject force umounts
lxc-start zoneminder 20201102123458.477 INFO     seccomp - seccomp.c:parse_config_v2:985 - Added native rule for arch 0 for reject_force_umount action 0(kill)
lxc-start zoneminder 20201102123458.477 INFO     seccomp - seccomp.c:do_resolve_add_rule:517 - Set seccomp rule to reject force umounts
lxc-start zoneminder 20201102123458.477 INFO     seccomp - seccomp.c:parse_config_v2:994 - Added compat rule for arch 1073741827 for reject_force_umount action 0(kill)
lxc-start zoneminder 20201102123458.477 INFO     seccomp - seccomp.c:do_resolve_add_rule:517 - Set seccomp rule to reject force umounts
lxc-start zoneminder 20201102123458.477 INFO     seccomp - seccomp.c:parse_config_v2:1004 - Added compat rule for arch 1073741886 for reject_force_umount action 0(kill)
lxc-start zoneminder 20201102123458.477 INFO     seccomp - seccomp.c:do_resolve_add_rule:517 - Set seccomp rule to reject force umounts
lxc-start zoneminder 20201102123458.477 INFO     seccomp - seccomp.c:parse_config_v2:1014 - Added native rule for arch -1073741762 for reject_force_umount action 0(kill)
lxc-start zoneminder 20201102123458.477 INFO     seccomp - seccomp.c:parse_config_v2:790 - Processing "[all]"
lxc-start zoneminder 20201102123458.477 INFO     seccomp - seccomp.c:parse_config_v2:790 - Processing "kexec_load errno 1"
lxc-start zoneminder 20201102123458.477 INFO     seccomp - seccomp.c:parse_config_v2:985 - Added native rule for arch 0 for kexec_load action 327681(errno)
lxc-start zoneminder 20201102123458.477 INFO     seccomp - seccomp.c:parse_config_v2:994 - Added compat rule for arch 1073741827 for kexec_load action 327681(errno)
lxc-start zoneminder 20201102123458.477 INFO     seccomp - seccomp.c:parse_config_v2:1004 - Added compat rule for arch 1073741886 for kexec_load action 327681(errno)
lxc-start zoneminder 20201102123458.477 INFO     seccomp - seccomp.c:parse_config_v2:1014 - Added native rule for arch -1073741762 for kexec_load action 327681(errno)
lxc-start zoneminder 20201102123458.477 INFO     seccomp - seccomp.c:parse_config_v2:790 - Processing "open_by_handle_at errno 1"
lxc-start zoneminder 20201102123458.477 INFO     seccomp - seccomp.c:parse_config_v2:985 - Added native rule for arch 0 for open_by_handle_at action 327681(errno)
lxc-start zoneminder 20201102123458.477 INFO     seccomp - seccomp.c:parse_config_v2:994 - Added compat rule for arch 1073741827 for open_by_handle_at action 327681(errno)
lxc-start zoneminder 20201102123458.477 INFO     seccomp - seccomp.c:parse_config_v2:1004 - Added compat rule for arch 1073741886 for open_by_handle_at action 327681(errno)
lxc-start zoneminder 20201102123458.477 INFO     seccomp - seccomp.c:parse_config_v2:1014 - Added native rule for arch -1073741762 for open_by_handle_at action 327681(errno)
lxc-start zoneminder 20201102123458.477 INFO     seccomp - seccomp.c:parse_config_v2:790 - Processing "init_module errno 1"
lxc-start zoneminder 20201102123458.477 INFO     seccomp - seccomp.c:parse_config_v2:985 - Added native rule for arch 0 for init_module action 327681(errno)
lxc-start zoneminder 20201102123458.477 INFO     seccomp - seccomp.c:parse_config_v2:994 - Added compat rule for arch 1073741827 for init_module action 327681(errno)
lxc-start zoneminder 20201102123458.477 INFO     seccomp - seccomp.c:parse_config_v2:1004 - Added compat rule for arch 1073741886 for init_module action 327681(errno)
lxc-start zoneminder 20201102123458.477 INFO     seccomp - seccomp.c:parse_config_v2:1014 - Added native rule for arch -1073741762 for init_module action 327681(errno)
lxc-start zoneminder 20201102123458.477 INFO     seccomp - seccomp.c:parse_config_v2:790 - Processing "finit_module errno 1"
lxc-start zoneminder 20201102123458.477 INFO     seccomp - seccomp.c:parse_config_v2:985 - Added native rule for arch 0 for finit_module action 327681(errno)
lxc-start zoneminder 20201102123458.477 INFO     seccomp - seccomp.c:parse_config_v2:994 - Added compat rule for arch 1073741827 for finit_module action 327681(errno)
lxc-start zoneminder 20201102123458.477 INFO     seccomp - seccomp.c:parse_config_v2:1004 - Added compat rule for arch 1073741886 for finit_module action 327681(errno)
lxc-start zoneminder 20201102123458.477 INFO     seccomp - seccomp.c:parse_config_v2:1014 - Added native rule for arch -1073741762 for finit_module action 327681(errno)
lxc-start zoneminder 20201102123458.477 INFO     seccomp - seccomp.c:parse_config_v2:790 - Processing "delete_module errno 1"
lxc-start zoneminder 20201102123458.477 INFO     seccomp - seccomp.c:parse_config_v2:985 - Added native rule for arch 0 for delete_module action 327681(errno)
lxc-start zoneminder 20201102123458.477 INFO     seccomp - seccomp.c:parse_config_v2:994 - Added compat rule for arch 1073741827 for delete_module action 327681(errno)
lxc-start zoneminder 20201102123458.477 INFO     seccomp - seccomp.c:parse_config_v2:1004 - Added compat rule for arch 1073741886 for delete_module action 327681(errno)
lxc-start zoneminder 20201102123458.477 INFO     seccomp - seccomp.c:parse_config_v2:1014 - Added native rule for arch -1073741762 for delete_module action 327681(errno)
lxc-start zoneminder 20201102123458.477 INFO     seccomp - seccomp.c:parse_config_v2:1020 - Merging compat seccomp contexts into main context
lxc-start zoneminder 20201102123458.477 INFO     start - start.c:lxc_init:844 - Container "zoneminder" is initialized
lxc-start zoneminder 20201102123458.511 WARN     cgfsng - cgroups/cgfsng.c:mkdir_eexist_on_last:1152 - File exists - Failed to create directory "/sys/fs/cgroup/cpuset//lxc.monitor.zoneminder"
lxc-start zoneminder 20201102123458.511 INFO     cgfsng - cgroups/cgfsng.c:cgfsng_monitor_create:1368 - The monitor process uses "lxc.monitor.zoneminder" as cgroup
lxc-start zoneminder 20201102123458.511 DEBUG    storage - storage/storage.c:get_storage_by_name:211 - Detected rootfs type "zfs"
lxc-start zoneminder 20201102123458.511 INFO     start - start.c:__lxc_start:1985 - Unshared CLONE_NEWNS
lxc-start zoneminder 20201102123458.512 DEBUG    storage - storage/storage.c:get_storage_by_name:211 - Detected rootfs type "zfs"
lxc-start zoneminder 20201102123458.514 DEBUG    conf - conf.c:lxc_mount_rootfs:1259 - Mounted rootfs "zfsdata/lxcstore/zoneminder" onto "/usr/lib/lxc/rootfs" with options "(null)"
lxc-start zoneminder 20201102123458.514 INFO     start - start.c:__lxc_start:1993 - Set up container rootfs as host root
lxc-start zoneminder 20201102123458.514 WARN     cgfsng - cgroups/cgfsng.c:mkdir_eexist_on_last:1152 - File exists - Failed to create directory "/sys/fs/cgroup/cpuset//lxc.payload.zoneminder"
lxc-start zoneminder 20201102123458.515 INFO     cgfsng - cgroups/cgfsng.c:cgfsng_payload_create:1471 - The container process uses "lxc.payload.zoneminder" as cgroup
lxc-start zoneminder 20201102123458.515 INFO     start - start.c:lxc_spawn:1706 - Cloned CLONE_NEWUSER
lxc-start zoneminder 20201102123458.515 INFO     start - start.c:lxc_spawn:1706 - Cloned CLONE_NEWNS
lxc-start zoneminder 20201102123458.515 INFO     start - start.c:lxc_spawn:1706 - Cloned CLONE_NEWPID
lxc-start zoneminder 20201102123458.515 INFO     start - start.c:lxc_spawn:1706 - Cloned CLONE_NEWUTS
lxc-start zoneminder 20201102123458.515 INFO     start - start.c:lxc_spawn:1706 - Cloned CLONE_NEWIPC
lxc-start zoneminder 20201102123458.515 DEBUG    start - start.c:lxc_try_preserve_namespaces:166 - Preserved user namespace via fd 30
lxc-start zoneminder 20201102123458.515 DEBUG    start - start.c:lxc_try_preserve_namespaces:166 - Preserved mnt namespace via fd 31
lxc-start zoneminder 20201102123458.515 DEBUG    start - start.c:lxc_try_preserve_namespaces:166 - Preserved pid namespace via fd 32
lxc-start zoneminder 20201102123458.515 DEBUG    start - start.c:lxc_try_preserve_namespaces:166 - Preserved uts namespace via fd 33
lxc-start zoneminder 20201102123458.515 DEBUG    start - start.c:lxc_try_preserve_namespaces:166 - Preserved ipc namespace via fd 34
lxc-start zoneminder 20201102123458.515 DEBUG    conf - conf.c:idmaptool_on_path_and_privileged:2687 - The binary "/usr/bin/newuidmap" has CAP_SETUID in its CAP_EFFECTIVE and CAP_PERMITTED sets
lxc-start zoneminder 20201102123458.515 DEBUG    conf - conf.c:idmaptool_on_path_and_privileged:2693 - The binary "/usr/bin/newgidmap" has CAP_SETGID in its CAP_EFFECTIVE and CAP_PERMITTED sets
lxc-start zoneminder 20201102123458.515 DEBUG    conf - conf.c:lxc_map_ids:2748 - Functional newuidmap and newgidmap binary found
lxc-start zoneminder 20201102123458.523 INFO     start - start.c:do_start:1091 - Unshared CLONE_NEWNET
lxc-start zoneminder 20201102123458.523 DEBUG    conf - conf.c:idmaptool_on_path_and_privileged:2687 - The binary "/usr/bin/newuidmap" has CAP_SETUID in its CAP_EFFECTIVE and CAP_PERMITTED sets
lxc-start zoneminder 20201102123458.523 DEBUG    conf - conf.c:idmaptool_on_path_and_privileged:2693 - The binary "/usr/bin/newgidmap" has CAP_SETGID in its CAP_EFFECTIVE and CAP_PERMITTED sets
lxc-start zoneminder 20201102123458.523 DEBUG    conf - conf.c:lxc_map_ids:2748 - Functional newuidmap and newgidmap binary found
lxc-start zoneminder 20201102123458.529 NOTICE   utils - utils.c:lxc_setgroups:1366 - Dropped additional groups
lxc-start zoneminder 20201102123458.529 WARN     cgfsng - cgroups/cgfsng.c:fchowmodat:1570 - No such file or directory - Failed to fchownat(16, memory.oom.group, 65536, 0, AT_EMPTY_PATH | AT_SYMLINK_NOFOLLOW )
lxc-start zoneminder 20201102123458.529 DEBUG    start - start.c:lxc_spawn:1779 - Preserved net namespace via fd 7
lxc-start zoneminder 20201102123458.534 INFO     network - network.c:instantiate_veth:285 - Retrieved mtu 1500 from br0
lxc-start zoneminder 20201102123458.534 INFO     network - network.c:instantiate_veth:333 - Attached "vethuH2IsT" to bridge "br0"
lxc-start zoneminder 20201102123458.534 DEBUG    network - network.c:instantiate_veth:449 - Instantiated veth tunnel "vethuH2IsT <--> veth1GFzgD"
lxc-start zoneminder 20201102123458.534 NOTICE   utils - utils.c:lxc_setgroups:1366 - Dropped additional groups
lxc-start zoneminder 20201102123458.534 NOTICE   utils - utils.c:lxc_switch_uid_gid:1344 - Switched to gid 0
lxc-start zoneminder 20201102123458.534 NOTICE   utils - utils.c:lxc_switch_uid_gid:1353 - Switched to uid 0
lxc-start zoneminder 20201102123458.535 INFO     start - start.c:do_start:1204 - Unshared CLONE_NEWCGROUP
lxc-start zoneminder 20201102123458.535 INFO     conf - conf.c:setup_utsname:752 - Set hostname to "zoneminder"
lxc-start zoneminder 20201102123458.581 DEBUG    network - network.c:lxc_network_setup_in_child_namespaces_common:3510 - Network device "eth0" has been setup
lxc-start zoneminder 20201102123458.581 INFO     network - network.c:lxc_setup_network_in_child_namespaces:3532 - Network has been setup
lxc-start zoneminder 20201102123458.581 INFO     conf - conf.c:mount_autodev:1060 - Preparing "/dev"
lxc-start zoneminder 20201102123458.581 DEBUG    conf - conf.c:mount_autodev:1066 - Using mount options: size=500000,mode=755
lxc-start zoneminder 20201102123458.581 INFO     conf - conf.c:mount_autodev:1109 - Prepared "/dev"
lxc-start zoneminder 20201102123458.581 DEBUG    conf - conf.c:mount_entry:1898 - Remounting "/sys/fs/fuse/connections" on "/usr/lib/lxc/rootfs/sys/fs/fuse/connections" to respect bind or remount options
lxc-start zoneminder 20201102123458.581 DEBUG    conf - conf.c:mount_entry:1917 - Flags for "/sys/fs/fuse/connections" were 4110, required extra flags are 14
lxc-start zoneminder 20201102123458.581 DEBUG    conf - conf.c:mount_entry:1961 - Mounted "/sys/fs/fuse/connections" on "/usr/lib/lxc/rootfs/sys/fs/fuse/connections" with filesystem type "none"
lxc-start zoneminder 20201102123458.581 INFO     conf - conf.c:lxc_fill_autodev:1153 - Populating "/dev"
lxc-start zoneminder 20201102123458.581 DEBUG    conf - conf.c:lxc_fill_autodev:1219 - Bind mounted host device node "/dev/full" onto "/usr/lib/lxc/rootfs/dev/full"
lxc-start zoneminder 20201102123458.581 DEBUG    conf - conf.c:lxc_fill_autodev:1219 - Bind mounted host device node "/dev/null" onto "/usr/lib/lxc/rootfs/dev/null"
lxc-start zoneminder 20201102123458.581 DEBUG    conf - conf.c:lxc_fill_autodev:1219 - Bind mounted host device node "/dev/random" onto "/usr/lib/lxc/rootfs/dev/random"
lxc-start zoneminder 20201102123458.581 DEBUG    conf - conf.c:lxc_fill_autodev:1219 - Bind mounted host device node "/dev/tty" onto "/usr/lib/lxc/rootfs/dev/tty"
lxc-start zoneminder 20201102123458.581 DEBUG    conf - conf.c:lxc_fill_autodev:1219 - Bind mounted host device node "/dev/urandom" onto "/usr/lib/lxc/rootfs/dev/urandom"
lxc-start zoneminder 20201102123458.581 DEBUG    conf - conf.c:lxc_fill_autodev:1219 - Bind mounted host device node "/dev/zero" onto "/usr/lib/lxc/rootfs/dev/zero"
lxc-start zoneminder 20201102123458.581 INFO     conf - conf.c:lxc_fill_autodev:1223 - Populated "/dev"
lxc-start zoneminder 20201102123458.581 INFO     utils - utils.c:lxc_mount_proc_if_needed:1200 - I am 1, /proc/self points to "1"
lxc-start zoneminder 20201102123458.581 DEBUG    conf - conf.c:lxc_setup_dev_console:1626 - Moved mount "/dev/pts/4" onto "/usr/lib/lxc/rootfs/dev/console"
lxc-start zoneminder 20201102123458.581 DEBUG    conf - conf.c:lxc_setup_dev_console:1641 - Mounted pty device 29(/dev/pts/4) onto "/usr/lib/lxc/rootfs/dev/console"
lxc-start zoneminder 20201102123458.582 DEBUG    conf - conf.c:lxc_setup_devpts:1522 - Mount new devpts instance with options "gid=5,newinstance,ptmxmode=0666,mode=0620,max=1024"
lxc-start zoneminder 20201102123458.582 DEBUG    conf - conf.c:lxc_setup_devpts:1537 - Created dummy "/dev/ptmx" file as bind mount target
lxc-start zoneminder 20201102123458.582 DEBUG    conf - conf.c:lxc_setup_devpts:1542 - Bind mounted "/dev/pts/ptmx" to "/dev/ptmx"
lxc-start zoneminder 20201102123458.582 DEBUG    conf - conf.c:lxc_allocate_ttys:939 - Created tty "/dev/pts/0" with ptx fd 30 and pty fd 31
lxc-start zoneminder 20201102123458.582 DEBUG    conf - conf.c:lxc_allocate_ttys:939 - Created tty "/dev/pts/1" with ptx fd 32 and pty fd 33
lxc-start zoneminder 20201102123458.582 DEBUG    conf - conf.c:lxc_allocate_ttys:939 - Created tty "/dev/pts/2" with ptx fd 34 and pty fd 35
lxc-start zoneminder 20201102123458.582 DEBUG    conf - conf.c:lxc_allocate_ttys:939 - Created tty "/dev/pts/3" with ptx fd 36 and pty fd 37
lxc-start zoneminder 20201102123458.582 INFO     conf - conf.c:lxc_allocate_ttys:956 - Finished creating 4 tty devices
lxc-start zoneminder 20201102123458.582 DEBUG    conf - conf.c:lxc_setup_ttys:894 - Bind mounted "/dev/pts/0" onto "/dev/tty1"
lxc-start zoneminder 20201102123458.582 DEBUG    conf - conf.c:lxc_setup_ttys:894 - Bind mounted "/dev/pts/1" onto "/dev/tty2"
lxc-start zoneminder 20201102123458.582 DEBUG    conf - conf.c:lxc_setup_ttys:894 - Bind mounted "/dev/pts/2" onto "/dev/tty3"
lxc-start zoneminder 20201102123458.582 DEBUG    conf - conf.c:lxc_setup_ttys:894 - Bind mounted "/dev/pts/3" onto "/dev/tty4"
lxc-start zoneminder 20201102123458.582 INFO     conf - conf.c:lxc_setup_ttys:901 - Finished setting up 4 /dev/tty<N> device(s)
lxc-start zoneminder 20201102123458.582 INFO     conf - conf.c:setup_personality:1573 - Set personality to "0x0"
lxc-start zoneminder 20201102123458.582 DEBUG    conf - conf.c:setup_caps:2376 - Capabilities have been setup
lxc-start zoneminder 20201102123458.582 NOTICE   conf - conf.c:lxc_setup:3361 - The container "zoneminder" is set up
lxc-start zoneminder 20201102123458.583 DEBUG    start - start.c:lxc_spawn:1855 - Preserved cgroup namespace via fd 12
lxc-start zoneminder 20201102123458.583 NOTICE   start - start.c:start:2086 - Exec'ing "/sbin/init"
lxc-start zoneminder 20201102123458.586 NOTICE   start - start.c:post_start:2097 - Started "/sbin/init" with pid "3938802"
lxc-start zoneminder 20201102123458.586 NOTICE   start - start.c:signal_handler:404 - Received 17 from pid 3938803 instead of container init 3938802
lxc-start zoneminder 20201102123618.935 DEBUG    start - start.c:signal_handler:422 - Container init process 3938802 exited
lxc-start zoneminder 20201102123618.935 DEBUG    start - start.c:__lxc_start:2028 - Container "zoneminder" is halting
lxc-start zoneminder 20201102123618.935 INFO     error - error.c:lxc_error_set_and_log:33 - Child <3938802> ended on signal (2)
lxc-start zoneminder 20201102123619.101 INFO     network - network.c:lxc_delete_network_priv:3232 - Removed interface "vethuH2IsT" from "br0"
lxc-start zoneminder 20201102123619.101 DEBUG    network - network.c:lxc_delete_network:3665 - Deleted network devices
lxc-start zoneminder 20201102123619.101 DEBUG    conf - conf.c:idmaptool_on_path_and_privileged:2687 - The binary "/usr/bin/newuidmap" has CAP_SETUID in its CAP_EFFECTIVE and CAP_PERMITTED sets
lxc-start zoneminder 20201102123619.101 DEBUG    conf - conf.c:idmaptool_on_path_and_privileged:2693 - The binary "/usr/bin/newgidmap" has CAP_SETGID in its CAP_EFFECTIVE and CAP_PERMITTED sets
lxc-start zoneminder 20201102123619.101 DEBUG    conf - conf.c:lxc_map_ids:2748 - Functional newuidmap and newgidmap binary found
lxc-start zoneminder 20201102123619.109 NOTICE   utils - utils.c:lxc_setgroups:1366 - Dropped additional groups
[justin@IXTREME ~]$

So looks like an issue with 4.0.5 …

jjb2018 · November 2, 2020, 12:50pm

@brauner - with LXC 4.0.5 the container fails to start with autostart (on boot) and also when started manually. Let me know if you need any more info. I’m happy to help if I can.

Thanks - Justin

jjb2018 · November 6, 2020, 3:31pm

Any more thoughts / questions on this? Anything more I can do to help?

martin-vi · November 11, 2020, 10:13am

Same problem here, Archlinux as well. Solved it with lxc version rollback to 4.0.4-1. Looking forward to provide logs and run tests with your support.