[SOLVED] Lxc_monitor - monitor.c:lxc_monitor_fifo_send:111 - Failed to open fifo to send message: No such file or directory

LXC
1

Hi all,
I have setup a simple lxc/lxd containers to aarch64 platform to use with opennebula system. First I tested the lxc/lxd system to run properly but I have problem with it. After I launch debian10/aarch64 system, everything looks fine on the console output.

Creating debian10
Starting debian10                             
But when I execute /bin/bash. It replies like this.
error: Container is not running.

Here are the following outputs for debian10 container information and the log error.

root@pine1:/var/log/lxd/debian10# more lxc.conf 
lxc.cap.drop = sys_time sys_module sys_rawio mac_admin mac_override
lxc.mount.auto = proc:rw sys:rw cgroup:mixed
lxc.autodev = 1
lxc.pts = 1024
lxc.mount.entry = /dev/fuse dev/fuse none bind,create=file,optional
lxc.mount.entry = /dev/net/tun dev/net/tun none bind,create=file,optional
lxc.mount.entry = /proc/sys/fs/binfmt_misc proc/sys/fs/binfmt_misc none rbind,create=dir,optional
lxc.mount.entry = /sys/fs/fuse/connections sys/fs/fuse/connections none rbind,create=dir,optional
lxc.mount.entry = /sys/kernel/debug sys/kernel/debug none rbind,create=dir,optional
lxc.mount.entry = /sys/kernel/security sys/kernel/security none rbind,create=dir,optional
lxc.mount.entry = /dev/mqueue dev/mqueue none rbind,create=dir,optional
lxc.include = /usr/share/lxc/config/common.conf.d/
lxc.logfile = /var/log/lxd/debian10/lxc.log
lxc.loglevel = warn
lxc.arch = linux64
lxc.hook.pre-start = /usr/bin/lxd callhook /var/lib/lxd 5 start
lxc.hook.post-stop = /usr/bin/lxd callhook /var/lib/lxd 5 stop
lxc.tty = 0
lxc.utsname = debian10
lxc.mount.entry = /var/lib/lxd/devlxd dev/lxd none bind,create=dir 0 0
lxc.aa_profile = lxd-debian10_</var/lib/lxd>
lxc.seccomp = /var/lib/lxd/security/seccomp/debian10
lxc.id_map = u 0 100000 65536
lxc.id_map = g 0 100000 65536
lxc.environment = http_proxy=http://[fe80::1%eth0]:13128
lxc.rootfs = /var/lib/lxd/containers/debian10/rootfs
lxc.mount.entry = /var/lib/lxd/shmounts/debian10 dev/.lxd-mounts none bind,create=dir 0 0



root@pine1:/var/log/lxd/debian10# more lxc.log
            lxc 20180401082858.881 WARN     lxc_monitor - monitor.c:lxc_monitor_fifo_send:111 - Failed to open fifo to send message: No such file or directory.
            lxc 20180401082858.881 WARN     lxc_monitor - monitor.c:lxc_monitor_fifo_send:111 - Failed to open fifo to send message: No such file or directory.
            lxc 20180401082900.943 WARN     lxc_monitor - monitor.c:lxc_monitor_fifo_send:111 - Failed to open fifo to send message: No such file or directory.
            lxc 20180401082900.943 WARN     lxc_monitor - monitor.c:lxc_monitor_fifo_send:111 - Failed to open fifo to send message: No such file or directory.
            lxc 20180401082901.468 WARN     lxc_monitor - monitor.c:lxc_monitor_fifo_send:111 - Failed to open fifo to send message: No such file or directory.
            lxc 20180401082901.468 WARN     lxc_monitor - monitor.c:lxc_monitor_fifo_send:111 - Failed to open fifo to send message: No such file or directory.
            lxc 20180401082901.468 WARN     lxc_monitor - monitor.c:lxc_monitor_fifo_send:111 - Failed to open fifo to send message: No such file or directory.
            lxc 20180401082901.696 WARN     lxc_monitor - monitor.c:lxc_monitor_fifo_send:111 - Failed to open fifo to send message: No such file or directory.
            lxc 20180401082901.696 WARN     lxc_monitor - monitor.c:lxc_monitor_fifo_send:111 - Failed to open fifo to send message: No such file or directory.

I am a totally newbie for lxc/lxd containers, could someone clarify the problem?
Thanks.

2

What are the exact commands you’re using?

3

Here are the exact commands,

root@pine1:~# lxc launch images:debian/10/arm64 debian10
Creating debian10
Starting debian10                             
root@pine1:~# lxc list
+--------------+---------+------+------+------------+-----------+
|     NAME     |  STATE  | IPV4 | IPV6 |    TYPE    | SNAPSHOTS |
+--------------+---------+------+------+------------+-----------+
| debian10     | STOPPED |      |      | PERSISTENT | 0         |
+--------------+---------+------+------+------------+-----------+
| distinct-imp | STOPPED |      |      | PERSISTENT | 0         |
+--------------+---------+------+------+------------+-----------+
| ubuntu1804   | STOPPED |      |      | PERSISTENT | 0         |
+--------------+---------+------+------+------------+-----------+
root@pine1:~# lxc exec debian10 -- ls -al
error: Container is not running.
4

Can you show the output of:

ps aux | grep debian10

please from after a lxc launch.

5

lxc info output would be useful too

6

Here are the commands and output.
lxc launch images:debian/10/arm64 debiantest

root@pine1:~# ps aux | grep debiantest
root 16929 0.3 0.3 263448 6108 pts/0 Sl+ 23:01 0:00 lxc launch images:debian/10/arm64 debiantest
root 16938 115 11.2 458940 228872 ? Sl 23:01 0:13 unsquashfs -f -d /var/lib/lxd/containers/debiantest/rootfs -n -da 198 -fr 198 -p 1 /var/lib/lxd/images/398f06a15b1cef70139ddcb39b5f2dde5b0ca1efba9b5e738fad59d26758db06.rootfs

root@pine1:~# ps aux | grep debiantest
root 16929 0.1 0.3 337176 6624 pts/0 Sl+ 23:01 0:00 lxc launch images:debian/10/arm64 debiantest
root 17115 0.3 0.3 119740 6512 ? Sl 23:01 0:00 /usr/bin/lxd forkstart debiantest /var/lib/lxd/containers /var/log/lxd/debiantest/lxc.conf
root 17121 0.0 0.1 119740 2208 ? Ss 23:01 0:00 /usr/bin/lxd forkstart debiantest /var/lib/lxd/containers /var/log/lxd/debiantest/lxc.conf
root 17122 0.0 0.0 1872 576 ? S 23:01 0:00 sh -c /usr/bin/lxd callhook /var/lib/lxd 7 start debiantest lxc pre-start
root 17123 0.3 0.3 129336 7304 ? Sl 23:01 0:00 /usr/bin/lxd callhook /var/lib/lxd 7 start debiantest lxc pre-start

root@pine1:~# lxc info debiantest
Name: debiantest
Remote: unix://
Architecture: aarch64
Created: 2018/04/03 20:01 UTC
Status: Stopped
Type: persistent
Profiles: default

root@pine1:~# lxc info
config: {}
api_extensions:

  • id_map
  • id_map_base
  • resource_limits
    api_status: stable
    api_version: "1.0"
    auth: trusted
    auth_methods: []
    public: false
    environment:
    addresses: []
    architectures:
    • aarch64
    • armv7l
      certificate: |
      -----BEGIN CERTIFICATE-----
      MIIFPjCCAyagAwIBAgIRANb91qszidXahWVtOxWICuIwDQYJKoZIhvcNAQELBQAw
      MzEcMBoGA1UEChMTbGludXhjb250YWluZXJzLm9yZzETMBEGA1UEAwwKcm9vdEBw
      aW5lMTAeFw0xODAzMDIxMzE1MTBaFw0yODAyMjgxMzE1MTBaMDMxHDAaBgNVBAoT
      E2xpbnV4Y29udGFpbmVycy5vcmcxEzARBgNVBAMMCnJvb3RAcGluZTEwggIiMA0G
      CSqGSIb3DQEBAQUAA4ICDwAwggIKAoICAQDZbY7Jw9wCeJ7j3Hbi2+Tv8lJPR3wT
      wwmZ+0nVgmMST/EvxlB4AMYX2nPiF5bSMbXGyYyEtt7EFNOGRq3G0MgrqgmvlvFg
      ERAIHaNI3EgRAYzyDU98puCt2BHVpTkeaMHAhyPmBqV32r813vQM3iFgVWyY/Z8e
      Uac6O5HvLpDfWh7p6Rp/in6vZ+5kQbprbyRXH3C59+ATdCIh4x1zZAj3GlJ4FMiF
      shJcz6m5pr1SO7TFbQOQlkcqa7jAFYXrq7ZsoW3Tlq3CwMYCuJ98+0C4gV90oWCP
      JFgkZneHWMTxA0VhJBJa744UP6t/DzfZlBLcwKZGo2lh7tKQ/Iej5JM4Yi9/NJf4
      S7FNwRY57O7e3c8/bRLPgPn78dRhRp2BuLhxIjDptX0vR50/hm1zoxwkazDd4xCU
      pG9N9Dm7hMddjJT6UBagsJRFBmTtGkcYuHJcWVi9o3HJ0KeqWuaQOoaworQCMrzX
      9bKIl+hQoQkkh4gqLFU4UJkboEMQS0Itq7UPrNrYJYcpjWy9VQoQa5d0ig/Ubg7/
      yKDukY+/ZTiX3e/3ylK3kq35QHCWulqBSOvUUvQc+OyF63t9u7cIPVkaZfrtvDPK
      tZ8PN1zUBCmsIl831MUYwiV3Xj67dhWEqfnAJuWkLqV8oX3sRgdbvWaAo8eZp4hK
      PwJoNC+oq0d+CwIDAQABo00wSzAOBgNVHQ8BAf8EBAMCBaAwEwYDVR0lBAwwCgYI
      KwYBBQUHAwEwDAYDVR0TAQH/BAIwADAWBgNVHREEDzANggVwaW5lMYcEwKgBHjAN
      BgkqhkiG9w0BAQsFAAOCAgEAtq84srXuLJEUIU7h8h0jCzXdOdnVsd4VSkNW61FZ
      s879ESpGoAa6GXXNyWIa7+4Q75HWZRq0ow/yZycYUvdwp8lxPE74CViar4r0+Khq
      TAOidGhNcMOxTD8FkUMf1nay/AayQioE0Ma+cCmkHvRYFs1ue6O38JumtRBWsAGU
      X+198kiM031vcY3eT87/RyivcgiOjC6zxTS25KqMOQ6acgP4GaJ4P+rxI/CHF/j8
      mdquJ4s/XLmMTkR9ABo0GBJ38PQ1JGFbq1NMnDjho4cieRPLummbYrDdi7TfzaWZ
      waUJp6Bipi+RcygZxD1pPkZbDySb3H/1cam5Tg5G2fQC1kJ4v2GVXLTDeGvxiwBn
      yMqdjYQA3adQyZe7dwu4UwKJs/DxKPllsQtlauzQNshoVACd38nnuzGETHGGKRu8
      f2s2+sI2M2/dMav+/MbKX49Df9pzfK/Z6NjrclmO309DsKecl9qe5OP+7Q+0fPtG
      7q99rhUcD4uipQyalmdSfG+ag2087Fzs5jn9S052GfP8J7x5xjq/xwf6RrJMn7u6
      j/ldkwjiWxVX8OpY9z6vPtv1/iQt8Qtw3ngJ5jFRu4pv17+LrGD9Mb9jJ+m/hwvo
      Blfq5BVxEScV1r4VWHZkZoQY/rYyPM+GrpQX6qodDDKs4K1UgrmXoQu6uABLzbi/
      Q0I=
      -----END CERTIFICATE-----
      certificate_fingerprint: 60a2b670e575615d4d78feb64fae64a157fc1f6a8d93f224999f7791d42b20f1
      driver: lxc
      driver_version: 2.1.1
      kernel: Linux
      kernel_architecture: aarch64
      kernel_version: 3.10.107-pine64
      server: lxd
      server_pid: 1959
      server_version: 2.0.11
      storage: dir
      storage_version: “”
7

After installing debootstrap package, i overcome the problem. But now in ubuntu-container hostnamectl command cant executed, and after execution of hostnamectl command, systemd-hostnamed.service failed.
How can I debug what is going on with the hostnamectl command or affect the systemd.
Thanks.
Here is the ubuntu version of container.
ubuntu@c1-ubuntu:~$ more /etc/lsb-release
DISTRIB_ID=Ubuntu
DISTRIB_RELEASE=16.04
DISTRIB_CODENAME=xenial
DISTRIB_DESCRIPTION=“Ubuntu 16.04.4 LTS”

8

hostnamectl hanging has been a bit of a recurring problem, it’s systemd related and I think @brauner figured out the fix for it. If that’s the case, I’d expect it to eventually make its way into Ubuntu through a stable update.

9

Thanks Graber for the descriptive information.

10

Yeah, the service file sets PrivateDevices=yes which would fail but I recently sent a patch to systemd that got merged which should allow systemd-hostnamed to start.

11

Great news, thanks Brauner.