Affi
December 3, 2020, 12:50pm
1
I am following this blog , to run X11 software in LXD containers. Everything was working good until I created x11 profile like below:
config:
environment.DISPLAY: :0
environment.PULSE_SERVER: unix:/home/ubuntu/pulse-native
nvidia.driver.capabilities: all
nvidia.runtime: "true"
user.user-data: |
#cloud-config
runcmd:
- 'sed -i "s/; enable-shm = yes/enable-shm = no/g" /etc/pulse/client.conf'
packages:
- x11-apps
- mesa-utils
- pulseaudio
description: GUI LXD profile
devices:
PASocket1:
bind: container
connect: unix:/run/user/1000/pulse/native
listen: unix:/home/ubuntu/pulse-native
security.gid: "1000"
security.uid: "1000"
uid: "1000"
gid: "1000"
mode: "0777"
type: proxy
X0:
bind: container
connect: unix:@/tmp/.X11-unix/X1
listen: unix:@/tmp/.X11-unix/X0
security.gid: "1000"
security.uid: "1000"
type: proxy
mygpu:
type: gpu
name: x11
used_by: []
I follow every step which are specified in the blog, but when I tried to run the container with the following command, I got an error and do not know :
lxc launch ubuntu:18.04 --profile default --profile x11 mycontainer
Error :
Failed to run: /snap/lxd/current/bin/lxd forkstart mycontainer /var/snap/lxd/common/lxd/containers /var/snap/lxd/common/lxd/logs/mycontainer/lxc.conf:lxc info --show-log local:mycontainer for more info
Below is the detailed version:
Name: mycontainer
Location: none
Remote: unix://
Architecture: x86_64
Created: 2020/12/03 12:35 UTC
Status: Stopped
Type: container
Profiles: default, x11
Log:
lxc mycontainer 20201203123522.126 WARN cgfsng - cgroups/cgfsng.c:mkdir_eexist_on_last:1152 - File exists - Failed to create directory "/sys/fs/cgroup/cpuset//lxc.monitor.mycontainer"
lxc mycontainer 20201203123522.127 WARN cgfsng - cgroups/cgfsng.c:mkdir_eexist_on_last:1152 - File exists - Failed to create directory "/sys/fs/cgroup/cpuset//lxc.payload.mycontainer"
lxc mycontainer 20201203123522.133 WARN cgfsng - cgroups/cgfsng.c:fchowmodat:1573 - No such file or directory - Failed to fchownat(17, memory.oom.group, 1000000000, 0, AT_EMPTY_PATH | AT_SYMLINK_NOFOLLOW )
lxc mycontainer 20201203123522.332 ERROR conf - conf.c:run_buffer:324 - Script exited with status 1
lxc mycontainer 20201203123522.332 ERROR conf - conf.c:lxc_setup:3374 - Failed to run mount hooks
lxc mycontainer 20201203123522.332 ERROR start - start.c:do_start:1218 - Failed to setup container "mycontainer"
lxc mycontainer 20201203123522.332 ERROR sync - sync.c:__sync_wait:36 - An error occurred in another process (expected sequence number 5)
lxc mycontainer 20201203123522.334 WARN network - network.c:lxc_delete_network_priv:3185 - Failed to rename interface with index 0 from "eth0" to its initial name "veth24353d31"
lxc mycontainer 20201203123522.334 ERROR lxccontainer - lxccontainer.c:wait_on_daemonized_start:860 - Received container state "ABORTING" instead of "RUNNING"
lxc mycontainer 20201203123522.334 ERROR start - start.c:__lxc_start:1999 - Failed to spawn container "mycontainer"
lxc mycontainer 20201203123522.334 WARN start - start.c:lxc_abort:1013 - No such process - Failed to send SIGKILL via pidfd 30 for process 6856
lxc mycontainer 20201203123522.479 WARN cgfsng - cgroups/cgfsng.c:cgfsng_monitor_destroy:1109 - Success - Failed to initialize cpuset /sys/fs/cgroup/cpuset//lxc.pivot/lxc.pivot
lxc 20201203123522.482 WARN commands - commands.c:lxc_cmd_rsp_recv:126 - Connection reset by peer - Failed to receive response for command "get_state"
I am able to run containers with default profile but not able to run it with above profile. Additionally, before I installed lxd from deb packge, now I removed it and install it using snap. Any help would be appreciated.
More Info
I checked other mates questions but not able to solve it:
Use proxy type for X0 device， the profile I am using:
lxc profile create x11app <<EOF
config:
environment.DISPLAY: :1
description: Default LXD profile
devices:
X1:
bind: container
connect: unix:@/tmp/.X11-unix/X1
listen: unix:@/tmp/.X11-unix/X1
type: proxy
eth0:
name: eth0
network: lxdbr0
type: nic
root:
path: /
pool: default
type: disk
EOF
Hi,
One of my container based on debian refuses to start after an update. The others based on Ubuntu/Arch/Alpine are starting fine.
$ lxc start voip1
Error: Failed to run: /snap/lxd/current/bin/lxd forkstart voip1 /var/snap/lxd/common/lxd/containers /var/snap/lxd/common/lxd/logs/voip1/lxc.conf:
Try `lxc info --show-log voip1` for more info
$ lxc info --show-log voip1
Name: voip1
Location: none
Remote: unix://
Architecture: x86_64
Created: 2019/09/02 01:06 UTC
Status: Stopped
Type: containe…
root@games:~# lxc config show test --expanded
architecture: x86_64
config:
image.architecture: amd64
image.description: ubuntu 18.04 LTS amd64 (release) (20181029)
image.label: release
image.os: ubuntu
image.release: bionic
image.serial: "20181029"
image.version: "18.04"
volatile.base_image: 30b9f587eb6fb50566f4183240933496d7b787f719aafb4b58e6a341495a38ad
volatile.eth0.hwaddr: 00:16:3e:ec:0b:25
volatile.idmap.base: "0"
volatile.idmap.next: '[{"Isuid":true,"Isgid":false,"Hos…
Regards,
stgraber
December 3, 2020, 2:05pm
2
Can you run lxc monitor --type=logging --pretty in a separate terminal while running lxc start again, then post the output from that monitor command?
Affi
December 3, 2020, 2:17pm
3
@stgraber Thanks, sure. Please find the attached logs from above command:
DBUG[12-03|15:15:39] New event listener: 91b18509-0790-402c-821e-a1f81ecb4a93
DBUG[12-03|15:16:04] Handling ip=@ method=GET protocol=unix url=/1.0 username=afridi
DBUG[12-03|15:16:04] Handling protocol=unix url=/1.0/profiles/x11 username=afridi ip=@ method=GET
DBUG[12-03|15:16:06] Handling ip=@ method=PUT protocol=unix url=/1.0/profiles/x11 username=afridi
DBUG[12-03|15:16:14] Handling username=afridi ip=@ method=GET protocol=unix url=/1.0
DBUG[12-03|15:16:14] Handling ip=@ method=GET protocol=unix url=/1.0/events username=afridi
DBUG[12-03|15:16:14] New event listener: c9431c5f-5dcb-4ae2-a99c-62cba251f16a
DBUG[12-03|15:16:14] Handling ip=@ method=POST protocol=unix url=/1.0/instances username=afridi
DBUG[12-03|15:16:14] Connecting to a remote simplestreams server
DBUG[12-03|15:16:14] Responding to instance create
DBUG[12-03|15:16:14] New task Operation: a255ef42-0984-4e4f-a78c-5d23aa87af60
DBUG[12-03|15:16:14] Started task operation: a255ef42-0984-4e4f-a78c-5d23aa87af60
DBUG[12-03|15:16:14] Connecting to a remote simplestreams server
DBUG[12-03|15:16:14] Handling ip=@ method=GET protocol=unix url=/1.0/operations/a255ef42-0984-4e4f-a78c-5d23aa87af60 username=afridi
DBUG[12-03|15:16:14] Image already exists in the DB fingerprint=f42eab18aa248c4caeebc4dd053c8fccd5830589dff4365612b96931275a2989
INFO[12-03|15:16:14] Creating container ephemeral=false name=mycontainer project=default
DBUG[12-03|15:16:14] FillInstanceConfig started driver=zfs instance=mycontainer pool=default project=default
DBUG[12-03|15:16:14] FillInstanceConfig finished driver=zfs instance=mycontainer pool=default project=default
INFO[12-03|15:16:14] Created container ephemeral=false name=mycontainer project=default
DBUG[12-03|15:16:14] CreateInstanceFromImage started driver=zfs instance=mycontainer pool=default project=default
DBUG[12-03|15:16:14] EnsureImage started driver=zfs fingerprint=f42eab18aa248c4caeebc4dd053c8fccd5830589dff4365612b96931275a2989 pool=default
DBUG[12-03|15:16:14] Checking image volume size driver=zfs fingerprint=f42eab18aa248c4caeebc4dd053c8fccd5830589dff4365612b96931275a2989 pool=default
DBUG[12-03|15:16:14] Setting image volume size size= driver=zfs fingerprint=f42eab18aa248c4caeebc4dd053c8fccd5830589dff4365612b96931275a2989 pool=default
DBUG[12-03|15:16:14] EnsureImage finished driver=zfs fingerprint=f42eab18aa248c4caeebc4dd053c8fccd5830589dff4365612b96931275a2989 pool=default
DBUG[12-03|15:16:14] Checking volume size driver=zfs instance=mycontainer pool=default project=default
DBUG[12-03|15:16:14] Mounted ZFS dataset dev=default/containers/mycontainer driver=zfs path=/var/snap/lxd/common/lxd/storage-pools/default/containers/mycontainer pool=default
DBUG[12-03|15:16:14] Unmounted ZFS dataset dev=default/containers/mycontainer driver=zfs path=/var/snap/lxd/common/lxd/storage-pools/default/containers/mycontainer pool=default
DBUG[12-03|15:16:14] CreateInstanceFromImage finished driver=zfs instance=mycontainer pool=default project=default
DBUG[12-03|15:16:14] UpdateInstanceBackupFile started project=default driver=zfs instance=mycontainer pool=default
DBUG[12-03|15:16:15] Mounted ZFS dataset driver=zfs path=/var/snap/lxd/common/lxd/storage-pools/default/containers/mycontainer pool=default dev=default/containers/mycontainer
DBUG[12-03|15:16:15] UpdateInstanceBackupFile finished project=default driver=zfs instance=mycontainer pool=default
DBUG[12-03|15:16:15] Success for task operation: a255ef42-0984-4e4f-a78c-5d23aa87af60
DBUG[12-03|15:16:15] Unmounted ZFS dataset dev=default/containers/mycontainer driver=zfs path=/var/snap/lxd/common/lxd/storage-pools/default/containers/mycontainer pool=default
DBUG[12-03|15:16:15] Handling url=/1.0/instances/mycontainer username=afridi ip=@ method=GET protocol=unix
DBUG[12-03|15:16:15] Handling ip=@ method=PUT protocol=unix url=/1.0/instances/mycontainer/state username=afridi
DBUG[12-03|15:16:15] New task Operation: 29861b8e-09a0-4648-84db-22fcc65a729e
DBUG[12-03|15:16:15] Started task operation: 29861b8e-09a0-4648-84db-22fcc65a729e
DBUG[12-03|15:16:15] Handling ip=@ method=GET protocol=unix url=/1.0/operations/29861b8e-09a0-4648-84db-22fcc65a729e username=afridi
DBUG[12-03|15:16:15] MountInstance started driver=zfs instance=mycontainer pool=default project=default
DBUG[12-03|15:16:15] Container idmap changed, remapping
DBUG[12-03|15:16:15] Updated metadata for task Operation: 29861b8e-09a0-4648-84db-22fcc65a729e
DBUG[12-03|15:16:15] MountInstance finished driver=zfs instance=mycontainer pool=default project=default
DBUG[12-03|15:16:15] Mounted ZFS dataset path=/var/snap/lxd/common/lxd/storage-pools/default/containers/mycontainer pool=default dev=default/containers/mycontainer driver=zfs
DBUG[12-03|15:16:18] Updated metadata for task Operation: 29861b8e-09a0-4648-84db-22fcc65a729e
DBUG[12-03|15:16:18] Starting device device=eth0 instance=mycontainer project=default type=nic
DBUG[12-03|15:16:18] Scheduler: network: veth9ec462d2 has been added: updating network priorities
DBUG[12-03|15:16:18] Scheduler: network: veth7427ee22 has been added: updating network priorities
DBUG[12-03|15:16:18] Starting device device=root instance=mycontainer project=default type=disk
DBUG[12-03|15:16:18] Starting device project=default type=proxy device=PASocket1 instance=mycontainer
DBUG[12-03|15:16:18] Starting device instance=mycontainer project=default type=proxy device=X0
DBUG[12-03|15:16:18] Starting device instance=mycontainer project=default type=gpu device=mygpu
DBUG[12-03|15:16:18] UpdateInstanceBackupFile started driver=zfs instance=mycontainer pool=default project=default
DBUG[12-03|15:16:18] Skipping unmount as in use driver=zfs pool=default refCount=1
DBUG[12-03|15:16:18] UpdateInstanceBackupFile finished driver=zfs instance=mycontainer pool=default project=default
INFO[12-03|15:16:18] Starting container project=default stateful=false used="1970-01-01 01:00:00 +0100 CET" action=start created="2020-12-03 15:16:14.805515395 +0100 CET" ephemeral=false name=mycontainer
DBUG[12-03|15:16:18] Handling url="/internal/containers/mycontainer/onstart?project=default" username=root ip=@ method=GET protocol=unix
DBUG[12-03|15:16:18] Scheduler: container mycontainer started: re-balancing
DBUG[12-03|15:16:18] Handling protocol=unix url="/internal/containers/mycontainer/onstopns?netns=%2Fproc%2F22349%2Ffd%2F4&project=default&target=stop" username=root ip=@ method=GET
DBUG[12-03|15:16:18] Stopping device device=eth0 instance=mycontainer project=default type=nic
DBUG[12-03|15:16:18] Clearing instance firewall static filters ipv4=0.0.0.0 ipv6=:: parent=lxdbr0 project=default dev=eth0 host_name=veth7427ee22 hwaddr=00:16:3e:31:7b:ce instance=mycontainer
DBUG[12-03|15:16:18] Clearing instance firewall dynamic filters hwaddr=00:16:3e:31:7b:ce instance=mycontainer ipv4=<nil> ipv6=<nil> parent=lxdbr0 project=default dev=eth0 host_name=veth7427ee22
DBUG[12-03|15:16:18] Failure for task operation: 29861b8e-09a0-4648-84db-22fcc65a729e: Failed to run: /snap/lxd/current/bin/lxd forkstart mycontainer /var/snap/lxd/common/lxd/containers /var/snap/lxd/common/lxd/logs/mycontainer/lxc.conf:
EROR[12-03|15:16:18] Failed starting container action=start created="2020-12-03 15:16:14.805515395 +0100 CET" ephemeral=false name=mycontainer project=default stateful=false used="1970-01-01 01:00:00 +0100 CET"
DBUG[12-03|15:16:18] Event listener finished: c9431c5f-5dcb-4ae2-a99c-62cba251f16a
DBUG[12-03|15:16:18] Disconnected event listener: c9431c5f-5dcb-4ae2-a99c-62cba251f16a
DBUG[12-03|15:16:19] Handling ip=@ method=GET protocol=unix url="/internal/containers/mycontainer/onstop?project=default&target=stop" username=root
INFO[12-03|15:16:19] Container initiated stop stateful=false used="2020-12-03 15:16:18.617314147 +0100 CET" action=stop created="2020-12-03 15:16:14.805515395 +0100 CET" ephemeral=false name=mycontainer project=default
DBUG[12-03|15:16:19] Container stopped, starting storage cleanup container=mycontainer
DBUG[12-03|15:16:19] Stopping device type=gpu device=mygpu instance=mycontainer project=default
DBUG[12-03|15:16:19] Stopping device device=X0 instance=mycontainer project=default type=proxy
DBUG[12-03|15:16:19] Stopping device device=PASocket1 instance=mycontainer project=default type=proxy
DBUG[12-03|15:16:19] Stopping device instance=mycontainer project=default type=disk device=root
DBUG[12-03|15:16:19] UnmountInstance started driver=zfs instance=mycontainer pool=default project=default
DBUG[12-03|15:16:19] Unmounted ZFS dataset dev=default/containers/mycontainer driver=zfs path=/var/snap/lxd/common/lxd/storage-pools/default/containers/mycontainer pool=default
DBUG[12-03|15:16:19] UnmountInstance finished driver=zfs instance=mycontainer pool=default project=default
INFO[12-03|15:16:20] Shut down container project=default stateful=false used="2020-12-03 15:16:18.617314147 +0100 CET" action=stop created="2020-12-03 15:16:14.805515395 +0100 CET" ephemeral=false name=mycontainer
DBUG[12-03|15:16:20] Scheduler: container mycontainer stopped: re-balancing
stgraber
December 3, 2020, 3:40pm
4
Can you try setting nvidia.runtime to false, see if that unblocks it?
The behavior seems consistent with nvidia-container failing.
Affi
December 3, 2020, 4:17pm
5
I did as instructed but now getting the following errors @stgraber :
Error: Error occurred when starting proxy device: Error: Failed to listen on /home/ubuntu/pulse-native: listen unix /home/ubuntu/pulse-native: bind: no such file or directory
Try `lxc info --show-log local:mycontainer` for more info
Here is the log:
Name: mycontainer
Location: none
Remote: unix://
Architecture: x86_64
Created: 2020/12/03 16:15 UTC
Status: Stopped
Type: container
Profiles: default, x11
Log:
lxc mycontainer 20201203161542.554 WARN cgfsng - cgroups/cgfsng.c:mkdir_eexist_on_last:1152 - File exists - Failed to create directory "/sys/fs/cgroup/cpuset//lxc.monitor.mycontainer"
lxc mycontainer 20201203161542.555 WARN cgfsng - cgroups/cgfsng.c:mkdir_eexist_on_last:1152 - File exists - Failed to create directory "/sys/fs/cgroup/cpuset//lxc.payload.mycontainer"
lxc mycontainer 20201203161542.560 WARN cgfsng - cgroups/cgfsng.c:fchowmodat:1573 - No such file or directory - Failed to fchownat(17, memory.oom.group, 1000000000, 0, AT_EMPTY_PATH | AT_SYMLINK_NOFOLLOW )
tomp
December 3, 2020, 4:46pm
6
Does /home/ubuntu exist inside container?
Affi
December 3, 2020, 4:48pm
7
Hi @tomp the container is stopped.
Even I tried the solution here which was mentioned by @duckhook .
I can confirm precisely the same errors. I can also confirm that quater’s workaround is effective.
I have also effectively worked around the problem by splitting the profile into two pieces with the X11 component following Simos’s original profile and the PulseAudio component following an earlier profile created by Simos in which PulseAudio is defined as a disk device rather than a proxy:
X11 component:
config:
environment.DISPLAY: :0
user.user-data: |
#cloud-config
packages:
…
tomp
December 3, 2020, 4:48pm
8
OK can you remove the proxy device too then please.
Affi
December 3, 2020, 5:08pm
9
@tomp Thanks I did as you instructed and Now the the container is running! Can you please let me know whats was the reason for that error very briefly?
I short I want I want to achieve is to setup the nvidia development env and also Ros and use it for the development?
thanks for your valuable time
tomp
December 3, 2020, 5:10pm
10
Does the /home/ubuntu directory exist in your container?
tomp
December 3, 2020, 5:15pm
12
Can you show output of ls -la /home/ubuntu please
Affi
December 3, 2020, 5:19pm
13
Here it is:
rwxr-xr-x 5 ubuntu ubuntu 10 Dec 3 17:08 .
drwxr-xr-x 3 root root 3 Dec 3 17:01 ..
-rw------- 1 ubuntu ubuntu 389 Dec 3 17:11 .bash_history
-rw-r--r-- 1 ubuntu ubuntu 220 Apr 4 2018 .bash_logout
-rw-r--r-- 1 ubuntu ubuntu 3771 Apr 4 2018 .bashrc
drwx------ 2 ubuntu ubuntu 2 Dec 3 17:08 .cache
drwx------ 3 ubuntu ubuntu 3 Dec 3 17:08 .mozilla
-rw-r--r-- 1 ubuntu ubuntu 807 Apr 4 2018 .profile
drwx------ 2 ubuntu ubuntu 3 Dec 3 17:01 .ssh
-rw-r--r-- 1 ubuntu ubuntu 0 Dec 3 17:01 .sudo_as_admin_successful
I just install firefox just to test x11 forwarding.
tomp
December 3, 2020, 5:31pm
14
Can you show output of lxc config show <instance> --expanded please
Affi
December 3, 2020, 5:32pm
15
Please find the logs:
architecture: x86_64
config:
environment.DISPLAY: :0
environment.PULSE_SERVER: unix:/home/ubuntu/pulse-native
image.architecture: amd64
image.description: ubuntu 18.04 LTS amd64 (release) (20201125)
image.label: release
image.os: ubuntu
image.release: bionic
image.serial: "20201125"
image.type: squashfs
image.version: "18.04"
nvidia.driver.capabilities: all
nvidia.runtime: "false"
user.user-data: |
#cloud-config
runcmd:
- 'sed -i "s/; enable-shm = yes/enable-shm = no/g" /etc/pulse/client.conf'
packages:
- x11-apps
- mesa-utils
- pulseaudio
volatile.base_image: f42eab18aa248c4caeebc4dd053c8fccd5830589dff4365612b96931275a2989
volatile.eth0.host_name: veth9a284d58
volatile.eth0.hwaddr: 00:16:3e:ef:89:a6
volatile.idmap.base: "0"
volatile.idmap.current: '[{"Isuid":true,"Isgid":false,"Hostid":1000000,"Nsid":0,"Maprange":1000000000},{"Isuid":false,"Isgid":true,"Hostid":1000000,"Nsid":0,"Maprange":1000000000}]'
volatile.idmap.next: '[{"Isuid":true,"Isgid":false,"Hostid":1000000,"Nsid":0,"Maprange":1000000000},{"Isuid":false,"Isgid":true,"Hostid":1000000,"Nsid":0,"Maprange":1000000000}]'
volatile.last_state.idmap: '[{"Isuid":true,"Isgid":false,"Hostid":1000000,"Nsid":0,"Maprange":1000000000},{"Isuid":false,"Isgid":true,"Hostid":1000000,"Nsid":0,"Maprange":1000000000}]'
volatile.last_state.power: RUNNING
volatile.uuid: 47dced0a-7e63-41c5-8801-deaecb830a2b
devices:
X0:
bind: container
connect: unix:@/tmp/.X11-unix/X1
listen: unix:@/tmp/.X11-unix/X0
security.gid: "1000"
security.uid: "1000"
type: proxy
eth0:
name: eth0
network: lxdbr0
type: nic
mygpu:
type: gpu
root:
path: /
pool: default
type: disk
ephemeral: false
profiles:
- default
- x11
stateful: false
description: ""
tomp
December 3, 2020, 5:37pm
16
And what is your host OS?
tomp
December 3, 2020, 5:38pm
18
I just tried the same proxy config on my ubuntu 20.04 system and it worked fine, created the unix socket inside the container as expected.
Does /run/user/1000/pulse/native exist on your host?
Affi
December 3, 2020, 5:41pm
19
No, following entries are there
tmpfs 1,5G 24K 1,5G 1% /run/user/121
tmpfs 1,5G 72K 1,5G 1% /run/user/1000
tomp
December 3, 2020, 5:42pm
20
So that will likely be the issue, you don’t have a host-side pulse audio listener, on my system I see:
srw-rw-rw- 1 user user 0 Dec 3 08:56 /run/user/1000/pulse/native
