I have upgrade incus to 7.4 on trixie and I cannot run incus anymore. When I tried to run a VM it finished in ERROR state. After looking, it seems that the qemu packaged with incus cannot be run:
# /opt/incus/bin/qemu-system-x86_64
/opt/incus/bin/qemu-system-x86_64: symbol lookup error: /opt/incus/bin/qemu-system-x86_64: undefined symbol: virgl_renderer_resource_map_fixed
Do you use zabbly incus stable?
Mine doesn’t ship qemu-system-x86_64 ?anymore?:
root@ict-stable:/opt/incus/bin# dpkg -L incus-base | grep /opt/incus/bin/
/opt/incus/bin/criu
/opt/incus/bin/incus-user
/opt/incus/bin/incusd
/opt/incus/bin/lego
/opt/incus/bin/lxcfs
/opt/incus/bin/nvidia-container-cli
/opt/incus/bin/qemu-vmsr-helper
/opt/incus/bin/skopeo
/opt/incus/bin/swtpm
/opt/incus/bin/swtpm_bios
/opt/incus/bin/swtpm_cert
/opt/incus/bin/swtpm_ioctl
/opt/incus/bin/swtpm_localca
/opt/incus/bin/swtpm_setup
/opt/incus/bin/truenas_incus_ctl
/opt/incus/bin/vhost-user-gpu
You could try to move all other binaries to “.bak” then try to start the vm again (maybe restart incus.service)
EDIT: wait I’m having a minimal install, let me try something first.
The “incus” package ships qemu-system-x86_64, I try to reproduce.
root@ict-stable:/opt/incus/bin# dpkg -L incus | grep /opt/incus/bin
/opt/incus/bin
/opt/incus/bin/qemu-img
/opt/incus/bin/qemu-nbd
/opt/incus/bin/qemu-system-x86_64
/opt/incus/bin/virtiofsd
Yes I have the meta package `incus`
I installed zabbly/incus-7.4 on debian/trixie in a nested vm and run another vm, works as expected same as in the CI.
Do you have a simliar output here:
root@nested:~# LD_LIBRARY_PATH=/opt/incus/lib ldd /opt/incus/bin/qemu-system-x86_64 | grep libvir
libvirglrenderer.so.1 => /opt/incus/lib/libvirglrenderer.so.1 (0x00007f6995fee000)
If that outputs right, then I might be how you launch incus.
root@nested:~# systemctl show incus | grep ExecStart
ExecStart={ path=/opt/incus/lib/systemd/incusd ; argv[]=/opt/incus/lib/systemd/incusd --group incus-admin $INCUS_OPTS --logfile /var/log/incus/incusd.log ; ignore_errors=no ; start_time=[Tue 2026-09-22 09:06:26 UTC] ; stop_time=[n/a] ; pid=7044 ; code=(null) ; status=0/0 }
ExecStartEx={ path=/opt/incus/lib/systemd/incusd ; argv[]=/opt/incus/lib/systemd/incusd --group incus-admin $INCUS_OPTS --logfile /var/log/incus/incusd.log ; flags= ; start_time=[Tue 2026-09-22 09:06:26 UTC] ; stop_time=[n/a] ; pid=7044 ; code=(null) ; status=0/0 }
ExecStartPost={ path=/opt/incus/lib/systemd/incusd ; argv[]=/opt/incus/lib/systemd/incusd waitready --timeout=600 ; ignore_errors=no ; start_time=[Tue 2026-09-22 09:06:26 UTC] ; stop_time=[Tue 2026-09-22 09:06:28 UTC] ; pid=7045 ; code=exited ; status=0 }
ExecStartPostEx={ path=/opt/incus/lib/systemd/incusd ; argv[]=/opt/incus/lib/systemd/incusd waitready --timeout=600 ; flags= ; start_time=[Tue 2026-09-22 09:06:26 UTC] ; stop_time=[Tue 2026-09-22 09:06:28 UTC] ; pid=7045 ; code=exited ; status=0 }
If that is also alright see /opt/incus/lib/systemd/incusd:
root@nested:~# cat /opt/incus/lib/systemd/incusd
#!/bin/sh
set -e
export INCUS_DOCUMENTATION=/opt/incus/doc/
export INCUS_LXC_HOOK=/opt/incus/share/lxc/hooks/
export INCUS_LXC_TEMPLATE_CONFIG=/opt/incus/share/lxc/config/
export INCUS_AGENT_PATH=/opt/incus/agent/
export INCUS_EDK2_PATH=/opt/incus/share/qemu/
export INCUS_UI=/opt/incus/ui/
export LD_LIBRARY_PATH=/opt/incus/lib/
export PATH=/opt/incus/bin/:${PATH}
export HOME=/var/lib/incus/
mkdir -p /var/log/incus/
exec incusd "$@"
Looking again at your initial post, you run qemu-system-x86_64 directly, that won’t work without “LD_LIBRARY_PATH” and the other infos in the script.
Please give the initial error.
Okay it seems like the LD_LIBRARY_PATH is not set correctly.
If I manually set the LD_LIBRARY_PATH then the error disappear.
This is the output:
systemctl show incus | grep ExecStart
ExecStart={ path=/opt/incus/lib/systemd/incusd ; argv[]=/opt/incus/lib/systemd/incusd --group incus-admin $INCUS_OPTS --logfile /var/log/incus/incusd.log ; ignore_errors=no ; start_time=[Tue 2026-09-22 09:17:44 UTC] ; stop_time=[n/a] ; pid=852172 ; code=(null) ; status=0/0 }
ExecStartEx={ path=/opt/incus/lib/systemd/incusd ; argv[]=/opt/incus/lib/systemd/incusd --group incus-admin $INCUS_OPTS --logfile /var/log/incus/incusd.log ; flags= ; start_time=[Tue 2026-09-22 09:17:44 UTC] ; stop_time=[n/a] ; pid=852172 ; code=(null) ; status=0/0 }
ExecStartPost={ path=/opt/incus/lib/systemd/incusd ; argv[]=/opt/incus/lib/systemd/incusd waitready --timeout=600 ; ignore_errors=no ; start_time=[Tue 2026-09-22 09:17:44 UTC] ; stop_time=[Tue 2026-09-22 09:17:55 UTC] ; pid=852173 ; code=exited ; status=0 }
ExecStartPostEx={ path=/opt/incus/lib/systemd/incusd ; argv[]=/opt/incus/lib/systemd/incusd waitready --timeout=600 ; flags= ; start_time=[Tue 2026-09-22 09:17:44 UTC] ; stop_time=[Tue 2026-09-22 09:17:55 UTC] ; pid=852173 ; code=exited ; status=0 }
and
cat /opt/incus/lib/systemd/incusd
#!/bin/sh
set -e
export INCUS_DOCUMENTATION=/opt/incus/doc/
export INCUS_LXC_HOOK=/opt/incus/share/lxc/hooks/
export INCUS_LXC_TEMPLATE_CONFIG=/opt/incus/share/lxc/config/
export INCUS_AGENT_PATH=/opt/incus/agent/
export INCUS_EDK2_PATH=/opt/incus/share/qemu/
export INCUS_UI=/opt/incus/ui/
export LD_LIBRARY_PATH=/opt/incus/lib/
export PATH=/opt/incus/bin/:${PATH}
export HOME=/var/lib/incus/
mkdir -p /var/log/incus/
exec incusd "$@"
If I look at env in running incusd i get
USER=rootLD_LIBRARY_PATH=/opt/incus/lib/LISTEN_PID=852172LISTEN_FDS=1INCUS_EDK2_PATH=/opt/incus/share/qemu/HOME=/var/lib/incus/SYSTEMD_EXEC_PID=852172INCUS_UI=/opt/incus/ui/JOURNAL_STREAM=10:870146989MEMORY_PRESSURE_WATCH=/sys/fs/cgroup/system.slice/incus.service/memory.pressureINCUS_LXC_HOOK=/opt/incus/share/lxc/hooks/PATH=/opt/incus/bin/:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/binINVOCATION_ID=27361874d5294ab4a165f82f49b3242cLISTEN_FDNAMES=incus.socketINCUS_DOCUMENTATION=/opt/incus/doc/LANG=en_US.UTF-8INCUS_OPTS=INCUS_LXC_TEMPLATE_CONFIG=/opt/incus/share/lxc/config/LXCFS_OPTS=PWD=/INCUS_AGENT_PATH=/opt/incus/agent/MEMORY_PRESSURE_WRITE=c29tZSAyMDAwMDAgMjAwMDAwMAA=
Which contains the right library path
The initial error is that if I do
incus start <vm>
When I do incus list I get the state ERROR
and in show log I have nothing
incus info --show-log <vm>
Name: <vm>
Description: <vm>
Status: ERROR
Type: virtual-machine
Architecture: x86_64
Created: 2026/09/22 07:31 UTC
Last Used: 2026/09/22 09:18 UTC
Log (qemu.log):
Try sudo journalctl -u incus -f then start the vm again to have a fresh output.
Post any error.
If you’r in hurry try to catch the command qemu-system-x86_64 xxx from the logs, then prepend it with “LD_LIBRARY_PATH”, if not running you could try to run the same command with strace.
I once had troubles with it, after all I installed qemu-full on my arch-linux to get it fixed (different error I think).
I have start it again and look in logs. This is the only one I get
Sep 22 09:36:56 asusnuc incusd[852172]: time="2026-09-22T09:36:56Z" level=warning msg="Using writeback cache I/O" devPath=/var/lib/incus/virtual-machines/k8s-prod-cluster-1-worker-0/image_metadata/root.qcow2 device=root fsType=zfs instance=k8s-prod-cluster-1-worker-0 instanceType=virtual-machine project=default
Sep 22 09:37:01 asusnuc incusd[852172]: time="2026-09-22T09:37:01Z" level=warning msg="Failed to send DNS NOTIFY" err="read udp 10.10.10.6:44981->10.10.10.6:53: read: connection refused" peer=localhost zone=incus.<zone>
I have tried to destroy and recreate the vm and I get
Sep 22 09:48:37 asusnuc incusd[852172]: time="2026-09-22T09:48:37Z" level=warning msg="QMP monitor read failed" err="read unix @->/proc/self/fd/5/qemu.monitor: read: connection reset by peer"
Edit /etc/default/incus add --debug to INCUS_OPTS then restart incus systemctl restart incus.service incus.socket
I hope we get more infos from that.
I’m mostly interested in a run of qemu-system-x86_64 with or without strace.
EDIT: You’r box “asusnuc” is healthy, as in disk free, memory free and stuff, right?
EDIT2: I’m missing systemctl daemon-reload before the restart.
That’s the thing I we are missing…
You’r running “zfs”, what is zfs list telling?
It gives me that
$ zfs list
NAME USED AVAIL REFER MOUNTPOINT
bpool 587M 245M 96K /boot
bpool/BOOT 584M 245M 96K none
bpool/BOOT/debian 584M 245M 259M /boot
rpool 254G 1.51T 192K /
rpool/ROOT 7.19G 1.51T 192K none
rpool/ROOT/debian 7.19G 1.51T 3.36G /
rpool/home 378M 1.51T 272K /home
rpool/home/user 273M 1.51T 273M /home/user
rpool/home/root 105M 1.51T 105M /root
rpool/usr 12.9M 1.51T 192K /usr
rpool/usr/local 12.7M 1.51T 12.7M /usr/local
rpool/var 246G 1.51T 192K /var
rpool/var/cache 647M 1.51T 647M /var/cache
rpool/var/lib 245G 1.51T 192K /var/lib
rpool/var/lib/incus 245G 1.51T 3.35G /var/lib/incus
rpool/var/lib/incus/disks 237G 1.51T 192K /var/lib/incus/disks
rpool/var/lib/incus/disks/data 237G 1.51T 192K legacy
rpool/var/lib/incus/disks/data/buckets 2.94M 1.51T 192K legacy
rpool/var/lib/incus/disks/data/buckets/default_incus-tf-state 2.75M 1.51T 1.64M legacy
rpool/var/lib/incus/disks/data/containers 147G 1.51T 192K legacy
rpool/var/lib/incus/disks/data/containers/desktop 117G 1.51T 118G legacy
rpool/var/lib/incus/disks/data/containers/immich 2.60G 1.51T 5.49G legacy
rpool/var/lib/incus/disks/data/containers/jellyfin 80.5M 1.51T 1.12G legacy
rpool/var/lib/incus/disks/data/containers/ubuntu 24.6G 1.51T 24.6G legacy
rpool/var/lib/incus/disks/data/custom 21.9G 1.51T 192K legacy
rpool/var/lib/incus/disks/data/custom/default_desktop-data 19.8G 1.51T 18.9G legacy
rpool/var/lib/incus/disks/data/custom/default_jellyfin-data 489M 1.51T 480M legacy
rpool/var/lib/incus/disks/data/custom/default_nixos-2505.iso 1.64G 1.51T 1.64G -
rpool/var/lib/incus/disks/data/deleted 1.94G 1.51T 192K legacy
rpool/var/lib/incus/disks/data/deleted/buckets 192K 1.51T 192K legacy
rpool/var/lib/incus/disks/data/deleted/containers 192K 1.51T 192K legacy
rpool/var/lib/incus/disks/data/deleted/custom 192K 1.51T 192K legacy
rpool/var/lib/incus/disks/data/deleted/images 1.94G 1.51T 192K legacy
rpool/var/lib/incus/disks/data/deleted/images/14923e83c8241e819601c29fb172f982eaad8a06ba5707f0226a36599ab3c471 384M 1.51T 384M legacy
rpool/var/lib/incus/disks/data/deleted/images/b880ea6a1a20a502b3cc0d38063c3bc798ffc7812ffce58f6d288469e625ba29 1.15G 1.51T 1.15G legacy
rpool/var/lib/incus/disks/data/deleted/images/d28919ade3a304aad94bd62c26e7ab7c4e5cfec34d18f0d7216dbfb7177b8757 411M 1.51T 411M legacy
rpool/var/lib/incus/disks/data/deleted/images/f148000f2cf443b5cbc072158279fdb50678db1e4575f36800b5b54d15a6d249 9.57M 1.51T 9.57M legacy
rpool/var/lib/incus/disks/data/deleted/virtual-machines 192K 1.51T 192K legacy
rpool/var/lib/incus/disks/data/images 5.68G 1.51T 192K legacy
rpool/var/lib/incus/disks/data/images/264e431cce4ade7d4f716e92808e6e96a6e2ae7d057b7c9371e6446e9bdc45f1 1.10G 1.51T 1.10G legacy
rpool/var/lib/incus/disks/data/images/6fb28a692ba71ad2d44dac8f3df97f78558c2fdd0cc7941ce2763cf3fd85b7d2 210M 1.51T 210M legacy
rpool/var/lib/incus/disks/data/images/745631c4c75655f8827478d43473db3cc0d26225d99e33f0aa02ec86a03373d4 411M 1.51T 411M legacy
rpool/var/lib/incus/disks/data/images/859ee5ae081d76d3f74faab14f57c199e936f486ba7104b2194946b80b47b195 196K 500M 196K legacy
rpool/var/lib/incus/disks/data/images/859ee5ae081d76d3f74faab14f57c199e936f486ba7104b2194946b80b47b195.block 257M 1.51T 257M -
rpool/var/lib/incus/disks/data/images/88f378aa1c255d1e7ee47ecdba7a9de677943247977e28381e4ba5aeb6322f33 3.00G 1.51T 3.00G legacy
rpool/var/lib/incus/disks/data/images/8e4d30cc0689cc784a36c7eea10dbd3debca14b3307b1e59878ac8a9967e73f8 12.0M 1.51T 12.0M legacy
rpool/var/lib/incus/disks/data/images/c88422834b9c5ca6200da006142dfb89957d6f904a47a06257c37ddea7a77ea9 196K 500M 196K legacy
rpool/var/lib/incus/disks/data/images/c88422834b9c5ca6200da006142dfb89957d6f904a47a06257c37ddea7a77ea9.block 239M 1.51T 239M -
rpool/var/lib/incus/disks/data/images/e353ac2cffcdc087af1bae56dc817c60833588d5258be7d1f700701de794c2c2 192M 1.51T 192M legacy
rpool/var/lib/incus/disks/data/images/ed665497423a32fe49f528565feaf658464e407af416ff9a03948fb5e309251d 289M 1.51T 289M legacy
rpool/var/lib/incus/disks/data/virtual-machines 60.5G 1.51T 192K legacy
rpool/var/lib/incus/disks/data/virtual-machines/k8s-prod-cluster-1-control-plane-0 760K 499M 788K legacy
rpool/var/lib/incus/disks/data/virtual-machines/k8s-prod-cluster-1-control-plane-0.block 3.08G 1.51T 3.08G -
rpool/var/lib/incus/disks/data/virtual-machines/k8s-prod-cluster-1-control-plane-1 692K 499M 720K legacy
rpool/var/lib/incus/disks/data/virtual-machines/k8s-prod-cluster-1-control-plane-1.block 2.87G 1.51T 2.87G -
rpool/var/lib/incus/disks/data/virtual-machines/k8s-prod-cluster-1-control-plane-2 644K 499M 672K legacy
rpool/var/lib/incus/disks/data/virtual-machines/k8s-prod-cluster-1-control-plane-2.block 2.12G 1.51T 2.12G -
rpool/var/lib/incus/disks/data/virtual-machines/k8s-prod-cluster-1-worker-0 664K 499M 692K legacy
rpool/var/lib/incus/disks/data/virtual-machines/k8s-prod-cluster-1-worker-0.block 128K 1.51T 128K -
rpool/var/lib/incus/disks/data/virtual-machines/k8s-prod-cluster-1-worker-1 620K 499M 448K legacy
rpool/var/lib/incus/disks/data/virtual-machines/k8s-prod-cluster-1-worker-1.block 27.0G 1.51T 25.9G -
rpool/var/lib/incus/disks/data/virtual-machines/k8s-prod-cluster-1-worker-2 548K 499M 416K legacy
rpool/var/lib/incus/disks/data/virtual-machines/k8s-prod-cluster-1-worker-2.block 25.4G 1.51T 23.7G -
rpool/var/log 229M 1.51T 229M /var/log
rpool/var/spool 276K 1.51T 276K /var/spool
rpool/var/tmp 616K 1.51T 616K /var/tmp
I have error on qmp.log
[2026-09-22T10:04:46Z] QUERY: {"execute":"query-hotpluggable-cpus","id":2}
[2026-09-22T10:04:46Z] REPLY: {"return": [{"props": {"core-id": 17, "thread-id": 0, "node-id": 0, "socket-id": 0}, "vcpus-count": 1, "type": "host-x86_64-cpu"}, {"props": {"core-id": 16, "thread-id": 0, "node-id": 0, "socket-id": 0}, "vcpus-count": 1, "type": "host-x86_64-cpu"}, {"props": {"core-id": 15, "thread-id": 0, "node-id": 0, "socket-id": 0}, "vcpus-count": 1, "type": "host-x86_64-cpu"}, {"props": {"core-id": 14, "thread-id": 0, "node-id": 0, "socket-id": 0}, "vcpus-count": 1, "type": "host-x86_64-cpu"}, {"props": {"core-id": 13, "thread-id": 0, "node-id": 0, "socket-id": 0}, "vcpus-count": 1, "type": "host-x86_64-cpu"}, {"props": {"core-id": 12, "thread-id": 0, "node-id": 0, "socket-id": 0}, "vcpus-count": 1, "type": "host-x86_64-cpu"}, {"props": {"core-id": 11, "thread-id": 0, "node-id": 0, "socket-id": 0}, "vcpus-count": 1, "type": "host-x86_64-cpu"}, {"props": {"core-id": 10, "thread-id": 0, "node-id": 0, "socket-id": 0}, "vcpus-count": 1, "type": "host-x86_64-cpu"}, {"props": {"core-id": 9, "thread-id": 0, "node-id": 0, "socket-id": 0}, "vcpus-count": 1, "type": "host-x86_64-cpu"}, {"props": {"core-id": 8, "thread-id": 0, "node-id": 0, "socket-id": 0}, "vcpus-count": 1, "type": "host-x86_64-cpu"}, {"props": {"core-id": 7, "thread-id": 0, "node-id": 0, "socket-id": 0}, "vcpus-count": 1, "type": "host-x86_64-cpu"}, {"props": {"core-id": 6, "thread-id": 0, "node-id": 0, "socket-id": 0}, "vcpus-count": 1, "type": "host-x86_64-cpu"}, {"props": {"core-id": 5, "thread-id": 0, "node-id": 0, "socket-id": 0}, "vcpus-count": 1, "type": "host-x86_64-cpu"}, {"props": {"core-id": 4, "thread-id": 0, "node-id": 0, "socket-id": 0}, "vcpus-count": 1, "type": "host-x86_64-cpu"}, {"props": {"core-id": 3, "thread-id": 0, "node-id": 0, "socket-id": 0}, "vcpus-count": 1, "type": "host-x86_64-cpu"}, {"props": {"core-id": 2, "thread-id": 0, "node-id": 0, "socket-id": 0}, "vcpus-count": 1, "type": "host-x86_64-cpu"}, {"props": {"core-id": 1, "thread-id": 0, "node-id": 0, "socket-id": 0}, "vcpus-count": 1, "type": "host-x86_64-cpu"}, {"props": {"core-id": 0, "thread-id": 0, "node-id": 0, "socket-id": 0}, "vcpus-count": 1, "qom-path": "/machine/unattached/device[0]", "type": "host-x86_64-cpu"}], "id": 2}
[2026-09-22T10:04:46Z] QUERY: {"execute":"device_add","arguments":{"core-id":17,"driver":"host-x86_64-cpu","id":"cpu0170","socket-id":0,"thread-id":0},"id":4}
[2026-09-22T10:04:46Z] REPLY: {"return": {}, "id": 4}
[2026-09-22T10:04:46Z] QUERY: {"execute":"device_add","arguments":{"core-id":16,"driver":"host-x86_64-cpu","id":"cpu0160","socket-id":0,"thread-id":0},"id":5}
[2026-09-22T10:04:46Z] REPLY: {"return": {}, "id": 5}
[2026-09-22T10:04:46Z] QUERY: {"execute":"device_add","arguments":{"core-id":15,"driver":"host-x86_64-cpu","id":"cpu0150","socket-id":0,"thread-id":0},"id":6}
[2026-09-22T10:04:46Z] REPLY: {"return": {}, "id": 6}
[2026-09-22T10:04:46Z] QUERY: {"execute":"query-cpus-fast","id":7}
[2026-09-22T10:04:46Z] REPLY: {"return": [{"thread-id": 873702, "qom-type": "host-x86_64-cpu", "props": {"core-id": 0, "thread-id": 0, "node-id": 0, "socket-id": 0}, "qom-path": "/machine/unattached/device[0]", "cpu-index": 0, "target": "x86_64"}, {"thread-id": 873713, "qom-type": "host-x86_64-cpu", "props": {"core-id": 17, "thread-id": 0, "node-id": 0, "socket-id": 0}, "qom-path": "/machine/peripheral/cpu0170", "cpu-index": 17, "target": "x86_64"}, {"thread-id": 873714, "qom-type": "host-x86_64-cpu", "props": {"core-id": 16, "thread-id": 0, "node-id": 0, "socket-id": 0}, "qom-path": "/machine/peripheral/cpu0160", "cpu-index": 16, "target": "x86_64"}, {"thread-id": 873715, "qom-type": "host-x86_64-cpu", "props": {"core-id": 15, "thread-id": 0, "node-id": 0, "socket-id": 0}, "qom-path": "/machine/peripheral/cpu0150", "cpu-index": 15, "target": "x86_64"}], "id": 7}
[2026-09-22T10:04:46Z] QUERY: {"execute":"query-cpus-fast","id":8}
[2026-09-22T10:04:46Z] REPLY: {"return": [{"thread-id": 873702, "qom-type": "host-x86_64-cpu", "props": {"core-id": 0, "thread-id": 0, "node-id": 0, "socket-id": 0}, "qom-path": "/machine/unattached/device[0]", "cpu-index": 0, "target": "x86_64"}, {"thread-id": 873713, "qom-type": "host-x86_64-cpu", "props": {"core-id": 17, "thread-id": 0, "node-id": 0, "socket-id": 0}, "qom-path": "/machine/peripheral/cpu0170", "cpu-index": 17, "target": "x86_64"}, {"thread-id": 873714, "qom-type": "host-x86_64-cpu", "props": {"core-id": 16, "thread-id": 0, "node-id": 0, "socket-id": 0}, "qom-path": "/machine/peripheral/cpu0160", "cpu-index": 16, "target": "x86_64"}, {"thread-id": 873715, "qom-type": "host-x86_64-cpu", "props": {"core-id": 15, "thread-id": 0, "node-id": 0, "socket-id": 0}, "qom-path": "/machine/peripheral/cpu0150", "cpu-index": 15, "target": "x86_64"}], "id": 8}
[2026-09-22T10:04:46Z] QUERY: {"execute":"netdev_add","arguments":{"fds":"/dev/net/tun.0:/dev/net/tun.1:/dev/net/tun.2:/dev/net/tun.3","id":"incus_eth0","type":"tap","vhost":true,"vhostfds":"/dev/vhost-net.0:/dev/vhost-net.1:/dev/vhost-net.2:/dev/vhost-net.3"},"id":17}
[2026-09-22T10:04:46Z] REPLY: {"return": {}, "id": 17}
[2026-09-22T10:04:46Z] QUERY: {"execute":"device_add","arguments":{"addr":"00.0","bootindex":1,"bus":"qemu_pcie4","driver":"virtio-net-pci","id":"dev-incus_eth0","mac":"10:66:6a:28:35:66","mq":true,"netdev":"incus_eth0","vectors":10},"id":18}
[2026-09-22T10:04:46Z] REPLY: {"return": {}, "id": 18}
[2026-09-22T10:04:46Z] QUERY: {"execute":"blockdev-add","arguments":{"data-file":{"aio":"threads","cache":{"direct":false,"no-flush":false},"driver":"host_device","filename":"/dev/fdset/1"},"discard":"unmap","driver":"qcow2","file":{"aio":"threads","cache":{"direct":false,"no-flush":false},"driver":"file","filename":"/dev/fdset/0"},"node-name":"incus_root","read-only":false},"id":21}
[2026-09-22T10:04:46Z] REPLY: {"return": {}, "id": 21}
[2026-09-22T10:04:46Z] QUERY: {"execute":"device_add","arguments":{"bootindex":0,"bus":"qemu_scsi.0","channel":0,"device_id":"incus_root","discard_granularity":65536,"drive":"incus_root","driver":"scsi-hd","id":"dev-incus_root","lun":1,"serial":"incus_root"},"id":22}
[2026-09-22T10:04:46Z] REPLY: {"return": {}, "id": 22}
[2026-09-22T10:04:46Z] QUERY: {"execute":"system_reset","id":23}
[2026-09-22T10:04:46Z] Event: {"timestamp": {"seconds": 1790071486, "microseconds": 752823}, "event": "RESET", "data": {"guest": false, "reason": "host-qmp-system-reset"}}
[2026-09-22T10:04:46Z] REPLY: {"return": {}, "id": 23}
[2026-09-22T10:04:46Z] QUERY: {"execute":"set-action","arguments":{"panic":"exit-failure","reboot":"reset","shutdown":"poweroff"},"id":25}
[2026-09-22T10:04:46Z] REPLY: {"return": {}, "id": 25}
[2026-09-22T10:04:46Z] QUERY: {"execute":"cont","id":26}
[2026-09-22T10:04:46Z] Event: {"timestamp": {"seconds": 1790071486, "microseconds": 754291}, "event": "RESUME"}
[2026-09-22T10:04:46Z] REPLY: {"return": {}, "id": 26}
[2026-09-22T10:04:48Z] Event: {"timestamp": {"seconds": 1790071488, "microseconds": 13671}, "event": "RTC_CHANGE", "data": {"offset": -1, "qom-path": "/machine/unattached/device[3]/rtc"}}
[2026-09-22T10:04:48Z] Event: {"timestamp": {"seconds": 1790071488, "microseconds": 628221}, "event": "BLOCK_IO_ERROR", "data": {"device": "", "nospace": true, "node-name": "incus_root", "qom-path": "/machine/peripheral/dev-incus_root", "reason": "No space left on device", "operation": "write", "action": "stop"}}
[2026-09-22T10:04:48Z] Event: {"timestamp": {"seconds": 1790071488, "microseconds": 638146}, "event": "STOP"}
[2026-09-22T10:04:57Z] QUERY: {"execute":"query-status","id":32}
[2026-09-22T10:04:57Z] REPLY: {"return": {"status": "io-error", "running": false}, "id": 32}
[2026-09-22T10:04:59Z] QUERY: {"execute":"query-status","id":34}
[2026-09-22T10:04:59Z] REPLY: {"return": {"status": "io-error", "running": false}, "id": 34}
It says no space left on device, do not know why.
Try to launch any new vm like incus launch images:debian/trixie v1 --vm
It’s simpler than I thought, you’r disk of that single vm is full:
zfs get volsize,refreservation,usedbysnapshots,usedbydataset rpool/var/lib/incus/disks/data/virtual-machines/k8s-prod-cluster-1-worker-1.block
incus config device set k8s-prod-cluster-1-worker-1 root size=50GiB
incus start k8s-prod-cluster-1-worker-1
Not sure how you did that.
I used terraform to destroy and recreate it.
So now it start but I get
BdsDxe: failed to load Boot0001 "UEFI QEMU QEMU HARDDISK " from PciRoot(0x0)/Pci(0x1,0x1)/Pci(0x0,0x0)/Scsi(0x0,0x1): Not Found
I have reset the secureboot keys and then recreate it and now it works.
So I think I had a problem with disk root size, but after that I do not know