Live Migration LVM Cluster

Title: [BUG] Live migration fails for VMs only (“root disk size is smaller than migration source”) — containers migrate fine on same shared storage pool

Instance move to destination failed on source: Failed migration on source: Error from migration control target: Failed creating instance on target: The configured target instance root disk size is smaller than the migration source

Error transferring instance data: Failed migration on target: Failed creating instance on target: The configured target instance root disk size is smaller than the migration source

Environment:

  • Incus version: 7.2 (client & server)
  • Storage backend: lvmcluster (sanlock), shared pool “vg-qnap-hdd-01” over iSCSI (QNAP) + multipath
  • Cluster: 4 nodes (trim-computes-shr-incus-01 through 04)
  • Affected instance type: Virtual Machines (qcow2 on raw block LV)
  • Unaffected instance type: Containers (same pool, same nodes) — migrate successfully without issue

Summary:
Live migration (incus move) consistently fails for VMs on a shared
lvmcluster storage pool, even when the target’s configured root disk
size is verified to be larger than the source. Containers on the exact
same pool and nodes migrate without any problem — this appears to be
VM-specific, not a general cluster/storage issue.

Error:
Instance move to destination failed on source: Failed migration on source:
Error from migration control target: Failed creating instance on target:
The configured target instance root disk size is smaller than the
migration source

Steps to reproduce:

  1. Launch a fresh VM from an existing published template
    (incus launch <template-alias> <name> --vm ...)
  2. incus stop
  3. incus move --target
  4. Fails immediately with the error above

This reproduces even with a completely fresh VM (not just VMs that
went through prior manual resize operations), which rules out stale
per-instance config as the sole cause.

Troubleshooting already performed:

  1. Container migration test on the identical pool/nodes — succeeds
    without error. Isolates the problem to VM instances specifically.

  2. Verified actual source disk size via qemu-img info -U directly
    on the underlying block device (.block LV) — virtual-size matches
    the configured size exactly (e.g. precisely 60GiB =
    64424509440 bytes). Ruled out any GiB/GB unit confusion.

  3. Progressively increased the instance root disk size override well
    beyond the verified source size: +1GiB, +5GiB, up to +12GiB above
    source (accounting for LVM extent rounding overhead, ~12MiB).
    The error persists identically at every increment, including when
    the target config is unambiguously larger than the source.

  4. Confirmed profile/instance config is identical and in sync between
    source and target node (queried directly on both nodes) — ruled out
    dqlite replication lag as a factor.

  5. Verified incus config device show <instance> on BOTH source and
    target node shows the same root disk size before each attempt.

  6. Separately discovered two cluster nodes with unhealthy lock stack
    state (wdmd failed / stuck process; multipath path showing
    “i/o pending” / prio=0) during unrelated investigation. Fully
    restored both nodes to a healthy state (clean restart of
    wdmd → sanlock → lvmlockd, confirmed via lvmlockctl -i and
    multipath -ll on all 4 nodes). Retried VM migration after full
    cluster health was confirmed — error still occurs identically.

Workaround in use:
incus export <instance> followed by incus import on the target
node (bypassing the move size-validation path entirely) completes
successfully with no size-related error.

Impact:
Cannot rely on live migration for VM maintenance/load-balancing across
nodes despite using shared cluster storage — must fall back to
export/import, which requires the instance to be stopped and involves
significantly more manual steps and downtime.

Request:

  • Please confirm whether this is a known issue with VM migration on
    lvmcluster-backed pools in Incus 7.2
  • Any guidance on what internal size comparison is actually being
    performed during VM move (vs. container move) that could explain
    why containers are unaffected
  • Recommended version/patch if already fixed upstream
Instance move to destination failed on source: Failed migration on source: Error from migration control target: Failed creating instance on target: The configured target instance root disk size is smaller than the migration source
Error transferring instance data: Failed migration on target: Failed creating instance on target: The configured target instance root disk size is smaller than the migration source
stgraber@vorash-d13:~ (incus:dev-cluster01/default)$ incus storage list
+--------------+------------+-------------------------------------------------+---------+---------+
|     NAME     |   DRIVER   |                   DESCRIPTION                   | USED BY |  STATE  |
+--------------+------------+-------------------------------------------------+---------+---------+
| distributed  | ceph       | Distributed storage on Ceph                     | 0       | CREATED |
+--------------+------------+-------------------------------------------------+---------+---------+
| local        | zfs        | Local storage pool (on system drive)            | 49      | CREATED |
+--------------+------------+-------------------------------------------------+---------+---------+
| remote       | lvmcluster | Remote pool on Fibre Channel SAN                | 0       | CREATED |
+--------------+------------+-------------------------------------------------+---------+---------+
| remote-iscsi | lvmcluster | Remote pool on SAN accessed using iSCSI         | 5       | CREATED |
+--------------+------------+-------------------------------------------------+---------+---------+
| remote-nvme  | lvmcluster | Remote pool on SAN accessed using NVME-over-TCP | 13      | CREATED |
+--------------+------------+-------------------------------------------------+---------+---------+
stgraber@vorash-d13:~ (incus:dev-cluster01/default)$ incus version
Client version: 7.2
Server version: 7.2
stgraber@vorash-d13:~ (incus:dev-cluster01/default)$ incus launch images:debian/13 foo --vm --storage remote-nvme
Launching foo
stgraber@vorash-d13:~ (incus:dev-cluster01/default)$ incus list foo
+------+---------+------+------------------------------------------------+-----------------+-----------+----------+
| NAME |  STATE  | IPV4 |                      IPV6                      |      TYPE       | SNAPSHOTS | LOCATION |
+------+---------+------+------------------------------------------------+-----------------+-----------+----------+
| foo  | RUNNING |      | fd42:c9f0:6f69:913f:1266:6aff:fe18:6246 (eth0) | VIRTUAL-MACHINE | 0         | incus02  |
+------+---------+------+------------------------------------------------+-----------------+-----------+----------+
stgraber@vorash-d13:~ (incus:dev-cluster01/default)$ incus move foo --target incus01
stgraber@vorash-d13:~ (incus:dev-cluster01/default)$ incus list foo
+------+---------+------+------------------------------------------------+-----------------+-----------+----------+
| NAME |  STATE  | IPV4 |                      IPV6                      |      TYPE       | SNAPSHOTS | LOCATION |
+------+---------+------+------------------------------------------------+-----------------+-----------+----------+
| foo  | RUNNING |      | fd42:c9f0:6f69:913f:1266:6aff:fe18:6246 (eth0) | VIRTUAL-MACHINE | 0         | incus01  |
+------+---------+------+------------------------------------------------+-----------------+-----------+----------+
stgraber@vorash-d13:~ (incus:dev-cluster01/default)$ incus stop foo
stgraber@vorash-d13:~ (incus:dev-cluster01/default)$ incus move foo --target incus03
stgraber@vorash-d13:~ (incus:dev-cluster01/default)$ incus list foo
+------+---------+------+------+-----------------+-----------+----------+
| NAME |  STATE  | IPV4 | IPV6 |      TYPE       | SNAPSHOTS | LOCATION |
+------+---------+------+------+-----------------+-----------+----------+
| foo  | STOPPED |      |      | VIRTUAL-MACHINE | 0         | incus03  |
+------+---------+------+------+-----------------+-----------+----------+
stgraber@vorash-d13:~ (incus:dev-cluster01/default)$ 

Please show:

  • Output of lvs and vgs on all servers
  • incus config show --expanded NAME of the VM being migrated
  • incus storage show NAME of the storage pool
  • incus info --target NAME output for each of the servers

nodes-01

root@trim-computes-shr-incus-01:/home/super# lvs
  LV                                                                  VG                            Attr       LSize    Pool Origin Data%  Meta%  Move Log Cpy%Sync Convert
  LV_HOME                                                             trim-computes-shr-incus-01-vg -wi-ao----  <13.97g
  LV_ROOT                                                             trim-computes-shr-incus-01-vg -wi-ao----   23.28g
  LV_SWAP                                                             trim-computes-shr-incus-01-vg -wi-ao----   16.00g
  LV_TMP                                                              trim-computes-shr-incus-01-vg -wi-ao----    9.31g
  LV_VAR                                                              trim-computes-shr-incus-01-vg -wi-ao----  146.59g
  LV_VAR_LOG                                                          trim-computes-shr-incus-01-vg -wi-ao----  <13.97g
  pool-iso-and-templates                                              trim-computes-shr-incus-01-vg -wi-ao----   20.00g
  containers_Staging_test--migrate--container                         vg-qnap-hdd-01                -wi------k   32.00g
  custom_default_trim--vm--stg--t1--ms--sql--s21--dev--disk2.block    vg-qnap-hdd-01                -wi------k   <1.82t
  custom_default_trim--vm--stg--t1--ms--sql--s21--dev--disk3.block    vg-qnap-hdd-01                -wi------k <300.05g
  custom_default_trim--vm--stg--t1--ms--sql--s21--dev--disk4.block    vg-qnap-hdd-01                -wi------k <100.02g
  custom_default_trim--vm--t1--stg--aml--smart--vol--disk2.block      vg-qnap-hdd-01                -wi-ao---k <500.08g
  custom_default_trim--vm--t1--stg--aml--smart--vol--disk3.block      vg-qnap-hdd-01                -wi-ao---k <250.04g
  custom_default_trim--vm--t1--stg--aml--smart--vol--disk4.block      vg-qnap-hdd-01                -wi-ao---k  150.02g
  virtual-machines_Staging_test--migrate--vm                          vg-qnap-hdd-01                -wi------k  500.00m
  virtual-machines_Staging_test--migrate--vm.block                    vg-qnap-hdd-01                -wi------k  <32.01g
  virtual-machines_Staging_test--win2022--v2                          vg-qnap-hdd-01                -wi------k  500.00m
  virtual-machines_Staging_test--win2022--v2.block                    vg-qnap-hdd-01                -wi------k   65.02g
  virtual-machines_Staging_trim--vm--shr--tx--template--win2022       vg-qnap-hdd-01                -wi-ao---k  500.00m
  virtual-machines_Staging_trim--vm--shr--tx--template--win2022.block vg-qnap-hdd-01                -wi-ao---k   65.01g
  virtual-machines_Staging_trim--vm--stg--t1--aml--smart              vg-qnap-hdd-01                -wi-ao---k  500.00m
  virtual-machines_Staging_trim--vm--stg--t1--aml--smart.block        vg-qnap-hdd-01                -wi-ao---k   60.01g
  virtual-machines_Staging_trim--vm--stg--t1--s21--mssql              vg-qnap-hdd-01                -wi------k  500.00m
  virtual-machines_Staging_trim--vm--stg--t1--s21--mssql.block        vg-qnap-hdd-01                -wi------k   62.01g
root@trim-computes-shr-incus-01:/home/super# vgs
  VG                            #PV #LV #SN Attr   VSize   VFree
  trim-computes-shr-incus-01-vg   1   7   0 wz--n- 444.19g <201.07g
  vg-qnap-hdd-01                  1  17   0 wz--ns  31.50t   28.10t

nodes-02

root@trim-computes-shr-incus-02:/home/super# lvs
  LV                                                                  VG                            Attr       LSize    Pool Origin Data%  Meta%  Move Log Cpy%Sync Convert
  LV_HOME                                                             trim-computes-shr-incus-02-vg -wi-ao----   18.62g
  LV_ROOT                                                             trim-computes-shr-incus-02-vg -wi-ao----   29.80g
  LV_SWAP                                                             trim-computes-shr-incus-02-vg -wi-ao----  <14.90g
  LV_TMP                                                              trim-computes-shr-incus-02-vg -wi-ao----    9.31g
  LV_VAR                                                              trim-computes-shr-incus-02-vg -wi-ao----  130.73g
  LV_VAR_LOG                                                          trim-computes-shr-incus-02-vg -wi-ao----  <13.97g
  pool-iso-and-templates                                              trim-computes-shr-incus-02-vg -wi-ao----   20.00g
  containers_Staging_test--migrate--container                         vg-qnap-hdd-01                -wi------k   32.00g
  custom_default_trim--vm--stg--t1--ms--sql--s21--dev--disk2.block    vg-qnap-hdd-01                -wi-ao---k   <1.82t
  custom_default_trim--vm--stg--t1--ms--sql--s21--dev--disk3.block    vg-qnap-hdd-01                -wi-ao---k <300.05g
  custom_default_trim--vm--stg--t1--ms--sql--s21--dev--disk4.block    vg-qnap-hdd-01                -wi-ao---k <100.02g
  custom_default_trim--vm--t1--stg--aml--smart--vol--disk2.block      vg-qnap-hdd-01                -wi------k <500.08g
  custom_default_trim--vm--t1--stg--aml--smart--vol--disk3.block      vg-qnap-hdd-01                -wi------k <250.04g
  custom_default_trim--vm--t1--stg--aml--smart--vol--disk4.block      vg-qnap-hdd-01                -wi------k  150.02g
  virtual-machines_Staging_test--migrate--vm                          vg-qnap-hdd-01                -wi------k  500.00m
  virtual-machines_Staging_test--migrate--vm.block                    vg-qnap-hdd-01                -wi------k  <32.01g
  virtual-machines_Staging_test--win2022--v2                          vg-qnap-hdd-01                -wi------k  500.00m
  virtual-machines_Staging_test--win2022--v2.block                    vg-qnap-hdd-01                -wi------k   65.02g
  virtual-machines_Staging_trim--vm--shr--tx--template--win2022       vg-qnap-hdd-01                -wi------k  500.00m
  virtual-machines_Staging_trim--vm--shr--tx--template--win2022.block vg-qnap-hdd-01                -wi------k   65.01g
  virtual-machines_Staging_trim--vm--stg--t1--aml--smart              vg-qnap-hdd-01                -wi------k  500.00m
  virtual-machines_Staging_trim--vm--stg--t1--aml--smart.block        vg-qnap-hdd-01                -wi------k   60.01g
  virtual-machines_Staging_trim--vm--stg--t1--s21--mssql              vg-qnap-hdd-01                -wi-ao---k  500.00m
  virtual-machines_Staging_trim--vm--stg--t1--s21--mssql.block        vg-qnap-hdd-01                -wi-ao---k   62.01g
root@trim-computes-shr-incus-02:/home/super# vgs
  VG                            #PV #LV #SN Attr   VSize   VFree
  trim-computes-shr-incus-02-vg   1   7   0 wz--n- 444.19g <206.86g
  vg-qnap-hdd-01                  1  17   0 wz--ns  31.50t   28.10t

nodes-03

root@trim-computes-shr-incus-03:/home/super# lvs
  LV                                                                  VG                            Attr       LSize    Pool Origin Data%  Meta%  Move Log Cpy%Sync Convert
  LV_HOME                                                             trim-computes-shr-incus-03-vg -wi-ao----   18.62g
  LV_ROOT                                                             trim-computes-shr-incus-03-vg -wi-ao----  <27.94g
  LV_SWAP                                                             trim-computes-shr-incus-03-vg -wi-ao----  <14.90g
  LV_TMP                                                              trim-computes-shr-incus-03-vg -wi-ao----    9.31g
  LV_VAR                                                              trim-computes-shr-incus-03-vg -wi-ao----  129.80g
  LV_VAR_LOG                                                          trim-computes-shr-incus-03-vg -wi-ao----  <13.97g
  pool-iso-and-templates                                              trim-computes-shr-incus-03-vg -wi-ao----   20.00g
  containers_Staging_test--migrate--container                         vg-qnap-hdd-01                -wi------k   32.00g
  custom_default_trim--vm--stg--t1--ms--sql--s21--dev--disk2.block    vg-qnap-hdd-01                -wi------k   <1.82t
  custom_default_trim--vm--stg--t1--ms--sql--s21--dev--disk3.block    vg-qnap-hdd-01                -wi------k <300.05g
  custom_default_trim--vm--stg--t1--ms--sql--s21--dev--disk4.block    vg-qnap-hdd-01                -wi------k <100.02g
  custom_default_trim--vm--t1--stg--aml--smart--vol--disk2.block      vg-qnap-hdd-01                -wi------k <500.08g
  custom_default_trim--vm--t1--stg--aml--smart--vol--disk3.block      vg-qnap-hdd-01                -wi------k <250.04g
  custom_default_trim--vm--t1--stg--aml--smart--vol--disk4.block      vg-qnap-hdd-01                -wi------k  150.02g
  virtual-machines_Staging_test--migrate--vm                          vg-qnap-hdd-01                -wi------k  500.00m
  virtual-machines_Staging_test--migrate--vm.block                    vg-qnap-hdd-01                -wi------k  <32.01g
  virtual-machines_Staging_test--win2022--v2                          vg-qnap-hdd-01                -wi-ao---k  500.00m
  virtual-machines_Staging_test--win2022--v2.block                    vg-qnap-hdd-01                -wi-ao---k   65.02g
  virtual-machines_Staging_trim--vm--shr--tx--template--win2022       vg-qnap-hdd-01                -wi------k  500.00m
  virtual-machines_Staging_trim--vm--shr--tx--template--win2022.block vg-qnap-hdd-01                -wi------k   65.01g
  virtual-machines_Staging_trim--vm--stg--t1--aml--smart              vg-qnap-hdd-01                -wi------k  500.00m
  virtual-machines_Staging_trim--vm--stg--t1--aml--smart.block        vg-qnap-hdd-01                -wi------k   60.01g
  virtual-machines_Staging_trim--vm--stg--t1--s21--mssql              vg-qnap-hdd-01                -wi------k  500.00m
  virtual-machines_Staging_trim--vm--stg--t1--s21--mssql.block        vg-qnap-hdd-01                -wi------k   62.01g
root@trim-computes-shr-incus-03:/home/super# vgs
  VG                            #PV #LV #SN Attr   VSize   VFree
  trim-computes-shr-incus-03-vg   1   7   0 wz--n- 444.19g <209.65g
  vg-qnap-hdd-01                  1  17   0 wz--ns  31.50t   28.10t

nodes-04

root@trim-computes-shr-incus-04:/home/super# lvs
  LV                                                                  VG                            Attr       LSize    Pool Origin Data%  Meta%  Move Log Cpy%Sync Convert
  LV_HOME                                                             trim-computes-shr-incus-04-vg -wi-ao----   18.62g
  LV_ROOT                                                             trim-computes-shr-incus-04-vg -wi-ao----  <27.94g
  LV_SWAP                                                             trim-computes-shr-incus-04-vg -wi-ao----  <14.90g
  LV_TMP                                                              trim-computes-shr-incus-04-vg -wi-ao----    9.31g
  LV_VAR                                                              trim-computes-shr-incus-04-vg -wi-ao----   29.80g
  LV_VAR_LOG                                                          trim-computes-shr-incus-04-vg -wi-ao----  <14.90g
  pool-iso-and-templates                                              trim-computes-shr-incus-04-vg -wi-ao----   20.00g
  containers_Staging_test--migrate--container                         vg-qnap-hdd-01                -wi------k   32.00g
  custom_default_trim--vm--stg--t1--ms--sql--s21--dev--disk2.block    vg-qnap-hdd-01                -wi------k   <1.82t
  custom_default_trim--vm--stg--t1--ms--sql--s21--dev--disk3.block    vg-qnap-hdd-01                -wi------k <300.05g
  custom_default_trim--vm--stg--t1--ms--sql--s21--dev--disk4.block    vg-qnap-hdd-01                -wi------k <100.02g
  custom_default_trim--vm--t1--stg--aml--smart--vol--disk2.block      vg-qnap-hdd-01                -wi------k <500.08g
  custom_default_trim--vm--t1--stg--aml--smart--vol--disk3.block      vg-qnap-hdd-01                -wi------k <250.04g
  custom_default_trim--vm--t1--stg--aml--smart--vol--disk4.block      vg-qnap-hdd-01                -wi------k  150.02g
  virtual-machines_Staging_test--migrate--vm                          vg-qnap-hdd-01                -wi------k  500.00m
  virtual-machines_Staging_test--migrate--vm.block                    vg-qnap-hdd-01                -wi------k  <32.01g
  virtual-machines_Staging_test--win2022--v2                          vg-qnap-hdd-01                -wi------k  500.00m
  virtual-machines_Staging_test--win2022--v2.block                    vg-qnap-hdd-01                -wi------k   65.02g
  virtual-machines_Staging_trim--vm--shr--tx--template--win2022       vg-qnap-hdd-01                -wi------k  500.00m
  virtual-machines_Staging_trim--vm--shr--tx--template--win2022.block vg-qnap-hdd-01                -wi------k   65.01g
  virtual-machines_Staging_trim--vm--stg--t1--aml--smart              vg-qnap-hdd-01                -wi------k  500.00m
  virtual-machines_Staging_trim--vm--stg--t1--aml--smart.block        vg-qnap-hdd-01                -wi------k   60.01g
  virtual-machines_Staging_trim--vm--stg--t1--s21--mssql              vg-qnap-hdd-01                -wi------k  500.00m
  virtual-machines_Staging_trim--vm--stg--t1--s21--mssql.block        vg-qnap-hdd-01                -wi------k   62.01g
root@trim-computes-shr-incus-04:/home/super# vgs
  VG                            #PV #LV #SN Attr   VSize   VFree
  trim-computes-shr-incus-04-vg   1   7   0 wz--n- 444.19g <308.72g
  vg-qnap-hdd-01                  1  17   0 wz--ns  31.50t   28.10t
root@trim-computes-shr-incus-02:/home/super# incus config show --expanded test-migrate-vm --project Staging
architecture: x86_64
config:
  image.description: Ubuntu 24.04 xxxxxxx Golden Image
  image.os: ubuntu
  image.release: "24.04"
  migration.stateful: "true"
  volatile.base_image: 3662cd1e39b471a191187eae9005dc334c4417d232622ce69b089bf973191d66
  volatile.cloud-init.instance-id: b25d2f0a-bab6-4557-bb26-8abfb0d344c9
  volatile.last_state.agent: STOPPED
  volatile.last_state.power: STOPPED
  volatile.last_state.ready: "false"
  volatile.uuid: fedb17dc-6b67-4347-8eb5-a9ebe080075b
  volatile.uuid.generation: fedb17dc-6b67-4347-8eb5-a9ebe080075b
  volatile.vm.boot_state: '{"version":1,"cpu_type":"kvm64,hv_relaxed,hv_vpindex,hv_runtime,hv_time,hv_synic,hv_stimer,hv_tlbflush,hv_ipi,hv_frequencies,hv_stimer_direct,hv_xmm_input,hv_tlbflush_ext,avx512cd,smx,tsc_adjust,avx512dq,pku,xsaves,avx512f,avx,3dnowprefetch,ssbd,smep,adx,pbe,sse4_1,dca,stibp,mpx,clwb,tm2,invpcid,pcid,ibrs,acpi,est,smap,ht,popcnt,abm,fma,rdrand,vnmi,monitor,sse4_2,rdseed,pdpe1gb,lahf_lm,bmi1,clflushopt,f16c,vmx,movbe,ss,avx512vl,arat,xtpr,pdcm,xgetbv1,ibpb,avx512bw,ds_cpl,fsgsbase,bmi2,erms,rdtscp,xsaveopt,xsavec,xsave,tm,dtes64,pclmulqdq,ssse3,avx2,aes","cpu_topology":{"sockets":1,"cores":1,"threads":1,"explicit":false},"machine_type":"pc-q35-11.0","memory_topology":{"base":1073741824,"max":274877906944,"extra":null}}'
  volatile.vm.rtc_adjustment: "0"
  volatile.vm.rtc_offset: "0"
  volatile.vsock_id: "1429969440"
devices:
  root:
    path: /
    pool: pool-qnap-hdd-01
    size: 32GiB
    type: disk
ephemeral: false
profiles:
  - default
stateful: false
description: ""
root@trim-computes-shr-incus-02:/home/super# incus storage list
+------------------------+------------+-------------+---------+---------+
|          NAME          |   DRIVER   | DESCRIPTION | USED BY |  STATE  |
+------------------------+------------+-------------+---------+---------+
| pool-iso-and-templates | dir        |             | 2       | CREATED |
+------------------------+------------+-------------+---------+---------+
| pool-qnap-hdd-01       | lvmcluster |             | 17      | CREATED |
+------------------------+------------+-------------+---------+---------+
root@trim-computes-shr-incus-02:/home/super# incus storage show pool-qnap-hdd-01
config:
  size: "34635685822464"
description: ""
name: pool-qnap-hdd-01
driver: lvmcluster
used_by:
  - /1.0/instances/test-migrate-container?project=Staging
  - /1.0/instances/test-migrate-vm?project=Staging
  - /1.0/instances/test-win2022-v2?project=Staging
  - /1.0/instances/trim-vm-shr-tx-template-win2022?project=Staging
  - /1.0/instances/trim-vm-stg-t1-aml-smart?project=Staging
  - /1.0/instances/trim-vm-stg-t1-s21-mssql?project=Staging
  - /1.0/profiles/default
  - /1.0/profiles/default?project=Production
  - /1.0/profiles/os-trim-rocky-linux
  - /1.0/profiles/os-trim-ubuntu
  - /1.0/profiles/os-trim-win2022
  - /1.0/storage-pools/pool-qnap-hdd-01/volumes/custom/trim-vm-stg-t1-ms-sql-s21-dev-disk2
  - /1.0/storage-pools/pool-qnap-hdd-01/volumes/custom/trim-vm-stg-t1-ms-sql-s21-dev-disk3
  - /1.0/storage-pools/pool-qnap-hdd-01/volumes/custom/trim-vm-stg-t1-ms-sql-s21-dev-disk4
  - /1.0/storage-pools/pool-qnap-hdd-01/volumes/custom/trim-vm-t1-stg-aml-smart-vol-disk2
  - /1.0/storage-pools/pool-qnap-hdd-01/volumes/custom/trim-vm-t1-stg-aml-smart-vol-disk3
  - /1.0/storage-pools/pool-qnap-hdd-01/volumes/custom/trim-vm-t1-stg-aml-smart-vol-disk4
status: Created
locations:
  - trim-computes-shr-incus-01
  - trim-computes-shr-incus-02
  - trim-computes-shr-incus-03
  - trim-computes-shr-incus-04
oot@trim-computes-shr-incus-02:/home/super# incus info --target  trim-computes-shr-incus-04
config:
  cluster.https_address: 10.25.3.53:8443
  core.https_address: 10.25.3.53:8443
  oidc.audience: xxxxxxxx
  oidc.client.id: xxxxxxxxxx
  oidc.issuer: https://xxxxxxxxxxxxxx/application/o/incus-xxxxxxx-cluster-01/
  user.ui.sso_only: "true"
  user.ui.title: Incus Cluster 01 xxxxxx
api_extensions_count: 529
api_status: stable
api_version: "1.0"
auth: trusted
public: false
auth_methods:
  - tls
  - oidc
auth_user_name: root
auth_user_method: unix
environment:
  addresses:
    - 10.25.3.53:8443
  architectures:
    - x86_64
    - i686
  certificate: ""
  certificate_fingerprint: eb04f6aaaa58792d320e4aeaa831ecb7fb59955db24bba62a178ab69143ffb34
  driver: lxc | qemu
  driver_version: 7.0.0 | 11.0.2
  firewall: nftables
  kernel: Linux
  kernel_architecture: x86_64
  kernel_features: {}
  kernel_version: 6.12.95+deb13-amd64
  lxc_features: {}
  os_name: Debian GNU/Linux
  os_version: "13"
  project: default
  server: incus
  server_clustered: true
  server_event_mode: full-mesh
  server_name: trim-computes-shr-incus-04
  server_pid: 24492
  server_version: "7.2"
  storage: lvm | dir | lvmcluster
  storage_version: 2.03.31(2) (2025-02-27) / 1.02.205 (2025-02-27) / 4.48.0 | 1 |
    2.03.31(2) (2025-02-27) / 1.02.205 (2025-02-27) / 4.48.0
  storage_supported_drivers:
    - name: btrfs
      version: "6.14"
      remote: false
    - name: dir
      version: "1"
      remote: false
    - name: lvmcluster
      version: 2.03.31(2) (2025-02-27) / 1.02.205 (2025-02-27) / 4.48.0
      remote: true
    - name: truenas
      version: 0.7.7
      remote: true
    - name: lvm
      version: 2.03.31(2) (2025-02-27) / 1.02.205 (2025-02-27) / 4.48.0
      remote: false

migrate to nodes-4

root@trim-computes-shr-incus-02:/home/super# incus move test-migrate-vm --target trim-computes-shr-incus-04 --project Staging
Error: Migration operation failure: Instance move to destination failed on source: Failed migration on source: Error from migration control target: Failed creating instance on target: The configured target instance root disk size is smaller than the migration source

Info Target Server Each Servers

root@trim-computes-shr-incus-02:/home/super# incus info --target trim-computes-shr-incus-01
config:
  cluster.https_address: 10.25.3.50:8443
  core.https_address: 10.25.3.50:8443
  oidc.audience: xxxxxxxxxxxxxxxxx
  oidc.client.id: xxxxxxxxxxxxxxxxx
  oidc.issuer: https://xxxxxxxxxxxxxx/application/o/incus-xxxxxxxx-cluster-01/
  user.ui.sso_only: "true"
  user.ui.title: Incus Cluster 01 xxxxxxxx
api_extensions_count: 529
api_status: stable
api_version: "1.0"
auth: trusted
public: false
auth_methods:
  - tls
  - oidc
auth_user_name: root
auth_user_method: unix
environment:
  addresses:
    - 10.25.3.50:8443
  architectures:
    - x86_64
    - i686
  certificate: ""
  certificate_fingerprint: eb04f6aaaa58792d320e4aeaa831ecb7fb59955db24bba62a178ab69143ffb34
  driver: lxc | qemu
  driver_version: 7.0.0 | 11.0.2
  firewall: nftables
  kernel: Linux
  kernel_architecture: x86_64
  kernel_features: {}
  kernel_version: 6.12.86+deb13-amd64
  lxc_features: {}
  os_name: Debian GNU/Linux
  os_version: "13"
  project: default
  server: incus
  server_clustered: true
  server_event_mode: full-mesh
  server_name: trim-computes-shr-incus-01
  server_pid: 344060
  server_version: "7.2"
  storage: dir | lvmcluster
  storage_version: 1 | 2.03.31(2) (2025-02-27) / 1.02.205 (2025-02-27) / 4.48.0
  storage_supported_drivers:
    - name: dir
      version: "1"
      remote: false
    - name: lvm
      version: 2.03.31(2) (2025-02-27) / 1.02.205 (2025-02-27) / 4.48.0
      remote: false
    - name: lvmcluster
      version: 2.03.31(2) (2025-02-27) / 1.02.205 (2025-02-27) / 4.48.0
      remote: true
    - name: truenas
      version: 0.7.7
      remote: true
    - name: zfs
      version: 2.3.2-2
      remote: false
    - name: btrfs
      version: "6.14"
      remote: false
root@trim-computes-shr-incus-02:/home/super# incus info --target trim-computes-shr-incus-02
config:
  cluster.https_address: 10.25.3.51:8443
  core.https_address: 10.25.3.51:8443
  oidc.audience: xxxxxxxxxxxxxxxxx
  oidc.client.id: xxxxxxxxxxxxxxxxx
  oidc.issuer: https://xxxxxxxxxxxxxx/application/o/incus-xxxxxxxx-cluster-01/
  user.ui.sso_only: "true"
  user.ui.title: Incus Cluster 01 xxxxxxxx
api_extensions_count: 529
api_status: stable
api_version: "1.0"
auth: trusted
public: false
auth_methods:
  - tls
  - oidc
auth_user_name: root
auth_user_method: unix
environment:
  addresses:
    - 10.25.3.51:8443
  architectures:
    - x86_64
    - i686
  certificate: ""
  certificate_fingerprint: eb04f6aaaa58792d320e4aeaa831ecb7fb59955db24bba62a178ab69143ffb34
  driver: lxc | qemu
  driver_version: 7.0.0 | 11.0.2
  firewall: nftables
  kernel: Linux
  kernel_architecture: x86_64
  kernel_features: {}
  kernel_version: 6.12.86+deb13-amd64
  lxc_features: {}
  os_name: Debian GNU/Linux
  os_version: "13"
  project: default
  server: incus
  server_clustered: true
  server_event_mode: full-mesh
  server_name: trim-computes-shr-incus-02
  server_pid: 142338
  server_version: "7.2"
  storage: dir | lvm | lvmcluster
  storage_version: 1 | 2.03.31(2) (2025-02-27) / 1.02.205 (2025-02-27) / 4.48.0 |
    2.03.31(2) (2025-02-27) / 1.02.205 (2025-02-27) / 4.48.0
  storage_supported_drivers:
    - name: dir
      version: "1"
      remote: false
    - name: truenas
      version: 0.7.7
      remote: true
    - name: btrfs
      version: "6.14"
      remote: false
    - name: lvm
      version: 2.03.31(2) (2025-02-27) / 1.02.205 (2025-02-27) / 4.48.0
      remote: false
    - name: lvmcluster
      version: 2.03.31(2) (2025-02-27) / 1.02.205 (2025-02-27) / 4.48.0
      remote: true
root@trim-computes-shr-incus-02:/home/super# incus info --target trim-computes-shr-incus-03
config:
  cluster.https_address: 10.25.3.52:8443
  core.https_address: 10.25.3.52:8443
  oidc.audience: xxxxxxxxxxxxxxxxx
  oidc.client.id: xxxxxxxxxxxxxxxxx
  oidc.issuer: https://xxxxxxxxxxxxxx/application/o/incus-xxxxxxxx-cluster-01/
  user.ui.sso_only: "true"
  user.ui.title: Incus Cluster 01 xxxxxxxx
api_extensions_count: 529
api_status: stable
api_version: "1.0"
auth: trusted
public: false
auth_methods:
  - tls
  - oidc
auth_user_name: root
auth_user_method: unix
environment:
  addresses:
    - 10.25.3.52:8443
  architectures:
    - x86_64
    - i686
  certificate: ""
  certificate_fingerprint: eb04f6aaaa58792d320e4aeaa831ecb7fb59955db24bba62a178ab69143ffb34
  driver: lxc | qemu
  driver_version: 7.0.0 | 11.0.2
  firewall: nftables
  kernel: Linux
  kernel_architecture: x86_64
  kernel_features: {}
  kernel_version: 6.12.86+deb13-amd64
  lxc_features: {}
  os_name: Debian GNU/Linux
  os_version: "13"
  project: default
  server: incus
  server_clustered: true
  server_event_mode: full-mesh
  server_name: trim-computes-shr-incus-03
  server_pid: 2323156
  server_version: "7.2"
  storage: lvm | lvmcluster | dir
  storage_version: 2.03.31(2) (2025-02-27) / 1.02.205 (2025-02-27) / 4.48.0 | 2.03.31(2)
    (2025-02-27) / 1.02.205 (2025-02-27) / 4.48.0 | 1
  storage_supported_drivers:
    - name: btrfs
      version: "6.14"
      remote: false
    - name: lvm
      version: 2.03.31(2) (2025-02-27) / 1.02.205 (2025-02-27) / 4.48.0
      remote: false
    - name: lvmcluster
      version: 2.03.31(2) (2025-02-27) / 1.02.205 (2025-02-27) / 4.48.0
      remote: true
    - name: truenas
      version: 0.7.7
      remote: true
    - name: dir
      version: "1"
      remote: false
root@trim-computes-shr-incus-02:/home/super# incus info --target trim-computes-shr-incus-04
config:
  cluster.https_address: 10.25.3.53:8443
  core.https_address: 10.25.3.53:8443
  oidc.audience: xxxxxxxxxxxxxxxxx
  oidc.client.id: xxxxxxxxxxxxxxxxx
  oidc.issuer: https://xxxxxxxxxxxxxx/application/o/incus-xxxxxxxx-cluster-01/
  user.ui.sso_only: "true"
  user.ui.title: Incus Cluster 01 xxxxxxxx
api_extensions_count: 529
api_status: stable
api_version: "1.0"
auth: trusted
public: false
auth_methods:
  - tls
  - oidc
auth_user_name: root
auth_user_method: unix
environment:
  addresses:
    - 10.25.3.53:8443
  architectures:
    - x86_64
    - i686
  certificate: ""
  certificate_fingerprint: eb04f6aaaa58792d320e4aeaa831ecb7fb59955db24bba62a178ab69143ffb34
  driver: lxc | qemu
  driver_version: 7.0.0 | 11.0.2
  firewall: nftables
  kernel: Linux
  kernel_architecture: x86_64
  kernel_features: {}
  kernel_version: 6.12.95+deb13-amd64
  lxc_features: {}
  os_name: Debian GNU/Linux
  os_version: "13"
  project: default
  server: incus
  server_clustered: true
  server_event_mode: full-mesh
  server_name: trim-computes-shr-incus-04
  server_pid: 24492
  server_version: "7.2"
  storage: dir | lvmcluster | lvm
  storage_version: 1 | 2.03.31(2) (2025-02-27) / 1.02.205 (2025-02-27) / 4.48.0 |
    2.03.31(2) (2025-02-27) / 1.02.205 (2025-02-27) / 4.48.0
  storage_supported_drivers:
    - name: btrfs
      version: "6.14"
      remote: false
    - name: dir
      version: "1"
      remote: false
    - name: lvmcluster
      version: 2.03.31(2) (2025-02-27) / 1.02.205 (2025-02-27) / 4.48.0
      remote: true
    - name: truenas
      version: 0.7.7
      remote: true
    - name: lvm
      version: 2.03.31(2) (2025-02-27) / 1.02.205 (2025-02-27) / 4.48.0
      remote: false

If I do this like your sample migration in default project. migrate vm to other nodes, from nodes-1 to nodes-2 | ok. fom nodes-2 to nodes-1 | ok, move again from nodes-1 to nodes-2 we get error btrfs input/output error

The btrfs input/output error is probably unrelated, though make sure that you only see the QEMU process for that VM on a single server.

You can usually work around an issue like that with incus query /1.0/instances/test-migrate-vm/debug/repair -X POST -d '{"action": "rebuild-config-volume"}'

So looks like the issue has something to do with the project here, will have to look closer into that.

Hmm, nope, not the project either:

stgraber@vorash-d13:~ (incus:dev-cluster02/default)$ incus list --project migration foo
+------+---------+------+------+-----------------+-----------+----------+
| NAME |  STATE  | IPV4 | IPV6 |      TYPE       | SNAPSHOTS | LOCATION |
+------+---------+------+------+-----------------+-----------+----------+
| foo  | STOPPED |      |      | VIRTUAL-MACHINE | 0         | entak    |
+------+---------+------+------+-----------------+-----------+----------+
stgraber@vorash-d13:~ (incus:dev-cluster02/default)$ incus move foo --target asuras --project migration
stgraber@vorash-d13:~ (incus:dev-cluster02/default)$

Project was a red herring, actual issue is instance config with fixed size value and how some of the rounding and QCOW2 overhead is calculated, so whether it shows up or not may vary based on size.

(post deleted by author)

issue still in there after rebuild

super@trim-computes-shr-incus-01:~$ incus list
+------+---------+------+------+-----------------+-----------+----------------------------+
| NAME |  STATE  | IPV4 | IPV6 |      TYPE       | SNAPSHOTS |          LOCATION          |
+------+---------+------+------+-----------------+-----------+----------------------------+
| foo  | STOPPED |      |      | VIRTUAL-MACHINE | 0         | trim-computes-shr-incus-01 |
+------+---------+------+------+-----------------+-----------+----------------------------+
super@trim-computes-shr-incus-01:~$ incus list --project Staging | grep migrate-vm
| test-migrate-vm                 | STOPPED |                          |      | VIRTUAL-MACHINE | 0         | trim-computes-shr-incus-02 |
super@trim-computes-shr-incus-01:~$ incus query "/1.0/instances/test-migrate-vm/debug/repair?project=Staging" -X POST -d '{"action": "rebuild-config-volume"}'
super@trim-computes-shr-incus-01:~$ incus move test-migrate-vm --target trim-computes-shr-incus-03 --project Staging
Error: Migration operation failure: Instance move to destination failed on source: Failed migration on source: Error from migration control target: Failed creating instance on target: The configured target instance root disk size is smaller than the migration source

details debug

incus --debug move test-migrate-vm --target trim-computes-shr-incus-03 --project Staging
DEBUG  [2026-07-21T08:33:29+07:00] Connecting to a local Incus over a Unix socket
DEBUG  [2026-07-21T08:33:29+07:00] Sending request to Incus                      etag= method=GET url="http://unix.socket/1.0"
DEBUG  [2026-07-21T08:33:29+07:00] Got response struct from Incus
DEBUG  [2026-07-21T08:33:29+07:00]
	{
		"config": {
			"cluster.https_address": "10.25.3.50:8443",
			"core.https_address": "10.25.3.50:8443",
			"oidc.audience": "xxxxxxxxxxxxx",
			"oidc.client.id": "xxxxxxxxxxxxxx",
			"oidc.issuer": "https://xxxxxxxxxxx/application/o/incus-xxxxxxxx-cluster-01/",
			"user.ui.sso_only": "true",
			"user.ui.title": "Incus Cluster 01 xxxxxxxx"
		},
		"api_extensions": [
			"storage_zfs_remove_snapshots",
			"container_host_shutdown_timeout",
			"container_stop_priority",
			"container_syscall_filtering",
			"auth_pki",
			"container_last_used_at",
			"etag",
			"patch",
			"usb_devices",
			"https_allowed_credentials",
			"image_compression_algorithm",
			"directory_manipulation",
			"container_cpu_time",
			"storage_zfs_use_refquota",
			"storage_lvm_mount_options",
			"network",
			"profile_usedby",
			"container_push",
			"container_exec_recording",
			"certificate_update",
			"container_exec_signal_handling",
			"gpu_devices",
			"container_image_properties",
			"migration_progress",
			"id_map",
			"network_firewall_filtering",
			"network_routes",
			"storage",
			"file_delete",
			"file_append",
			"network_dhcp_expiry",
			"storage_lvm_vg_rename",
			"storage_lvm_thinpool_rename",
			"network_vlan",
			"image_create_aliases",
			"container_stateless_copy",
			"container_only_migration",
			"storage_zfs_clone_copy",
			"unix_device_rename",
			"storage_lvm_use_thinpool",
			"storage_rsync_bwlimit",
			"network_vxlan_interface",
			"storage_btrfs_mount_options",
			"entity_description",
			"image_force_refresh",
			"storage_lvm_lv_resizing",
			"id_map_base",
			"file_symlinks",
			"container_push_target",
			"network_vlan_physical",
			"storage_images_delete",
			"container_edit_metadata",
			"container_snapshot_stateful_migration",
			"storage_driver_ceph",
			"storage_ceph_user_name",
			"resource_limits",
			"storage_volatile_initial_source",
			"storage_ceph_force_osd_reuse",
			"storage_block_filesystem_btrfs",
			"resources",
			"kernel_limits",
			"storage_api_volume_rename",
			"network_sriov",
			"console",
			"restrict_dev_incus",
			"migration_pre_copy",
			"infiniband",
			"dev_incus_events",
			"proxy",
			"network_dhcp_gateway",
			"file_get_symlink",
			"network_leases",
			"unix_device_hotplug",
			"storage_api_local_volume_handling",
			"operation_description",
			"clustering",
			"event_lifecycle",
			"storage_api_remote_volume_handling",
			"nvidia_runtime",
			"container_mount_propagation",
			"container_backup",
			"dev_incus_images",
			"container_local_cross_pool_handling",
			"proxy_unix",
			"proxy_udp",
			"clustering_join",
			"proxy_tcp_udp_multi_port_handling",
			"network_state",
			"proxy_unix_dac_properties",
			"container_protection_delete",
			"unix_priv_drop",
			"pprof_http",
			"proxy_haproxy_protocol",
			"network_hwaddr",
			"proxy_nat",
			"network_nat_order",
			"container_full",
			"backup_compression",
			"nvidia_runtime_config",
			"storage_api_volume_snapshots",
			"storage_unmapped",
			"projects",
			"network_vxlan_ttl",
			"container_incremental_copy",
			"usb_optional_vendorid",
			"snapshot_scheduling",
			"snapshot_schedule_aliases",
			"container_copy_project",
			"clustering_server_address",
			"clustering_image_replication",
			"container_protection_shift",
			"snapshot_expiry",
			"container_backup_override_pool",
			"snapshot_expiry_creation",
			"network_leases_location",
			"resources_cpu_socket",
			"resources_gpu",
			"resources_numa",
			"kernel_features",
			"id_map_current",
			"event_location",
			"storage_api_remote_volume_snapshots",
			"network_nat_address",
			"container_nic_routes",
			"cluster_internal_copy",
			"seccomp_notify",
			"lxc_features",
			"container_nic_ipvlan",
			"network_vlan_sriov",
			"storage_cephfs",
			"container_nic_ipfilter",
			"resources_v2",
			"container_exec_user_group_cwd",
			"container_syscall_intercept",
			"container_disk_shift",
			"storage_shifted",
			"resources_infiniband",
			"daemon_storage",
			"instances",
			"image_types",
			"resources_disk_sata",
			"clustering_roles",
			"images_expiry",
			"resources_network_firmware",
			"backup_compression_algorithm",
			"ceph_data_pool_name",
			"container_syscall_intercept_mount",
			"compression_squashfs",
			"container_raw_mount",
			"container_nic_routed",
			"container_syscall_intercept_mount_fuse",
			"container_disk_ceph",
			"virtual-machines",
			"image_profiles",
			"clustering_architecture",
			"resources_disk_id",
			"storage_lvm_stripes",
			"vm_boot_priority",
			"unix_hotplug_devices",
			"api_filtering",
			"instance_nic_network",
			"clustering_sizing",
			"firewall_driver",
			"projects_limits",
			"container_syscall_intercept_hugetlbfs",
			"limits_hugepages",
			"container_nic_routed_gateway",
			"projects_restrictions",
			"custom_volume_snapshot_expiry",
			"volume_snapshot_scheduling",
			"trust_ca_certificates",
			"snapshot_disk_usage",
			"clustering_edit_roles",
			"container_nic_routed_host_address",
			"container_nic_ipvlan_gateway",
			"resources_usb_pci",
			"resources_cpu_threads_numa",
			"resources_cpu_core_die",
			"api_os",
			"container_nic_routed_host_table",
			"container_nic_ipvlan_host_table",
			"container_nic_ipvlan_mode",
			"resources_system",
			"images_push_relay",
			"network_dns_search",
			"container_nic_routed_limits",
			"instance_nic_bridged_vlan",
			"network_state_bond_bridge",
			"usedby_consistency",
			"custom_block_volumes",
			"clustering_failure_domains",
			"resources_gpu_mdev",
			"console_vga_type",
			"projects_limits_disk",
			"network_type_macvlan",
			"network_type_sriov",
			"container_syscall_intercept_bpf_devices",
			"network_type_ovn",
			"projects_networks",
			"projects_networks_restricted_uplinks",
			"custom_volume_backup",
			"backup_override_name",
			"storage_rsync_compression",
			"network_type_physical",
			"network_ovn_external_subnets",
			"network_ovn_nat",
			"network_ovn_external_routes_remove",
			"tpm_device_type",
			"storage_zfs_clone_copy_rebase",
			"gpu_mdev",
			"resources_pci_iommu",
			"resources_network_usb",
			"resources_disk_address",
			"network_physical_ovn_ingress_mode",
			"network_ovn_dhcp",
			"network_physical_routes_anycast",
			"projects_limits_instances",
			"network_state_vlan",
			"instance_nic_bridged_port_isolation",
			"instance_bulk_state_change",
			"network_gvrp",
			"instance_pool_move",
			"gpu_sriov",
			"pci_device_type",
			"storage_volume_state",
			"network_acl",
			"migration_stateful",
			"disk_state_quota",
			"storage_ceph_features",
			"projects_compression",
			"projects_images_remote_cache_expiry",
			"certificate_project",
			"network_ovn_acl",
			"projects_images_auto_update",
			"projects_restricted_cluster_target",
			"images_default_architecture",
			"network_ovn_acl_defaults",
			"gpu_mig",
			"project_usage",
			"network_bridge_acl",
			"warnings",
			"projects_restricted_backups_and_snapshots",
			"clustering_join_token",
			"clustering_description",
			"server_trusted_proxy",
			"clustering_update_cert",
			"storage_api_project",
			"server_instance_driver_operational",
			"server_supported_storage_drivers",
			"event_lifecycle_requestor_address",
			"resources_gpu_usb",
			"clustering_evacuation",
			"network_ovn_nat_address",
			"network_bgp",
			"network_forward",
			"custom_volume_refresh",
			"network_counters_errors_dropped",
			"metrics",
			"image_source_project",
			"clustering_config",
			"network_peer",
			"linux_sysctl",
			"network_dns",
			"ovn_nic_acceleration",
			"certificate_self_renewal",
			"instance_project_move",
			"storage_volume_project_move",
			"cloud_init",
			"network_dns_nat",
			"database_leader",
			"instance_all_projects",
			"clustering_groups",
			"ceph_rbd_du",
			"instance_get_full",
			"qemu_metrics",
			"gpu_mig_uuid",
			"event_project",
			"clustering_evacuation_live",
			"instance_allow_inconsistent_copy",
			"network_state_ovn",
			"storage_volume_api_filtering",
			"image_restrictions",
			"storage_zfs_export",
			"network_dns_records",
			"storage_zfs_reserve_space",
			"network_acl_log",
			"storage_zfs_blocksize",
			"metrics_cpu_seconds",
			"instance_snapshot_never",
			"certificate_token",
			"instance_nic_routed_neighbor_probe",
			"event_hub",
			"agent_nic_config",
			"projects_restricted_intercept",
			"metrics_authentication",
			"images_target_project",
			"images_all_projects",
			"cluster_migration_inconsistent_copy",
			"cluster_ovn_chassis",
			"container_syscall_intercept_sched_setscheduler",
			"storage_lvm_thinpool_metadata_size",
			"storage_volume_state_total",
			"instance_file_head",
			"instances_nic_host_name",
			"image_copy_profile",
			"container_syscall_intercept_sysinfo",
			"clustering_evacuation_mode",
			"resources_pci_vpd",
			"qemu_raw_conf",
			"storage_cephfs_fscache",
			"network_load_balancer",
			"vsock_api",
			"instance_ready_state",
			"network_bgp_holdtime",
			"storage_volumes_all_projects",
			"metrics_memory_oom_total",
			"storage_buckets",
			"storage_buckets_create_credentials",
			"metrics_cpu_effective_total",
			"projects_networks_restricted_access",
			"storage_buckets_local",
			"loki",
			"acme",
			"internal_metrics",
			"cluster_join_token_expiry",
			"remote_token_expiry",
			"init_preseed",
			"storage_volumes_created_at",
			"cpu_hotplug",
			"projects_networks_zones",
			"network_txqueuelen",
			"cluster_member_state",
			"instances_placement_scriptlet",
			"storage_pool_source_wipe",
			"zfs_block_mode",
			"instance_generation_id",
			"disk_io_cache",
			"amd_sev",
			"storage_pool_loop_resize",
			"migration_vm_live",
			"ovn_nic_nesting",
			"oidc",
			"network_ovn_l3only",
			"ovn_nic_acceleration_vdpa",
			"cluster_healing",
			"instances_state_total",
			"auth_user",
			"security_csm",
			"instances_rebuild",
			"numa_cpu_placement",
			"custom_volume_iso",
			"network_allocations",
			"zfs_delegate",
			"storage_api_remote_volume_snapshot_copy",
			"operations_get_query_all_projects",
			"metadata_configuration",
			"syslog_socket",
			"event_lifecycle_name_and_project",
			"instances_nic_limits_priority",
			"disk_initial_volume_configuration",
			"operation_wait",
			"image_restriction_privileged",
			"cluster_internal_custom_volume_copy",
			"disk_io_bus",
			"storage_cephfs_create_missing",
			"instance_move_config",
			"ovn_ssl_config",
			"certificate_description",
			"disk_io_bus_virtio_blk",
			"loki_config_instance",
			"instance_create_start",
			"clustering_evacuation_stop_options",
			"boot_host_shutdown_action",
			"agent_config_drive",
			"network_state_ovn_lr",
			"image_template_permissions",
			"storage_bucket_backup",
			"storage_lvm_cluster",
			"shared_custom_block_volumes",
			"auth_tls_jwt",
			"oidc_claim",
			"device_usb_serial",
			"numa_cpu_balanced",
			"image_restriction_nesting",
			"network_integrations",
			"instance_memory_swap_bytes",
			"network_bridge_external_create",
			"network_zones_all_projects",
			"storage_zfs_vdev",
			"container_migration_stateful",
			"profiles_all_projects",
			"instances_scriptlet_get_instances",
			"instances_scriptlet_get_cluster_members",
			"instances_scriptlet_get_project",
			"network_acl_stateless",
			"instance_state_started_at",
			"networks_all_projects",
			"network_acls_all_projects",
			"storage_buckets_all_projects",
			"resources_load",
			"instance_access",
			"project_access",
			"projects_force_delete",
			"resources_cpu_flags",
			"disk_io_bus_cache_filesystem",
			"instance_oci",
			"clustering_groups_config",
			"instances_lxcfs_per_instance",
			"clustering_groups_vm_cpu_definition",
			"disk_volume_subpath",
			"projects_limits_disk_pool",
			"network_ovn_isolated",
			"qemu_raw_qmp",
			"network_load_balancer_health_check",
			"oidc_scopes",
			"network_integrations_peer_name",
			"qemu_scriptlet",
			"instance_auto_restart",
			"storage_lvm_metadatasize",
			"ovn_nic_promiscuous",
			"ovn_nic_ip_address_none",
			"instances_state_os_info",
			"network_load_balancer_state",
			"instance_nic_macvlan_mode",
			"storage_lvm_cluster_create",
			"network_ovn_external_interfaces",
			"instances_scriptlet_get_instances_count",
			"cluster_rebalance",
			"custom_volume_refresh_exclude_older_snapshots",
			"storage_initial_owner",
			"storage_live_migration",
			"instance_console_screenshot",
			"image_import_alias",
			"authorization_scriptlet",
			"console_force",
			"network_ovn_state_addresses",
			"network_bridge_acl_devices",
			"instance_debug_memory",
			"init_preseed_storage_volumes",
			"init_preseed_profile_project",
			"instance_nic_routed_host_address",
			"instance_smbios11",
			"api_filtering_extended",
			"acme_dns01",
			"security_iommu",
			"network_ipv4_dhcp_routes",
			"network_state_ovn_ls",
			"network_dns_nameservers",
			"acme_http01_port",
			"network_ovn_ipv4_dhcp_expiry",
			"instance_state_cpu_time",
			"network_io_bus",
			"disk_io_bus_usb",
			"storage_driver_linstor",
			"instance_oci_entrypoint",
			"network_address_set",
			"server_logging",
			"network_forward_snat",
			"memory_hotplug",
			"instance_nic_routed_host_tables",
			"instance_publish_split",
			"init_preseed_certificates",
			"custom_volume_sftp",
			"network_ovn_external_nic_address",
			"network_physical_gateway_hwaddr",
			"backup_s3_upload",
			"snapshot_manual_expiry",
			"resources_cpu_address_sizes",
			"disk_attached",
			"limits_memory_hotplug",
			"disk_wwn",
			"server_logging_webhook",
			"storage_driver_truenas",
			"container_disk_tmpfs",
			"instance_limits_oom",
			"backup_override_config",
			"network_ovn_tunnels",
			"init_preseed_cluster_groups",
			"usb_attached",
			"backup_iso",
			"instance_systemd_credentials",
			"cluster_group_usedby",
			"bpf_token_delegation",
			"file_storage_volume",
			"network_hwaddr_pattern",
			"storage_volume_full",
			"storage_bucket_full",
			"device_pci_firmware",
			"resources_serial",
			"ovn_nic_limits",
			"storage_lvmcluster_qcow2",
			"oidc_allowed_subnets",
			"file_delete_force",
			"nic_sriov_select_ext",
			"network_zones_dns_contact",
			"nic_attached_connected",
			"nic_sriov_security_trusted",
			"direct_backup",
			"instance_snapshot_disk_only_restore",
			"unix_hotplug_pci",
			"cluster_evacuating_restoring",
			"projects_restricted_image_servers",
			"storage_lvmcluster_size",
			"authorization_scriptlet_cert",
			"lvmcluster_remove_snapshots",
			"daemon_storage_logs",
			"instances_debug_repair",
			"network_io_bus_ovn",
			"dependent",
			"metrics_project_resources",
			"storage_volume_nbd",
			"projects_restricted_storage_pool_access",
			"server_shutdown_action",
			"instances_placement_scriptlet_rebalance",
			"network_bridge_multicast_snooping",
			"storage_create_options",
			"instances_tpm_platform_cert",
			"linstor_raw",
			"network_address_set_ip_ranges",
			"storage_volumes_rebuild",
			"api_fragments",
			"instance_limits_cpu_topology",
			"instance_nbd",
			"network_bridge_bgp_instances",
			"core_https_allowed_websocket_origin",
			"storage_btrfs_compression",
			"oci_network_config",
			"infiniband_sriov_guid",
			"instance_selinux"
		],
		"api_status": "stable",
		"api_version": "1.0",
		"auth": "trusted",
		"public": false,
		"auth_methods": [
			"tls",
			"oidc"
		],
		"auth_user_name": "super",
		"auth_user_method": "unix",
		"environment": {
			"addresses": [
				"10.25.3.50:8443"
			],
			"architectures": [
				"x86_64",
				"i686"
			],
			"certificate": "-----BEGIN CERTIFICATE-----xxxxxxxxxxxxxxxx-----END CERTIFICATE-----\n",
			"certificate_fingerprint": "eb04f6aaaa58792d320e4aeaa831ecb7fb59955db24bba62a178ab69143ffb34",
			"driver": "lxc | qemu",
			"driver_version": "7.0.0 | 11.0.2",
			"firewall": "nftables",
			"kernel": "Linux",
			"kernel_architecture": "x86_64",
			"kernel_features": {},
			"kernel_version": "6.12.86+deb13-amd64",
			"lxc_features": {},
			"os_name": "Debian GNU/Linux",
			"os_version": "13",
			"project": "default",
			"server": "incus",
			"server_clustered": true,
			"server_event_mode": "full-mesh",
			"server_name": "trim-computes-shr-incus-01",
			"server_pid": 344060,
			"server_version": "7.2",
			"storage": "lvmcluster | dir",
			"storage_version": "2.03.31(2) (2025-02-27) / 1.02.205 (2025-02-27) / 4.48.0 | 1",
			"storage_supported_drivers": [
				{
					"Name": "dir",
					"Version": "1",
					"Remote": false
				},
				{
					"Name": "lvm",
					"Version": "2.03.31(2) (2025-02-27) / 1.02.205 (2025-02-27) / 4.48.0",
					"Remote": false
				},
				{
					"Name": "lvmcluster",
					"Version": "2.03.31(2) (2025-02-27) / 1.02.205 (2025-02-27) / 4.48.0",
					"Remote": true
				},
				{
					"Name": "truenas",
					"Version": "0.7.7",
					"Remote": true
				},
				{
					"Name": "zfs",
					"Version": "2.3.2-2",
					"Remote": false
				},
				{
					"Name": "btrfs",
					"Version": "6.14",
					"Remote": false
				}
			]
		}
	}
DEBUG  [2026-07-21T08:33:29+07:00] Connected to the websocket: ws://unix.socket/1.0/events?project=Staging&target=trim-computes-shr-incus-03
DEBUG  [2026-07-21T08:33:29+07:00] Sending request to Incus                      etag= method=POST url="http://unix.socket/1.0/instances/test-migrate-vm?project=Staging&target=trim-computes-shr-incus-03"
DEBUG  [2026-07-21T08:33:29+07:00]
	{
		"name": "test-migrate-vm",
		"migration": true,
		"live": true,
		"instance_only": false,
		"target": null,
		"pool": "",
		"project": "",
		"allow_inconsistent": false,
		"Config": null,
		"Devices": null,
		"Profiles": null
	}
DEBUG  [2026-07-21T08:33:29+07:00] Got operation from Incus
DEBUG  [2026-07-21T08:33:29+07:00]
	{
		"id": "7b2be58c-aae0-4dc3-b794-4318d7763951",
		"class": "task",
		"description": "Migrating instance",
		"created_at": "2026-07-20T21:33:29.904771754-04:00",
		"updated_at": "2026-07-20T21:33:29.904771754-04:00",
		"status": "Running",
		"status_code": 103,
		"resources": {
			"instances": [
				"/1.0/instances/test-migrate-vm?project=Staging"
			]
		},
		"metadata": {},
		"may_cancel": false,
		"err": "",
		"location": "trim-computes-shr-incus-02"
	}
DEBUG  [2026-07-21T08:33:29+07:00] Sending request to Incus                      etag= method=GET url="http://unix.socket/1.0/operations/7b2be58c-aae0-4dc3-b794-4318d7763951?project=Staging&target=trim-computes-shr-incus-03"
DEBUG  [2026-07-21T08:33:29+07:00] Got response struct from Incus
DEBUG  [2026-07-21T08:33:29+07:00]
	{
		"id": "7b2be58c-aae0-4dc3-b794-4318d7763951",
		"class": "task",
		"description": "Migrating instance",
		"created_at": "2026-07-20T21:33:29.904771754-04:00",
		"updated_at": "2026-07-20T21:33:29.904771754-04:00",
		"status": "Running",
		"status_code": 103,
		"resources": {
			"instances": [
				"/1.0/instances/test-migrate-vm?project=Staging"
			]
		},
		"metadata": {},
		"may_cancel": false,
		"err": "",
		"location": "trim-computes-shr-incus-02"
	}
Error: Migration operation failure: Instance move to destination failed on source: Failed migration on source: Error from migration control target: Failed creating instance on target: The configured target instance root disk size is smaller than the migration source