Incus Move failing with "Storage pool not found"

Incus
1

Hey All,

I recently migrated my VM/Container hosts from the LXD snap to the Incus zabbly package on Ubuntu 22.04. After I got all of the connections back between my hosts I receive the following error while trying to migrate VMs from one host to another: “Error: Failed instance creation: Error transferring instance data: Failed migration on target: Failed loading storage pool: Storage pool not found” Similar to this post: Cannot move VMs, volumes now exist in cluster db but not in ZFS - #4 by baleygr

I’m thinking this is a configuration holdover from when I was using LXD as my storage pool configuration appears to have been set back to default, though on these hosts I left it there originally and the only way I know they may have been reset is the rsync.compression option went unset after the migration.

Are there any common solutions to this problem or any more information I can provide?

Thank you,
Gage

2

Firstly, is this an incus cluster or a set of standalone incus hosts?

Secondly, can you do:

incus config show --expanded <an-affected-container>
incus storage list   # for both source and destination nodes
incus storage show <storage-name>   # for the storage used by the container
incus storage info <storage-name>   # ditto
1 Like
3

It’s a set of 6 standalone hosts, all configured to be the same configuration wise (though two of them use zfs instead of dir for the storage backend).

on dell2: incus config show --expanded UbuntuVNC

architecture: x86_64
config:
  cloud-init.user-data: |
    #cloud-config
    growpart:
      mode: auto
      devices: ['/']
    package_upgrade: true
    packages:
      - git
      - openssh-server
    users:
      - name: gage
        ssh_authorized_keys:
          - ssh-rsa 
          - ssh-rsa 
        passwd: 
        groups: [adm, cdrom, sudo, dip, plugdev]
        sudo: ALL=(ALL) NOPASSWD:ALL
        shell: /bin/bash
        home: /home/gage
        chpasswd: { expire: False }
  image.architecture: amd64
  image.description: ubuntu 23.10 amd64 (release) (20231220)
  image.label: release
  image.os: ubuntu
  image.release: mantic
  image.serial: "20231220"
  image.type: disk1.img
  image.version: "23.10"
  limits.cpu: "4"
  limits.memory: 4GB
  migration.stateful: "false"
  volatile.base_image: d50804c2a478cecf8e289a5699b4954d95f8ca5955316d23a7af2247ec0c294e
  volatile.cloud-init.instance-id: 7a2718bb-3bb8-4f7b-907f-473507c3de50
  volatile.eth40.hwaddr: 00:16:3e:79:5f:bc
  volatile.last_state.power: STOPPED
  volatile.uuid: 72ae98d1-e612-47bf-9b80-a4855fff1b8c
  volatile.uuid.generation: 72ae98d1-e612-47bf-9b80-a4855fff1b8c
  volatile.vsock_id: "1790239100"
devices:
  config:
    source: cloud-init:config
    type: disk
  eth40:
    mtu: "1500"
    nictype: bridged
    parent: br10
    type: nic
    vlan: "40"
  root:
    path: /
    pool: default
    size: 50GiB
    size.state: 0GiB
    type: disk
ephemeral: false
profiles:
- defaultVM
- defaultUser
- vlan40
stateful: false
description: ""

dell2: incus storage list

+---------+--------+--------------------------------------+-------------+---------+---------+
|  NAME   | DRIVER |                SOURCE                | DESCRIPTION | USED BY |  STATE  |
+---------+--------+--------------------------------------+-------------+---------+---------+
| default | dir    | /var/lib/incus/storage-pools/default |             | 18      | CREATED |
+---------+--------+--------------------------------------+-------------+---------+---------+

on dell1: incus storage list

+---------+--------+--------------------------------------+-------------+---------+---------+
|  NAME   | DRIVER |                SOURCE                | DESCRIPTION | USED BY |  STATE  |
+---------+--------+--------------------------------------+-------------+---------+---------+
| default | dir    | /var/lib/incus/storage-pools/default |             | 6       | CREATED |
+---------+--------+--------------------------------------+-------------+---------+---------+

dell2: incus storage show default

config:
  rsync.compression: "false"
  source: /var/lib/incus/storage-pools/default
description: ""
name: default
driver: dir
used_by:
- /1.0/instances/MFSChunk2
- /1.0/instances/UbuntuVNC
- /1.0/instances/VyOSTest0
- /1.0/instances/VyOSTest1
- /1.0/instances/VyOSTest2
- /1.0/instances/code
- /1.0/instances/cp0
- /1.0/instances/jellyfin0
- /1.0/instances/mfsmaster0
- /1.0/instances/mqtt0
- /1.0/instances/ptunnel0
- /1.0/instances/rsync0
- /1.0/instances/sync0
- /1.0/instances/tftp0
- /1.0/profiles/default
- /1.0/profiles/defaultContainer
- /1.0/profiles/defaultVM
- /1.0/profiles/defaultVyOS
status: Created
locations:
- none

on dell1: incus storage show default

config:
  rsync.compression: "false"
  source: /var/lib/incus/storage-pools/default
description: ""
name: default
driver: dir
used_by:
- /1.0/instances/MFSChunk1
- /1.0/instances/v110
- /1.0/profiles/default
- /1.0/profiles/defaultContainer
- /1.0/profiles/defaultVM
- /1.0/profiles/defaultVyOS
status: Created
locations:
- none

on dell2: incus storage info default

info:
  description: ""
  driver: dir
  name: default
  space used: 117.15GiB
  total space: 914.79GiB
used by:
  instances:
  - MFSChunk2
  - UbuntuVNC
  - VyOSTest0
  - VyOSTest1
  - VyOSTest2
  - code
  - cp0
  - jellyfin0
  - mfsmaster0
  - mqtt0
  - ptunnel0
  - rsync0
  - sync0
  - tftp0
  profiles:
  - default
  - defaultContainer
  - defaultVM
  - defaultVyOS

on dell1: incus storage info default

info:
  description: ""
  driver: dir
  name: default
  space used: 17.09GiB
  total space: 914.79GiB
used by:
  instances:
  - MFSChunk1
  - v110
  profiles:
  - default
  - defaultContainer
  - defaultVM
  - defaultVyOS
4

Hey All,

I managed to fix this by exporting all of my instances and just running through the initialization of each host manually and it seems to have fixed the issue. There may be a problem with how the lxd-to-incus migration script works but I’ve solved the crux of my problem so it’s no longer pertinent.

Thank you,
Gage