I just got exactly the same error when trying to setup Linstor in a fresh IncusOS cluster:
The reasone turned out to be the size of the ZFS pool. Apperently, 20 GB is not enough!
If using 20GB volume, the empty Incus volume created using the command incus storage volume create remote fsvol would occupy over 10 GB:
# linstor storage-pool list
╭───────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────╮
┊ StoragePool ┊ Node ┊ Driver ┊ PoolName ┊ FreeCapacity ┊ TotalCapacity ┊ CanSnapshots ┊ State ┊ SharedName ┊
╞═══════════════════════════════════════════════════════════════════════════════════════════════════════════════════════════════════════════════╡
┊ DfltDisklessStorPool ┊ incus-os1 ┊ DISKLESS ┊ ┊ ┊ ┊ False ┊ Ok ┊ incus-os1;DfltDisklessStorPool ┊
┊ DfltDisklessStorPool ┊ incus-os2 ┊ DISKLESS ┊ ┊ ┊ ┊ False ┊ Ok ┊ incus-os2;DfltDisklessStorPool ┊
┊ DfltDisklessStorPool ┊ incus-os3 ┊ DISKLESS ┊ ┊ ┊ ┊ False ┊ Ok ┊ incus-os3;DfltDisklessStorPool ┊
┊ DfltDisklessStorPool ┊ incus-os4 ┊ DISKLESS ┊ ┊ ┊ ┊ False ┊ Ok ┊ incus-os4;DfltDisklessStorPool ┊
┊ remote ┊ incus-os1 ┊ ZFS ┊ linstore ┊ 18.89 GiB ┊ 19.50 GiB ┊ True ┊ Ok ┊ incus-os1;remote ┊
┊ remote ┊ incus-os2 ┊ ZFS ┊ linstore ┊ 18.89 GiB ┊ 19.50 GiB ┊ True ┊ Ok ┊ incus-os2;remote ┊
┊ remote ┊ incus-os3 ┊ ZFS ┊ linstore ┊ 8.73 GiB ┊ 19.50 GiB ┊ True ┊ Ok ┊ incus-os3;remote ┊
┊ remote ┊ incus-os4 ┊ ZFS ┊ linstore ┊ 8.73 GiB ┊ 19.50 GiB ┊ True ┊ Ok ┊ incus-os4;remote ┊
╰───────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────╯
Consequently, cloning/copying of this volume fails:
% incus storage volume copy remote/fsvol remote/fsvol1
Error: Unable to start cloning resource definition: json: cannot unmarshal object into Go value of type client.ApiCallError
It looks like Linstor has a very conservative estimation of the free space required for the cloning operation and probably checks if the free space on the same storage pool (since ZFS can only create snapshots on the same pool) is at least as large as the volume size. Consequently the clone operation fails with the error:
Using a volume on the local pool probably failed for the same reason:
When I used a 50 GB disk for IncusOS (the minimal space requirement), only about 16 GB was available in the local storage pool:
root@linstor-controller1:~# linstor storage-pool create zfs incus-os1 zfs_pool local/linstor
root@linstor-controller1:~# linstor storage-pool create zfs incus-os2 zfs_pool local/linstor
root@linstor-controller1:~# linstor storage-pool create zfs incus-os3 zfs_pool local/linstor
root@linstor-controller1:~# linstor storage-pool create zfs incus-os4 zfs_pool local/linstor
root@linstor-controller1:~# linstor sp l
╭────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────╮
┊ StoragePool ┊ Node ┊ Driver ┊ PoolName ┊ FreeCapacity ┊ TotalCapacity ┊ CanSnapshots ┊ State ┊ SharedName ┊
╞════════════════════════════════════════════════════════════════════════════════════════════════════════════════════════════════════════════════════╡
┊ DfltDisklessStorPool ┊ incus-os1 ┊ DISKLESS ┊ ┊ ┊ ┊ False ┊ Ok ┊ incus-os1;DfltDisklessStorPool ┊
┊ DfltDisklessStorPool ┊ incus-os2 ┊ DISKLESS ┊ ┊ ┊ ┊ False ┊ Ok ┊ incus-os2;DfltDisklessStorPool ┊
┊ DfltDisklessStorPool ┊ incus-os3 ┊ DISKLESS ┊ ┊ ┊ ┊ False ┊ Ok ┊ incus-os3;DfltDisklessStorPool ┊
┊ DfltDisklessStorPool ┊ incus-os4 ┊ DISKLESS ┊ ┊ ┊ ┊ False ┊ Ok ┊ incus-os4;DfltDisklessStorPool ┊
┊ zfs_pool ┊ incus-os1 ┊ ZFS ┊ local/linstor ┊ 15.16 GiB ┊ 16.50 GiB ┊ True ┊ Ok ┊ incus-os1;zfs_pool ┊
┊ zfs_pool ┊ incus-os2 ┊ ZFS ┊ local/linstor ┊ 14.87 GiB ┊ 16.50 GiB ┊ True ┊ Ok ┊ incus-os2;zfs_pool ┊
┊ zfs_pool ┊ incus-os3 ┊ ZFS ┊ local/linstor ┊ 14.98 GiB ┊ 16.50 GiB ┊ True ┊ Ok ┊ incus-os3;zfs_pool ┊
┊ zfs_pool ┊ incus-os4 ┊ ZFS ┊ local/linstor ┊ 15.80 GiB ┊ 16.50 GiB ┊ True ┊ Ok ┊ incus-os4;zfs_pool ┊
╰────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────╯
I changed the disk size to 100 GB (had to reinstall IncusOS as there seem to be no easy way to expand the existing ZFS file system on the last disk partition), and that now was sufficiently large:
root@linstor-controller1:~# linstor storage-pool list
╭────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────╮
┊ StoragePool ┊ Node ┊ Driver ┊ PoolName ┊ FreeCapacity ┊ TotalCapacity ┊ CanSnapshots ┊ State ┊ SharedName ┊
╞════════════════════════════════════════════════════════════════════════════════════════════════════════════════════════════════════════════════════╡
┊ DfltDisklessStorPool ┊ incus-os1 ┊ DISKLESS ┊ ┊ ┊ ┊ False ┊ Ok ┊ incus-os1;DfltDisklessStorPool ┊
┊ DfltDisklessStorPool ┊ incus-os2 ┊ DISKLESS ┊ ┊ ┊ ┊ False ┊ Ok ┊ incus-os2;DfltDisklessStorPool ┊
┊ DfltDisklessStorPool ┊ incus-os3 ┊ DISKLESS ┊ ┊ ┊ ┊ False ┊ Ok ┊ incus-os3;DfltDisklessStorPool ┊
┊ DfltDisklessStorPool ┊ incus-os4 ┊ DISKLESS ┊ ┊ ┊ ┊ False ┊ Ok ┊ incus-os4;DfltDisklessStorPool ┊
┊ zfs_pool ┊ incus-os1 ┊ ZFS ┊ local/linstor ┊ 63.81 GiB ┊ 66.50 GiB ┊ True ┊ Ok ┊ incus-os1;zfs_pool ┊
┊ zfs_pool ┊ incus-os2 ┊ ZFS ┊ local/linstor ┊ 64.34 GiB ┊ 66.50 GiB ┊ True ┊ Ok ┊ incus-os2;zfs_pool ┊
┊ zfs_pool ┊ incus-os3 ┊ ZFS ┊ local/linstor ┊ 64.34 GiB ┊ 66.50 GiB ┊ True ┊ Ok ┊ incus-os3;zfs_pool ┊
┊ zfs_pool ┊ incus-os4 ┊ ZFS ┊ local/linstor ┊ 64.43 GiB ┊ 66.50 GiB ┊ True ┊ Ok ┊ incus-os4;zfs_pool ┊
╰────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────╯
% incus storage volume create remote fsvol
Storage volume fsvol created
% incus storage volume copy remote/fsvol remote/fsvol1
Storage volume copied successfully!
% incus launch images:debian/12 c1 --storage remote
Launching c1
% incus storage volume attach remote fsvol c1 /mnt
% incus launch images:debian/13 v1 --storage remote --vm -c migration.stateful=true
Launching v1
root@linstor-controller1:~# linstor resource-definition list --show-props Aux/Incus/name Aux/Incus/type Aux/Incus/content-type
╭──────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────╮
┊ ResourceName ┊ ResourceGroup ┊ Layers ┊ State ┊ Aux/Incus/name ┊ Aux/Incus/type ┊ Aux/Incus/content-type ┊
╞══════════════════════════════════════════════════════════════════════════════════════════════════════════════════════════════════════════════════════════════════════════════════════════════════════════════════╡
┊ incus-volume-777ec6eb092d4384b92b522d54cb664c ┊ remote ┊ DRBD,STORAGE ┊ ok ┊ incus-volume-internal_fsvol1 ┊ custom ┊ filesystem ┊
┊ incus-volume-ae49130a7dab40539d5dd578a23600b8 ┊ remote ┊ DRBD,STORAGE ┊ ok ┊ incus-volume-internal_fsvol ┊ custom ┊ filesystem ┊
┊ incus-volume-bf67ea1f5e93447ea12505c4528282c4 ┊ remote ┊ DRBD,STORAGE ┊ ok ┊ incus-volume-20afac0c21620ccf1950a160c750acd4e8b692207a4a1130a810b82e515f5fdc ┊ images ┊ block ┊
┊ incus-volume-c4bc004dbf514f1688fc0c5fa5a93867 ┊ remote ┊ DRBD,STORAGE ┊ ok ┊ incus-volume-internal_v1 ┊ virtual-machines ┊ block ┊
┊ incus-volume-d44304e38e0d4913ba856324299fb618 ┊ remote ┊ DRBD,STORAGE ┊ ok ┊ incus-volume-internal_c1 ┊ containers ┊ filesystem ┊
┊ incus-volume-e5405ac549f8476a900532125247ec5b ┊ remote ┊ DRBD,STORAGE ┊ ok ┊ incus-volume-bb5d397a2780afaa037416b3469e6bc72f00e369011dfb5e6540faeeed60dcd7 ┊ images ┊ filesystem ┊
╰──────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────╯
Still, a bit puzzled by the space consumption. Over 40 GB seems a bit large for just one container, one VM and one empty storage pool with a copy:
root@linstor-controller1:~# linstor storage-pool list
╭────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────╮
┊ StoragePool ┊ Node ┊ Driver ┊ PoolName ┊ FreeCapacity ┊ TotalCapacity ┊ CanSnapshots ┊ State ┊ SharedName ┊
╞════════════════════════════════════════════════════════════════════════════════════════════════════════════════════════════════════════════════════╡
┊ DfltDisklessStorPool ┊ incus-os1 ┊ DISKLESS ┊ ┊ ┊ ┊ False ┊ Ok ┊ incus-os1;DfltDisklessStorPool ┊
┊ DfltDisklessStorPool ┊ incus-os2 ┊ DISKLESS ┊ ┊ ┊ ┊ False ┊ Ok ┊ incus-os2;DfltDisklessStorPool ┊
┊ DfltDisklessStorPool ┊ incus-os3 ┊ DISKLESS ┊ ┊ ┊ ┊ False ┊ Ok ┊ incus-os3;DfltDisklessStorPool ┊
┊ DfltDisklessStorPool ┊ incus-os4 ┊ DISKLESS ┊ ┊ ┊ ┊ False ┊ Ok ┊ incus-os4;DfltDisklessStorPool ┊
┊ zfs_pool ┊ incus-os1 ┊ ZFS ┊ local/linstor ┊ 42.96 GiB ┊ 66.50 GiB ┊ True ┊ Ok ┊ incus-os1;zfs_pool ┊
┊ zfs_pool ┊ incus-os2 ┊ ZFS ┊ local/linstor ┊ 43.40 GiB ┊ 66.50 GiB ┊ True ┊ Ok ┊ incus-os2;zfs_pool ┊
┊ zfs_pool ┊ incus-os3 ┊ ZFS ┊ local/linstor ┊ 21.39 GiB ┊ 66.50 GiB ┊ True ┊ Ok ┊ incus-os3;zfs_pool ┊
┊ zfs_pool ┊ incus-os4 ┊ ZFS ┊ local/linstor ┊ 21.82 GiB ┊ 66.50 GiB ┊ True ┊ Ok ┊ incus-os4;zfs_pool ┊
╰────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────╯
Just for the record (mainly to myself), here is the complete setup of Linstor (without SSL) from a freshly created IncusOS cluster:
% incus cluster ls
+-----------+-------------------------------------------------------+------------------+--------------+----------------+-------------+--------+-------------------+
| NAME | URL | ROLES | ARCHITECTURE | FAILURE DOMAIN | DESCRIPTION | STATUS | MESSAGE |
+-----------+-------------------------------------------------------+------------------+--------------+----------------+-------------+--------+-------------------+
| incus-os1 | https://[fd42:470f:55fe:4d36:216:3eff:fe03:6f67]:8443 | database-leader | x86_64 | default | | ONLINE | Fully operational |
| | | database | | | | | |
+-----------+-------------------------------------------------------+------------------+--------------+----------------+-------------+--------+-------------------+
| incus-os2 | https://[fd42:470f:55fe:4d36:216:3eff:fe0e:fea4]:8443 | database | x86_64 | default | | ONLINE | Fully operational |
+-----------+-------------------------------------------------------+------------------+--------------+----------------+-------------+--------+-------------------+
| incus-os3 | https://[fd42:470f:55fe:4d36:216:3eff:fe89:7f20]:8443 | database | x86_64 | default | | ONLINE | Fully operational |
+-----------+-------------------------------------------------------+------------------+--------------+----------------+-------------+--------+-------------------+
| incus-os4 | https://[fd42:470f:55fe:4d36:216:3eff:feda:d82f]:8443 | database-standby | x86_64 | default | | ONLINE | Fully operational |
+-----------+-------------------------------------------------------+------------------+--------------+----------------+-------------+--------+-------------------+
- Launch a container for the Linstor controller in the
internalproject. I used Debian 13 with the instructions from here (just to match the version in IncusOS), but using Ubuntu 24.04 as in the tutorial also worked.
% incus project switch internal
% incus launch images:debian/13 linstor-controller1
% incus exec linstor-controller1 -- bash
root@linstor-controller1:~# apt install ca-certificates
# create:
root@linstor-controller1:~# cat /etc/apt/sources.list.d/linbit.sources
Types: deb
URIs: https://packages.linbit.com/public
Suites: proxmox-9
Components: drbd-9
Architectures: amd64
Signed-By: /etc/apt/keyrings/linbit.asc
root@linstor-controller1:~# cat /etc/apt/keyrings/linbit.asc
-----BEGIN PGP PUBLIC KEY BLOCK-----
xsFNBGZsIboBEADLvvRG52QXsGL7d33xOYQzxjriCdLsXTnBhsC/bQc4dpQBfAp7
FEYhp93NcrwwPXLp5thYHfg3RF/O5pbyvpAnKZJt0rXMEvwy2K3JVJL7ddYs4cU6
I4m1n6W+YYQydEeMmZUFc77DNwQ74Dw3Xx/natz1dK2Y9S0pyBPb2ZMtWwDMuDpV
P/Y/W/wuDMWusbtSjVb+4TXJy046vPBobzi2jtQyaPJFfqwRiYqJYrQmsnns7L3F
ksd63Y4veqK9rvNiYDVXZNsXja0An59rUdwhMlHj/wJWhr23SnSbcQv3hkvY/I19
YT5FD9Y9srmRG2tIiQbK2rAjLqjKNGvYINRBlwnLDCCnoiCLJTahi2CT90aOr0Ae
7QKITi9cpDZJO+/vaLw7JnHEmhpt5W1WySFtSgSQWIYdkhF2Rx1aOkQwT/Ig6rDV
tkA8CjJ4ACMYXAx+zh+pxIRg2JNkLoGdl7pc/+5f4VV9iup3VW5U9MoC3KzZBDGJ
/DNF9x/1Rkf/H7tP3pYU3UmaPOCMvOx3zuwo1qqEUT9pKxybZo+lOPdNVgZbAuKY
C2jJa3Mv64IqyBds9tfZY8Sj+pbhfSvgTSmXR0WARXPS3po1PjUicnrStc+cWfEY
g7vh4Wn2EsExlgmdARvDl1TgENQCLshTI2jTIPu9XXUZlDVltGJZuGem4wARAQAB
zSlMSU5CSVQgUGFja2FnZSBhbmQgUmVwb3NpdG9yeSBTaWduaW5nIEtlecLBjgQT
AQoAOBYhBE5ThVRnJtE8tkmHLPwFox24Jv5IBQJmbCG6AhsDBQsJCAcCBhUKCQgL
AgQWAgMBAh4BAheAAAoJEPwFox24Jv5IaTIP/0qHRPuK0cKPsMEw7Bx+y9liST9y
XC6xEbcWEPm9qkjW73/ZdTLRKI4Ty9UGH7Q0zQ1otUdGYOolidtDAYKS2V3++PwQ
mbESJJiKOeKs1rjXeEBUr0usyhsL3P4/hFLCMf1ctgZNWklanu/N/aMQVjTQoYJu
rDCxq1y58/3hAyrWQ2kITHjVvpP5cXqXpDlwiLKy+oYNxvUdE6FUzNbuQ6htzWyQ
ugmMyjjqjlfD6gC7OqDcXk9eUf7AHbgf5+UQ+RbjMZ+YBoH9gihL/1TI1Ith50NX
5cVRMyscZ9inWFK8Fw2ubD8ZifmIQfrMZJMW0iajgJhX0GAqczl54Ihb08EODeRO
82oOgoeIJ7H14y2WfYA7Pb2Zap6WLrvA+k3arsr94aSDGutpThTBABR9F7F3fOLo
8dlv+jGXnsHtTeU9qh2+ZifyPZ3BVukyizoQk+TDxOavqNryQc7zLpwKsGymRJjP
M3ODV1fUVm6hLgPSMJP0tLakvK76+o/RCr5z5gCUyxjnnV0pbkYLhhE7FtLeSoPb
rxmNRzSFfdXk2uD1idlh54559JdSSh/HzqdZ1biizLs+xJK8JZPZI+3F/whVylwU
iwOhLRojCowfN2DhiiAencH0fsjgec3PT51bdCU6agvH8f6l1ivAuRb1RGT9WGpo
Xe+WxMjgfi4lbTsF
=m29F
-----END PGP PUBLIC KEY BLOCK-----
root@linstor-controller1:~# apt install linstor-controller linstor-client
root@linstor-controller1:~# systemctl enable --now linstor-controller
- Enable the Linstor (sattilite?) service on every IncusOS node:
% incus admin os service edit linstor --target incus-os1
% incus admin os service edit linstor --target incus-os2
% incus admin os service edit linstor --target incus-os3
% incus admin os service edit linstor --target incus-os4
% incus admin os service edit linstor --target incus-os2
% incus admin os service show linstor --target incus-os1
WARNING: The IncusOS API and configuration is subject to change
config:
enabled: true
listen_address: ""
state: {}
- Add the cluster nodes to as satilites inside the Linstor controller container:
% incus cluster ls
+-----------+-------------------------------------------------------+------------------+--------------+----------------+-------------+--------+-------------------+
| NAME | URL | ROLES | ARCHITECTURE | FAILURE DOMAIN | DESCRIPTION | STATUS | MESSAGE |
+-----------+-------------------------------------------------------+------------------+--------------+----------------+-------------+--------+-------------------+
| incus-os1 | https://[fd42:470f:55fe:4d36:216:3eff:fe03:6f67]:8443 | database-leader | x86_64 | default | | ONLINE | Fully operational |
| | | database | | | | | |
+-----------+-------------------------------------------------------+------------------+--------------+----------------+-------------+--------+-------------------+
| incus-os2 | https://[fd42:470f:55fe:4d36:216:3eff:fe0e:fea4]:8443 | database | x86_64 | default | | ONLINE | Fully operational |
+-----------+-------------------------------------------------------+------------------+--------------+----------------+-------------+--------+-------------------+
| incus-os3 | https://[fd42:470f:55fe:4d36:216:3eff:fe89:7f20]:8443 | database | x86_64 | default | | ONLINE | Fully operational |
+-----------+-------------------------------------------------------+------------------+--------------+----------------+-------------+--------+-------------------+
| incus-os4 | https://[fd42:470f:55fe:4d36:216:3eff:feda:d82f]:8443 | database-standby | x86_64 | default | | ONLINE | Fully operational |
+-----------+-------------------------------------------------------+------------------+--------------+----------------+-------------+--------+-------------------+
root@linstor-controller1:~# linstor node create incus-os1 fd42:470f:55fe:4d36:216:3eff:fe03:6f67 --node-type satellite
root@linstor-controller1:~# linstor node create incus-os2 fd42:470f:55fe:4d36:216:3eff:fe0e:fea4 --node-type satellite
root@linstor-controller1:~# linstor node create incus-os3 fd42:470f:55fe:4d36:216:3eff:fe89:7f20 --node-type satellite
root@linstor-controller1:~# linstor node create incus-os4 fd42:470f:55fe:4d36:216:3eff:feda:d82f --node-type satellite
root@linstor-controller1:~# linstor node list
╭──────────────────────────────────────────────────────────────────────────────────────╮
┊ Node ┊ NodeType ┊ Addresses ┊ State ┊
╞══════════════════════════════════════════════════════════════════════════════════════╡
┊ incus-os1 ┊ SATELLITE ┊ FD42:470F:55FE:4D36:216:3EFF:FE03:6F67:3366 (PLAIN) ┊ Online ┊
┊ incus-os2 ┊ SATELLITE ┊ FD42:470F:55FE:4D36:216:3EFF:FE0E:FEA4:3366 (PLAIN) ┊ Online ┊
┊ incus-os3 ┊ SATELLITE ┊ FD42:470F:55FE:4D36:216:3EFF:FE89:7F20:3366 (PLAIN) ┊ Online ┊
┊ incus-os4 ┊ SATELLITE ┊ FD42:470F:55FE:4D36:216:3EFF:FEDA:D82F:3366 (PLAIN) ┊ Online ┊
╰──────────────────────────────────────────────────────────────────────────────────────╯
- Add a ZFS volume to the local Incus storage pool on each node and use it to create a Linstor storage pool:
% incus admin os system storage create-volume -d '{"pool":"local","name":"linstor","use":"linstor"}' --target incus-os1
% incus admin os system storage create-volume -d '{"pool":"local","name":"linstor","use":"linstor"}' --target incus-os2
% incus admin os system storage create-volume -d '{"pool":"local","name":"linstor","use":"linstor"}' --target incus-os3
% incus admin os system storage create-volume -d '{"pool":"local","name":"linstor","use":"linstor"}' --target incus-os4
root@linstor-controller1:~# linstor storage-pool create zfs incus-os1 zfs_pool local/linstor
root@linstor-controller1:~# linstor storage-pool create zfs incus-os2 zfs_pool local/linstor
root@linstor-controller1:~# linstor storage-pool create zfs incus-os3 zfs_pool local/linstor
root@linstor-controller1:~# linstor storage-pool create zfs incus-os4 zfs_pool local/linstor
root@linstor-controller1:~# linstor storage-pool list
╭────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────╮
┊ StoragePool ┊ Node ┊ Driver ┊ PoolName ┊ FreeCapacity ┊ TotalCapacity ┊ CanSnapshots ┊ State ┊ SharedName ┊
╞════════════════════════════════════════════════════════════════════════════════════════════════════════════════════════════════════════════════════╡
┊ DfltDisklessStorPool ┊ incus-os1 ┊ DISKLESS ┊ ┊ ┊ ┊ False ┊ Ok ┊ incus-os1;DfltDisklessStorPool ┊
┊ DfltDisklessStorPool ┊ incus-os2 ┊ DISKLESS ┊ ┊ ┊ ┊ False ┊ Ok ┊ incus-os2;DfltDisklessStorPool ┊
┊ DfltDisklessStorPool ┊ incus-os3 ┊ DISKLESS ┊ ┊ ┊ ┊ False ┊ Ok ┊ incus-os3;DfltDisklessStorPool ┊
┊ DfltDisklessStorPool ┊ incus-os4 ┊ DISKLESS ┊ ┊ ┊ ┊ False ┊ Ok ┊ incus-os4;DfltDisklessStorPool ┊
┊ zfs_pool ┊ incus-os1 ┊ ZFS ┊ local/linstor ┊ 63.81 GiB ┊ 66.50 GiB ┊ True ┊ Ok ┊ incus-os1;zfs_pool ┊
┊ zfs_pool ┊ incus-os2 ┊ ZFS ┊ local/linstor ┊ 64.34 GiB ┊ 66.50 GiB ┊ True ┊ Ok ┊ incus-os2;zfs_pool ┊
┊ zfs_pool ┊ incus-os3 ┊ ZFS ┊ local/linstor ┊ 64.34 GiB ┊ 66.50 GiB ┊ True ┊ Ok ┊ incus-os3;zfs_pool ┊
┊ zfs_pool ┊ incus-os4 ┊ ZFS ┊ local/linstor ┊ 64.43 GiB ┊ 66.50 GiB ┊ True ┊ Ok ┊ incus-os4;zfs_pool ┊
╰────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────╯
- Create the remote storage pool in Incus:
% incus ls
+---------------------+---------+------+--------------------------------------------------+-----------------+-----------+-----------+
| NAME | STATE | IPV4 | IPV6 | TYPE | SNAPSHOTS | LOCATION |
+---------------------+---------+------+--------------------------------------------------+-----------------+-----------+-----------+
| linstor-controller1 | RUNNING | | fd42:cc7e:3e0d:c769:1266:6aff:fe2e:502c (eth0) | CONTAINER | 0 | incus-os1 |
+---------------------+---------+------+--------------------------------------------------+-----------------+-----------+-----------+
% incus config set storage.linstor.controller_connection="http://[fd42:cc7e:3e0d:c769:1266:6aff:fe2e:502c]:3370"
% incus storage create remote linstor --target incus-os1
% incus storage create remote linstor --target incus-os2
% incus storage create remote linstor --target incus-os3
% incus storage create remote linstor --target incus-os4
% incus storage create remote linstor linstor.resource_group.storage_pool=zfs_pool
root@linstor-controller1:~# linstor resource-group list
╭─────────────────────────────────────────────────────────────────────────────────────╮
┊ ResourceGroup ┊ SelectFilter ┊ VlmNrs ┊ Description ┊
╞═════════════════════════════════════════════════════════════════════════════════════╡
┊ DfltRscGrp ┊ PlaceCount: 2 ┊ ┊ ┊
╞┄┄┄┄┄┄┄┄┄┄┄┄┄┄┄┄┄┄┄┄┄┄┄┄┄┄┄┄┄┄┄┄┄┄┄┄┄┄┄┄┄┄┄┄┄┄┄┄┄┄┄┄┄┄┄┄┄┄┄┄┄┄┄┄┄┄┄┄┄┄┄┄┄┄┄┄┄┄┄┄┄┄┄┄┄╡
┊ remote ┊ PlaceCount: 2 ┊ ┊ Resource group managed by Incus ┊
┊ ┊ StoragePool(s): zfs_pool ┊ ┊ ┊
╰─────────────────────────────────────────────────────────────────────────────────────╯
Do I understand it correctly, that with this setup the volume local/linstor is unencrypted, even though the local storage pool is encrypeted?