meme33
(California Polytechnic)
May 24, 2026, 9:18pm
1
Greetings all, I just setup a incus cluster with linstor as the backend. I have this setup somewhere else and it works fine. But I cant seem to make a vm or a container less than 10GB , otherwise I get the following error.
The drives are lvm thin, im kinda scratching my head on this one. I would like for the default value to be maybe 4 GB not 10.
I have tried running the override and also just setting up in profile, but I still cant get smaller volumes. If I create the volume in linstor it does work, but that kinda defeats the purpose. Can anyone help me ?
bensmrs
(Benjamin Somers)
May 24, 2026, 10:20pm
2
LINSTOR unfortunately disabled shrinking DRBD volumes recently. I suggest you to set the volume.size property on your storage pool to the value you want, like 4GiB.
meme33
(California Polytechnic)
May 24, 2026, 10:37pm
3
@bensmrs , I have and I get the same error. I was positive I had a way of setting the size (and from what I remember it was from incus that it was set and not in linstor). But this new install is not allowing me to. I guess it’s thinking that all standard size is 10GiB and if I ask for anything else, it fails because it probably cuts out 10GiB before it reads the size override?
meme33
(California Polytechnic)
May 25, 2026, 1:21am
4
root@gigabyte:/home/mihai# incus create docker:guacamole/guacd guacd-1 -d root,size=2GiB --storage linstor-remote -p default -n guacd
Creating guacd-1
Error: Failed instance creation: Failed creating instance from image: Unable to resize volume definition: Message: ‘Shrinking volumes is not supported by layer ‘DRBD’. Volumes can only grow in size.’; Details: ‘Resource definition: incus-volume-7863a7ecb83742b9ad81fa1d1b99ec3a, Volume number: 0’
Fresh install, nothing on there… its so odd
I just setup a small cluster a few days ago. I havent had a reason for a vm smaller than 10GiB yet, but now that i try im also getting the same issue … @stgraber would this be a good issue to post to github ?
stgraber
(Stéphane Graber)
May 26, 2026, 4:35am
6
It’s not clear that there is an issue yet. That is, other than the Linstor limitation.
As mentioned by @bensmrs , if you need volumes smaller than the default of 10GiB, you need to set volume.size on your pool.
What wasn’t mentioned is that this will only apply to NEW volumes. Any image that you already have on your system will not shrink to the new volume.size if it already has an image volume on the pool.
My suspicion here is that @meme33 already had an optimized image for that particular image and that this optimized image was created prior to the change of volume.size, so creating a new instance with a size lower than 10GiB still fails with the Linstor error.
You can use incus storage volume list and incus storage volume info to check.
incus storage volume delete can also be used to delete any such images, though depending on how the storage driver works, that may not actually be sufficient as there may be ref-counting logic at play which will not fully delete the image unless all downstream clones are gone.
Anyway, if changing volume.size, and not getting the expected behavior, try again with an image that you’ve never used before.
meme33
(California Polytechnic)
May 26, 2026, 4:46am
7
@stgraber I have just tried it with a new alma linux image (as I dont use alma). It gives me the same issue, I cant get it to start unless I set the root size to 10GiB and up.
meme33
(California Polytechnic)
May 26, 2026, 4:49am
8
volume.size is set on my storage pool
stgraber
(Stéphane Graber)
May 26, 2026, 4:50am
9
Interesting, so yeah, that’d point towards a bug in the Linstor image unpack logic as it should really create a volume based on volume.size.
incus monitor --pretty while attempting with another never-before-used image would be interesting as it may tell us more about the sequence of events.
meme33
(California Polytechnic)
May 26, 2026, 5:01am
10
Here is my output from incus monitor
GNU nano 8.4 output
time="2026-05-25T21:58:47-07:00" level=debug msg="[r620] Checking image volume size" driver=linstor fingerprint=9c1ed61288fb4d76427ca030f2d16ea2f16ab468de2e467ea71db798f0ce91d7 pool=linstor-incus
time="2026-05-25T21:58:47-07:00" level=debug msg="[r620] Getting device path" contentType=filesystem vol=9c1ed61288fb4d76427ca030f2d16ea2f16ab468de2e467ea71db798f0ce91d7 volType=images
time="2026-05-25T21:58:47-07:00" level=debug msg="[r620] Queried resource definitions" contentType=filesystem query="Aux/Incus/name=incus-volume-9c1ed61288fb4d76427ca030f2d16ea2f16ab468de2e467ea71db798f0ce91d7" result="[{{incus-volume-09c1ee41a67542d1b3f0957812d11527 map[Aux/Incus/content-type:filesystem Aux/Incus/name:incus-volume-9c1ed61288fb4d76427ca030f2d16ea2f16ab468de2e467ea71db798f0ce91d7 Aux/Incus/type:images DrbdOptions/Net/allow-two-primaries:yes DrbdOptions/Resource/quorum:majority DrbdOptions/auto-verify-alg:crct10dif] [] [{DRBD 0x2f5539cbc3c0} {STORAGE <nil>}] 5b75109f-89df-4419-acd1-79903992bed2 linstor-incus} []>
time="2026-05-25T21:58:47-07:00" level=debug msg="[r620] Setting volume quota" driver=linstor pool=linstor-incus volume=9c1ed61288fb4d76427ca030f2d16ea2f16ab468de2e467ea71db798f0ce91d7
time="2026-05-25T21:58:47-07:00" level=debug msg="[r620] LINSTOR: curl -X 'GET' -H 'Accept: application/json' 'http://4.2.0.2:3370/v1/resource-definitions?props=Aux%2FIncus%2Fname%3Dincus-volume-9c1ed61288fb4d76427ca030f2d16ea2f16ab468de2e467ea71db798f0ce91d7&props=Aux%2FIncus%2Ftype%3Dimages'"
time="2026-05-25T21:58:47-07:00" level=debug msg="[r620] Getting resource definition for volume" contentType=filesystem vol=9c1ed61288fb4d76427ca030f2d16ea2f16ab468de2e467ea71db798f0ce91d7 volType=images
time="2026-05-25T21:58:47-07:00" level=debug msg="[r620] LINSTOR: curl -X 'POST' -d '{}' -H 'Accept: application/json' -H 'Content-Type: application/json' 'http://4.2.0.2:3370/v1/resource-definitions/incus-volume-09c1ee41a67542d1b3f0957812d11527/resources/r620/make-available'"
time="2026-05-25T21:58:47-07:00" level=debug msg="[r620] Queried resource definitions" contentType=filesystem query="Aux/Incus/name=incus-volume-9c1ed61288fb4d76427ca030f2d16ea2f16ab468de2e467ea71db798f0ce91d7" result="[{{incus-volume-09c1ee41a67542d1b3f0957812d11527 map[Aux/Incus/content-type:filesystem Aux/Incus/name:incus-volume-9c1ed61288fb4d76427ca030f2d16ea2f16ab468de2e467ea71db798f0ce91d7 Aux/Incus/type:images DrbdOptions/Net/allow-two-primaries:yes DrbdOptions/Resource/quorum:majority DrbdOptions/auto-verify-alg:crct10dif] [] [{DRBD 0x2f553a238b90} {STORAGE <nil>}] 5b75109f-89df-4419-acd1-79903992bed2 linstor-incus} []>
time="2026-05-25T21:58:47-07:00" level=debug msg="[r620] LINSTOR: curl -X 'GET' -H 'Accept: application/json' 'http://4.2.0.2:3370/v1/resource-definitions/incus-volume-09c1ee41a67542d1b3f0957812d11527/resources/r620/volumes'"
time="2026-05-25T21:58:47-07:00" level=debug msg="[r620] Getting resource definition for volume" contentType=filesystem vol=9c1ed61288fb4d76427ca030f2d16ea2f16ab468de2e467ea71db798f0ce91d7 volType=images
time="2026-05-25T21:58:47-07:00" level=debug msg="[r620] LINSTOR: curl -X 'GET' -H 'Accept: application/json' 'http://4.2.0.2:3370/v1/resource-definitions?props=Aux%2FIncus%2Fname%3Dincus-volume-9c1ed61288fb4d76427ca030f2d16ea2f16ab468de2e467ea71db798f0ce91d7&props=Aux%2FIncus%2Ftype%3Dimages&with_volume_definitions=true'"
time="2026-05-25T21:58:47-07:00" level=debug msg="[r620] Queried resource definitions" contentType=filesystem query="Aux/Incus/name=incus-volume-9c1ed61288fb4d76427ca030f2d16ea2f16ab468de2e467ea71db798f0ce91d7" result="[{{incus-volume-09c1ee41a67542d1b3f0957812d11527 map[Aux/Incus/content-type:filesystem Aux/Incus/name:incus-volume-9c1ed61288fb4d76427ca030f2d16ea2f16ab468de2e467ea71db798f0ce91d7 Aux/Incus/type:images DrbdOptions/Net/allow-two-primaries:yes DrbdOptions/Resource/quorum:majority DrbdOptions/auto-verify-alg:crct10dif] [] [{DRBD 0x2f553beb8320} {STORAGE <nil>}] 5b75109f-89df-4419-acd1-79903992bed2 linstor-incus} [{>
time="2026-05-25T21:58:47-07:00" level=debug msg="[r620] Matched trusted cert" fingerprint=d116d96aec2fd998d779a29e50ea740ac36166d2f2dc9b2d9593a053e187d5e1 subject="CN=root@gigabyte,O=Linux Containers"
time="2026-05-25T21:58:47-07:00" level=debug msg="[r620] Matched trusted cert" fingerprint=d116d96aec2fd998d779a29e50ea740ac36166d2f2dc9b2d9593a053e187d5e1 subject="CN=root@gigabyte,O=Linux Containers"
time="2026-05-25T21:58:47-07:00" level=debug msg="[r620] Handling API request" fingerprint=d116d96aec2fd998d779a29e50ea740ac36166d2f2dc9b2d9593a053e187d5e1 ip="4.4.0.11:55680" method=GET protocol=cluster url="/1.0/instances?project=bdebruhl&recursion=2"
time="2026-05-25T21:58:47-07:00" level=debug msg="[r620] GetInstanceUsage started" driver=linstor instance=myimagetest pool=linstor-incus project=bdebruhl
time="2026-05-25T21:58:47-07:00" level=debug msg="[r620] LINSTOR: curl -X 'GET' -H 'Accept: application/json' 'http://4.2.0.2:3370/v1/resource-definitions?props=Aux%2FIncus%2Fname%3Dincus-volume-bdebruhl_myimagetest&props=Aux%2FIncus%2Ftype%3Dcontainers'"
time="2026-05-25T21:58:47-07:00" level=debug msg="[r620] Getting volume usage" driver=linstor pool=linstor-incus volume=bdebruhl_myimagetest
time="2026-05-25T21:58:47-07:00" level=debug msg="[r620] Getting resource definition for volume" contentType=filesystem vol=bdebruhl_myimagetest volType=containers
time="2026-05-25T21:58:47-07:00" level=error msg="[r620] Error getting disk usage" err="Could not get volume usage: Resource definition not found" instance=myimagetest instanceType=container project=bdebruhl
time="2026-05-25T21:58:47-07:00" level=debug msg="[r620] GetInstanceUsage finished" driver=linstor instance=myimagetest pool=linstor-incus project=bdebruhl
time="2026-05-25T21:58:47-07:00" level=debug msg="[r620] Queried resource definitions" contentType=filesystem query="Aux/Incus/name=incus-volume-bdebruhl_myimagetest" result="[]" vol=bdebruhl_myimagetest volType=containers
time="2026-05-25T21:58:47-07:00" level=debug msg="[r620] Handling API request" fingerprint=d116d96aec2fd998d779a29e50ea740ac36166d2f2dc9b2d9593a053e187d5e1 ip="4.4.0.11:55690" method=GET protocol=cluster url="/1.0/instances/research-networkSecurity-base?project=bhartma&recursion=2"
time="2026-05-25T21:58:47-07:00" level=debug msg="[r620] Matched trusted cert" fingerprint=d116d96aec2fd998d779a29e50ea740ac36166d2f2dc9b2d9593a053e187d5e1 subject="CN=root@gigabyte,O=Linux Containers"
time="2026-05-25T21:58:47-07:00" level=debug msg="[r620] Connecting to a VM agent over a VM socket"
time="2026-05-25T21:58:47-07:00" level=debug msg="[r620] Sending request to Incus" etag= method=GET url="https://custom.socket/1.0"
time="2026-05-25T21:58:47-07:00" level=debug msg="[r620] Got response struct from Incus"
time="2026-05-25T21:58:47-07:00" level=debug msg="[r620] Sending request to Incus" etag= method=GET url="https://custom.socket/1.0/state"
time="2026-05-25T21:58:47-07:00" level=debug msg="[r620] \n\t{\n\t\t\"config\": null,\n\t\t\"api_extensions\": [\n\t\t\t\"storage_zfs_remove_snapshots\",\n\t\t\t\"container_host_shutdown_timeout\",\n\t\t\t\"container_stop_priority\",\n\t\t\t\"container_syscall_filtering\",\n\t\t\t\"auth_pki\",\n\t\t\t\"container_last_used_at\",\n\t\t\t\"etag\",\n\t\t\t\"patch\",\n\t\t\t\"usb_devices\",\n\t\t\t\"https_allowed_credentials\",\n\t\t\t\"image_compression_algorithm\",\n\t\t\t\"directory_manipulation\",\n\t\t\t\"container_cpu_time\",\n\t\t\t\"storage_zfs_use_refquota\",\n\t\t\t\"storage_lvm_mount_options\",\n\t\t\t\"network\",\n\t\t\t>
time="2026-05-25T21:58:47-07:00" level=debug msg="[r620] Got response struct from Incus"
time="2026-05-25T21:58:47-07:00" level=debug msg="[r620] \n\t{\n\t\t\"status\": \"\",\n\t\t\"status_code\": 0,\n\t\t\"disk\": null,\n\t\t\"memory\": {\n\t\t\t\"usage\": 3959304192,\n\t\t\t\"usage_peak\": 0,\n\t\t\t\"total\": 6123995136,\n\t\t\t\"swap_usage\": 0,\n\t\t\t\"swap_usage_peak\": 0\n\t\t},\n\t\t\"network\": {\n\t\t\t\"enp5s0\": {\n\t\t\t\t\"addresses\": [\n\t\t\t\t\t{\n\t\t\t\t\t\t\"family\": \"inet\",\n\t\t\t\t\t\t\"address\": \"10.229.149.39\",\n\t\t\t\t\t\t\"netmask\": \"24\",\n\t\t\t\t\t\t\"scope\": \"global\"\n\t\t\t\t\t},\n\t\t\t\t\t{\n\t\t\t\t\t\t\"family\": \"inet6\",\n\t\t\t\t\t\t\"address\": \"fd42:c68d:af1a>
time="2026-05-25T21:58:47-07:00" level=debug msg="[r620] Getting resource definition for volume" contentType=block vol=bhartma_research-networkSecurity-base volType=virtual-machines
time="2026-05-25T21:58:47-07:00" level=debug msg="[r620] Getting volume usage" driver=linstor pool=linstor-incus volume=bhartma_research-networkSecurity-base
time="2026-05-25T21:58:47-07:00" level=debug msg="[r620] GetInstanceUsage started" driver=linstor instance=research-networkSecurity-base pool=linstor-incus project=bhartma
time="2026-05-25T21:58:47-07:00" level=debug msg="[r620] LINSTOR: curl -X 'GET' -H 'Accept: application/json' 'http://4.2.0.2:3370/v1/resource-definitions?props=Aux%2FIncus%2Fname%3Dincus-volume-bhartma_research-networkSecurity-base&props=Aux%2FIncus%2Ftype%3Dvirtual-machines'"
time="2026-05-25T21:58:47-07:00" level=debug msg="[r620] LINSTOR: curl -X 'GET' -H 'Accept: application/json' 'http://4.2.0.2:3370/v1/view/resources?limit=0&offset=0&resources=incus-volume-63a4aef3080b4206a5c30e5ea617e706'"
time="2026-05-25T21:58:47-07:00" level=debug msg="[r620] Queried resource definitions" contentType=block query="Aux/Incus/name=incus-volume-bhartma_research-networkSecurity-base" result="[{{incus-volume-63a4aef3080b4206a5c30e5ea617e706 map[Aux/Incus/content-type:block Aux/Incus/name:incus-volume-bhartma_research-networkSecurity-base Aux/Incus/type:virtual-machines DrbdOptions/Net/allow-two-primaries:yes DrbdOptions/Resource/quorum:majority DrbdOptions/auto-verify-alg:crct10dif cloned-from:incus-volume-87547ea95b5d4452b7dad54a264c541d] [] [{DRBD 0x2f553aae8460} {STORAGE <nil>}] 73d0f284-c91f-40d9-82e5-0321cb913ae5 linstor-incus>
time="2026-05-25T21:58:47-07:00" level=debug msg="[r620] Volume flags" driver=linstor flags="[DISKLESS DRBD_DISKLESS]" node=r620 pool=linstor-incus volume=bhartma_research-networkSecurity-base
time="2026-05-25T21:58:47-07:00" level=debug msg="[r620] GetInstanceUsage finished" driver=linstor instance=research-networkSecurity-base pool=linstor-incus project=bhartma
time="2026-05-25T21:58:47-07:00" level=debug msg="[r620] Volume flags" driver=linstor flags="[]" node=r730xd-1 pool=linstor-incus volume=bhartma_research-networkSecurity-base
time="2026-05-25T21:58:47-07:00" level=debug msg="[r620] Volume flags" driver=linstor flags="[]" node=r730xd-3 pool=linstor-incus volume=bhartma_research-networkSecurity-base
time="2026-05-25T21:58:47-07:00" level=debug msg="[r620] LINSTOR: curl -X 'GET' -H 'Accept: application/json' 'http://4.2.0.2:3370/v1/resource-definitions?props=Aux%2FIncus%2Fname%3Dincus-volume-9c1ed61288fb4d76427ca030f2d16ea2f16ab468de2e467ea71db798f0ce91d7&props=Aux%2FIncus%2Ftype%3Dimages'"
time="2026-05-25T21:58:47-07:00" level=debug msg="[r620] Getting resource definition for volume" contentType=filesystem vol=9c1ed61288fb4d76427ca030f2d16ea2f16ab468de2e467ea71db798f0ce91d7 volType=images
time="2026-05-25T21:58:47-07:00" level=debug msg="[r620] LINSTOR: curl -X 'PUT' -d '{\"size_kib\":2097152}' -H 'Accept: application/json' -H 'Content-Type: application/json' 'http://4.2.0.2:3370/v1/resource-definitions/incus-volume-09c1ee41a67542d1b3f0957812d11527/volume-definitions/0'"
time="2026-05-25T21:58:47-07:00" level=debug msg="[r620] Queried resource definitions" contentType=filesystem query="Aux/Incus/name=incus-volume-9c1ed61288fb4d76427ca030f2d16ea2f16ab468de2e467ea71db798f0ce91d7" result="[{{incus-volume-09c1ee41a67542d1b3f0957812d11527 map[Aux/Incus/content-type:filesystem Aux/Incus/name:incus-volume-9c1ed61288fb4d76427ca030f2d16ea2f16ab468de2e467ea71db798f0ce91d7 Aux/Incus/type:images DrbdOptions/Net/allow-two-primaries:yes DrbdOptions/Resource/quorum:majority DrbdOptions/auto-verify-alg:crct10dif] [] [{DRBD 0x2f553b5aebe0} {STORAGE <nil>}] 5b75109f-89df-4419-acd1-79903992bed2 linstor-incus} []>
time="2026-05-25T21:58:47-07:00" level=debug msg="[r620] LINSTOR: Status code not within 200 to 400, but 500 (Internal Server Error)\n"
time="2026-05-25T21:58:47-07:00" level=debug msg="[r620] EnsureImage finished" driver=linstor fingerprint=9c1ed61288fb4d76427ca030f2d16ea2f16ab468de2e467ea71db798f0ce91d7 pool=linstor-incus
time="2026-05-25T21:58:47-07:00" level=debug msg="[r620] CreateInstanceFromImage finished" driver=linstor instance=myimagetest pool=linstor-incus project=bdebruhl
time="2026-05-25T21:58:47-07:00" level=debug msg="[r620] Instance operation lock finished" action=create err="<nil>" instance=myimagetest project=bdebruhl reusable=false
time="2026-05-25T21:58:47-07:00" level=debug msg="[r620] Removing device" device=root instance=myimagetest instanceType=container project=bdebruhl type=disk
time="2026-05-25T21:58:47-07:00" level=debug msg="[r620] Failure for operation" class=task description="Creating instance" err="Failed creating instance from image: Unable to resize volume definition: Message: 'Shrinking volumes is not supported by layer 'DRBD'. Volumes can only grow in size.'; Details: 'Resource definition: incus-volume-09c1ee41a67542d1b3f0957812d11527, Volume number: 0'" operation=b3847c73-3503-4568-bd4a-fd35e32ab6f7 project=bdebruhl
time="2026-05-25T21:58:48-07:00" level=debug msg="[r620] Matched trusted cert" fingerprint=d116d96aec2fd998d779a29e50ea740ac36166d2f2dc9b2d9593a053e187d5e1 subject="CN=root@gigabyte,O=Linux Containers"
time="2026-05-25T21:58:48-07:00" level=debug msg="[r620] Matched trusted cert" fingerprint=d116d96aec2fd998d779a29e50ea740ac36166d2f2dc9b2d9593a053e187d5e1 subject="CN=root@gigabyte,O=Linux Containers"
time="2026-05-25T21:58:48-07:00" level=debug msg="[r620] Handling API request" fingerprint=d116d96aec2fd998d779a29e50ea740ac36166d2f2dc9b2d9593a053e187d5e1 ip="4.4.0.11:55704" method=GET protocol=cluster url="/1.0/operations?project=bdebruhl&recursion=1"
time="2026-05-25T21:58:48-07:00" level=debug msg="[r620] Matched trusted cert" fingerprint=d116d96aec2fd998d779a29e50ea740ac36166d2f2dc9b2d9593a053e187d5e1 subject="CN=root@gigabyte,O=Linux Containers"
time="2026-05-25T21:58:48-07:00" level=debug msg="[r620] Matched trusted cert" fingerprint=d116d96aec2fd998d779a29e50ea740ac36166d2f2dc9b2d9593a053e187d5e1 subject="CN=root@gigabyte,O=Linux Containers"
time="2026-05-25T21:58:48-07:00" level=debug msg="[r620] Handling API request" fingerprint=d116d96aec2fd998d779a29e50ea740ac36166d2f2dc9b2d9593a053e187d5e1 ip="4.4.0.11:55720" method=GET protocol=cluster url="/1.0/operations?project=bdebruhl&recursion=1"
time="2026-05-25T21:58:50-07:00" level=debug msg="[r620] Matched trusted cert" fingerprint=d116d96aec2fd998d779a29e50ea740ac36166d2f2dc9b2d9593a053e187d5e1 subject="CN=root@gigabyte,O=Linux Containers"
time="2026-05-25T21:58:50-07:00" level=debug msg="[r620] Handling API request" fingerprint=d116d96aec2fd998d779a29e50ea740ac36166d2f2dc9b2d9593a053e187d5e1 ip="4.4.0.11:55732" method=GET protocol=cluster url="/1.0/operations?all-projects=true&recursion=1"
time="2026-05-25T21:58:50-07:00" level=debug msg="[r620] Matched trusted cert" fingerprint=d116d96aec2fd998d779a29e50ea740ac36166d2f2dc9b2d9593a053e187d5e1 subject="CN=root@gigabyte,O=Linux Containers"
time="2026-05-25T21:58:50-07:00" level=debug msg="[r620] Matched trusted cert" fingerprint=d116d96aec2fd998d779a29e50ea740ac36166d2f2dc9b2d9593a053e187d5e1 subject="CN=root@gigabyte,O=Linux Containers"
time="2026-05-25T21:58:50-07:00" level=debug msg="[r620] Matched trusted cert" fingerprint=d116d96aec2fd998d779a29e50ea740ac36166d2f2dc9b2d9593a053e187d5e1 subject="CN=root@gigabyte,O=Linux Containers"
time="2026-05-25T21:58:50-07:00" level=debug msg="[r620] Handling API request" fingerprint=d116d96aec2fd998d779a29e50ea740ac36166d2f2dc9b2d9593a053e187d5e1 ip="4.4.0.11:55742" method=GET protocol=cluster url="/1.0/operations?all-projects=true&recursion=1"
the image I was trying to make is called myimagetest … here is everything grepped for that
time=“2026-05-25T21:58:47-07:00” level=debug msg=“[r620] Instance operation lock created” action=create instance=myimagetest project=bdebruhl reusable=false
time=“2026-05-25T21:58:47-07:00” level=info msg=“[r620] Creating instance” ephemeral=false instance=myimagetest instanceType=container project=bdebruhl
time=“2026-05-25T21:58:47-07:00” level=debug msg=“[r620] Adding device” device=root instance=myimagetest instanceType=container project=bdebruhl type=disk
time=“2026-05-25T21:58:47-07:00” level=info msg=“[r620] Created instance” ephemeral=false instance=myimagetest instanceType=container project=bdebruhl
time=“2026-05-25T21:58:47-07:00” level=debug msg=“[r620] CreateInstanceFromImage started” driver=linstor instance=myimagetest pool=linstor-incus project=bdebruhl
time=“2026-05-25T21:58:47-07:00” level=debug msg=“[r620] GetInstanceUsage started” driver=linstor instance=myimagetest pool=linstor-incus project=bdebruhl
time=“2026-05-25T21:58:47-07:00” level=debug msg=“[r620] LINSTOR: curl -X ‘GET’ -H ‘Accept: application/json’ ‘http://4.2.0.2:3370/v1/resource-definitions?props=Aux%2FIncus%2Fname%3Dincus-volume-bdebruhl_myimagetest&props=Aux%2FIncus%2Ftype%3Dcontainers’”
time=“2026-05-25T21:58:47-07:00” level=debug msg=“[r620] Getting volume usage” driver=linstor pool=linstor-incus volume=bdebruhl_myimagetest
time=“2026-05-25T21:58:47-07:00” level=debug msg=“[r620] Getting resource definition for volume” contentType=filesystem vol=bdebruhl_myimagetest volType=containers
time=“2026-05-25T21:58:47-07:00” level=error msg=“[r620] Error getting disk usage” err=“Could not get volume usage: Resource definition not found” instance=myimagetest instanceType=container project=bdebruhl
time=“2026-05-25T21:58:47-07:00” level=debug msg=“[r620] GetInstanceUsage finished” driver=linstor instance=myimagetest pool=linstor-incus project=bdebruhl
time=“2026-05-25T21:58:47-07:00” level=debug msg=“[r620] Queried resource definitions” contentType=filesystem query=“Aux/Incus/name=incus-volume-bdebruhl_myimagetest” result=“ ” vol=bdebruhl_myimagetest volType=containers
time=“2026-05-25T21:58:47-07:00” level=debug msg=“[r620] CreateInstanceFromImage finished” driver=linstor instance=myimagetest pool=linstor-incus project=bdebruhl
time=“2026-05-25T21:58:47-07:00” level=debug msg=“[r620] Instance operation lock finished” action=create err=“” instance=myimagetest project=bdebruhl reusable=false
time=“2026-05-25T21:58:47-07:00” level=debug msg=“[r620] Removing device” device=root instance=myimagetest instanceType=container project=bdebruhl type=disk
root@r620:/home/mihai#
bensmrs
(Benjamin Somers)
May 26, 2026, 9:49am
11
Hmmm that’s confusing as I can’t reproduce in my testing environment when volume.size is set… I’ll create another one later this week and dig a bit inside that part of the codebase.
ykazakov
(Yevgeny Kazakov)
May 26, 2026, 5:28pm
12
I get the same error when trying to use root,size=2GiB:
Error: Failed instance creation: Failed creating instance from image: Unable to resize volume definition: Message: ‘Shrinking volumes is not supported by layer ‘DRBD’. Volumes can only grow in size.’;
But after setting volume.size and deleting the previous image, the container is created successfully:
~% incus image ls
+-------+--------------+--------+--------------------------------------+--------------+-----------------+-----------+-----------------------+
| ALIAS | FINGERPRINT | PUBLIC | DESCRIPTION | ARCHITECTURE | TYPE | SIZE | UPLOAD DATE |
+-------+--------------+--------+--------------------------------------+--------------+-----------------+-----------+-----------------------+
| | 6cc88cf1d4fc | no | Debian trixie amd64 (20260526_05:24) | x86_64 | CONTAINER | 100.34MiB | 2026/05/26 19:10 CEST |
+-------+--------------+--------+--------------------------------------+--------------+-----------------+-----------+-----------------------+
| | 8466cf277c03 | no | docker.io/guacamole/guacd (OCI) | x86_64 | CONTAINER | 123.13MiB | 2026/05/26 18:44 CEST |
+-------+--------------+--------+--------------------------------------+--------------+-----------------+-----------+-----------------------+
~ % incus image rm 8466cf277c03
~ % incus storage set remote volume.size=2GiB
~ % incus create docker:guacamole/guacd guacd-1 -d root,size=2GiB --storage remote -p default
Creating guacd-1
~ % incus start guacd-1
~ % incus exec guacd-1 -- df -h /
Filesystem Size Used Available Use% Mounted on
/dev/drbd1012 1.9G 237.5M 1.6G 13% /
On the linstor controller node I see:
# linstor volume-definition list -r incus-volume-d994a147aaa34e6282fcdbf811ba8c7e
╭────────────────────────────────────────────────────────────────────────────────────────────────╮
┊ ResourceName ┊ VolumeNr ┊ VolumeMinor ┊ Size ┊ Gross ┊ State ┊
╞════════════════════════════════════════════════════════════════════════════════════════════════╡
┊ incus-volume-d994a147aaa34e6282fcdbf811ba8c7e ┊ 0 ┊ 1008 ┊ 2 GiB ┊ ┊ ok ┊
╰────────────────────────────────────────────────────────────────────────────────────────────────╯
My cluster is on latest IncusOS 202605181246, incus-linstor 202605181246
bensmrs
(Benjamin Somers)
May 26, 2026, 5:35pm
13
That is similar to my experience (and expectations)
I assume this is something that changed on linstor side?
stgraber
(Stéphane Graber)
May 27, 2026, 6:58pm
15
Yep, they introduced that restriction pretty recently.
So has there been standard call it makes for 10GiB first and then it shrinks it to whatever we setup in the instance config ?
Or was incus calling the right size from the beginning but linstor is just being weird ?
stgraber
(Stéphane Graber)
May 28, 2026, 2:36am
17
Incus has a default volume size of 10GiB, that’s what it will use for any newly unpacked image. If your create a container with a size smaller than that, the container gets a clone of the 10GiB image and that volume then gets shrunk to the configure size.
Because of the Linstor change, this is no longer possible and will fail.
So your options are either to deal with a 10GiB minimum or change volume.size on the pool so Incus uses a size other than 10GiB when unpacking an image.