Troubleshooting "No space left on device" errors

Incus
,
1

Hi,

I have encountered a sudden problem when moving containers to a new storage pool on a different drive - all actions related to moving containers or exporting and importing containers started producing MANY error messages such as “… failed: No space left on device (28)” and “… Cannot open: No space left on device”

I’m trying to import by backed-up or exported on another machine containers to /mnt/dev/lxd storate pool and there is plenty of space on that mounted device:

(base) leonid@xlr2:~$ lxc storage list
+---------+--------+--------------+-------------+---------+---------+
|  NAME   | DRIVER |    SOURCE    | DESCRIPTION | USED BY |  STATE  |
+---------+--------+--------------+-------------+---------+---------+
| default | dir    | /mnt/dev/lxd |             | 7       | CREATED |
+---------+--------+--------------+-------------+---------+---------+
(base) leonid@xlr2:~$
(base) leonid@xlr2:~$ df -Th /mnt/dev
Filesystem     Type  Size  Used Avail Use% Mounted on
/dev/sdm       ext4  931G   94G  837G  11% /mnt/dev
(base) leonid@xlr2:~$
(base) leonid@xlr2:/mnt/dev$ df -Th /var/snap/lxd/common/lxd/disks
Filesystem                        Type  Size  Used Avail Use% Mounted on
/dev/mapper/ubuntu--vg-ubuntu--lv ext4  226G   91G  125G  43% /
(base) leonid@xlr2:/mnt/dev$

Here are the troubleshooting actions that I already attempted unsuccessfully:

  • rebooted machine
  • completely removed and re-installed LXD using snap
  • checked that there are no “deleted” files that are still being used (sudo lsof | grep deleted)
  • tried importing containers originally exported on this machine and also one exported on another machine and copied here
  • ran fsck on the device - all good
  • ran SMART checks on the SDD drive - no errors, all good

My system:

(base) leonid@xlr2:~$ cat /etc/lsb-release
DISTRIB_ID=Ubuntu
DISTRIB_RELEASE=22.04
DISTRIB_CODENAME=jammy
DISTRIB_DESCRIPTION="Ubuntu 22.04.3 LTS"
(base) leonid@xlr2:~$ lxd --version
5.19
(base) leonid@xlr2:~$ lxc --version
5.19
(base) leonid@xlr2:~$

All my attempts result in the same “No space left on device” error :frowning:

How can I find the root cause of my problem?
Thank you.

2

I’m sorry but given the recent actions from Canonical regarding LXD:

We really can’t be providing support to LXD users on this forum anymore.

You may want to consider switching to Incus instead, or if you’d like to stay on LXD, you should reach out on the Canonical forum instead.

Sorry about that!

3

Hi Stéphane,

I appreciate your response and the information provided.

I decided to try migrating my setup to incus because I do not see LXD related support at the CanonicalUbuntu forums at present time.

Unfortunately, I get the same result/errors as shown below:

(base) leonid@xlr2:~$ incus --version
0.4
(base) leonid@xlr2:~$ sudo adduser leonid incus-admin
Adding user `leonid' to group `incus-admin' ...
Adding user leonid to group incus-admin
Done.
(base) leonid@xlr2:~$ newgrp incus-admin
(base) leonid@xlr2:~$
(base) leonid@xlr2:~$ incus info | grep version
api_version: "1.0"
  driver_version: 5.0.3 | 8.1.3
  kernel_version: 5.15.0-91-generic
  os_version: "22.04"
  server_version: "0.4"
  storage_version: "1"
    version: "1"
    version: 2.03.11(2) (2021-01-08) / 1.02.175 (2021-01-08) / 4.45.0
    version: 5.16.2
(base) leonid@xlr2:~$

(base) leonid@xlr2:~$ lxd-to-incus
Error: This tool must be run as root
(base) leonid@xlr2:~$
(base) leonid@xlr2:~$ sudo su -
root@xlr2:~#
root@xlr2:~# lxd-to-incus
=> Looking for source server
==> Detected: snap package
=> Looking for target server
==> Detected: systemd
=> Connecting to source server
=> Connecting to the target server
=> Checking server versions
==> Source version: 5.19
==> Target version: 0.4
=> Validating version compatibility
=> Checking that the source server isn't empty
=> Checking that the target server is empty
=> Validating source server configuration

The migration is now ready to proceed.
At this point, the source server and all its instances will be stopped.
Instances will come back online once the migration is complete.

Proceed with the migration? [default=no]: yes
=> Stopping the source server
=> Stopping the target server
=> Wiping the target server
=> Migrating the data
=> Migrating database
=> Writing database patch
=> Cleaning up target paths
=> Starting the target server
=> Checking the target server
Uninstall the LXD package? [default=no]: yes
=> Uninstalling the source server
root@xlr2:~# exit
logout
(base) leonid@xlr2:~$

(base) leonid@xlr2:~$ incus list
+------+-------+------+------+------+-----------+
| NAME | STATE | IPV4 | IPV6 | TYPE | SNAPSHOTS |
+------+-------+------+------+------+-----------+
(base) leonid@xlr2:~$
(base) leonid@xlr2:~$ incus storage list
+---------+--------+--------------+-------------+---------+---------+
|  NAME   | DRIVER |    SOURCE    | DESCRIPTION | USED BY |  STATE  |
+---------+--------+--------------+-------------+---------+---------+
| default | dir    | /mnt/dev/lxd |             | 7       | CREATED |
+---------+--------+--------------+-------------+---------+---------+
(base) leonid@xlr2:~$ incus storage info default
info:
  description: ""
  driver: dir
  name: default
  space used: 93.65GiB
  total space: 930.32GiB
used by:
  profiles:
  - default
  - largemacvlan
  - macvlan
  - mediummacvlan
  - micromacvlan
  - nanomacvlan
  - smallmacvlan
(base) leonid@xlr2:~$

(base) leonid@xlr2:~$ df -Th /mnt/dev/lxd
Filesystem     Type  Size  Used Avail Use% Mounted on
/dev/sdm       ext4  931G   94G  837G  11% /mnt/dev
(base) leonid@xlr2:~$ cd /mnt/dev
(base) leonid@xlr2:/mnt/dev$ ls -lh lxd-tor-01-07-2024.tar.gz
-rw-rw-r-- 1 leonid leonid 2.2G Jan  7 11:41 lxd-tor-01-07-2024.tar.gz
(base) leonid@xlr2:/mnt/dev$ incus import ./lxd-tor-01-07-2024.tar.gz -s default
Error: Create instance from backup: Error starting unpack: Failed to run: tar -zxf - --xattrs-include=* --restrict --force-local --numeric-owner -C /var/lib/incus/storage-pools/default/containers/tor --strip-components=2 backup/container: exit status 2 (tar: rootfs/usr/lib/python3/dist-packages/launchpadlib/tests/test_credential_store.py: Cannot open: No space left on device
tar: rootfs/usr/lib/python3/dist-packages/launchpadlib/tests/test_http.py: Cannot open: No space left on device
tar: rootfs/usr/lib/python3/dist-packages/launchpadlib/tests/test_launchpad.py: Cannot open: No space left on device
tar: rootfs/usr/lib/python3/dist-packages/launchpadlib/uris.py: Cannot open: No space left on device
tar: rootfs/usr/lib/python3/dist-packages/launchpadlib-1.10.16.egg-info: Cannot mkdir: No space left on device
tar: rootfs/usr/lib/python3/dist-packages/launchpadlib-1.10.16.egg-info: Cannot mkdir: No space left on device
tar: rootfs/usr/lib/python3/dist-packages/launchpadlib-1.10.16.egg-info/PKG-INFO: Cannot open: No such file or directory
tar: rootfs/usr/lib/python3/dist-packages/launchpadlib-1.10.16.egg-info: Cannot mkdir: No space left on device
tar: rootfs/usr/lib/python3/dist-packages/launchpadlib-1.10.16.egg-info/dependency_links.txt: Cannot open: No such file or directory
tar: rootfs/usr/lib/python3/dist-packages/launchpadlib-1.10.16.egg-info: Cannot mkdir: No space left on device
tar: rootfs/usr/lib/python3/dist-packages/launchpadlib-1.10.16.egg-info/not-zip-safe: Cannot open: No such file or directory
tar: rootfs/usr/lib/python3/dist-packages/launchpadlib-1.10.16.egg-info: Cannot mkdir: No space left on device
tar: rootfs/usr/lib/python3/dist-packages/launchpadlib-1.10.16.egg-info/requires.txt: Cannot open: No such file or directory
tar: rootfs/usr/lib/python3/dist-packages/launchpadlib-1.10.16.egg-info: Cannot mkdir: No space left on device
tar: rootfs/usr/lib/python3/dist-packages/launchpadlib-1.10.16.egg-info/top_level.txt: Cannot open: No such file or directory
tar: rootfs/usr/lib/python3/dist-packages/lazr: Cannot mkdir: No space left on device
tar: rootfs/usr/lib/python3/dist-packages/lazr: Cannot mkdir: No space left on device
tar: rootfs/usr/lib/python3/dist-packages/lazr/restfulclient: Cannot mkdir: No such file or directory
tar: rootfs/usr/lib/python3/dist-packages/lazr: Cannot mkdir: No space left on device
tar: rootfs/usr/lib/python3/dist-packages/lazr/restfulclient/__init__.py: Cannot open: No such file or directory
tar: rootfs/usr/lib/python3/dist-packages/lazr: Cannot mkdir: No space left on device

Appreciate your help.

4

Can you show df -i /mnt/dev/lxd/ as well as df -h /var/lib/incus/?

5

The fact that the unpack is failing on things as small as directory entries makes it quite plausible that you’re running out of inodes rather than bytes.

6

Here is the output of those two commands:

(base) leonid@xlr2:~$ df -i /mnt/dev/lxd/
Filesystem     Inodes  IUsed IFree IUse% Mounted on
/dev/sdm       238496 178637 59859   75% /mnt/dev
(base) leonid@xlr2:~$
(base) leonid@xlr2:~$ df -h /var/lib/incus/
Filesystem                         Size  Used Avail Use% Mounted on
/dev/mapper/ubuntu--vg-ubuntu--lv  226G   92G  125G  43% /
(base) leonid@xlr2:~$
7

Can you show cat /proc/self/mountinfo?

8

I think that your diagnosis is correct - it looks like /mnt/dev is running of inodes (3rd from the end of the list):

(base) leonid@xlr2:/mnt/dev$ df -i
Filesystem                           Inodes  IUsed     IFree IUse% Mounted on
tmpfs                              16475896   1596  16474300    1% /run
/dev/mapper/ubuntu--vg-ubuntu--lv  15065088 543783  14521305    4% /
tmpfs                              16475896      1  16475895    1% /dev/shm
tmpfs                              16475896      4  16475892    1% /run/lock
tmpfs                              16475896      1  16475895    1% /run/qemu
/dev/sdv2                            131072    310    130762    1% /boot
/dev/sdv1                                 0      0         0     - /boot/efi
tmpfs                               3295179     31   3295148    1% /run/user/1000
/dev/sda                           44621648     12  44621636    1% /mnt/drive/a
/dev/sdb                           44366072     12  44366060    1% /mnt/drive/b
/dev/sdc                           44603576     12  44603564    1% /mnt/drive/c
/dev/sdd                           44292720     12  44292708    1% /mnt/drive/d
/dev/sde                           44135192     12  44135180    1% /mnt/drive/e
/dev/sdf                           44571328     12  44571316    1% /mnt/drive/f
/dev/sdg                           44508472     12  44508460    1% /mnt/drive/g
/dev/sdh                           44326824     12  44326812    1% /mnt/drive/h
/dev/sdi                           44349856     12  44349844    1% /mnt/drive/i
/dev/sdj                           44482784     12  44482772    1% /mnt/drive/j
/dev/sdk                           44438496     12  44438484    1% /mnt/drive/k
/dev/sdl                           44235608     12  44235596    1% /mnt/drive/l
/dev/sdn                           44363608     12  44363596    1% /mnt/drive/n
/dev/sdo                           44324248     12  44324236    1% /mnt/drive/o
/dev/sdp                            1907744     85   1907659    1% /mnt/drive/p
/dev/sdq                            1907744     85   1907659    1% /mnt/drive/q
/dev/sdr                            1430816     67   1430749    1% /mnt/drive/r
/dev/sds                            1907744     85   1907659    1% /mnt/drive/s
/dev/sdt                            1430816     67   1430749    1% /mnt/drive/t
/dev/sdu                            1907744     85   1907659    1% /mnt/drive/u
/dev/sdw                            1430816     67   1430749    1% /mnt/drive/w
/dev/sdx                            1430816     67   1430749    1% /mnt/drive/x
/dev/sdy1                           3337984    141   3337843    1% /mnt/drive/y
/dev/md0                          390676480   1814 390674666    1% /mnt/ssd
/dev/sdm                             238496 178637     59859   75% /mnt/dev
tmpfs                              16475896      1  16475895    1% /var/lib/incus/shmounts
tmpfs                              16475896      2  16475894    1% /var/lib/incus/guestapi
(base) leonid@xlr2:/mnt/dev$

Here is the mountinfo output:

(base) leonid@xlr2:/mnt/dev$ cat /proc/self/mountinfo
24 30 0:22 / /sys rw,nosuid,nodev,noexec,relatime shared:7 - sysfs sysfs rw
25 30 0:23 / /proc rw,nosuid,nodev,noexec,relatime shared:13 - proc proc rw
26 30 0:5 / /dev rw,nosuid,relatime shared:2 - devtmpfs udev rw,size=65801752k,nr_inodes=16450438,mode=755,inode64
27 26 0:24 / /dev/pts rw,nosuid,noexec,relatime shared:3 - devpts devpts rw,gid=5,mode=620,ptmxmode=000
28 30 0:25 / /run rw,nosuid,nodev,noexec,relatime shared:5 - tmpfs tmpfs rw,size=13180720k,mode=755,inode64
30 1 253:0 / / rw,relatime shared:1 - ext4 /dev/mapper/ubuntu--vg-ubuntu--lv rw
31 24 0:6 / /sys/kernel/security rw,nosuid,nodev,noexec,relatime shared:8 - securityfs securityfs rw
32 26 0:27 / /dev/shm rw,nosuid,nodev shared:4 - tmpfs tmpfs rw,inode64
33 28 0:28 / /run/lock rw,nosuid,nodev,noexec,relatime shared:6 - tmpfs tmpfs rw,size=5120k,inode64
34 24 0:29 / /sys/fs/cgroup rw,nosuid,nodev,noexec,relatime shared:9 - cgroup2 cgroup2 rw
35 24 0:30 / /sys/fs/pstore rw,nosuid,nodev,noexec,relatime shared:10 - pstore pstore rw
36 24 0:31 / /sys/firmware/efi/efivars rw,nosuid,nodev,noexec,relatime shared:11 - efivarfs efivarfs rw
37 24 0:32 / /sys/fs/bpf rw,nosuid,nodev,noexec,relatime shared:12 - bpf bpf rw,mode=700
38 25 0:33 / /proc/sys/fs/binfmt_misc rw,relatime shared:14 - autofs systemd-1 rw,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=35221
39 26 0:20 / /dev/mqueue rw,nosuid,nodev,noexec,relatime shared:15 - mqueue mqueue rw
40 26 0:34 / /dev/hugepages rw,relatime shared:16 - hugetlbfs hugetlbfs rw,pagesize=2M
41 24 0:7 / /sys/kernel/debug rw,nosuid,nodev,noexec,relatime shared:17 - debugfs debugfs rw
42 24 0:12 / /sys/kernel/tracing rw,nosuid,nodev,noexec,relatime shared:18 - tracefs tracefs rw
43 24 0:35 / /sys/fs/fuse/connections rw,nosuid,nodev,noexec,relatime shared:19 - fusectl fusectl rw
44 24 0:21 / /sys/kernel/config rw,nosuid,nodev,noexec,relatime shared:20 - configfs configfs rw
67 28 0:36 / /run/credentials/systemd-sysusers.service ro,nosuid,nodev,noexec,relatime shared:21 - ramfs none rw,mode=700
92 28 0:37 / /run/qemu rw,nosuid,nodev,relatime shared:31 - tmpfs tmpfs rw,mode=755,inode64
95 30 7:0 / /snap/core18/2796 ro,nodev,relatime shared:47 - squashfs /dev/loop0 ro,errors=continue
98 30 7:1 / /snap/core18/2812 ro,nodev,relatime shared:49 - squashfs /dev/loop1 ro,errors=continue
101 30 7:2 / /snap/core20/2015 ro,nodev,relatime shared:51 - squashfs /dev/loop2 ro,errors=continue
104 30 7:3 / /snap/core20/2105 ro,nodev,relatime shared:53 - squashfs /dev/loop3 ro,errors=continue
107 30 7:4 / /snap/core22/1033 ro,nodev,relatime shared:55 - squashfs /dev/loop4 ro,errors=continue
113 30 7:6 / /snap/snapd/20290 ro,nodev,relatime shared:59 - squashfs /dev/loop6 ro,errors=continue
126 30 7:7 / /snap/snapd/20671 ro,nodev,relatime shared:61 - squashfs /dev/loop7 ro,errors=continue
375 30 7:8 / /snap/yq/2307 ro,nodev,relatime shared:63 - squashfs /dev/loop8 ro,errors=continue
116 30 7:9 / /snap/yq/2407 ro,nodev,relatime shared:65 - squashfs /dev/loop9 ro,errors=continue
119 30 65:82 / /boot rw,relatime shared:67 - ext4 /dev/sdv2 rw
122 119 65:81 / /boot/efi rw,relatime shared:69 - vfat /dev/sdv1 rw,fmask=0022,dmask=0022,codepage=437,iocharset=iso8859-1,shortname=mixed,errors=remount-ro
125 38 0:38 / /proc/sys/fs/binfmt_misc rw,nosuid,nodev,noexec,relatime shared:71 - binfmt_misc binfmt_misc rw
630 28 0:25 /snapd/ns /run/snapd/ns rw,nosuid,nodev,noexec,relatime - tmpfs tmpfs rw,size=13180720k,mode=755,inode64
657 28 0:50 / /run/user/1000 rw,nosuid,nodev,relatime shared:353 - tmpfs tmpfs rw,size=13180716k,nr_inodes=3295179,mode=700,uid=1000,gid=1000,inode64
686 30 8:0 / /mnt/drive/a rw,relatime shared:361 - xfs /dev/sda rw,attr2,inode64,logbufs=8,logbsize=32k,noquota
770 30 8:16 / /mnt/drive/b rw,relatime shared:369 - xfs /dev/sdb rw,attr2,inode64,logbufs=8,logbsize=32k,noquota
787 30 8:32 / /mnt/drive/c rw,relatime shared:377 - xfs /dev/sdc rw,attr2,inode64,logbufs=8,logbsize=32k,noquota
804 30 8:48 / /mnt/drive/d rw,relatime shared:385 - xfs /dev/sdd rw,attr2,inode64,logbufs=8,logbsize=32k,noquota
821 30 8:64 / /mnt/drive/e rw,relatime shared:393 - xfs /dev/sde rw,attr2,inode64,logbufs=8,logbsize=32k,noquota
838 30 8:80 / /mnt/drive/f rw,relatime shared:401 - xfs /dev/sdf rw,attr2,inode64,logbufs=8,logbsize=32k,noquota
855 30 8:96 / /mnt/drive/g rw,relatime shared:409 - xfs /dev/sdg rw,attr2,inode64,logbufs=8,logbsize=32k,noquota
872 30 8:112 / /mnt/drive/h rw,relatime shared:417 - xfs /dev/sdh rw,attr2,inode64,logbufs=8,logbsize=32k,noquota
889 30 8:128 / /mnt/drive/i rw,relatime shared:425 - xfs /dev/sdi rw,attr2,inode64,logbufs=8,logbsize=32k,noquota
906 30 8:144 / /mnt/drive/j rw,relatime shared:433 - xfs /dev/sdj rw,attr2,inode64,logbufs=8,logbsize=32k,noquota
923 30 8:160 / /mnt/drive/k rw,relatime shared:441 - xfs /dev/sdk rw,attr2,inode64,logbufs=8,logbsize=32k,noquota
940 30 8:176 / /mnt/drive/l rw,relatime shared:449 - xfs /dev/sdl rw,attr2,inode64,logbufs=8,logbsize=32k,noquota
957 30 8:208 / /mnt/drive/n rw,relatime shared:457 - xfs /dev/sdn rw,attr2,inode64,logbufs=8,logbsize=32k,noquota
974 30 8:224 / /mnt/drive/o rw,relatime shared:465 - xfs /dev/sdo rw,attr2,inode64,logbufs=8,logbsize=32k,noquota
991 30 8:240 / /mnt/drive/p rw,relatime shared:473 - ext4 /dev/sdp rw
1008 30 65:0 / /mnt/drive/q rw,relatime shared:481 - ext4 /dev/sdq rw
1025 30 65:16 / /mnt/drive/r rw,relatime shared:489 - ext4 /dev/sdr rw
1042 30 65:32 / /mnt/drive/s rw,relatime shared:497 - ext4 /dev/sds rw
1059 30 65:48 / /mnt/drive/t rw,relatime shared:505 - ext4 /dev/sdt rw
1076 30 65:64 / /mnt/drive/u rw,relatime shared:513 - ext4 /dev/sdu rw
1093 30 65:96 / /mnt/drive/w rw,relatime shared:521 - ext4 /dev/sdw rw
1110 30 65:112 / /mnt/drive/x rw,relatime shared:529 - ext4 /dev/sdx rw
1264 30 65:129 / /mnt/drive/y rw,relatime shared:549 - ext4 /dev/sdy1 rw
1283 30 9:0 / /mnt/ssd rw,relatime shared:622 - xfs /dev/md0 rw,attr2,discard,inode64,logbufs=8,logbsize=32k,sunit=1024,swidth=2048,noquota
1127 30 8:192 / /mnt/dev rw,relatime shared:537 - ext4 /dev/sdm rw,discard
1145 30 0:61 / /var/lib/incus-lxcfs rw,nosuid,nodev,relatime shared:551 - fuse.lxcfs lxcfs rw,user_id=0,group_id=0,allow_other
1146 30 0:51 / /var/lib/incus/shmounts rw,relatime shared:546 - tmpfs tmpfs rw,size=100k,mode=711,inode64
1181 30 0:56 / /var/lib/incus/guestapi rw,relatime shared:560 - tmpfs tmpfs rw,size=100k,mode=755,inode64
1199 30 8:192 /lxd /var/lib/incus/storage-pools/default rw,relatime shared:537 - ext4 /dev/sdm rw,discard
(base) leonid@xlr2:/mnt/dev$

The '/mnt/dev` mount is mounted like the following:

sudo mount -o discard /dev/sdm /mnt/dev

It’s 1TB SSD drive mounted with “discard”:

(base) leonid@xlr2:/mnt/dev$ sudo fdisk -l /dev/sdm
Disk /dev/sdm: 931.51 GiB, 1000204886016 bytes, 1953525168 sectors
Disk model: CT1000MX500SSD1
Units: sectors of 1 * 512 = 512 bytes
Sector size (logical/physical): 512 bytes / 512 bytes
I/O size (minimum/optimal): 512 bytes / 512 bytes
(base) leonid@xlr2:/mnt/dev$

I suspect that the limitation is due to the fact that /dev/mnt was formatted as ext4, which limits number of inodes (as I learn now):

sudo mkfs.ext4 -m 0 -T largefile4 /dev/sdm
sudo tune2fs -m 0 /dev/sdm
sudo tune2fs -O dir_index /dev/sdm
sudo e2fsck -fD /dev/sdm
sudo mount -o discard /dev/sdm /mnt/dev

Perhaps I should backup everything, and reformat as XFS?

9

It’s definitely a bit light on inodes, though should only start failing when unpacking another 60k files. I guess a container with a bunch of files could reach that.

It’s been a long time since I last ran into that with ext4 but at least back then, there was no way to increase the inode count after initial mkfs.ext4. The -i flag can be used during mkfs to get more inodes out of the filesystem.

AFAIK XFS has the advantage of not having a set inode count, so it avoids that particular problem, though I’ve got very little experience with XFS in general.

10

Hi Stéphane,

Thank you very much for pointing me into the right direction!

The root cause of all my issues was the fact that I originally formatted the SSD using command that I used for another use-case where I only needed to store a small number fo very large (~100GB) files - I used “-T largefile4”.

The “largefile4” type has very high inode_ratio compared to the default - 4M+ vs 16K+ - which results in less inodes available:

leonid@xlr2:~$ cat /etc/mke2fs.conf | grep -A 3 "largefile4"
        largefile4 = {
                inode_ratio = 4194304
                blocksize = -1
        }
leonid@xlr2:~$ cat /etc/mke2fs.conf | grep -A 6 "\[defaults\]"
[defaults]
        base_features = sparse_super,large_file,filetype,resize_inode,dir_index,ext_attr
        default_mntopts = acl,user_xattr
        enable_periodic_fsck = 0
        blocksize = 4096
        inode_size = 256
        inode_ratio = 16384
leonid@xlr2:~$

I have successfully reformatted the drive and tested importing the LXD containers created on this and another machine into 2 storage pools - everything is working as expected:

leonid@xlr2:~$ incus storage list
+---------+--------+-----------------+-------------+---------+---------+
|  NAME   | DRIVER |     SOURCE      | DESCRIPTION | USED BY |  STATE  |
+---------+--------+-----------------+-------------+---------+---------+
| default | dir    | /mnt/dev/incus/ |             | 8       | CREATED |
+---------+--------+-----------------+-------------+---------+---------+
| ssd     | dir    | /mnt/ssd/incus/ |             | 1       | CREATED |
+---------+--------+-----------------+-------------+---------+---------+
leonid@xlr2:~$ df -Th /mnt/ssd /mnt/dev
Filesystem     Type  Size  Used Avail Use% Mounted on
/dev/md0       xfs   3.7T  1.1T  2.6T  31% /mnt/ssd
/dev/sdm       ext4  916G  5.6G  911G   1% /mnt/dev
leonid@xlr2:~$ df -ih /mnt/ssd /mnt/dev
Filesystem     Inodes IUsed IFree IUse% Mounted on
/dev/md0         373M  270K  373M    1% /mnt/ssd
/dev/sdm          59M  117K   59M    1% /mnt/dev
leonid@xlr2:~$

I will be using Incus for my Linux Container now !!!

Kind Regards.

2 Likes