Request for advice: best way to upgrade server and migrate from LXD to Incus?

Hi again all; one further question, if that’s okay?

It’s been a little while, but I’ve now got my 10Tb pool all upgrading/re-silvered and happy. I’ve got incus stable (6.3) installed from @stgraber’s jabbly sources, and I was all ready to to lxd-to-incus, but I thought I’d do the incus info and lxc info and see what’s different.

The server is 22.04 + HWE kernel (which gets zfs 2.2 kernel module).

In incus info I see:

  - name: zfs
    version: 2.1.5-1ubuntu6~22.04.4
    remote: false

and with lxc info I get:

  - name: zfs
    version: 2.2.0-0ubuntu1~23.10.3
    remote: false

and zfs version:

# zfs version
zfs-2.1.5-1ubuntu6~22.04.4
zfs-kmod-2.2.0-0ubuntu1~23.10.3
# uname -a
Linux bigstore 6.5.0-45-generic #45~22.04.1-Ubuntu SMP PREEMPT_DYNAMIC Mon Jul 15 16:40:02 UTC 2 x86_64 x86_64 x86_64 GNU/Linux

So, I being a little paranoid, and due to me running into a problem with shiftfs, idmaps which was solved by using ZFS 2.2, I’m a bit concerned about what I may break in the process of moving to incus.

I have two volumes that are shared between two containers which is why I ran into the problem, and it looks like incus will be using 2.1.5 of ZFS which I don’t think contains the idmap aware stuff that solved my previous “shiftfs-disappeared” problem.

The final resting place for this server is Debian 12 (bookworm) which does have ZFS 2.2 in debian backports. The previous advice (which may still hold) was to upgrade to incus on 22.04, do the backups and then switch of Debian (which will be different physical root/boot disk(s)).

Should I (on Ubuntu):

  • Use the zabbly sources for ZFS + Incus to get ZFS 2.2 + Incus 6.3?
  • OR: be okay just using the zabbly sources for Incuse 6.3, leaving ZFS at 2.1.5.

And then on Debian:

  • Use zabbly for Incus and debian-backports for ZFS
  • OR: Use zabbly of Incus, ZFS and kernel?

I’m most concerned about a) drifting too far from bookworm in terms of kernel + ZFS over time. Should I use the 6.0 LTS instead? I’m not sure of the trade-offs. This server needs to effectively be bullet-proof, stable and not need too much attention to maintain it!?

Thanks again for any advice that you can offer.