Lost database after upgrade LXD 2.0.11 > 3.0.3

Yes after the upgrade at 00:06h my containers were still running because I did not shut them down prior to upgrade LXD. Few minutes after 00:13:57h I went to see why it took so long to reboot and gave the system a hard reset.

Perhaps this explains the log?

Upgrade event:

2018-12-22 14:30:42 startup packages configure
2018-12-25 00:05:54 startup archives unpack
2018-12-25 00:05:55 upgrade liblxc1:amd64 2.0.8-0ubuntu1~16.04.2 3.0.3-0ubuntu1~16.04.1
2018-12-25 00:05:55 status triggers-pending libc-bin:amd64 2.23-0ubuntu10
2018-12-25 00:05:55 status half-configured liblxc1:amd64 2.0.8-0ubuntu1~16.04.2
2018-12-25 00:05:55 status unpacked liblxc1:amd64 2.0.8-0ubuntu1~16.04.2
….
2018-12-25 00:06:12 status installed lxd:amd64 3.0.3-0ubuntu1~16.04.1
2018-12-25 00:06:12 trigproc systemd:amd64 229-4ubuntu21.10 <none>
2018-12-25 00:06:12 status half-configured systemd:amd64 229-4ubuntu21.10
2018-12-25 00:06:12 status installed systemd:amd64 229-4ubuntu21.10
2018-12-25 00:06:12 trigproc ureadahead:amd64 0.100.0-19 <none>
2018-12-25 00:06:12 status half-configured ureadahead:amd64 0.100.0-19
2018-12-25 00:06:12 status installed ureadahead:amd64 0.100.0-19
2018-12-25 00:06:12 trigproc libc-bin:amd64 2.23-0ubuntu10 <none>
2018-12-25 00:06:12 status half-configured libc-bin:amd64 2.23-0ubuntu10
2018-12-25 00:06:12 status installed libc-bin:amd64 2.23-0ubuntu10
2018-12-25 00:06:12 startup packages configure

Reboot event:

server:~$ last -x | less
user    pts/0        192.168.0.109    Wed Dec 26 13:04   still logged in
runlevel (to lvl 5)   4.4.0-141-generi Wed Dec 26 13:04   still running
reboot   system boot  4.4.0-141-generi Wed Dec 26 13:04   still running
shutdown system down  4.4.0-141-generi Tue Dec 25 16:01 - 13:04  (21:02)
user    tty1                          Tue Dec 25 16:00 - down   (00:01)
user    pts/0        192.168.0.109    Tue Dec 25 08:29 - 12:53  (04:23)
runlevel (to lvl 5)   4.4.0-141-generi Tue Dec 25 08:27 - 16:01  (07:34)
reboot   system boot  4.4.0-141-generi Tue Dec 25 08:27 - 16:01  (07:34)
user    tty1                          Tue Dec 25 03:25 - crash  (05:02)
user    pts/0        192.168.0.109    Tue Dec 25 00:14 - 03:16  (03:01)
runlevel (to lvl 5)   4.4.0-141-generi Tue Dec 25 00:13 - 08:27  (08:13)
reboot   system boot  4.4.0-141-generi Tue Dec 25 00:13 - 16:01  (15:48)
user    pts/7        192.168.0.109    Mon Dec 24 20:56 - 00:10  (03:14)

I started over a year ago with my first container and installed an basic configuration with zfs.
The zfs drive is a separate partition on the host. Nothing special…

I send you the requested tarball.