No containers running anymore, failed to apply update 34 in endless loop, snap package

LXD
1

my snap lxd server is not running anymore and now no services are running
need help so resolve the issue

Sep 24 08:09:17 Ubuntu-1804-bionic-64-minimal lxd.daemon[3808]: => LXD failed to start
Sep 24 08:09:17 Ubuntu-1804-bionic-64-minimal systemd[1]: snap.lxd.daemon.service: Main process exited, code=exited, status=1/FAILURE
Sep 24 08:09:17 Ubuntu-1804-bionic-64-minimal systemd[1]: snap.lxd.daemon.service: Failed with result 'exit-code'.
Sep 24 08:09:17 Ubuntu-1804-bionic-64-minimal systemd[1]: snap.lxd.daemon.service: Service hold-off time over, scheduling restart.
Sep 24 08:09:17 Ubuntu-1804-bionic-64-minimal systemd[1]: snap.lxd.daemon.service: Scheduled restart job, restart counter is at 91.
Sep 24 08:09:17 Ubuntu-1804-bionic-64-minimal systemd[1]: Stopped Service for snap application lxd.daemon.
Sep 24 08:09:17 Ubuntu-1804-bionic-64-minimal systemd[1]: Started Service for snap application lxd.daemon.
Sep 24 08:09:17 Ubuntu-1804-bionic-64-minimal lxd.daemon[3964]: => Preparing the system (17320)
Sep 24 08:09:17 Ubuntu-1804-bionic-64-minimal lxd.daemon[3964]: ==> Loading snap configuration
Sep 24 08:09:17 Ubuntu-1804-bionic-64-minimal lxd.daemon[3964]: ==> Setting up mntns symlink (mnt:[4026532401])
Sep 24 08:09:17 Ubuntu-1804-bionic-64-minimal lxd.daemon[3964]: ==> Setting up kmod wrapper
Sep 24 08:09:17 Ubuntu-1804-bionic-64-minimal lxd.daemon[3964]: ==> Preparing /boot
Sep 24 08:09:17 Ubuntu-1804-bionic-64-minimal lxd.daemon[3964]: ==> Preparing a clean copy of /run
Sep 24 08:09:17 Ubuntu-1804-bionic-64-minimal lxd.daemon[3964]: ==> Preparing /run/bin
Sep 24 08:09:17 Ubuntu-1804-bionic-64-minimal lxd.daemon[3964]: ==> Preparing a clean copy of /etc
Sep 24 08:09:17 Ubuntu-1804-bionic-64-minimal lxd.daemon[3964]: ==> Preparing a clean copy of /usr/share/misc
Sep 24 08:09:17 Ubuntu-1804-bionic-64-minimal lxd.daemon[3964]: ==> Setting up ceph configuration
Sep 24 08:09:17 Ubuntu-1804-bionic-64-minimal lxd.daemon[3964]: ==> Setting up LVM configuration
Sep 24 08:09:17 Ubuntu-1804-bionic-64-minimal lxd.daemon[3964]: ==> Rotating logs
Sep 24 08:09:17 Ubuntu-1804-bionic-64-minimal lxd.daemon[3964]: ==> Setting up ZFS (0.7)
Sep 24 08:09:17 Ubuntu-1804-bionic-64-minimal lxd.daemon[3964]: ==> Escaping the systemd cgroups
Sep 24 08:09:17 Ubuntu-1804-bionic-64-minimal lxd.daemon[3964]: ====> Detected cgroup V1
Sep 24 08:09:17 Ubuntu-1804-bionic-64-minimal lxd.daemon[3964]: ==> Escaping the systemd process resource limits
Sep 24 08:09:17 Ubuntu-1804-bionic-64-minimal lxd.daemon[3964]: ==> Disabling shiftfs on this kernel (auto)
Sep 24 08:09:17 Ubuntu-1804-bionic-64-minimal lxd.daemon[14339]: Closed liblxcfs.so
Sep 24 08:09:17 Ubuntu-1804-bionic-64-minimal lxd.daemon[14339]: Running destructor lxcfs_exit
Sep 24 08:09:17 Ubuntu-1804-bionic-64-minimal lxd.daemon[14339]: Running constructor lxcfs_init to reload liblxcfs
Sep 24 08:09:17 Ubuntu-1804-bionic-64-minimal kernel: [ 1206.009065] new mount options do not match the existing superblock, will be ignored
Sep 24 08:09:17 Ubuntu-1804-bionic-64-minimal lxd.daemon[14339]: mount namespace: 5
Sep 24 08:09:17 Ubuntu-1804-bionic-64-minimal lxd.daemon[14339]: hierarchies:
Sep 24 08:09:17 Ubuntu-1804-bionic-64-minimal lxd.daemon[14339]:   0: fd:   6:
Sep 24 08:09:17 Ubuntu-1804-bionic-64-minimal lxd.daemon[14339]:   1: fd:   7: name=systemd
Sep 24 08:09:17 Ubuntu-1804-bionic-64-minimal lxd.daemon[14339]:   2: fd:   8: cpu,cpuacct
Sep 24 08:09:17 Ubuntu-1804-bionic-64-minimal lxd.daemon[14339]:   3: fd:   9: net_cls,net_prio
Sep 24 08:09:17 Ubuntu-1804-bionic-64-minimal lxd.daemon[14339]:   4: fd:  10: hugetlb
Sep 24 08:09:17 Ubuntu-1804-bionic-64-minimal lxd.daemon[14339]:   5: fd:  11: pids
Sep 24 08:09:17 Ubuntu-1804-bionic-64-minimal lxd.daemon[14339]:   6: fd:  12: blkio
Sep 24 08:09:17 Ubuntu-1804-bionic-64-minimal lxd.daemon[14339]:   7: fd:  13: cpuset
Sep 24 08:09:17 Ubuntu-1804-bionic-64-minimal lxd.daemon[14339]:   8: fd:  14: memory
Sep 24 08:09:17 Ubuntu-1804-bionic-64-minimal lxd.daemon[14339]:   9: fd:  15: rdma
Sep 24 08:09:17 Ubuntu-1804-bionic-64-minimal lxd.daemon[14339]:  10: fd:  16: perf_event
Sep 24 08:09:17 Ubuntu-1804-bionic-64-minimal lxd.daemon[14339]:  11: fd:  17: freezer
Sep 24 08:09:17 Ubuntu-1804-bionic-64-minimal lxd.daemon[14339]:  12: fd:  19: devices
Sep 24 08:09:17 Ubuntu-1804-bionic-64-minimal lxd.daemon[14339]: Kernel does not support swap accounting
Sep 24 08:09:17 Ubuntu-1804-bionic-64-minimal lxd.daemon[14339]: api_extensions:
Sep 24 08:09:17 Ubuntu-1804-bionic-64-minimal lxd.daemon[14339]: - cgroups
Sep 24 08:09:17 Ubuntu-1804-bionic-64-minimal lxd.daemon[14339]: - sys_cpu_online
Sep 24 08:09:17 Ubuntu-1804-bionic-64-minimal lxd.daemon[14339]: - proc_cpuinfo
Sep 24 08:09:17 Ubuntu-1804-bionic-64-minimal lxd.daemon[14339]: - proc_diskstats
Sep 24 08:09:17 Ubuntu-1804-bionic-64-minimal lxd.daemon[14339]: - proc_loadavg
Sep 24 08:09:17 Ubuntu-1804-bionic-64-minimal lxd.daemon[14339]: - proc_meminfo
Sep 24 08:09:17 Ubuntu-1804-bionic-64-minimal lxd.daemon[14339]: - proc_stat
Sep 24 08:09:17 Ubuntu-1804-bionic-64-minimal lxd.daemon[14339]: - proc_swaps
Sep 24 08:09:17 Ubuntu-1804-bionic-64-minimal lxd.daemon[14339]: - proc_uptime
Sep 24 08:09:17 Ubuntu-1804-bionic-64-minimal lxd.daemon[14339]: - shared_pidns
Sep 24 08:09:17 Ubuntu-1804-bionic-64-minimal lxd.daemon[14339]: - cpuview_daemon
Sep 24 08:09:17 Ubuntu-1804-bionic-64-minimal lxd.daemon[14339]: - loadavg_daemon
Sep 24 08:09:17 Ubuntu-1804-bionic-64-minimal lxd.daemon[14339]: - pidfds
Sep 24 08:09:17 Ubuntu-1804-bionic-64-minimal lxd.daemon[14339]: Reloaded LXCFS
Sep 24 08:09:17 Ubuntu-1804-bionic-64-minimal lxd.daemon[3964]: => Re-using existing LXCFS
Sep 24 08:09:17 Ubuntu-1804-bionic-64-minimal lxd.daemon[3964]: => Starting LXD
Sep 24 08:09:17 Ubuntu-1804-bionic-64-minimal lxd.daemon[3964]: t=2020-09-24T08:09:17+0200 lvl=warn msg=" - Couldn't find the CGroup memory swap accounting, swap limits will be ignored"
Sep 24 08:09:19 Ubuntu-1804-bionic-64-minimal lxd.daemon[3964]: t=2020-09-24T08:09:19+0200 lvl=eror msg="Failed to start the daemon: failed to open cluster database: failed to ensure schema: failed to apply update 34: invalid ID"
Sep 24 08:09:19 Ubuntu-1804-bionic-64-minimal lxd.daemon[3964]: Error: failed to open cluster database: failed to ensure schema: failed to apply update 34: invalid ID
Sep 24 08:09:19 Ubuntu-1804-bionic-64-minimal lxd.daemon[3964]: => LXD failed to start
Sep 24 08:09:19 Ubuntu-1804-bionic-64-minimal systemd[1]: snap.lxd.daemon.service: Main process exited, code=exited, status=1/FAILURE
Sep 24 08:09:19 Ubuntu-1804-bionic-64-minimal systemd[1]: snap.lxd.daemon.service: Failed with result 'exit-code'.
Sep 24 08:09:20 Ubuntu-1804-bionic-64-minimal systemd[1]: snap.lxd.daemon.service: Service hold-off time over, scheduling restart.
Sep 24 08:09:20 Ubuntu-1804-bionic-64-minimal systemd[1]: snap.lxd.daemon.service: Scheduled restart job, restart counter is at 92.

snap info lxd

name: lxd
summary: System container manager and API
publisher: Canonical✓
store-url: https://snapcraft.io/lxd
contact: https://github.com/lxc/lxd/issues
license: unset
description: |
LXD is a system container manager

With LXD you can run hundreds of containers of a variety of Linux
distributions, apply resource limits, pass in directories, USB devices
or GPUs and setup any network and storage you want.

LXD containers are lightweight, secure by default and a great
alternative to running Linux virtual machines.

Run any Linux distribution you want

Pre-made images are available for Ubuntu, Alpine Linux, ArchLinux,
CentOS, Debian, Fedora, Gentoo, OpenSUSE and more.

A full list of available images can be found here: https://images.linuxcontainers.org

Can’t find the distribution you want? It’s easy to make your own images too, either using our
distrobuilder tool or by assembling your own image tarball by hand.

Containers at scale

LXD is network aware and all interactions go through a simple REST API,
making it possible to remotely interact with containers on remote
systems, copying and moving them as you wish.

Want to go big? LXD also has built-in clustering support,
letting you turn dozens of servers into one big LXD server.

Configuration options

Supported options for the LXD snap (snap set lxd KEY=VALUE):

  • ceph.builtin: Use snap-specific ceph configuration [default=false]
  • criu.enable: Enable experimental live-migration support [default=false]
  • daemon.debug: Increases logging to debug level [default=false]
  • daemon.group: Group of users that can interact with LXD [default=lxd]
  • daemon.preseed: A YAML configuration to feed lxd init on initial start
  • lxcfs.pidfd: Start per-container process tracking [default=false]
  • lxcfs.loadavg: Start tracking per-container load average [default=false]
  • lxcfs.cfs: Consider CPU shares for CPU usage [default=false]
  • openvswitch.builtin: Run a snap-specific OVS daemon [default=false]
  • shiftfs.enable: Enable shiftfs support [default=auto]

Documentation: https://lxd.readthedocs.io
commands:

  • lxd.benchmark
  • lxd.buginfo
  • lxd.check-kernel
  • lxd.lxc
  • lxd.lxc-to-lxd
  • lxd
  • lxd.migrate
    services:
    lxd.activate: oneshot, enabled, inactive
    lxd.daemon: simple, enabled, active
    snap-id: J60k4JY0HppjwOjW8dZdYc8obXKxujRu
    tracking: latest/stable
    refresh-date: today at 08:05 CEST
    channels:
    latest/stable: 4.6 2020-09-21 (17320) 71MB -
    latest/candidate: 4.6 2020-09-23 (17399) 71MB -
    latest/beta: ↑
    latest/edge: git-4ee1507 2020-09-23 (17404) 71MB -
    4.6/stable: 4.6 2020-09-21 (17320) 71MB -
    4.6/candidate: 4.6 2020-09-23 (17399) 71MB -
    4.6/beta: ↑
    4.6/edge: ↑
    4.5/stable: 4.5 2020-09-18 (17299) 71MB -
    4.5/candidate: 4.5 2020-09-18 (17299) 71MB -
    4.5/beta: ↑
    4.5/edge: ↑
    4.4/stable: 4.4 2020-08-19 (16926) 74MB -
    4.4/candidate: 4.4 2020-08-19 (16926) 74MB -
    4.4/beta: ↑
    4.4/edge: ↑
    4.3/stable: 4.3 2020-07-09 (16100) 74MB -
    4.3/candidate: 4.3 2020-07-20 (16380) 74MB -
    4.3/beta: ↑
    4.3/edge: ↑
    4.0/stable: 4.0.3 2020-08-19 (16922) 73MB -
    4.0/candidate: 4.0.3 2020-08-19 (16922) 73MB -
    4.0/beta: ↑
    4.0/edge: git-134359c 2020-09-15 (17234) 70MB -
    3.0/stable: 3.0.4 2019-10-10 (11348) 55MB -
    3.0/candidate: 3.0.4 2019-10-10 (11348) 55MB -
    3.0/beta: ↑
    3.0/edge: git-81b81b9 2019-10-10 (11362) 55MB -
    2.0/stable: 2.0.12 2020-08-18 (16879) 38MB -
    2.0/candidate: 2.0.12 2020-08-17 (16879) 38MB -
    2.0/beta: ↑
    2.0/edge: git-82c7d62 2020-08-17 (16867) 39MB -
    installed: 4.6 (17320) 71MB -
2

This sounds like the same issue as https://github.com/lxc/lxd/issues/7920

With special attention to @stgraber comment here https://github.com/lxc/lxd/issues/7920#issuecomment-696931669

Please could you take a look at that thread and comment on there if it seems to be the same issue.