Using LXD clustering on a 5-node cluster, which seems to have failed on automatic refreshing to 4.0.0 (snap 14709).
Now I have 3 nodes which are saying they’re waiting for the other two to update, while the other two are saying they’re behind and need to catch up. I suspect the ones that are down are database nodes, as they’re the first ones I set up, but I don’t know how many replicas are in the cluster normally.
How do I get myself out of this hole?
lxc cluster list isn’t available at present.
Nodes needing updates are saying the following in their logs
t=2020-04-21T08:42:27+0000 lvl=eror msg=“Failed to start the daemon: failed to open cluster database: failed to ensure schema: this node’s version is behind, please upgrade”
Nodes on current version are saying the following:
t=2020-04-21T09:00:23+0000 lvl=info msg=“Wait for other cluster nodes to upgrade their versions”