Incusd node failed connecting to global database after restart

Incus
1

The incus version is 6.0.5-lts

I used incus config edit to set server config logging.loki.target.url and restart incusd with systemctl restart incus, then the log shows that:

level=error msg=“Failed connecting to global database” attempt=6 err="failed to create cowsql connection: no available cowsql leader server found”

In the other node, I execute incus cluster list, and got this

NAME URL ROLES ARCHITECTURE FAILURE DOMAIN DESCRIPTION STATUS MESSAGE
10.120.16.51 https://10.120.16.51:8443 database x86_64 default OFFLINE No heartbeat for 1h40m10.159455383s (2025-09-04 15:11:16.515853095 +0800 +0800)
10.120.16.52 https://10.120.16.52:8443 database-leader x86_64 default ONLINE Fully operational
database
10.120.16.53 https://10.120.16.53:8443 database x86_64 default ONLINE Fully operational

what can I do to fix this error, and I am sure the network is is reachable.

2

I tried to remove /var/lib/incus/database/glabal, and it started successfully, but all instance disappeared, even after I run incus admin recover

So I removed the cluster member in the normal node. Then running incus admin init, but it shows Error: Failed to join cluster: This server is already clustered

3

It seems I’ve messed everything up. :sob:

4

Try copying /var/lib/incus/database/global from whichever server is the current database-leader, that may help.

But yeah, in general, you really shouldn’t be deleting anything in /var/lib/incus/database/global unless we’re the ones telling you to do it :slight_smile: