Hello everyone,
Creating a cluster with ovn network gives me headache, I follow up the ovn with cluster documantation but there is something wrong. When I entered the following command
incus network create aovn --type=ovn
after those commands, the tnode1 member stuck and the cluster cant reached anymore. Can someone enlighten me?
Regards.
incus network create UPLINK --type=physical parent=end0 --target=tnode[1-3]
incus network create UPLINK --type=physical \
ipv4.ovn.ranges=172.16.10.100-172.16.10.200 \
ipv6.ovn.ranges=fd42:4242:4242:1000::100-fd42:4242:4242:1000::200 \
ipv4.gateway=172.16.10.1/24 \
ipv6.gateway=fd42:4242:4242:1000::1/64 \
dns.nameservers=8.8.8.8,1.1.1.1
root@tnode3:/etc/netplan# incus network show UPLINK
config:
dns.nameservers: 8.8.8.8,1.1.1.1
ipv4.gateway: 172.16.10.1/24
ipv4.ovn.ranges: 172.16.10.100-172.16.10.200
ipv6.gateway: fd42:4242:4242:1000::1/64
ipv6.ovn.ranges: fd42:4242:4242:1000::100-fd42:4242:4242:1000::200
volatile.last_state.created: "false"
description: ""
name: UPLINK
type: physical
used_by: []
managed: true
status: Created
locations:
- tnode2
- tnode3
- tnode1
project: default
ubuntu@tnode2:~$ incus network ls
+----------------+----------+---------+----------------+--------------------------+-------------+---------+---------+
| NAME | TYPE | MANAGED | IPV4 | IPV6 | DESCRIPTION | USED BY | STATE |
+----------------+----------+---------+----------------+--------------------------+-------------+---------+---------+
| UPLINK | physical | YES | | | | 0 | CREATED |
+----------------+----------+---------+----------------+--------------------------+-------------+---------+---------+
| aovn | ovn | YES | 10.18.106.1/24 | fd42:64a5:c64:63eb::1/64 | | 0 | ERRORED |
+----------------+----------+---------+----------------+--------------------------+-------------+---------+---------+
| br-int | bridge | NO | | | | 0 | |
+----------------+----------+---------+----------------+--------------------------+-------------+---------+---------+
| end0 | physical | NO | | | | 1 | |
+----------------+----------+---------+----------------+--------------------------+-------------+---------+---------+
| genev_sys_6081 | unknown | NO | | | | 0 | |
+----------------+----------+---------+----------------+--------------------------+-------------+---------+---------+
| lo | loopback | NO | | | | 0 | |
+----------------+----------+---------+----------------+--------------------------+-------------+---------+---------+
| ovs-system | unknown | NO | | | | 0 | |
+----------------+----------+---------+----------------+--------------------------+-------------+---------+---------+
root@tnode3:/etc/netplan# incus network show aovn
config:
bridge.mtu: "1442"
ipv4.address: 10.18.106.1/24
ipv4.nat: "true"
ipv6.address: fd42:64a5:c64:63eb::1/64
ipv6.nat: "true"
network: UPLINK
volatile.network.ipv4.address: 172.16.10.100
volatile.network.ipv6.address: fd42:4242:4242:1000::100
description: ""
name: aovn
type: ovn
used_by: []
managed: true
status: Errored
locations:
- tnode2
- tnode3
- tnode1
project: default
Cluster status
ubuntu@tnode2:~$ incus cluster ls
+--------+----------------------------+-----------------+--------------+----------------+-------------+---------+------------------------------------------------------------------------------+
| NAME | URL | ROLES | ARCHITECTURE | FAILURE DOMAIN | DESCRIPTION | STATUS | MESSAGE |
+--------+----------------------------+-----------------+--------------+----------------+-------------+---------+------------------------------------------------------------------------------+
| tnode1 | https://192.168.1.201:8443 | database | aarch64 | default | | OFFLINE | No heartbeat for 19m26.037627423s (2025-06-29 07:31:25.81357484 +0300 +0300) |
+--------+----------------------------+-----------------+--------------+----------------+-------------+---------+------------------------------------------------------------------------------+
| tnode2 | https://192.168.1.202:8443 | database | aarch64 | default | | ONLINE | Fully operational |
+--------+----------------------------+-----------------+--------------+----------------+-------------+---------+------------------------------------------------------------------------------+
| tnode3 | https://192.168.1.203:8443 | database-leader | aarch64 | default | | ONLINE | Fully operational |
| | | database | | | | | |
+--------+----------------------------+-----------------+--------------+----------------+-------------+---------+------------------------------------------------------------------------------+
Here is the monitor message.
WARNING[2025-06-29T07:40:03+03:00] [tnode3] Cluster member isn't responding name=tnode1
P.S.
The tnode1 network interface switched to another name end0 → end1. I suppose, I fixed that issue, but still my newly created network looks like this.
+----------------+----------+---------+----------------+--------------------------+-------------+---------+---------+
| NAME | TYPE | MANAGED | IPV4 | IPV6 | DESCRIPTION | USED BY | STATE |
+----------------+----------+---------+----------------+--------------------------+-------------+---------+---------+
| UPLINK | physical | YES | | | | 0 | CREATED |
+----------------+----------+---------+----------------+--------------------------+-------------+---------+---------+
| aovn | ovn | YES | 10.18.106.1/24 | fd42:64a5:c64:63eb::1/64 | | 0 | ERRORED |
+----------------+----------+---------+----------------+--------------------------+-------------+---------+---------+
| br-int | bridge | NO | | | | 0 | |
+----------------+----------+---------+----------------+--------------------------+-------------+---------+---------+
| end0 | physical | NO | | | | 1 | |
+----------------+----------+---------+----------------+--------------------------+-------------+---------+---------+
| genev_sys_6081 | unknown | NO | | | | 0 | |
+----------------+----------+---------+----------------+--------------------------+-------------+---------+---------+
| lo | loopback | NO | | | | 0 | |
+----------------+----------+---------+----------------+--------------------------+-------------+---------+---------+
| ovs-system | unknown | NO | | | | 0 | |
+----------------+----------+---------+----------------+--------------------------+-------------+---------+---------+