Hi, I’ve been trying to work with the documentation to set up Incus with OVN on a cluster. It mostly seems to work but I seem to be falling at the last hurdle. i.e. creating the UPLINK network.
Incus UI / cluster is showing all nodes up, ovs seems consistent across all three nodes, so it feels like it’s working as intended …
# ovs-vsctl show
f8096055-1b18-4ee3-ae5f-ffdc9873f4b8
Bridge br-int
fail_mode: secure
datapath_type: system
Port ovn-abd377-0
Interface ovn-abd377-0
type: geneve
options: {csum="true", key=flow, remote_ip="10.10.10.3"}
Port ovn-3c321d-0
Interface ovn-3c321d-0
type: geneve
options: {csum="true", key=flow, remote_ip="10.10.10.2"}
Port br-int
Interface br-int
type: internal
ovs_version: "3.1.0"
I have a bridge set up which both Incus and OVN are using;
# ifconfig br1
br1: flags=4163<UP,BROADCAST,RUNNING,MULTICAST> mtu 1500
inet 10.10.10.1 netmask 255.0.0.0 broadcast 10.10.10.255
inet6 2a00:23c7:3c21:cc01:6e6e:7ff:fe16:a2f7 prefixlen 64 scopeid 0x0<global>
inet6 fe80::6e6e:7ff:fe16:a2f7 prefixlen 64 scopeid 0x20<link>
ether 6c:6e:07:16:a2:f7 txqueuelen 1000 (Ethernet)
RX packets 70199 bytes 18206614 (17.3 MiB)
RX errors 0 dropped 0 overruns 0 frame 0
TX packets 1104773 bytes 197194883 (188.0 MiB)
TX errors 0 dropped 0 overruns 0 carrier 0 collisions 0
So if I do;
incus network create UPLINK --type=physical parent=br1 --target=core
incus network create UPLINK --type=physical parent=br1 --target=borg
incus network create UPLINK --type=physical parent=br1 --target=p400
incus network create UPLINK --type=physical
incus network set UPLINK ipv4.ovn.ranges=10.10.10.200-10.10.10.254
This seems to complete and UPLINK appears in the UI.
But, on the Overview page for UPLINK, the UI reports;
Could not load network state: Network interface "UPLINK" not found
Despite everything else saying it was “CREATED”;
# incus network list
+----------------+----------+---------+------+------+-------------+---------+---------+
| NAME | TYPE | MANAGED | IPV4 | IPV6 | DESCRIPTION | USED BY | STATE |
+----------------+----------+---------+------+------+-------------+---------+---------+
| UPLINK | physical | YES | | | | 0 | CREATED |
+----------------+----------+---------+------+------+-------------+---------+---------+
| br0 | bridge | NO | | | | 0 | |
+----------------+----------+---------+------+------+-------------+---------+---------+
| br1 | bridge | NO | | | | 2 | |
+----------------+----------+---------+------+------+-------------+---------+---------+
| br-int | bridge | NO | | | | 0 | |
+----------------+----------+---------+------+------+-------------+---------+---------+
| eth0 | physical | NO | | | | 0 | |
+----------------+----------+---------+------+------+-------------+---------+---------+
| eth1 | physical | NO | | | | 0 | |
+----------------+----------+---------+------+------+-------------+---------+---------+
| genev_sys_6081 | unknown | NO | | | | 0 | |
+----------------+----------+---------+------+------+-------------+---------+---------+
| lo | loopback | NO | | | | 0 | |
+----------------+----------+---------+------+------+-------------+---------+---------+
| ovs-system | unknown | NO | | | | 0 | |
+----------------+----------+---------+------+------+-------------+---------+---------+
| wlan0 | physical | NO | | | | 0 | |
+----------------+----------+---------+------+------+-------------+---------+---------+
And when I move on to create an OVN network, it gives me what I take to be a partially Bogus error that I’m guessing is the result of the network interface not actually having been created;
# incus network create my-ovn --type=ovn
Error: Failed generating auto config: Failed to automatically find an unused IPv4 subnet, manual configuration required
I’ve looked at all the logging I can find and I can’t seem to see what looks like an error message anywhere. Anyone any idea what might be wrong or where I can look to see why it doesn’t want to actually create UPLINK?
Working with Raspberry Pi’s, Raspberry Pi OS (Debian) self compiled kernel 6.6.78 kernel with Geneve module enabled. Incus version 6.10.1.
tia