But don’t think I saw anything about this referenced.
I currently use my own Wireguard VPN Mesh to interconnect at Layer 2, multiple LXD servers & their Containers/VMs across multiple nodes on multiple Clouds (Hetzner & Digital Ocean).
But I was thinking about @tomp work with LXD/VxLAN/OVN and wondered if there’s been any integration with that and LXD Clusters ?
Seems like LXD Clusters could then have member Nodes inter-cloud, inter-Datacenters ?
LXD clusters themselves do not need to be in the same subnet. Although we do not recommend doing WAN clusters (>5ms of latency between them) as dqlite requires low latency between members.
Normal bridge networks are created on each cluster member and use SNAT of the host’s external address, so they would be fine being in different subnets.
The fan network overlay requires the cluster members to be in the same subnet.
For OVN, the actual OVN overlay doesn’t require cluster members be in the same subnet.
However it is important to understand that in LXD each cluster can act as a potential ingress/egress point to the uplink network for all of the instances in that network (i.e there is only one active router gateway chassis in the network at a time).
This normally means that OVN uplink networks need to be in the same L2 subnet.
However it is not strictly true if you are only doing egress through the uplink and are doing SNAT on the host, and don’t mind the SNAT address changing depending on which cluster member chassis is active for that network.