Host= Ubuntu 20.04 LTS
LXD (snap) = 5.0.1
Using ZFS storage pools on all hosts
My use case, I have a multiple VLAN network with 3 LXD hosts on the same (management) VLAN (layer 2 network), each host is statically addressed. I have all three hosts configured with a managed bridge (br0) to provide network abstraction, (as I can’t have all my containers on the same (macvlan) layer 2 network without issues of duplicate IPs) for security reasons. All VLANs are routed on the LAN and to the ISP uplink interface. The containers use static addresses as well. In the past I have used proxy devices in the container config for forwarding ingress traffic to containers running web apps (NGINX reverse-proxy, apache, email) especially when running in a public VPS, with great success. My goal with this project is to be able to migrate these web containers from one host to the other without re-addressing the containers. At the moment all three hosts use the same addressing scheme on the bridge (10.148.4.0/24), so the IP addresses move around without issue. All hosts are on the same VLAN, the containers currently just NAT the outbound traffic with “ipv4.nat: “true”” on the managed bridge.
My question is: can I use a network forward “floating IP” to push inbound/outbound traffic to/from the managed bridge by port number, then on to the containers? I have also considered VXLAN (multicast with tunnel.lan.protocol: vxlan) since the hosts all share the same L2 network, but I like to keep things as simple as possible. Either way I’d like to utilize the features in LXD where I can for simplicity. I am not using any routing protocols, no BGP, no OVS - just tagged interfaces at the host level and I let the edge router handle all the routing/filtering from the WAN. Is there any advantage with one over the other, between proxy , VXLAN, or floating IP forwards to the managed bridge?
Happy Holidays everyone!