L2 EVPN (VXLAN over BGP) for multi-tenancy?

Hi!

We are considering using Incus (and IncusOS) for a multi-tenancy LXC+VM solution. We are currently using L2 EVPN (exchanging VXLAN+MAC-address over BGP) for our network to provide private-networks to our users (and ourselves).

We can’t find any documentation on how to do this natively in Incus. The best approach seems to be to use OVS and handle it there?

Yeah, we don’t currently have native support for BGP EVPN with VXLAN but it’s something that I’d like to see us support natively.

We do have a built-in BGP server in Incus which may turn out to be useful for this, though I don’t know how much work would be involved in attaching go-bgp to the kernel VXLAN and NDP stuff as opposed to integrating with an external process like FRR.

1 Like

Shall we open an issue, in the hope of motivating people passing by which happen to be network experts?
I wouldn’t say no to the feature :slight_smile:

Sure, we can open an issue for it. It’s certainly something I’d like us to support, I just don’t know how difficult it would be to get go-bgp and the kernel’s VXLAN stuff to play ball :slight_smile:

I’ve done it by hand using FRR outside of Incus and it works fine, but that’s not exactly ideal as far as integration and having two BGP daemons on the same machine is a bit weird.

Let me see if I can work up a working example in the next few weeks. I don’t believe it’s very hard but let’s see..:

Please, please have fun with that one :slight_smile:
I should be fully booked on backup infrastructure design until January, but will happily join the effort then if needed!

@0fbe if you’re motivated, please make yourself known on Support BGP-EVPN with VXLAN · Issue #2738 · lxc/incus · GitHub so that you can be assigned to the issue. No pressure if you don’t want to commit to it now, obviously.