Incus network bridge interfaces package drop

ckruijntjens · May 8, 2025, 7:21pm

Hi All,

I notice some package drop and the numbers keep increasing. Is there an easy way to find out what is going on? I used tcpdump to track different things. However o can not seem to find the source of this problem.

I have 2 systems (Servers) and both machines have on both bridges package drops. These are the statics of the bridge interfaces of 1 machine:

5: bridge0: <BROADCAST,MULTICAST,UP,LOWER_UP> mtu 1500 qdisc noqueue state UP mode DEFAULT group default qlen 1000
    link/ether b2:7e:d7:8c:3c:68 brd ff:ff:ff:ff:ff:ff
    RX:  bytes packets errors dropped  missed   mcast           
    1791224774  144289      0    9296       0   19323 
    TX:  bytes packets errors dropped carrier collsns           
       9505253   97463      0       0       0       0 
6: bridge1: <BROADCAST,MULTICAST,UP,LOWER_UP> mtu 1500 qdisc noqueue state UP mode DEFAULT group default qlen 1000
    link/ether f6:87:cb:95:28:94 brd ff:ff:ff:ff:ff:ff
    RX:  bytes packets errors dropped  missed   mcast           
       1603873   18758      0    9346       0     453 
    TX:  bytes packets errors dropped carrier collsns           
        734084    3149      0       0       0       0

Hope someone can help me with this strange behaviour. Everything is working fine inside my network so i dont understand why packages are being dropped.

ckruijntjens · May 8, 2025, 9:01pm

Hi Guys,

I found why there are dropped packages. I own 4 Netgear GS308EPP switches. All these switches have 2 options:

loop detection
upnp switch finder

So i disabled all this on all switches. no i dont have any dropped packages anymore. Is there a way to have these options enabled on the switches and dont show this as dropped packages on the bridge interfaces?

So my monitoring program is nice and quiet.

ckruijntjens · May 9, 2025, 9:14am

hmmm i still see some packet drops inside the containers and on the host.

However a lot less then before. When i run tcpdump on the interface the packet drops stop. any advice?

1: lo: <LOOPBACK,UP,LOWER_UP> mtu 65536 qdisc noqueue state UNKNOWN mode DEFAULT group default qlen 1000
    link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00
    RX:  bytes packets errors dropped  missed   mcast           
       4421326   25291      0       0       0       0 
    TX:  bytes packets errors dropped carrier collsns           
       4421326   25291      0       0       0       0 
2: enp4s0: <BROADCAST,MULTICAST,UP,LOWER_UP> mtu 1500 qdisc mq master bridge1 state UP mode DEFAULT group default qlen 1000
    link/ether 3c:7c:3f:d8:ae:a7 brd ff:ff:ff:ff:ff:ff
    RX:   bytes  packets errors dropped  missed   mcast           
     1427239295  3387341      0       0       0  131804 
    TX:   bytes  packets errors dropped carrier collsns           
    32741219422 22667810      0       0       0       0 
3: eno1: <BROADCAST,MULTICAST,UP,LOWER_UP> mtu 1500 qdisc fq_codel master bridge0 state UP mode DEFAULT group default qlen 1000
    link/ether 3c:7c:3f:d8:ae:a6 brd ff:ff:ff:ff:ff:ff
    RX:  bytes  packets errors dropped  missed   mcast           
    9178691007 11362624      0       0       0  124110 
    TX:  bytes  packets errors dropped carrier collsns           
    1009211915  5796670      0       0       0       0 
    altname enp0s31f6
4: bridge0: <BROADCAST,MULTICAST,UP,LOWER_UP> mtu 1500 qdisc noqueue state UP mode DEFAULT group default qlen 1000
    link/ether ce:b6:84:ca:bf:69 brd ff:ff:ff:ff:ff:ff
    RX:  bytes packets errors dropped  missed   mcast           
       5509420   57852      0      14       0    3258 
    TX:  bytes packets errors dropped carrier collsns           
       3628561   14237      0       0       0       0 
5: bridge1: <BROADCAST,MULTICAST,UP,LOWER_UP> mtu 1500 qdisc noqueue state UP mode DEFAULT group default qlen 1000
    link/ether f6:78:83:4d:28:e5 brd ff:ff:ff:ff:ff:ff
    RX:   bytes packets errors dropped  missed   mcast           
     1624692670 2842883      0     372       0  188459 
    TX:   bytes packets errors dropped carrier collsns           
    24696946707  440561      0       0       0       0 
6: bridge1.40@bridge1: <BROADCAST,MULTICAST,UP,LOWER_UP> mtu 1400 qdisc noqueue state UP mode DEFAULT group default qlen 1000
    link/ether f6:78:83:4d:28:e5 brd ff:ff:ff:ff:ff:ff
    RX:  bytes packets errors dropped  missed   mcast           
     924748399  522264      0       0       0     195 
    TX:  bytes packets errors dropped carrier collsns           
         36944     182      0       0       0       0 
7: bridge1.50@bridge1: <BROADCAST,MULTICAST,UP,LOWER_UP> mtu 1400 qdisc noqueue state UP mode DEFAULT group default qlen 1000
    link/ether f6:78:83:4d:28:e5 brd ff:ff:ff:ff:ff:ff
    RX:  bytes packets errors dropped  missed   mcast           
          1828      29      0       0       0      28 
    TX:  bytes packets errors dropped carrier collsns           
         36944     182      0       0       0       0 
9: veth9b65019f@if8: <BROADCAST,MULTICAST,UP,LOWER_UP> mtu 1500 qdisc noqueue master bridge1 state UP mode DEFAULT group default qlen 1000
    link/ether ca:e9:24:38:9e:99 brd ff:ff:ff:ff:ff:ff link-netnsid 0
    RX:  bytes packets errors dropped  missed   mcast           
      11191915   12825      0       0       0       0 
    TX:  bytes packets errors dropped carrier collsns           
      61191602  252177      0     103       0       0 
11: veth6958180b@if10: <BROADCAST,MULTICAST,UP,LOWER_UP> mtu 1500 qdisc noqueue master bridge1 state UP mode DEFAULT group default qlen 1000
    link/ether 02:3a:5a:29:ba:23 brd ff:ff:ff:ff:ff:ff link-netnsid 1
    RX:  bytes packets errors dropped  missed   mcast           
      78156336  298099      0       0       0       0 
    TX:  bytes packets errors dropped carrier collsns           
     297186890  537386      0     102       0       0 
12: tapd2044a27: <BROADCAST,MULTICAST,UP,LOWER_UP> mtu 1500 qdisc mq master bridge1 state UP mode DEFAULT group default qlen 1000
    link/ether 06:df:ba:06:76:52 brd ff:ff:ff:ff:ff:ff
    RX:  bytes packets errors dropped  missed   mcast           
      13099055   13035      0       0       0       0 
    TX:  bytes packets errors dropped carrier collsns           
      60546479  251665      0       0       0       0 
14: veth6ac7056a@if13: <BROADCAST,MULTICAST,UP,LOWER_UP> mtu 1500 qdisc noqueue master bridge1 state UP mode DEFAULT group default qlen 1000
    link/ether ca:74:22:0b:47:2a brd ff:ff:ff:ff:ff:ff link-netnsid 2
    RX:  bytes packets errors dropped  missed   mcast           
      30971185  180919      0       0       0       0 
    TX:  bytes packets errors dropped carrier collsns           
     161954557  477785      0     102       0       0 
16: veth202ecade@if15: <BROADCAST,MULTICAST,UP,LOWER_UP> mtu 1500 qdisc noqueue master bridge1 state UP mode DEFAULT group default qlen 1000
    link/ether d6:b6:c3:be:f4:30 brd ff:ff:ff:ff:ff:ff link-netnsid 3
    RX:  bytes packets errors dropped  missed   mcast           
      73035386  400280      0       0       0       0 
    TX:  bytes packets errors dropped carrier collsns           
    1096658931 1089271      0     102       0       0 
18: veth154a87bd@if17: <BROADCAST,MULTICAST,UP,LOWER_UP> mtu 1500 qdisc noqueue master bridge1 state UP mode DEFAULT group default qlen 1000
    link/ether ee:da:11:15:87:5a brd ff:ff:ff:ff:ff:ff link-netnsid 4
    RX:  bytes packets errors dropped  missed   mcast           
     658295189 4199294      0       0       0       0 
    TX:  bytes packets errors dropped carrier collsns           
    1372986648 3320449      0     102       0       0 
20: vethcc289464@if19: <BROADCAST,MULTICAST,UP,LOWER_UP> mtu 1500 qdisc noqueue master bridge1 state UP mode DEFAULT group default qlen 1000
    link/ether c6:a8:9c:fe:19:77 brd ff:ff:ff:ff:ff:ff link-netnsid 5
    RX:  bytes packets errors dropped  missed   mcast           
     100428205  139702      0       0       0       0 
    TX:  bytes packets errors dropped carrier collsns           
     154674025  388685      0     102       0       0 
21: tap42aee9bc: <BROADCAST,MULTICAST,UP,LOWER_UP> mtu 1500 qdisc mq master bridge1 state UP mode DEFAULT group default qlen 1000
    link/ether 96:00:87:6c:3b:d4 brd ff:ff:ff:ff:ff:ff
    RX:  bytes  packets errors dropped  missed   mcast           
    9783222068 10025789      0       0       0       0 
    TX:  bytes  packets errors dropped carrier collsns           
    2113615073  7161478      0       0       0       0 
22: tapb1af6ec3: <BROADCAST,MULTICAST,UP,LOWER_UP> mtu 1500 qdisc mq master bridge0 state UP mode DEFAULT group default qlen 1000
    link/ether 32:57:40:95:9c:d4 brd ff:ff:ff:ff:ff:ff
    RX:  bytes  packets errors dropped  missed   mcast           
     981340196  5782328      0       0       0       0 
    TX:  bytes  packets errors dropped carrier collsns           
    9090708032 11226057      0       0       0       0 
23: tap6e8dc695: <BROADCAST,MULTICAST,UP,LOWER_UP> mtu 1500 qdisc mq master bridge1 state UP mode DEFAULT group default qlen 1000
    link/ether aa:93:20:66:60:df brd ff:ff:ff:ff:ff:ff
    RX:  bytes packets errors dropped  missed   mcast           
      81196263  347862      0       0       0       0 
    TX:  bytes packets errors dropped carrier collsns           
     193711593  435822      0       0       0       0 
25: veth5dad8362@if24: <BROADCAST,MULTICAST,UP,LOWER_UP> mtu 1500 qdisc noqueue master bridge1 state UP mode DEFAULT group default qlen 1000
    link/ether 8a:cb:c9:ae:06:24 brd ff:ff:ff:ff:ff:ff link-netnsid 6
    RX:  bytes packets errors dropped  missed   mcast           
      11001351   12458      0       0       0       0 
    TX:  bytes packets errors dropped carrier collsns           
      60138410  250792      0       0       0       0 
26: tapc7e0ff31: <BROADCAST,MULTICAST,UP,LOWER_UP> mtu 1500 qdisc mq master bridge1 state UP mode DEFAULT group default qlen 1000
    link/ether 72:e6:80:be:2c:e5 brd ff:ff:ff:ff:ff:ff
    RX:  bytes packets errors dropped  missed   mcast           
      70408560  143409      0       0       0       0 
    TX:  bytes packets errors dropped carrier collsns           
     187485420  424011      0       0       0       0 
28: vethf24cc301@if27: <BROADCAST,MULTICAST,UP,LOWER_UP> mtu 1500 qdisc noqueue master bridge1 state UP mode DEFAULT group default qlen 1000
    link/ether d6:0f:2a:06:6d:40 brd ff:ff:ff:ff:ff:ff link-netnsid 7
    RX:  bytes packets errors dropped  missed   mcast           
      11828883   12492      0       0       0       0 
    TX:  bytes packets errors dropped carrier collsns           
      60112237  250759      0       0       0       0 
30: veth694ef529@if29: <BROADCAST,MULTICAST,UP,LOWER_UP> mtu 1500 qdisc noqueue master bridge1 state UP mode DEFAULT group default qlen 1000
    link/ether f2:e7:73:f9:7e:c5 brd ff:ff:ff:ff:ff:ff link-netnsid 8
    RX:  bytes packets errors dropped  missed   mcast           
      22897284   24149      0       0       0       0 
    TX:  bytes packets errors dropped carrier collsns           
      73522505  266443      0       0       0       0 
32: veth85aa9165@if31: <BROADCAST,MULTICAST,UP,LOWER_UP> mtu 1500 qdisc noqueue master bridge1 state UP mode DEFAULT group default qlen 1000
    link/ether ce:49:7f:ae:f0:cf brd ff:ff:ff:ff:ff:ff link-netnsid 9
    RX:  bytes packets errors dropped  missed   mcast           
      16631563   27413      0       0       0       0 
    TX:  bytes packets errors dropped carrier collsns           
      67813081  269569      0       0       0       0 
34: veth606f54fe@if33: <BROADCAST,MULTICAST,UP,LOWER_UP> mtu 1500 qdisc noqueue master bridge1 state UP mode DEFAULT group default qlen 1000
    link/ether c6:87:4d:87:c9:d1 brd ff:ff:ff:ff:ff:ff link-netnsid 10
    RX:  bytes packets errors dropped  missed   mcast           
      12231894   32804      0       0       0       0 
    TX:  bytes packets errors dropped carrier collsns           
     147180009  309004      0       0       0       0 
36: vethb6be6eed@if35: <BROADCAST,MULTICAST,UP,LOWER_UP> mtu 1500 qdisc noqueue master bridge1 state UP mode DEFAULT group default qlen 1000
    link/ether 96:67:8c:d1:d9:5c brd ff:ff:ff:ff:ff:ff link-netnsid 11
    RX:  bytes packets errors dropped  missed   mcast           
      12587150   13768      0       0       0       0 
    TX:  bytes packets errors dropped carrier collsns           
      60280434  252013      0       0       0       0 
38: veth6bd9f330@if37: <BROADCAST,MULTICAST,UP,LOWER_UP> mtu 1500 qdisc noqueue master bridge1 state UP mode DEFAULT group default qlen 1000
    link/ether 26:45:48:c3:b5:e1 brd ff:ff:ff:ff:ff:ff link-netnsid 13
    RX:  bytes packets errors dropped  missed   mcast           
      16249765   22293      0       0       0       0 
    TX:  bytes packets errors dropped carrier collsns           
      82674464  308683      0       0       0       0

ckruijntjens · May 14, 2025, 6:55pm

@stgraber do you have any experiense on this topic? When i run tcpdump on the interfaces that are dropping packages the drops are stopping. The moment i shutdown tcpdump the drops are returning.