LXD installation and init breaks Debian 11 network

kgardas · May 12, 2021, 7:42pm

Hi,

I do have Debian 11 RC1 installation on testing workstation and was curious if it is possible to have lxd running on it. So following installation guide I did steps above and ended with perfectly broken network setup. E.g. can’t ping hosts around, can’t reach anything and after reboot I’m not able to get even IP from network DHCPD:

$ sudo apt install snapd

$ sudo snap install lxd
lxd 4.14 from Canonical��� installed

$ sudo su - 
root@rtems:~# df -h
Filesystem      Size  Used Avail Use% Mounted on
udev            3.7G     0  3.7G   0% /dev
tmpfs           752M  1.5M  750M   1% /run
/dev/sda2       183G   66G  108G  38% /
tmpfs           3.7G     0  3.7G   0% /dev/shm
tmpfs           5.0M  4.0K  5.0M   1% /run/lock
/dev/loop0       33M   33M     0 100% /snap/snapd/11588
/dev/loop1       56M   56M     0 100% /snap/core18/1997
/dev/sda1       511M  5.4M  506M   2% /boot/efi
tmpfs           752M   48K  751M   1% /run/user/113
tmpfs           752M   44K  751M   1% /run/user/1000
/dev/loop2       71M   71M     0 100% /snap/lxd/20400

# lxd init
WARNING: cgroup v2 is not fully supported yet, proceeding with partial confinement
Would you like to use LXD clustering? (yes/no) [default=no]: 
Do you want to configure a new storage pool? (yes/no) [default=yes]: 
Name of the new storage pool [default=default]: 
Name of the storage backend to use (btrfs, dir, lvm, ceph) [default=btrfs]: 
Create a new BTRFS pool? (yes/no) [default=yes]: 
Would you like to use an existing empty block device (e.g. a disk or partition)? (yes/no [default=no]: 
Size in GB of the new loop device (1GB minimum) [default=30GB]: 
Would you like to connect to a MAAS server? (yes/no) [default=no]: 
Would you like to create a new local network bridge? (yes/no) [default=yes]: 
What should the new bridge be called? [default=lxdbr0]: 
What IPv4 address should be used? (CIDR subnet notation, ���auto��� or ���none���) [default=auto]: 
What IPv6 address should be used? (CIDR subnet notation, ���auto��� or ���none���) [default=auto]: 
Would you like the LXD server to be available over the network? (yes/no) [default=no]: 
Would you like stale cached images to be updated automatically? (yes/no) [default=yes] 
Would you like a YAML "lxd init" preseed to be printed? (yes/no) [default=no]: yes
config: {}
networks:
- config:
    ipv4.address: auto
    ipv6.address: auto
  description: ""
  name: lxdbr0
  type: ""
  project: default
storage_pools:
- config:
    size: 30GB
  description: ""
  name: default
  driver: btrfs
profiles:
- config: {}
  description: ""
  devices:
    eth0:
      name: eth0
      network: lxdbr0
      type: nic
    root:
      path: /
      pool: default
      type: disk
  name: default
projects: []
cluster: null

root@rtems:~# ip addr
1: lo: <LOOPBACK,UP,LOWER_UP> mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000
    link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00
    inet 127.0.0.1/8 scope host lo
       valid_lft forever preferred_lft forever
    inet6 ::1/128 scope host 
       valid_lft forever preferred_lft forever
2: enp3s0: <BROADCAST,MULTICAST,UP,LOWER_UP> mtu 1500 qdisc mq state UP group default qlen 1000
    link/ether 00:30:59:12:28:85 brd ff:ff:ff:ff:ff:ff
    inet 10.0.10.34/24 brd 10.0.10.255 scope global dynamic noprefixroute enp3s0
       valid_lft 42853sec preferred_lft 42853sec
    inet6 fe80::230:59ff:fe12:2885/64 scope link noprefixroute 
       valid_lft forever preferred_lft forever
3: enp0s31f6: <NO-CARRIER,BROADCAST,MULTICAST,UP> mtu 1500 qdisc pfifo_fast state DOWN group default qlen 1000
    link/ether 00:30:59:20:04:9a brd ff:ff:ff:ff:ff:ff
4: lxdbr0: <NO-CARRIER,BROADCAST,MULTICAST,UP> mtu 1500 qdisc noqueue state DOWN group default qlen 1000
    link/ether 00:16:3e:81:fa:76 brd ff:ff:ff:ff:ff:ff
    inet 10.31.182.1/24 scope global lxdbr0
       valid_lft forever preferred_lft forever
    inet6 fd42:b4e1:1279:5576::1/64 scope global 
       valid_lft forever preferred_lft forever
root@rtems:~# 

root@rtems:~# ping 10.0.10.138
PING 10.0.10.138 (10.0.10.138) 56(84) bytes of data.
64 bytes from 10.0.10.138: icmp_seq=1 ttl=255 time=0.601 ms
64 bytes from 10.0.10.138: icmp_seq=2 ttl=255 time=0.259 ms
64 bytes from 10.0.10.138: icmp_seq=3 ttl=255 time=0.513 ms
From 10.0.10.34 icmp_seq=10 Destination Host Unreachable
From 10.0.10.34 icmp_seq=11 Destination Host Unreachable
From 10.0.10.34 icmp_seq=12 Destination Host Unreachable
From 10.0.10.34 icmp_seq=13 Destination Host Unreachable
From 10.0.10.34 icmp_seq=14 Destination Host Unreachable

As you can see above, after configuration I’ve been lucky and network was working for the last 3 icmp ping requests and then stopped.

I’ve duplicated this issue not only on latest 4.x release (from snap), but also with stable 4.0 channel release.

route table seems to be ok:

root@rtems:~# ip route
default via 10.0.10.138 dev enp3s0 proto dhcp metric 100 
10.0.10.0/24 dev enp3s0 proto kernel scope link src 10.0.10.34 metric 100 
10.31.182.0/24 dev lxdbr0 proto kernel scope link src 10.31.182.1 linkdown 
 root@rtems:~#

The recovery from this state was hard uninstall of lxd:

root@rtems:~# snap remove lxd
lxd removed
root@rtems:~#

and then restart of the box and also hard restart (power off for few seconds) of attached Cisco small business switch. After that business was back again and network working.

As this is pretty default configuration I would appreciate any idea what’s broken or if I made any mistake in the installation and init.

Thanks!
Karel

stgraber · May 12, 2021, 8:40pm

This is pretty odd, especially that you would have needed a reboot of the switch too.

What comes to mind would potentially be some weirdness because of existing nft based firewalling on the system? Might be useful to capture nft list ruleset, iptables -L -n -v and ip6tables -L -n -v when things are broken to see what may be going on. dmesg output is also always a good one to get.

kgardas · May 13, 2021, 9:27am

root@rtems:~# nft list ruleset
bash: nft: command not found
root@rtems:~# iptables -L -n -v
Chain INPUT (policy ACCEPT 0 packets, 0 bytes)
 pkts bytes target     prot opt in     out     source               destination         

Chain FORWARD (policy ACCEPT 0 packets, 0 bytes)
 pkts bytes target     prot opt in     out     source               destination         

Chain OUTPUT (policy ACCEPT 0 packets, 0 bytes)
 pkts bytes target     prot opt in     out     source               destination         
root@rtems:~# ip6tables -L -n -v
Chain INPUT (policy ACCEPT 0 packets, 0 bytes)
 pkts bytes target     prot opt in     out     source               destination         

Chain FORWARD (policy ACCEPT 0 packets, 0 bytes)
 pkts bytes target     prot opt in     out     source               destination         

Chain OUTPUT (policy ACCEPT 0 packets, 0 bytes)
 pkts bytes target     prot opt in     out     source               destination         
root@rtems:~#

Please note that switch behavior is indeed interesting. I’ve thought this will be arp related issue hence cured by time, but even if I start machine after night, it’s still w/o network and only switch restart fixed that.

tomp · May 13, 2021, 10:33am

Please can you install nftables and then re-run sudo nft list ruleset, as its possible you have nft rules in place even without the tool being installed.

kgardas · May 13, 2021, 11:16am

This is after uninstallation of lxd and restarting the switch. Please note machine does not need to be restarted. Just switch and machine than happily gets its DHCP IP.

root@rtems:~# nft list ruleset
table inet lxd {
}
root@rtems:~#

and now, this is with lxd 4.14 installed and initialized and network not working:

root@rtems:~# nft list ruleset
table inet lxd {
    chain pstrt.lxdbr0 {
            type nat hook postrouting priority srcnat; policy accept;
            ip saddr 10.225.158.0/24 ip daddr != 10.225.158.0/24 masquerade
            ip6 saddr fd42:6d7f:531f:7936::/64 ip6 daddr != fd42:6d7f:531f:7936::/64 masquerade
    }

    chain fwd.lxdbr0 {
            type filter hook forward priority filter; policy accept;
            ip version 4 oifname "lxdbr0" accept
            ip version 4 iifname "lxdbr0" accept
            ip6 version 6 oifname "lxdbr0" accept
            ip6 version 6 iifname "lxdbr0" accept
    }

    chain in.lxdbr0 {
            type filter hook input priority filter; policy accept;
            iifname "lxdbr0" tcp dport 53 accept
            iifname "lxdbr0" udp dport 53 accept
            iifname "lxdbr0" udp dport 67 accept
            iifname "lxdbr0" udp dport 547 accept
    }

    chain out.lxdbr0 {
            type filter hook output priority filter; policy accept;
            oifname "lxdbr0" tcp sport 53 accept
            oifname "lxdbr0" udp sport 53 accept
            oifname "lxdbr0" udp sport 67 accept
            oifname "lxdbr0" udp sport 547 accept
    }
}
root@rtems:~#

I’ve also logged into switch ssh and have not seen any complains logging messages there. Please also note that switch is using VLANs and the machine is connected to VLAN 10 but port configuration is untagged hence packets going to machine should not have VLAN tag inside them.

tomp · May 13, 2021, 11:21am

Any of interesting in journalctl after you install LXD? There are no issues with those firewall rulles.

kgardas · May 13, 2021, 11:39am

Thanks for verification, now journalctl:

May 13 13:13:26 rtems lxd.daemon[3929]: => Starting LXD
May 13 13:13:26 rtems lxd.daemon[4099]: t=2021-05-13T13:13:26+0200 lvl=warn msg=" - Couldn't find the CGroup network priority controller, network priority will be ignored"
May 13 13:13:27 rtems lxd.daemon[3929]: => First LXD execution on this system
May 13 13:13:27 rtems lxd.daemon[3929]: => LXD is ready
May 13 13:13:34 rtems NetworkManager[501]: <info>  [1620904414.8664] manager: (lxdbr0): new Bridge device (/org/freedesktop/NetworkManager/Devices/5)
May 13 13:13:34 rtems systemd-udevd[4172]: Using default interface naming scheme 'v247'.
May 13 13:13:34 rtems systemd-udevd[4172]: ethtool: autonegotiation is unset or enabled, the speed and duplex are not writable.
May 13 13:13:34 rtems avahi-daemon[496]: Joining mDNS multicast group on interface lxdbr0.IPv4 with address 10.225.158.1.
May 13 13:13:34 rtems avahi-daemon[496]: New relevant interface lxdbr0.IPv4 for mDNS.
May 13 13:13:34 rtems NetworkManager[501]: <info>  [1620904414.9313] device (lxdbr0): state change: unmanaged -> unavailable (reason 'connection-assumed', sys-iface-state: 'external')
May 13 13:13:34 rtems avahi-daemon[496]: Registering new address record for 10.225.158.1 on lxdbr0.IPv4.
May 13 13:13:34 rtems NetworkManager[501]: <info>  [1620904414.9361] device (lxdbr0): state change: unavailable -> disconnected (reason 'connection-assumed', sys-iface-state: 'external')
May 13 13:13:34 rtems NetworkManager[501]: <info>  [1620904414.9376] device (lxdbr0): Activation: starting connection 'lxdbr0' (569254b2-202d-45a8-b675-34306a497d80)
May 13 13:13:34 rtems NetworkManager[501]: <info>  [1620904414.9378] device (lxdbr0): state change: disconnected -> prepare (reason 'none', sys-iface-state: 'external')
May 13 13:13:34 rtems NetworkManager[501]: <info>  [1620904414.9385] device (lxdbr0): state change: prepare -> config (reason 'none', sys-iface-state: 'external')
May 13 13:13:34 rtems NetworkManager[501]: <info>  [1620904414.9389] device (lxdbr0): state change: config -> ip-config (reason 'none', sys-iface-state: 'external')
May 13 13:13:34 rtems NetworkManager[501]: <info>  [1620904414.9393] device (lxdbr0): state change: ip-config -> ip-check (reason 'none', sys-iface-state: 'external')
May 13 13:13:34 rtems dbus-daemon[498]: [system] Activating via systemd: service name='org.freedesktop.nm_dispatcher' unit='dbus-org.freedesktop.nm-dispatcher.service' requested by ':1.7' ()
May 13 13:13:34 rtems avahi-daemon[496]: Joining mDNS multicast group on interface lxdbr0.IPv6 with address fd42:6d7f:531f:7936::1.
May 13 13:13:34 rtems avahi-daemon[496]: New relevant interface lxdbr0.IPv6 for mDNS.
May 13 13:13:34 rtems avahi-daemon[496]: Registering new address record for fd42:6d7f:531f:7936::1 on lxdbr0.*.
May 13 13:13:34 rtems systemd[1]: Starting Network Manager Script Dispatcher Service...
May 13 13:13:34 rtems dbus-daemon[498]: [system] Successfully activated service 'org.freedesktop.nm_dispatcher'
May 13 13:13:34 rtems systemd[1]: Started Network Manager Script Dispatcher Service.
May 13 13:13:34 rtems NetworkManager[501]: <info>  [1620904414.9704] device (lxdbr0): state change: ip-check -> secondaries (reason 'none', sys-iface-state: 'external')
May 13 13:13:34 rtems NetworkManager[501]: <info>  [1620904414.9708] device (lxdbr0): state change: secondaries -> activated (reason 'none', sys-iface-state: 'external')
May 13 13:13:34 rtems NetworkManager[501]: <info>  [1620904414.9723] device (lxdbr0): Activation: successful, device activated.
May 13 13:13:35 rtems kernel: kauditd_printk_skb: 18 callbacks suppressed
May 13 13:13:35 rtems kernel: audit: type=1400 audit(1620904415.009:142): apparmor="STATUS" operation="profile_load" profile="unconfined" name="lxd_dnsmasq-lxdbr0_</var/snap/lxd/common/lxd>"
May 13 13:13:35 rtems audit[4192]: AVC apparmor="STATUS" operation="profile_load" profile="unconfined" name="lxd_dnsmasq-lxdbr0_</var/snap/lxd/common/lxd>" pid=4192 comm="apparmor_parser"
May 13 13:13:35 rtems kernel: BTRFS: device label default devid 1 transid 5 /dev/loop4 scanned by lxd (4152)
May 13 13:13:35 rtems kernel: BTRFS info (device loop4): disk space caching is enabled
May 13 13:13:35 rtems kernel: BTRFS info (device loop4): has skinny extents
May 13 13:13:35 rtems kernel: BTRFS info (device loop4): flagging fs with big metadata feature
May 13 13:13:35 rtems kernel: BTRFS info (device loop4): enabling ssd optimizations
May 13 13:13:35 rtems kernel: BTRFS info (device loop4): creating UUID tree
May 13 13:13:35 rtems kernel: BTRFS info (device loop4): disk space caching is enabled
May 13 13:13:35 rtems kernel: BTRFS info (device loop4): has skinny extents
May 13 13:13:35 rtems kernel: BTRFS info (device loop4): enabling ssd optimizations
May 13 13:13:35 rtems systemd[1]: snap.lxd.lxd.3f6f9315-b619-4161-9f0d-3687e7742c82.scope: Succeeded.
May 13 13:13:35 rtems systemd[1]: snap.lxd.lxd.3f6f9315-b619-4161-9f0d-3687e7742c82.scope: Consumed 1.036s CPU time.
May 13 13:13:35 rtems dnsmasq[4205]: started, version 2.79 cachesize 150
May 13 13:13:35 rtems dnsmasq[4205]: compile time options: IPv6 GNU-getopt DBus i18n IDN DHCP DHCPv6 no-Lua TFTP conntrack ipset auth nettlehash DNSSEC loop-detect inotify
May 13 13:13:35 rtems dnsmasq-dhcp[4205]: DHCP, IP range 10.225.158.2 -- 10.225.158.254, lease time 1h
May 13 13:13:35 rtems dnsmasq-dhcp[4205]: DHCPv6 stateless on lxdbr0
May 13 13:13:35 rtems dnsmasq-dhcp[4205]: DHCPv4-derived IPv6 names on lxdbr0
May 13 13:13:35 rtems dnsmasq-dhcp[4205]: router advertisement on lxdbr0
May 13 13:13:35 rtems dnsmasq-dhcp[4205]: DHCPv6 stateless on fd42:6d7f:531f:7936::, constructed for lxdbr0
May 13 13:13:35 rtems dnsmasq-dhcp[4205]: DHCPv4-derived IPv6 names on fd42:6d7f:531f:7936::, constructed for lxdbr0
May 13 13:13:35 rtems dnsmasq-dhcp[4205]: router advertisement on fd42:6d7f:531f:7936::, constructed for lxdbr0
May 13 13:13:35 rtems dnsmasq-dhcp[4205]: IPv6 router advertisement enabled
May 13 13:13:35 rtems dnsmasq-dhcp[4205]: DHCP, sockets bound exclusively to interface lxdbr0
May 13 13:13:35 rtems dnsmasq[4205]: using local addresses only for domain lxd
May 13 13:13:35 rtems dnsmasq[4205]: reading /etc/resolv.conf
May 13 13:13:35 rtems dnsmasq[4205]: using local addresses only for domain lxd
May 13 13:13:35 rtems dnsmasq[4205]: using nameserver 10.0.10.138#53
May 13 13:13:35 rtems dnsmasq[4205]: read /etc/hosts - 5 addresses
May 13 13:13:44 rtems systemd[1]: NetworkManager-dispatcher.service: Succeeded.
May 13 13:15:01 rtems CRON[4261]: pam_unix(cron:session): session opened for user root(uid=0) by (uid=0)
May 13 13:15:01 rtems CRON[4262]: (root) CMD (command -v debian-sa1 > /dev/null && debian-sa1 1 1)
May 13 13:15:01 rtems CRON[4261]: pam_unix(cron:session): session closed for user root
May 13 13:17:01 rtems CRON[4264]: pam_unix(cron:session): session opened for user root(uid=0) by (uid=0)
May 13 13:17:01 rtems CRON[4265]: (root) CMD (   cd / && run-parts --report /etc/cron.hourly)
May 13 13:17:01 rtems CRON[4264]: pam_unix(cron:session): session closed for user root
May 13 13:25:01 rtems CRON[4269]: pam_unix(cron:session): session opened for user root(uid=0) by (uid=0)
May 13 13:25:01 rtems CRON[4270]: (root) CMD (command -v debian-sa1 > /dev/null && debian-sa1 1 1)
May 13 13:25:01 rtems CRON[4269]: pam_unix(cron:session): session closed for user root
May 13 13:30:01 rtems CRON[4273]: pam_unix(cron:session): session opened for user root(uid=0) by (uid=0)
May 13 13:30:01 rtems CRON[4275]: (root) CMD ([ -x /etc/init.d/anacron ] && if [ ! -d /run/systemd/system ]; then /usr/sbin/invoke-rc.d anacron start >/dev/null; fi)
May 13 13:30:01 rtems CRON[4273]: pam_unix(cron:session): session closed for user root
May 13 13:31:19 rtems systemd[1]: Started Run anacron jobs.
May 13 13:31:19 rtems anacron[4277]: Anacron 2.3 started on 2021-05-13
May 13 13:31:19 rtems anacron[4277]: Normal exit (0 jobs run)
May 13 13:31:19 rtems systemd[1]: anacron.service: Succeeded.
root@rtems:~#

I don’t see any particular issue there, but I’m no expert of course. Thanks for looking into it!
Karel

kgardas · May 13, 2021, 11:40am

journalctl dump above mentions hosts and resolve files, so let’s copy them here too:

root@rtems:~# cat /etc/resolv.conf 
# Generated by NetworkManager
nameserver 10.0.10.138
root@rtems:~# cat /etc/hosts
127.0.0.1       localhost
127.0.1.1       rtems.localdomain       rtems

# The following lines are desirable for IPv6 capable hosts
::1     localhost ip6-localhost ip6-loopback
ff02::1 ip6-allnodes
ff02::2 ip6-allrouters
root@rtems:~#

tomp · May 13, 2021, 11:42am

Can you install lxd again such that the network is broken, but before that install tcpdump, and then run sudo tcpdump -i enp3s0 -nn and then run your ping to your router and see what happens.

kgardas · May 13, 2021, 12:27pm

My network is currently broken. I already do have tcpdump so I guess no need to reinstall/reset etc.

Now let’s see:

root@rtems:~# tcpdump -i enp3s0 -nn > /tmp/dump.txt 2>&1 &
[1] 4320
root@rtems:~# ping 10.0.10.138
PING 10.0.10.138 (10.0.10.138) 56(84) bytes of data.
From 10.0.10.34 icmp_seq=1 Destination Host Unreachable
From 10.0.10.34 icmp_seq=2 Destination Host Unreachable
From 10.0.10.34 icmp_seq=3 Destination Host Unreachable
From 10.0.10.34 icmp_seq=4 Destination Host Unreachable
From 10.0.10.34 icmp_seq=5 Destination Host Unreachable
From 10.0.10.34 icmp_seq=6 Destination Host Unreachable
^C
--- 10.0.10.138 ping statistics ---
8 packets transmitted, 0 received, +6 errors, 100% packet loss, time 7153ms

pipe 4
root@rtems:~#

And tcpdump output:

root@rtems:~# cat /tmp/dump.txt 
tcpdump: verbose output suppressed, use -v[v]... for full protocol decode
listening on enp3s0, link-type EN10MB (Ethernet), snapshot length 262144 bytes
13:48:32.144789 IP 0.0.0.0.68 > 255.255.255.255.67: BOOTP/DHCP, Request from 00:77:8d:da:c0:ce, length 300
13:48:32.775164 STP 802.1w, Rapid STP, Flags [Learn, Forward, Agreement], bridge-id 8000.00:77:8d:da:c0:ce.8006, length 36
13:48:33.044784 ARP, Request who-has 10.0.0.101 tell 10.0.0.101, length 46
13:48:33.655405 IP 10.0.0.101.5353 > 224.0.0.251.5353: 0- [0q] 1/0/0 TXT "type=0" "version=1" "refresh-age-timeout=0" "priority=6" "refresh-flag=0" "root-mac-address=00:8e:73:2c:1f:a5" "cos)
13:48:33.655816 IP 10.0.30.254.5353 > 224.0.0.251.5353: 0- [0q] 1/0/0 TXT "type=0" "version=1" "refresh-age-timeout=0" "priority=6" "refresh-flag=0" "root-mac-address=00:8e:73:2c:1f:a5" "co)
13:48:34.555623 IP 0.0.0.0.68 > 255.255.255.255.67: BOOTP/DHCP, Request from 3c:57:31:4c:00:cd, length 300
13:48:34.775173 STP 802.1w, Rapid STP, Flags [Learn, Forward, Agreement], bridge-id 8000.00:77:8d:da:c0:ce.8006, length 36
13:48:36.775172 STP 802.1w, Rapid STP, Flags [Learn, Forward, Agreement], bridge-id 8000.00:77:8d:da:c0:ce.8006, length 36
13:48:37.525374 LLDP, length 119: switchdac0ce
13:48:37.778987 ARP, Request who-has 10.0.10.138 tell 10.0.10.34, length 28
13:48:38.018349 LLDP, length 215: rtems.localdomain
13:48:38.655035 IP 10.0.30.253.5353 > 224.0.0.251.5353: 0- [0q] 1/0/0 TXT "type=0" "version=1" "refresh-age-timeout=0" "priority=6" "refresh-flag=0" "root-mac-address=00:77:8d:da:c0:ce" "co)
13:48:38.656342 IP 10.0.0.101.5353 > 224.0.0.251.5353: 0- [0q] 1/0/0 TXT "type=0" "version=1" "refresh-age-timeout=0" "priority=6" "refresh-flag=0" "root-mac-address=00:8e:73:2c:1f:a5" "cos)
13:48:38.656759 IP 10.0.30.254.5353 > 224.0.0.251.5353: 0- [0q] 1/0/0 TXT "type=0" "version=1" "refresh-age-timeout=0" "priority=6" "refresh-flag=0" "root-mac-address=00:8e:73:2c:1f:a5" "co)
13:48:38.657468 IP 10.0.0.101.5353 > 224.0.0.251.5353: 0- [0q] 1/0/0 TXT "type=0" "version=1" "refresh-age-timeout=0" "priority=6" "refresh-flag=0" "root-mac-address=00:77:8d:da:c0:ce" "cos)
13:48:38.660263 IP 10.0.30.253.5353 > 224.0.0.251.5353: 0- [0q] 1/0/0 TXT "type=0" "version=1" "refresh-age-timeout=0" "priority=6" "refresh-flag=0" "root-mac-address=00:77:8d:da:c0:ce" "co)
13:48:38.775160 STP 802.1w, Rapid STP, Flags [Learn, Forward, Agreement], bridge-id 8000.00:77:8d:da:c0:ce.8006, length 36
13:48:38.788355 ARP, Request who-has 10.0.10.138 tell 10.0.10.34, length 28
13:48:39.812355 ARP, Request who-has 10.0.10.138 tell 10.0.10.34, length 28
13:48:40.206065 ARP, Request who-has 10.0.0.101 tell 10.0.0.101, length 46
13:48:40.775175 STP 802.1w, Rapid STP, Flags [Learn, Forward, Agreement], bridge-id 8000.00:77:8d:da:c0:ce.8006, length 36
13:48:40.836546 ARP, Request who-has 10.0.10.138 tell 10.0.10.34, length 28
13:48:41.155161 ARP, Request who-has 10.0.30.138 tell 10.0.30.254, length 46
13:48:41.860364 ARP, Request who-has 10.0.10.138 tell 10.0.10.34, length 28
13:48:42.775193 STP 802.1w, Rapid STP, Flags [Learn, Forward, Agreement], bridge-id 8000.00:77:8d:da:c0:ce.8006, length 36
13:48:42.884353 ARP, Request who-has 10.0.10.138 tell 10.0.10.34, length 28
13:48:43.655066 IP 10.0.30.253.5353 > 224.0.0.251.5353: 0- [0q] 1/0/0 TXT "type=0" "version=1" "refresh-age-timeout=0" "priority=6" "refresh-flag=0" "root-mac-address=00:77:8d:da:c0:ce" "co)
13:48:43.656288 IP 10.0.0.101.5353 > 224.0.0.251.5353: 0- [0q] 1/0/0 TXT "type=0" "version=1" "refresh-age-timeout=0" "priority=6" "refresh-flag=0" "root-mac-address=00:77:8d:da:c0:ce" "cos)
13:48:43.657867 IP 10.0.30.253.5353 > 224.0.0.251.5353: 0- [0q] 1/0/0 TXT "type=0" "version=1" "refresh-age-timeout=0" "priority=6" "refresh-flag=0" "root-mac-address=00:77:8d:da:c0:ce" "co)
13:48:43.908512 ARP, Request who-has 10.0.10.138 tell 10.0.10.34, length 28
13:48:44.144783 IP 0.0.0.0.68 > 255.255.255.255.67: BOOTP/DHCP, Request from 00:77:8d:da:c0:ce, length 300
13:48:44.775195 STP 802.1w, Rapid STP, Flags [Learn, Forward, Agreement], bridge-id 8000.00:77:8d:da:c0:ce.8006, length 36
13:48:44.932362 ARP, Request who-has 10.0.10.138 tell 10.0.10.34, length 28
13:48:45.956362 ARP, Request who-has 10.0.10.138 tell 10.0.10.34, length 28
13:48:46.555672 IP 0.0.0.0.68 > 255.255.255.255.67: BOOTP/DHCP, Request from 3c:57:31:4c:00:cd, length 300
13:48:46.775212 STP 802.1w, Rapid STP, Flags [Learn, Forward, Agreement], bridge-id 8000.00:77:8d:da:c0:ce.8006, length 36
13:48:47.297098 ARP, Request who-has 10.0.0.101 tell 10.0.0.101, length 46
13:48:48.775649 STP 802.1w, Rapid STP, Flags [Learn, Forward, Agreement], bridge-id 8000.00:77:8d:da:c0:ce.8006, length 36
13:48:50.395852 IP6 fe80::277:8dff:feda:c0ce.546 > ff02::1:2.547: dhcp6 inf-req
13:48:50.775213 STP 802.1w, Rapid STP, Flags [Learn, Forward, Agreement], bridge-id 8000.00:77:8d:da:c0:ce.8006, length 36
13:48:52.775203 STP 802.1w, Rapid STP, Flags [Learn, Forward, Agreement], bridge-id 8000.00:77:8d:da:c0:ce.8006, length 36
13:48:54.023338 IP6 :: > ff02::1: HBH ICMP6, multicast listener querymax resp delay: 1000 addr: ::, length 24
13:48:54.023341 IP 0.0.0.0 > 224.0.0.1: igmp query v2
13:48:54.024740 IP 0.0.0.0 > 224.0.0.1: igmp query v2
13:48:54.024760 IP 0.0.0.0 > 224.0.0.1: igmp query v2
13:48:54.025258 IP6 :: > ff02::1: HBH ICMP6, multicast listener querymax resp delay: 1000 addr: ::, length 24
13:48:54.027321 IP6 :: > ff02::1: HBH ICMP6, multicast listener querymax resp delay: 1000 addr: ::, length 24
13:48:54.028032 IP 0.0.0.0 > 224.0.0.1: igmp query v2
13:48:54.029147 IP6 :: > ff02::1: HBH ICMP6, multicast listener querymax resp delay: 1000 addr: ::, length 24
13:48:54.430888 ARP, Request who-has 10.0.0.101 tell 10.0.0.101, length 46
13:48:54.775223 STP 802.1w, Rapid STP, Flags [Learn, Forward, Agreement], bridge-id 8000.00:77:8d:da:c0:ce.8006, length 36
13:48:55.396367 IP 10.0.10.34 > 224.0.0.251: igmp v2 report 224.0.0.251
13:48:56.144867 IP 0.0.0.0.68 > 255.255.255.255.67: BOOTP/DHCP, Request from 00:77:8d:da:c0:ce, length 300
13:48:56.775224 STP 802.1w, Rapid STP, Flags [Learn, Forward, Agreement], bridge-id 8000.00:77:8d:da:c0:ce.8006, length 36
13:48:57.825355 IP6 fe80::277:8dff:feda:c0ce.546 > ff02::1:2.547: dhcp6 solicit
13:48:58.555694 IP 0.0.0.0.68 > 255.255.255.255.67: BOOTP/DHCP, Request from 3c:57:31:4c:00:cd, length 300
13:48:58.775211 STP 802.1w, Rapid STP, Flags [Learn, Forward, Agreement], bridge-id 8000.00:77:8d:da:c0:ce.8006, length 36
13:49:00.775249 STP 802.1w, Rapid STP, Flags [Learn, Forward, Agreement], bridge-id 8000.00:77:8d:da:c0:ce.8006, length 36
13:49:01.691335 ARP, Request who-has 10.0.0.101 tell 10.0.0.101, length 46
13:49:02.623660 IP 10.0.30.110 > 239.255.255.250: igmp v2 report 239.255.255.250
13:49:02.775233 STP 802.1w, Rapid STP, Flags [Learn, Forward, Agreement], bridge-id 8000.00:77:8d:da:c0:ce.8006, length 36
13:49:03.655195 IP 10.0.0.101.5353 > 224.0.0.251.5353: 0- [0q] 1/0/0 TXT "type=0" "version=1" "refresh-age-timeout=0" "priority=6" "refresh-flag=0" "root-mac-address=00:8e:73:2c:1f:a5" "cos)
13:49:03.655610 IP 10.0.30.254.5353 > 224.0.0.251.5353: 0- [0q] 1/0/0 TXT "type=0" "version=1" "refresh-age-timeout=0" "priority=6" "refresh-flag=0" "root-mac-address=00:8e:73:2c:1f:a5" "co)
13:49:04.775232 STP 802.1w, Rapid STP, Flags [Learn, Forward, Agreement], bridge-id 8000.00:77:8d:da:c0:ce.8006, length 36
13:49:06.775244 STP 802.1w, Rapid STP, Flags [Learn, Forward, Agreement], bridge-id 8000.00:77:8d:da:c0:ce.8006, length 36
13:49:07.524935 LLDP, length 119: switchdac0ce
13:49:08.021889 LLDP, length 215: rtems.localdomain
13:49:08.144863 IP 0.0.0.0.68 > 255.255.255.255.67: BOOTP/DHCP, Request from 00:77:8d:da:c0:ce, length 300
13:49:08.655101 IP 10.0.30.253.5353 > 224.0.0.251.5353: 0- [0q] 1/0/0 TXT "type=0" "version=1" "refresh-age-timeout=0" "priority=6" "refresh-flag=0" "root-mac-address=00:77:8d:da:c0:ce" "co)
13:49:08.655104 IP 10.0.0.101.5353 > 224.0.0.251.5353: 0- [0q] 1/0/0 TXT "type=0" "version=1" "refresh-age-timeout=0" "priority=6" "refresh-flag=0" "root-mac-address=00:8e:73:2c:1f:a5" "cos)
13:49:08.656680 IP 10.0.30.254.5353 > 224.0.0.251.5353: 0- [0q] 1/0/0 TXT "type=0" "version=1" "refresh-age-timeout=0" "priority=6" "refresh-flag=0" "root-mac-address=00:8e:73:2c:1f:a5" "co)
 13:49:08.657429 IP 10.0.0.101.5353 > 224.0.0.251.5353: 0- [0q] 1/0/0 TXT "type=0" "version=1" "refresh-age-timeout=0" "priority=6" "refresh-flag=0" "root-mac-address=00:77:8d:da:c0:ce" "cos)
 13:49:08.659597 IP 10.0.30.253.5353 > 224.0.0.251.5353: 0- [0q] 1/0/0 TXT "type=0" "version=1" "refresh-age-timeout=0" "priority=6" "refresh-flag=0" "root-mac-address=00:77:8d:da:c0:ce" "co)
 13:49:08.775228 STP 802.1w, Rapid STP, Flags [Learn, Forward, Agreement], bridge-id 8000.00:77:8d:da:c0:ce.8006, length 36
13:49:09.475376 ARP, Request who-has 10.0.0.101 tell 10.0.0.101, length 46
13:49:10.555721 IP 0.0.0.0.68 > 255.255.255.255.67: BOOTP/DHCP, Request from 3c:57:31:4c:00:cd, length 300
13:49:10.775241 STP 802.1w, Rapid STP, Flags [Learn, Forward, Agreement], bridge-id 8000.00:77:8d:da:c0:ce.8006, length 36
13:49:12.775254 STP 802.1w, Rapid STP, Flags [Learn, Forward, Agreement], bridge-id 8000.00:77:8d:da:c0:ce.8006, length 36
13:49:13.575657 CDPv2, ttl: 180s, Device-ID '00778ddac0ce'
      0x0000:  0000 0002 0101 cc00 040a 001e fd02 08aa
      0x0010:  aa03 0000 0086 dd00 10fe 8000 0000 0000
      0x0020:  0002 778d fffe dac0 ce
      0x0000:  6769 36
      0x0000:  0000 0029
      0x0000:  322e 352e 372e 3835
      0x0000:  4369 7363 6f20 5347 3235 302d 3038 4850
      0x0010:  2028 5049 443a 5347 3235 302d 3038 4850
      0x0020:  2d4b 3929 2d56 5344
      0x0000:  0001
      0x0000:  01
      0x0000:  00
      0x0000:  00
      0x0000:  7377 6974 6368 6461 6330 6365
      0x0000:  0000 35fb 0000 0000 ffff ffff, length 189
13:49:13.655111 IP 10.0.0.101.5353 > 224.0.0.251.5353: 0- [0q] 1/0/0 TXT "type=0" "version=1" "refresh-age-timeout=0" "priority=6" "refresh-flag=0" "root-mac-address=00:77:8d:da:c0:ce" "cos)
13:49:13.656587 IP 10.0.30.253.5353 > 224.0.0.251.5353: 0- [0q] 1/0/0 TXT "type=0" "version=1" "refresh-age-timeout=0" "priority=6" "refresh-flag=0" "root-mac-address=00:77:8d:da:c0:ce" "co)
13:49:13.657350 IP 10.0.30.253.5353 > 224.0.0.251.5353: 0- [0q] 1/0/0 TXT "type=0" "version=1" "refresh-age-timeout=0" "priority=6" "refresh-flag=0" "root-mac-address=00:77:8d:da:c0:ce" "co)
13:49:14.775256 STP 802.1w, Rapid STP, Flags [Learn, Forward, Agreement], bridge-id 8000.00:77:8d:da:c0:ce.8006, length 36
13:49:15.806199 IP6 fe80::3e57:31ff:fe4c:cd.546 > ff02::1:2.547: dhcp6 solicit
13:49:16.735392 ARP, Request who-has 10.0.0.101 tell 10.0.0.101, length 46
13:49:16.775259 STP 802.1w, Rapid STP, Flags [Learn, Forward, Agreement], bridge-id 8000.00:77:8d:da:c0:ce.8006, length 36
13:49:18.775250 STP 802.1w, Rapid STP, Flags [Learn, Forward, Agreement], bridge-id 8000.00:77:8d:da:c0:ce.8006, length 36
13:49:20.144900 IP 0.0.0.0.68 > 255.255.255.255.67: BOOTP/DHCP, Request from 00:77:8d:da:c0:ce, length 300
13:49:20.775270 STP 802.1w, Rapid STP, Flags [Learn, Forward, Agreement], bridge-id 8000.00:77:8d:da:c0:ce.8006, length 36
13:49:22.555769 IP 0.0.0.0.68 > 255.255.255.255.67: BOOTP/DHCP, Request from 3c:57:31:4c:00:cd, length 300
13:49:22.775723 STP 802.1w, Rapid STP, Flags [Learn, Forward, Agreement], bridge-id 8000.00:77:8d:da:c0:ce.8006, length 36
13:49:23.867094 ARP, Request who-has 10.0.0.101 tell 10.0.0.101, length 46
13:49:24.775268 STP 802.1w, Rapid STP, Flags [Learn, Forward, Agreement], bridge-id 8000.00:77:8d:da:c0:ce.8006, length 36
13:49:26.775284 STP 802.1w, Rapid STP, Flags [Learn, Forward, Agreement], bridge-id 8000.00:77:8d:da:c0:ce.8006, length 36
13:49:28.775260 STP 802.1w, Rapid STP, Flags [Learn, Forward, Agreement], bridge-id 8000.00:77:8d:da:c0:ce.8006, length 36
13:49:30.775304 STP 802.1w, Rapid STP, Flags [Learn, Forward, Agreement], bridge-id 8000.00:77:8d:da:c0:ce.8006, length 36
13:49:30.957510 ARP, Request who-has 10.0.0.101 tell 10.0.0.101, length 46
13:49:32.144922 IP 0.0.0.0.68 > 255.255.255.255.67: BOOTP/DHCP, Request from 00:77:8d:da:c0:ce, length 300
13:49:32.775505 STP 802.1w, Rapid STP, Flags [Learn, Forward, Agreement], bridge-id 8000.00:77:8d:da:c0:ce.8006, length 36
13:49:33.654978 IP 10.0.0.101.5353 > 224.0.0.251.5353: 0- [0q] 1/0/0 TXT "type=0" "version=1" "refresh-age-timeout=0" "priority=6" "refresh-flag=0" "root-mac-address=00:8e:73:2c:1f:a5" "cos)
13:49:33.655391 IP 10.0.30.254.5353 > 224.0.0.251.5353: 0- [0q] 1/0/0 TXT "type=0" "version=1" "refresh-age-timeout=0" "priority=6" "refresh-flag=0" "root-mac-address=00:8e:73:2c:1f:a5" "co)
13:49:34.555795 IP 0.0.0.0.68 > 255.255.255.255.67: BOOTP/DHCP, Request from 3c:57:31:4c:00:cd, length 300
13:49:34.775524 STP 802.1w, Rapid STP, Flags [Learn, Forward, Agreement], bridge-id 8000.00:77:8d:da:c0:ce.8006, length 36
13:49:36.775945 STP 802.1w, Rapid STP, Flags [Learn, Forward, Agreement], bridge-id 8000.00:77:8d:da:c0:ce.8006, length 36
13:49:37.525001 LLDP, length 119: switchdac0ce
13:49:38.025988 LLDP, length 215: rtems.localdomain
13:49:38.108759 ARP, Request who-has 10.0.0.101 tell 10.0.0.101, length 46
13:49:38.654941 IP 10.0.0.101.5353 > 224.0.0.251.5353: 0- [0q] 1/0/0 TXT "type=0" "version=1" "refresh-age-timeout=0" "priority=6" "refresh-flag=0" "root-mac-address=00:8e:73:2c:1f:a5" "cos)
13:49:38.655353 IP 10.0.30.254.5353 > 224.0.0.251.5353: 0- [0q] 1/0/0 TXT "type=0" "version=1" "refresh-age-timeout=0" "priority=6" "refresh-flag=0" "root-mac-address=00:8e:73:2c:1f:a5" "co)
13:49:38.656701 IP 10.0.30.253.5353 > 224.0.0.251.5353: 0- [0q] 1/0/0 TXT "type=0" "version=1" "refresh-age-timeout=0" "priority=6" "refresh-flag=0" "root-mac-address=00:77:8d:da:c0:ce" "co)
13:49:38.658443 IP 10.0.0.101.5353 > 224.0.0.251.5353: 0- [0q] 1/0/0 TXT "type=0" "version=1" "refresh-age-timeout=0" "priority=6" "refresh-flag=0" "root-mac-address=00:77:8d:da:c0:ce" "cos)
13:49:38.659954 IP 10.0.30.253.5353 > 224.0.0.251.5353: 0- [0q] 1/0/0 TXT "type=0" "version=1" "refresh-age-timeout=0" "priority=6" "refresh-flag=0" "root-mac-address=00:77:8d:da:c0:ce" "co)
13:49:38.775278 STP 802.1w, Rapid STP, Flags [Learn, Forward, Agreement], bridge-id 8000.00:77:8d:da:c0:ce.8006, length 36
13:49:40.775291 STP 802.1w, Rapid STP, Flags [Learn, Forward, Agreement], bridge-id 8000.00:77:8d:da:c0:ce.8006, length 36
13:49:42.775682 STP 802.1w, Rapid STP, Flags [Learn, Forward, Agreement], bridge-id 8000.00:77:8d:da:c0:ce.8006, length 36
13:49:43.654888 IP 10.0.0.101.5353 > 224.0.0.251.5353: 0- [0q] 1/0/0 TXT "type=0" "version=1" "refresh-age-timeout=0" "priority=6" "refresh-flag=0" "root-mac-address=00:77:8d:da:c0:ce" "cos)
13:49:43.656332 IP 10.0.30.253.5353 > 224.0.0.251.5353: 0- [0q] 1/0/0 TXT "type=0" "version=1" "refresh-age-timeout=0" "priority=6" "refresh-flag=0" "root-mac-address=00:77:8d:da:c0:ce" "co)
 13:49:43.657097 IP 10.0.30.253.5353 > 224.0.0.251.5353: 0- [0q] 1/0/0 TXT "type=0" "version=1" "refresh-age-timeout=0" "priority=6" "refresh-flag=0" "root-mac-address=00:77:8d:da:c0:ce" "co)
13:49:44.144913 IP 0.0.0.0.68 > 255.255.255.255.67: BOOTP/DHCP, Request from 00:77:8d:da:c0:ce, length 300
13:49:44.775320 STP 802.1w, Rapid STP, Flags [Learn, Forward, Agreement], bridge-id 8000.00:77:8d:da:c0:ce.8006, length 36
13:49:46.003291 ARP, Request who-has 10.0.0.101 tell 10.0.0.101, length 46
13:49:46.555805 IP 0.0.0.0.68 > 255.255.255.255.67: BOOTP/DHCP, Request from 3c:57:31:4c:00:cd, length 300
13:49:46.775313 STP 802.1w, Rapid STP, Flags [Learn, Forward, Agreement], bridge-id 8000.00:77:8d:da:c0:ce.8006, length 36
13:49:48.775303 STP 802.1w, Rapid STP, Flags [Learn, Forward, Agreement], bridge-id 8000.00:77:8d:da:c0:ce.8006, length 36
13:49:50.104831 IP6 fe80::72f3:5aff:fe24:a2a8.546 > ff02::1:2.547: dhcp6 solicit
13:49:50.775315 STP 802.1w, Rapid STP, Flags [Learn, Forward, Agreement], bridge-id 8000.00:77:8d:da:c0:ce.8006, length 36
13:49:52.775327 STP 802.1w, Rapid STP, Flags [Learn, Forward, Agreement], bridge-id 8000.00:77:8d:da:c0:ce.8006, length 36
13:49:53.135172 ARP, Request who-has 10.0.0.101 tell 10.0.0.101, length 46
13:49:54.775337 STP 802.1w, Rapid STP, Flags [Learn, Forward, Agreement], bridge-id 8000.00:77:8d:da:c0:ce.8006, length 36
13:49:56.144947 IP 0.0.0.0.68 > 255.255.255.255.67: BOOTP/DHCP, Request from 00:77:8d:da:c0:ce, length 300
13:49:56.215196 IP6 fe80::28e:73ff:fe2c:1fa5.546 > ff02::1:2.547: dhcp6 inf-req
13:49:56.540582 ARP, Request who-has 10.0.30.113 tell 10.0.30.138, length 46
13:49:56.775786 STP 802.1w, Rapid STP, Flags [Learn, Forward, Agreement], bridge-id 8000.00:77:8d:da:c0:ce.8006, length 36
13:49:58.555870 IP 0.0.0.0.68 > 255.255.255.255.67: BOOTP/DHCP, Request from 3c:57:31:4c:00:cd, length 300
13:49:58.775316 STP 802.1w, Rapid STP, Flags [Learn, Forward, Agreement], bridge-id 8000.00:77:8d:da:c0:ce.8006, length 36
13:50:00.225403 ARP, Request who-has 10.0.0.101 tell 10.0.0.101, length 46
13:50:00.775461 STP 802.1w, Rapid STP, Flags [Learn, Forward, Agreement], bridge-id 8000.00:77:8d:da:c0:ce.8006, length 36
13:50:02.775356 STP 802.1w, Rapid STP, Flags [Learn, Forward, Agreement], bridge-id 8000.00:77:8d:da:c0:ce.8006, length 36
13:50:03.654823 IP 10.0.0.101.5353 > 224.0.0.251.5353: 0- [0q] 1/0/0 TXT "type=0" "version=1" "refresh-age-timeout=0" "priority=6" "refresh-flag=0" "root-mac-address=00:8e:73:2c:1f:a5" "cos)
13:50:03.655240 IP 10.0.30.254.5353 > 224.0.0.251.5353: 0- [0q] 1/0/0 TXT "type=0" "version=1" "refresh-age-timeout=0" "priority=6" "refresh-flag=0" "root-mac-address=00:8e:73:2c:1f:a5" "co)
13:50:04.775347 STP 802.1w, Rapid STP, Flags [Learn, Forward, Agreement], bridge-id 8000.00:77:8d:da:c0:ce.8006, length 36
13:50:06.775382 STP 802.1w, Rapid STP, Flags [Learn, Forward, Agreement], bridge-id 8000.00:77:8d:da:c0:ce.8006, length 36
13:50:07.507147 ARP, Request who-has 10.0.0.101 tell 10.0.0.101, length 46
13:50:07.525065 LLDP, length 119: switchdac0ce
13:50:08.030039 LLDP, length 215: rtems.localdomain
13:50:08.144962 IP 0.0.0.0.68 > 255.255.255.255.67: BOOTP/DHCP, Request from 00:77:8d:da:c0:ce, length 300
13:50:08.654733 IP 10.0.0.101.5353 > 224.0.0.251.5353: 0- [0q] 1/0/0 TXT "type=0" "version=1" "refresh-age-timeout=0" "priority=6" "refresh-flag=0" "root-mac-address=00:8e:73:2c:1f:a5" "cos)
13:50:08.655151 IP 10.0.30.254.5353 > 224.0.0.251.5353: 0- [0q] 1/0/0 TXT "type=0" "version=1" "refresh-age-timeout=0" "priority=6" "refresh-flag=0" "root-mac-address=00:8e:73:2c:1f:a5" "co)
13:50:08.657736 IP 10.0.30.253.5353 > 224.0.0.251.5353: 0- [0q] 1/0/0 TXT "type=0" "version=1" "refresh-age-timeout=0" "priority=6" "refresh-flag=0" "root-mac-address=00:77:8d:da:c0:ce" "co)
13:50:08.659300 IP 10.0.0.101.5353 > 224.0.0.251.5353: 0- [0q] 1/0/0 TXT "type=0" "version=1" "refresh-age-timeout=0" "priority=6" "refresh-flag=0" "root-mac-address=00:77:8d:da:c0:ce" "cos

tomp · May 13, 2021, 12:36pm

Can you show output of lxc network show lxdbr0 please

tomp · May 13, 2021, 12:37pm

Also output of ip neigh

tomp · May 13, 2021, 12:39pm

And once you’ve pasted those here, please can you remove LXD again and restore your network connectivity and then show output of ip a, ip r and ip neigh again, thanks.

kgardas · May 13, 2021, 1:17pm

So this is with network broken and lxd installed/initialized:

root@rtems:~# lxc network show lxdbr0
WARNING: cgroup v2 is not fully supported yet, proceeding with partial confinement
To start your first instance, try: lxc launch ubuntu:18.04

config:
  ipv4.address: 10.225.158.1/24
  ipv4.nat: "true"
  ipv6.address: fd42:6d7f:531f:7936::1/64
  ipv6.nat: "true"
description: ""
name: lxdbr0
type: bridge
used_by:
- /1.0/profiles/default
managed: true
status: Created
locations:
- none
root@rtems:~# ip neigh
10.0.10.138 dev enp3s0  FAILED
root@rtems:~#

And this is with network restored to previous and working state:

The restoration is done with just:

root@rtems:~# snap remove lxd
lxd removed
root@rtems:~#

and switch restart.

So hence here is the output of required commands:

root@rtems:~# ip a
1: lo: <LOOPBACK,UP,LOWER_UP> mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000
  link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00
  inet 127.0.0.1/8 scope host lo
     valid_lft forever preferred_lft forever
  inet6 ::1/128 scope host 
     valid_lft forever preferred_lft forever
2: enp3s0: <BROADCAST,MULTICAST,UP,LOWER_UP> mtu 1500 qdisc mq state UP group default qlen 1000
  link/ether 00:30:59:12:28:85 brd ff:ff:ff:ff:ff:ff
  inet 10.0.10.34/24 brd 10.0.10.255 scope global dynamic noprefixroute enp3s0
     valid_lft 43015sec preferred_lft 43015sec
  inet6 fe80::230:59ff:fe12:2885/64 scope link noprefixroute 
     valid_lft forever preferred_lft forever
3: enp0s31f6: <NO-CARRIER,BROADCAST,MULTICAST,UP> mtu 1500 qdisc pfifo_fast state DOWN group default qlen 1000
  link/ether 00:30:59:20:04:9a brd ff:ff:ff:ff:ff:ff
root@rtems:~# ip r
default via 10.0.10.138 dev enp3s0 proto dhcp metric 100 
10.0.10.0/24 dev enp3s0 proto kernel scope link src 10.0.10.34 metric 100 
root@rtems:~# ip neigh
10.0.10.138 dev enp3s0 lladdr 00:0d:b9:57:6d:66 REACHABLE
root@rtems:~#

Thanks for looking into it! Karel

tomp · May 13, 2021, 1:45pm

OK, I’ve never seen anything like this before.

Just to confirm that its an issue with ARP resolution taking place, please can you try adding a static entry for your default gateway and see if that then works with LXD installed using:

sudo ip neigh add 10.0.10.138 lladdr 00:0d:b9:57:6d:66 dev enp3s0

kgardas · May 13, 2021, 1:50pm

This does not work, or does not seems to:

root@rtems:~# ip neigh add 10.0.10.138 lladdr 00:0d:b9:57:6d:66 dev enp3s0
RTNETLINK answers: File exists
root@rtems:~#

Anyway, let me reinstall/reconfigure with different network on the bridge and let see if this is working well or not.

tomp · May 13, 2021, 1:51pm

You probably need to remove the failed entry first.

tomp · May 13, 2021, 1:52pm

What do you mean “different network on the bridge” - there are no external NICs connected to lxdbr0 bridge right?

kgardas · May 13, 2021, 1:54pm

Thomas,
not sure if this is related, but at one case IIRC I’ve seen bridge was initialized with address 10.11.x.x/24 and this is conflicting address here. E.g. different network connected to the same switch has it.

So let’s completely forget 10.x.x.x/24 on bridge and let’s use 192.168.2.1./24 on it to be on completely safe side.

Working on it…

kgardas · May 13, 2021, 1:59pm

OK, so this was not it. Still failing even with 192.168.2.1/24:

root@rtems:~# lxd init
WARNING: cgroup v2 is not fully supported yet, proceeding with partial confinement
Would you like to use LXD clustering? (yes/no) [default=no]: 
Do you want to configure a new storage pool? (yes/no) [default=yes]: 
Name of the new storage pool [default=default]: 
Name of the storage backend to use (dir, lvm, ceph, btrfs) [default=btrfs]: 
Create a new BTRFS pool? (yes/no) [default=yes]: 
Would you like to use an existing empty block device (e.g. a disk or partition)? (yes/no) [default=no]: 
Size in GB of the new loop device (1GB minimum) [default=30GB]: 
Would you like to connect to a MAAS server? (yes/no) [default=no]: 
Would you like to create a new local network bridge? (yes/no) [default=yes]: 
What should the new bridge be called? [default=lxdbr0]: 
What IPv4 address should be used? (CIDR subnet notation, ���auto��� or ���none���) [default=auto]: 192.168.2.1/24
Would you like LXD to NAT IPv4 traffic on your bridge? [default=yes]: 
What IPv6 address should be used? (CIDR subnet notation, ���auto��� or ���none���) [default=auto]: none
Would you like the LXD server to be available over the network? (yes/no) [default=no]: 
Would you like stale cached images to be updated automatically? (yes/no) [default=yes] 
Would you like a YAML "lxd init" preseed to be printed? (yes/no) [default=no]: yes
config: {}
networks:
- config:
ipv4.address: 192.168.2.1/24
ipv4.nat: "true"
ipv6.address: none
 description: ""
name: lxdbr0
type: ""
project: default
storage_pools:
- config:
  size: 30GB
 description: ""
 name: default
 driver: btrfs
profiles:
- config: {}
 description: ""
 devices:
   eth0:
    name: eth0
    network: lxdbr0
    type: nic
  root:
    path: /
    pool: default
    type: disk
name: default
projects: []
cluster: null

root@rtems:~# ip a
1: lo: <LOOPBACK,UP,LOWER_UP> mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000
  link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00
  inet 127.0.0.1/8 scope host lo
     valid_lft forever preferred_lft forever
  inet6 ::1/128 scope host 
     valid_lft forever preferred_lft forever
2: enp3s0: <BROADCAST,MULTICAST,UP,LOWER_UP> mtu 1500 qdisc mq state UP group default qlen 1000
  link/ether 00:30:59:12:28:85 brd ff:ff:ff:ff:ff:ff
  inet 10.0.10.34/24 brd 10.0.10.255 scope global dynamic noprefixroute enp3s0
   valid_lft 43136sec preferred_lft 43136sec
  inet6 fe80::230:59ff:fe12:2885/64 scope link noprefixroute 
   valid_lft forever preferred_lft forever
3: enp0s31f6: <NO-CARRIER,BROADCAST,MULTICAST,UP> mtu 1500 qdisc pfifo_fast state DOWN group default qlen 1000
  link/ether 00:30:59:20:04:9a brd ff:ff:ff:ff:ff:ff
9: lxdbr0: <NO-CARRIER,BROADCAST,MULTICAST,UP> mtu 1500 qdisc noqueue state DOWN group default qlen 1000
  link/ether 00:16:3e:62:92:de brd ff:ff:ff:ff:ff:ff
  inet 192.168.2.1/24 scope global lxdbr0
   valid_lft forever preferred_lft forever
root@rtems:~# ip r
default via 10.0.10.138 dev enp3s0 proto dhcp metric 100 
10.0.10.0/24 dev enp3s0 proto kernel scope link src 10.0.10.34 metric 100 
192.168.2.0/24 dev lxdbr0 proto kernel scope link src 192.168.2.1 linkdown 
root@rtems:~# ip nei
10.0.10.138 dev enp3s0 lladdr 00:0d:b9:57:6d:66 STALE
root@rtems:~# ip nei
10.0.10.138 dev enp3s0 lladdr 00:0d:b9:57:6d:66 STALE
root@rtems:~# ip nei
10.0.10.138 dev enp3s0 lladdr 00:0d:b9:57:6d:66 STALE
root@rtems:~# ping 10.0.10.138
PING 10.0.10.138 (10.0.10.138) 56(84) bytes of data.
^C
--- 10.0.10.138 ping statistics ---
2 packets transmitted, 0 received, 100% packet loss, time 1005ms

root@rtems:~# ip nei
10.0.10.138 dev enp3s0 lladdr 00:0d:b9:57:6d:66 DELAY
root@rtems:~# ip nei
10.0.10.138 dev enp3s0  FAILED
root@rtems:~#