Container network interfaces not aquiring address after snap refresh

bmweller · December 14, 2020, 8:38pm

Hello All

I’ve recently deployed a juju local controller and postgresql container. Last week I was working with the postgres instance through the day and checked back later in the evening to find the service was unvailable. I first checked on the containers using juju show-status but the command hung indefinintely.

After digging around I spotted that snap had upgraded LXD in the evening and since then neither container is able to aquire an ip address. Coincidently I noted this behavior on a prior installation one or two weeks earlier but did not look further into it.

On this occasion I captured a few bit of logs but not sure now where to look next. I rather not recreate the containers like last time and understand why this setup has failed. Any advise would be appreciated,

Command run December 9th

root@lxdhost:~# snap changes
ID Status Spawn Ready Summary 
71 Done yesterday at 19:35 UTC yesterday at 19:36 UTC Auto-refresh snaps "core20", "lxd" 

root@lxdhost:~# snap list
Name Version Rev Tracking Publisher Notes 
core20    20201027                875    latest/stable  canonical✓  base
juju      2.8.7                   14932  2.8/stable     canonical✓  classic
lxd       4.8                     18546  latest/stable  canonical✓  -

Connected to the Postgres container via -> lxc exec juju-1d3465-1 bash
(same result on the juju container)

root@juju-1d3465-0:~# ip a 
1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 
link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 
inet 127.0.0.1/8 scope host lo 
valid_lft forever preferred_lft forever 
inet6 ::1/128 scope host 
valid_lft forever preferred_lft forever 
14: eth0@if15: mtu 1500 qdisc noqueue state UP group default qlen 1000 
link/ether 00:16:3e:81:5a:1f brd ff:ff:ff:ff:ff:ff link-netnsid 0 
inet6 fe80::216:3eff:fe81:5a1f/64 scope link 
valid_lft forever preferred_lft forever 
root@juju-1d3465-0:~#

from the controller container

Dec 08 19:51:25 juju-ea203b-1 systemd-networkd[194]: eth0: DHCP lease lost 
Dec 08 19:51:25 juju-ea203b-1 dbus-daemon[235]: [system] Activating via systemd: service name='org.freedesktop.hostname1' unit='dbus-org.freedesktop.hostname1.service' requested by ':1.0' (uid=100 pid=194 comm="/lib/sys
Dec 08 19:51:25 juju-ea203b-1 systemd[1]: systemd-hostnamed.service: Failed to reset devices.list: Operation not permitted 
Dec 08 19:51:25 juju-ea203b-1 systemd[1]: Failed to set devices.allow on /system.slice/systemd-hostnamed.service: Operation not permitted 
Dec 08 19:51:25 juju-ea203b-1 systemd[1]: Failed to set devices.allow on /system.slice/systemd-hostnamed.service: Operation not permitted 
Dec 08 19:51:25 juju-ea203b-1 systemd[1]: Failed to set devices.allow on /system.slice/systemd-hostnamed.service: Operation not permitted 
Dec 08 19:51:25 juju-ea203b-1 systemd[1]: Failed to set devices.allow on /system.slice/systemd-hostnamed.service: Operation not permitted 
Dec 08 19:51:25 juju-ea203b-1 systemd[1]: Failed to set devices.allow on /system.slice/systemd-hostnamed.service: Operation not permitted 
Dec 08 19:51:25 juju-ea203b-1 systemd[1]: Failed to set devices.allow on /system.slice/systemd-hostnamed.service: Operation not permitted 
Dec 08 19:51:25 juju-ea203b-1 systemd[1]: Failed to set devices.allow on /system.slice/systemd-hostnamed.service: Operation not permitted 
Dec 08 19:51:25 juju-ea203b-1 systemd[1]: Failed to set devices.allow on /system.slice/systemd-hostnamed.service: Operation not permitted 
Dec 08 19:51:25 juju-ea203b-1 systemd[1]: Starting Hostname Service... 
Dec 08 19:51:25 juju-ea203b-1 dbus-daemon[235]: [system] Successfully activated service 'org.freedesktop.hostname1' 
Dec 08 19:51:25 juju-ea203b-1 systemd[1]: Started Hostname Service.

list-leases result from the 9th

root@lxdhost:~# lxc network list-leases lxdbr0 
+---------------+-------------------+--------------+---------+ 
| HOSTNAME      | MAC ADDRESS       | IP ADDRESS   | TYPE    | 
+---------------+-------------------+--------------+---------+ 
| juju-1d3465-0 | 00:16:3e:81:5a:1f | 10.51.32.183 | DYNAMIC | 
+---------------+-------------------+--------------+---------+ 
| juju-ea203b-1 | 00:16:3e:05:86:f9 | 10.51.32.8   | DYNAMIC | 
+---------------+-------------------+--------------+---------+

stgraber · December 14, 2020, 10:57pm

Usual suspects on the host are:

Port conflict preventing LXD’s dnsmasq from starting
Docker installed on the host (tends to mess with firewalling)
Some other firewalling piece on the host preventing reaching dnsmasq

netstat -lnp, ps fauxww and grep lxdbr0 /var/log/syslog are usually good places to start.

You may also want to look for dmesg | grep DENIED

bmweller · December 14, 2020, 11:34pm

USER         PID %CPU %MEM    VSZ   RSS TTY      STAT START   TIME COMMAND
root           2  0.0  0.0      0     0 ?        S    Dec14   0:00 [kthreadd]
root           3  0.0  0.0      0     0 ?        I<   Dec14   0:00  \_ [rcu_gp]
root           4  0.0  0.0      0     0 ?        I<   Dec14   0:00  \_ [rcu_par_gp]
root           6  0.0  0.0      0     0 ?        I<   Dec14   0:00  \_ [kworker/0:0H-kblockd]
root           9  0.0  0.0      0     0 ?        I<   Dec14   0:00  \_ [mm_percpu_wq]
root          10  0.0  0.0      0     0 ?        S    Dec14   0:00  \_ [ksoftirqd/0]
root          11  0.0  0.0      0     0 ?        I    Dec14   0:04  \_ [rcu_sched]
root          12  0.0  0.0      0     0 ?        S    Dec14   0:00  \_ [migration/0]
root          13  0.0  0.0      0     0 ?        S    Dec14   0:00  \_ [idle_inject/0]
root          14  0.0  0.0      0     0 ?        S    Dec14   0:00  \_ [cpuhp/0]
root          15  0.0  0.0      0     0 ?        S    Dec14   0:00  \_ [cpuhp/1]
root          16  0.0  0.0      0     0 ?        S    Dec14   0:00  \_ [idle_inject/1]
root          17  0.0  0.0      0     0 ?        S    Dec14   0:00  \_ [migration/1]
root          18  0.0  0.0      0     0 ?        S    Dec14   0:00  \_ [ksoftirqd/1]
root          20  0.0  0.0      0     0 ?        I<   Dec14   0:00  \_ [kworker/1:0H-events_highpri]
root          21  0.0  0.0      0     0 ?        S    Dec14   0:00  \_ [cpuhp/2]
root          22  0.0  0.0      0     0 ?        S    Dec14   0:00  \_ [idle_inject/2]
root          23  0.0  0.0      0     0 ?        S    Dec14   0:00  \_ [migration/2]
root          24  0.0  0.0      0     0 ?        S    Dec14   0:00  \_ [ksoftirqd/2]
root          26  0.0  0.0      0     0 ?        I<   Dec14   0:00  \_ [kworker/2:0H-kblockd]
root          27  0.0  0.0      0     0 ?        S    Dec14   0:00  \_ [cpuhp/3]
root          28  0.0  0.0      0     0 ?        S    Dec14   0:00  \_ [idle_inject/3]
root          29  0.0  0.0      0     0 ?        S    Dec14   0:00  \_ [migration/3]
root          30  0.0  0.0      0     0 ?        S    Dec14   0:00  \_ [ksoftirqd/3]
root          32  0.0  0.0      0     0 ?        I<   Dec14   0:00  \_ [kworker/3:0H-kblockd]
root          33  0.0  0.0      0     0 ?        S    Dec14   0:00  \_ [cpuhp/4]
root          34  0.0  0.0      0     0 ?        S    Dec14   0:00  \_ [idle_inject/4]
root          35  0.0  0.0      0     0 ?        S    Dec14   0:00  \_ [migration/4]
root          36  0.0  0.0      0     0 ?        S    Dec14   0:00  \_ [ksoftirqd/4]
root          38  0.0  0.0      0     0 ?        I<   Dec14   0:00  \_ [kworker/4:0H-events_highpri]
root          39  0.0  0.0      0     0 ?        S    Dec14   0:00  \_ [cpuhp/5]
root          40  0.0  0.0      0     0 ?        S    Dec14   0:00  \_ [idle_inject/5]
root          41  0.0  0.0      0     0 ?        S    Dec14   0:00  \_ [migration/5]
root          42  0.0  0.0      0     0 ?        S    Dec14   0:00  \_ [ksoftirqd/5]
root          44  0.0  0.0      0     0 ?        I<   Dec14   0:00  \_ [kworker/5:0H-kblockd]
root          45  0.0  0.0      0     0 ?        S    Dec14   0:00  \_ [cpuhp/6]
root          46  0.0  0.0      0     0 ?        S    Dec14   0:00  \_ [idle_inject/6]
root          47  0.0  0.0      0     0 ?        S    Dec14   0:00  \_ [migration/6]
root          48  0.0  0.0      0     0 ?        S    Dec14   0:00  \_ [ksoftirqd/6]
root          50  0.0  0.0      0     0 ?        I<   Dec14   0:00  \_ [kworker/6:0H-kblockd]
root          51  0.0  0.0      0     0 ?        S    Dec14   0:00  \_ [cpuhp/7]
root          52  0.0  0.0      0     0 ?        S    Dec14   0:00  \_ [idle_inject/7]
root          53  0.0  0.0      0     0 ?        S    Dec14   0:00  \_ [migration/7]
root          54  0.0  0.0      0     0 ?        S    Dec14   0:00  \_ [ksoftirqd/7]
root          56  0.0  0.0      0     0 ?        I<   Dec14   0:00  \_ [kworker/7:0H-kblockd]
root          57  0.0  0.0      0     0 ?        S    Dec14   0:00  \_ [kdevtmpfs]
root          58  0.0  0.0      0     0 ?        I<   Dec14   0:00  \_ [netns]
root          59  0.0  0.0      0     0 ?        S    Dec14   0:00  \_ [rcu_tasks_kthre]
root          60  0.0  0.0      0     0 ?        S    Dec14   0:00  \_ [kauditd]
root          61  0.0  0.0      0     0 ?        I    Dec14   0:00  \_ [kworker/4:1-events]
root          62  0.0  0.0      0     0 ?        S    Dec14   0:00  \_ [khungtaskd]
root          63  0.0  0.0      0     0 ?        S    Dec14   0:00  \_ [oom_reaper]
root          64  0.0  0.0      0     0 ?        I<   Dec14   0:00  \_ [writeback]
root          65  0.0  0.0      0     0 ?        S    Dec14   0:00  \_ [kcompactd0]
root          66  0.0  0.0      0     0 ?        SN   Dec14   0:00  \_ [ksmd]
root          67  0.0  0.0      0     0 ?        SN   Dec14   0:00  \_ [khugepaged]
root         114  0.0  0.0      0     0 ?        I<   Dec14   0:00  \_ [kintegrityd]
root         115  0.0  0.0      0     0 ?        I<   Dec14   0:00  \_ [kblockd]
root         116  0.0  0.0      0     0 ?        I<   Dec14   0:00  \_ [blkcg_punt_bio]
root         118  0.0  0.0      0     0 ?        I    Dec14   0:00  \_ [kworker/2:1-events]
root         120  0.0  0.0      0     0 ?        I<   Dec14   0:00  \_ [tpm_dev_wq]
root         121  0.0  0.0      0     0 ?        I<   Dec14   0:00  \_ [ata_sff]
root         122  0.0  0.0      0     0 ?        I<   Dec14   0:00  \_ [md]
root         123  0.0  0.0      0     0 ?        I<   Dec14   0:00  \_ [edac-poller]
root         124  0.0  0.0      0     0 ?        I<   Dec14   0:00  \_ [devfreq_wq]
root         125  0.0  0.0      0     0 ?        S    Dec14   0:00  \_ [watchdogd]
root         128  0.0  0.0      0     0 ?        S    Dec14   0:00  \_ [kswapd0]
root         129  0.0  0.0      0     0 ?        S    Dec14   0:00  \_ [ecryptfs-kthrea]
root         131  0.0  0.0      0     0 ?        I<   Dec14   0:00  \_ [kthrotld]
root         132  0.0  0.0      0     0 ?        I<   Dec14   0:00  \_ [acpi_thermal_pm]
root         133  0.0  0.0      0     0 ?        I<   Dec14   0:00  \_ [vfio-irqfd-clea]
root         134  0.0  0.0      0     0 ?        I    Dec14   0:00  \_ [kworker/1:2-events]
root         138  0.0  0.0      0     0 ?        I<   Dec14   0:00  \_ [ipv6_addrconf]
root         147  0.0  0.0      0     0 ?        I<   Dec14   0:00  \_ [kstrp]
root         150  0.0  0.0      0     0 ?        I<   Dec14   0:00  \_ [kworker/u17:0]
root         165  0.0  0.0      0     0 ?        I    Dec14   0:00  \_ [kworker/7:1-events]
root         166  0.0  0.0      0     0 ?        I<   Dec14   0:00  \_ [charger_manager]
root         224  0.0  0.0      0     0 ?        I    Dec14   0:00  \_ [kworker/3:2-mm_percpu_wq]
root         226  0.0  0.0      0     0 ?        I<   Dec14   0:00  \_ [cryptd]
root         258  0.0  0.0      0     0 ?        S    Dec14   0:00  \_ [scsi_eh_0]
root         259  0.0  0.0      0     0 ?        I<   Dec14   0:00  \_ [scsi_tmf_0]
root         260  0.0  0.0      0     0 ?        S    Dec14   0:00  \_ [scsi_eh_1]
root         261  0.0  0.0      0     0 ?        I<   Dec14   0:00  \_ [scsi_tmf_1]
root         262  0.0  0.0      0     0 ?        S    Dec14   0:00  \_ [scsi_eh_2]
root         263  0.0  0.0      0     0 ?        I<   Dec14   0:00  \_ [scsi_tmf_2]
root         264  0.0  0.0      0     0 ?        S    Dec14   0:00  \_ [scsi_eh_3]
root         265  0.0  0.0      0     0 ?        I<   Dec14   0:00  \_ [scsi_tmf_3]
root         272  0.0  0.0      0     0 ?        I<   Dec14   0:00  \_ [kworker/5:1H]
root         278  0.0  0.0      0     0 ?        I<   Dec14   0:00  \_ [kworker/2:1H-kblockd]
root         280  0.0  0.0      0     0 ?        I<   Dec14   0:00  \_ [kworker/4:1H-kblockd]
root         292  0.0  0.0      0     0 ?        I<   Dec14   0:00  \_ [kdmflush]
root         296  0.0  0.0      0     0 ?        I<   Dec14   0:00  \_ [dm_bufio_cache]
root         300  0.0  0.0      0     0 ?        I<   Dec14   0:00  \_ [kdmflush]
root         301  0.0  0.0      0     0 ?        I<   Dec14   0:00  \_ [kdmflush]
root         310  0.0  0.0      0     0 ?        I<   Dec14   0:00  \_ [kdmflush]
root         311  0.0  0.0      0     0 ?        I<   Dec14   0:00  \_ [kworker/7:1H-kblockd]
root         312  0.0  0.0      0     0 ?        I<   Dec14   0:00  \_ [kcopyd]
root         313  0.0  0.0      0     0 ?        I<   Dec14   0:00  \_ [dm-thin]
root         314  0.0  0.0      0     0 ?        I<   Dec14   0:00  \_ [kdmflush]
root         327  0.0  0.0      0     0 ?        I<   Dec14   0:00  \_ [kworker/1:1H-kblockd]
root         342  0.0  0.0      0     0 ?        I<   Dec14   0:00  \_ [raid5wq]
root         382  0.0  0.0      0     0 ?        I<   Dec14   0:00  \_ [kworker/0:1H-kblockd]
root         383  0.0  0.0      0     0 ?        S    Dec14   0:00  \_ [jbd2/dm-0-8]
root         384  0.0  0.0      0     0 ?        I<   Dec14   0:00  \_ [ext4-rsv-conver]
root         410  0.0  0.0      0     0 ?        I<   Dec14   0:00  \_ [kworker/3:1H-kblockd]
root         444  0.0  0.0      0     0 ?        I<   Dec14   0:00  \_ [kworker/6:1H-kblockd]
root         535  0.0  0.0      0     0 ?        S    Dec14   0:00  \_ [irq/126-mei_me]
root         706  0.0  0.0      0     0 ?        I<   Dec14   0:00  \_ [kaluad]
root         707  0.0  0.0      0     0 ?        I<   Dec14   0:00  \_ [kmpath_rdacd]
root         708  0.0  0.0      0     0 ?        I<   Dec14   0:00  \_ [kmpathd]
root         709  0.0  0.0      0     0 ?        I<   Dec14   0:00  \_ [kmpath_handlerd]
root         720  0.0  0.0      0     0 ?        S<   Dec14   0:00  \_ [loop0]
root         733  0.0  0.0      0     0 ?        S<   Dec14   0:00  \_ [loop1]
root         735  0.0  0.0      0     0 ?        S<   Dec14   0:00  \_ [loop2]
root         736  0.0  0.0      0     0 ?        S<   Dec14   0:00  \_ [loop3]
root         737  0.0  0.0      0     0 ?        S<   Dec14   0:00  \_ [loop4]
root         738  0.0  0.0      0     0 ?        S<   Dec14   0:00  \_ [loop5]
root         739  0.0  0.0      0     0 ?        S<   Dec14   0:00  \_ [loop6]
root         742  0.0  0.0      0     0 ?        S<   Dec14   0:00  \_ [loop8]
root         747  0.0  0.0      0     0 ?        S<   Dec14   0:00  \_ [loop9]
root         749  0.0  0.0      0     0 ?        S<   Dec14   0:00  \_ [loop10]
root         755  0.0  0.0      0     0 ?        S<   Dec14   0:00  \_ [loop12]
root        1321  0.0  0.0      0     0 ?        I<   Dec14   0:00  \_ [dio/dm-0]
root        1339  0.0  0.0   2488   592 ?        S    Dec14   0:00  \_ bpfilter_umh
root        1368  0.0  0.0      0     0 ?        S<   Dec14   0:00  \_ [spl_system_task]
root        1369  0.0  0.0      0     0 ?        S<   Dec14   0:00  \_ [spl_delay_taskq]
root        1370  0.0  0.0      0     0 ?        S<   Dec14   0:00  \_ [spl_dynamic_tas]
root        1371  0.0  0.0      0     0 ?        S<   Dec14   0:00  \_ [spl_kmem_cache]
root        1394  0.0  0.0      0     0 ?        S<   Dec14   0:00  \_ [zvol]
root        1395  0.0  0.0      0     0 ?        S    Dec14   0:00  \_ [arc_prune]
root        1396  0.0  0.0      0     0 ?        SN   Dec14   0:00  \_ [zthr_procedure]
root        1397  0.0  0.0      0     0 ?        SN   Dec14   0:00  \_ [zthr_procedure]
root        1398  0.0  0.0      0     0 ?        S    Dec14   0:00  \_ [dbu_evict]
root        1399  0.0  0.0      0     0 ?        SN   Dec14   0:00  \_ [dbuf_evict]
root        1458  0.0  0.0      0     0 ?        SN   Dec14   0:00  \_ [z_vdev_file]
root        1459  0.0  0.0      0     0 ?        S    Dec14   0:00  \_ [l2arc_feed]
root        1530  0.0  0.0      0     0 ?        I<   Dec14   0:00  \_ [kdmflush]
root        1541  0.0  0.0      0     0 ?        S    Dec14   0:00  \_ [jbd2/dm-5-8]
root        1542  0.0  0.0      0     0 ?        I<   Dec14   0:00  \_ [ext4-rsv-conver]
root        1629  0.0  0.0      0     0 ?        I<   Dec14   0:00  \_ [kdmflush]
root        1643  0.0  0.0      0     0 ?        S    Dec14   0:00  \_ [jbd2/dm-6-8]
root        1644  0.0  0.0      0     0 ?        I<   Dec14   0:00  \_ [ext4-rsv-conver]
root        1698  0.0  0.0      0     0 ?        I<   Dec14   0:00  \_ [kdmflush]
root        1714  0.0  0.0      0     0 ?        S    Dec14   0:00  \_ [jbd2/dm-7-8]
root        1715  0.0  0.0      0     0 ?        I<   Dec14   0:00  \_ [ext4-rsv-conver]
root        2303  0.0  0.0      0     0 ?        I    Dec14   0:00  \_ [kworker/6:4-events]
root        2978  0.0  0.0      0     0 ?        I    Dec14   0:00  \_ [kworker/2:2-events]
root        8683  0.0  0.0      0     0 ?        I    Dec14   0:00  \_ [kworker/0:0-events]
root       10616  0.0  0.0      0     0 ?        I    Dec14   0:00  \_ [kworker/5:0-events]
root       52443  0.0  0.0      0     0 ?        I    Dec14   0:01  \_ [kworker/u16:1-dm-thin]
root       53580  0.0  0.0      0     0 ?        I    00:00   0:00  \_ [kworker/7:0-events]
root       59996  0.0  0.0      0     0 ?        I    00:06   0:00  \_ [kworker/6:1-kdmflush]
root       60007  0.0  0.0      0     0 ?        I    00:06   0:00  \_ [kworker/0:1-events]
root       61968  0.0  0.0      0     0 ?        I    00:07   0:00  \_ [kworker/5:1-events]
root       72527  0.0  0.0      0     0 ?        I    00:17   0:00  \_ [kworker/4:2-events]
root       72983  0.0  0.0      0     0 ?        I    00:17   0:00  \_ [kworker/u16:2-dm-thin]
root       73248  0.0  0.0      0     0 ?        I    00:17   0:00  \_ [kworker/u16:4-events_power_efficient]
root       74372  0.0  0.0      0     0 ?        I    00:18   0:00  \_ [kworker/3:1]
root       74467  0.0  0.0      0     0 ?        I    00:18   0:00  \_ [kworker/1:0]
root       80189  0.0  0.0      0     0 ?        I    00:23   0:00  \_ [kworker/0:2]
root           1  0.0  0.0 169132 13196 ?        Ss   Dec14   0:03 /sbin/init
root         458  0.0  0.4 147236 69908 ?        S<s  Dec14   0:00 /lib/systemd/systemd-journald
root         481  0.0  0.1  79504 24160 ?        SLsl Dec14   0:01 /sbin/dmeventd -f
root         491  0.0  0.0  21364  5476 ?        Ss   Dec14   0:01 /lib/systemd/systemd-udevd
root         710  0.0  0.1 345772 18300 ?        SLsl Dec14   0:00 /sbin/multipathd -d -s
systemd+     784  0.0  0.0  90424  6460 ?        Ssl  Dec14   0:00 /lib/systemd/systemd-timesyncd
systemd+     831  0.0  0.0  26920  8004 ?        Ss   Dec14   0:00 /lib/systemd/systemd-networkd
systemd+     834  0.0  0.0  24356 12476 ?        Ss   Dec14   0:00 /lib/systemd/systemd-resolved
root         866  0.0  0.0 234692  7720 ?        Ssl  Dec14   0:00 /usr/lib/accountsservice/accounts-daemon
root         879  0.0  0.0   5568  2904 ?        Ss   Dec14   0:00 /usr/sbin/cron -f
message+     881  0.0  0.0   7656  4936 ?        Ss   Dec14   0:00 /usr/bin/dbus-daemon --system --address=systemd: --nofork --nopidfile --systemd-activation --syslog-only
root         889  0.0  0.0  81900  3600 ?        Ssl  Dec14   0:00 /usr/sbin/irqbalance --foreground
root         890  0.0  0.1  26300 18088 ?        Ss   Dec14   0:00 /usr/bin/python3 /usr/bin/networkd-dispatcher --run-startup-triggers
syslog       896  0.0  0.0 224348  4804 ?        Ssl  Dec14   0:00 /usr/sbin/rsyslogd -n -iNONE
root         913  0.2  0.2 1815568 37016 ?       Ssl  Dec14   0:10 /usr/lib/snapd/snapd
root         915  0.0  0.0  17576  8564 ?        Ss   Dec14   0:00 /lib/systemd/systemd-logind
root         917  0.0  0.0 122024  9708 ?        Ssl  Dec14   0:00 /usr/sbin/thermald --no-daemon --dbus-enable
daemon       918  0.0  0.0   3792  2236 ?        Ss   Dec14   0:00 /usr/sbin/atd -f
root         940  0.0  0.0  12176  7316 ?        Ss   Dec14   0:00 sshd: /usr/sbin/sshd -D [listener] 0 of 10-100 startups
root       11263  0.0  0.0  13792  9024 ?        Ss   Dec14   0:00  \_ sshd: lxduser [priv]
lxduser    11342  0.0  0.0  13932  6056 ?        S    Dec14   0:00  |   \_ sshd: lxduser@notty
root       80190  0.0  0.0  13796  9012 ?        Ss   00:23   0:00  \_ sshd: lxduser [priv]
lxduser    80290  0.0  0.0  13936  6004 ?        S    00:23   0:00      \_ sshd: lxduser@pts/0
lxduser    80291  0.3  0.0   7324  5144 pts/0    Ss   00:23   0:00          \_ -bash
root       80315  0.1  0.0   8224  4620 pts/0    S+   00:24   0:00              \_ sudo ps fauxww
root       80323  0.0  0.0   8724  4016 pts/0    R+   00:24   0:00                  \_ ps fauxww
root         956  0.0  0.0   2860  1852 tty1     Ss+  Dec14   0:00 /sbin/agetty -o -p -- \u --noclear tty1 linux
root         970  0.0  0.0 233732  8108 ?        Ssl  Dec14   0:00 /usr/lib/policykit-1/polkitd --no-debug
root         988  0.0  0.1 105116 20676 ?        Ssl  Dec14   0:00 /usr/bin/python3 /usr/share/unattended-upgrades/unattended-upgrade-shutdown --wait-for-signal
root        1143  0.0  0.0   4636  1848 ?        Ss   Dec14   0:00 /bin/sh /snap/lxd/18546/commands/daemon.start
root        1296  0.1  0.4 2100664 73200 ?       Sl   Dec14   0:06  \_ lxd --logfile /var/snap/lxd/common/lxd/logs/lxd.log --group lxd
root        1284  0.1  0.0 237208  1684 ?        Sl   Dec14   0:07 lxcfs /var/snap/lxd/common/var/lib/lxcfs -p /var/snap/lxd/common/lxcfs.pid
uuidd       1505  0.0  0.0   6780  1076 ?        Ss   Dec14   0:00 /usr/sbin/uuidd --socket-activation
root        1579  0.0  0.0 1306692 14772 ?       Ss   Dec14   0:00 [lxc monitor] /var/snap/lxd/common/lxd/containers juju-1d3465-0
1000000     1590  0.0  0.0  77780  8724 ?        Ss   Dec14   0:01  \_ /sbin/init
1000000     1732  0.0  0.4 225940 74668 ?        Ss   Dec14   0:01      \_ /lib/systemd/systemd-journald
1000000     1778  0.0  0.0  33352  3532 ?        Ss   Dec14   0:00      \_ /lib/systemd/systemd-udevd
1000100     2086  0.0  0.0  71892  5340 ?        Ss   Dec14   0:00      \_ /lib/systemd/systemd-networkd
1000101     2089  0.0  0.0  70668  5496 ?        Ss   Dec14   0:00      \_ /lib/systemd/systemd-resolved
1000000     2132  0.0  0.0  31752  3156 ?        Ss   Dec14   0:00      \_ /usr/sbin/cron -f
1000102     2133  0.0  0.0 197636  4140 ?        Ssl  Dec14   0:00      \_ /usr/sbin/rsyslogd -n
1000001     2149  0.0  0.0  28336  2416 ?        Ss   Dec14   0:00      \_ /usr/sbin/atd -f
1000103     2150  0.0  0.0  50156  4620 ?        Ss   Dec14   0:00      \_ /usr/bin/dbus-daemon --system --address=systemd: --nofork --nopidfile --systemd-activation --syslog-only
1000000     2160  0.0  0.0  62144  5536 ?        Ss   Dec14   0:00      \_ /lib/systemd/systemd-logind
1000000     2164  0.0  0.1 170828 17116 ?        Ssl  Dec14   0:00      \_ /usr/bin/python3 /usr/bin/networkd-dispatcher --run-startup-triggers
1000000     2167  0.0  0.0 288000  6976 ?        Ssl  Dec14   0:00      \_ /usr/lib/accountsservice/accounts-daemon
1000000     2171  0.0  0.0  21772  3492 ?        Ss   Dec14   0:00      \_ bash /etc/systemd/system/jujud-machine-0-exec-start.sh
1000000     2190  0.1  0.4 827684 75820 ?        SLl  Dec14   0:05      |   \_ /var/lib/juju/tools/machine-0/jujud machine --data-dir /var/lib/juju --machine-id 0 --debug
1000000     2176  0.0  0.1 187672 20148 ?        Ssl  Dec14   0:00      \_ /usr/bin/python3 /usr/share/unattended-upgrades/unattended-upgrade-shutdown --wait-for-signal
1000000     2181  0.0  0.0  16416  2356 pts/0    Ss+  Dec14   0:00      \_ /sbin/agetty -o -p -- \u --noclear --keep-baud console 115200,38400,9600 linux
1000000     2192  0.0  0.0 288884  6524 ?        Ssl  Dec14   0:00      \_ /usr/lib/policykit-1/polkitd --no-debug
1000000     2203  0.0  0.0  72304  5660 ?        Ss   Dec14   0:00      \_ /usr/sbin/sshd -D
1000000     2623  1.0  0.5 1462900 81956 ?       SLsl Dec14   0:53      \_ /usr/bin/mongod --auth --bind_ip_all --dbpath /var/lib/juju/db --ipv6 --journal --keyFile /var/lib/juju/shared-secret --oplogSize 512 --port 37017 --quiet --replSet juju --sslMode requireSSL --sslPEMKeyFile /var/lib/juju/server.pem --sslPEMKeyPassword=xxxxxxx --storageEngine wiredTiger --syslog
root        1736  0.0  0.0 1232960 14980 ?       Ss   Dec14   0:00 [lxc monitor] /var/snap/lxd/common/lxd/containers juju-ea203b-1
1000000     1796  0.0  0.0  77688  8624 ?        Ss   Dec14   0:00  \_ /sbin/init
1000000     1957  0.0  0.1 127292 28696 ?        Ss   Dec14   0:00      \_ /lib/systemd/systemd-journald
1000000     1976  0.0  0.0  42108  3584 ?        Ss   Dec14   0:00      \_ /lib/systemd/systemd-udevd
1000100     2095  0.0  0.0  71892  5280 ?        Ss   Dec14   0:00      \_ /lib/systemd/systemd-networkd
1000101     2096  0.0  0.0  70668  5332 ?        Ss   Dec14   0:00      \_ /lib/systemd/systemd-resolved
1000000     2269  0.0  0.0  62148  5624 ?        Ss   Dec14   0:00      \_ /lib/systemd/systemd-logind
1000000     2272  0.0  0.1 170832 16992 ?        Ssl  Dec14   0:00      \_ /usr/bin/python3 /usr/bin/networkd-dispatcher --run-startup-triggers
1000102     2274  0.0  0.0 197636  4156 ?        Ssl  Dec14   0:00      \_ /usr/sbin/rsyslogd -n
1000103     2275  0.0  0.0  50048  4404 ?        Ss   Dec14   0:00      \_ /usr/bin/dbus-daemon --system --address=systemd: --nofork --nopidfile --systemd-activation --syslog-only
1000000     2278  0.0  0.1 187676 19984 ?        Ssl  Dec14   0:00      \_ /usr/bin/python3 /usr/share/unattended-upgrades/unattended-upgrade-shutdown --wait-for-signal
1000000     2281  0.0  0.0  31752  3160 ?        Ss   Dec14   0:00      \_ /usr/sbin/cron -f
1000001     2285  0.0  0.0  28336  2388 ?        Ss   Dec14   0:00      \_ /usr/sbin/atd -f
1000000     2286  0.0  0.0 287996  6948 ?        Ssl  Dec14   0:00      \_ /usr/lib/accountsservice/accounts-daemon
1000000     2297  0.0  0.0  21772  3468 ?        Ss   Dec14   0:00      \_ bash /etc/systemd/system/jujud-machine-1-exec-start.sh
1000000     2312  0.0  0.4 827428 69880 ?        SLl  Dec14   0:01      |   \_ /var/lib/juju/tools/machine-1/jujud machine --data-dir /var/lib/juju --machine-id 1 --debug
1000000     2299  0.0  0.0  21772  3432 ?        Ss   Dec14   0:00      \_ bash /etc/systemd/system/jujud-unit-postgresql-1-exec-start.sh
1000000     2313  0.0  0.4 827428 66532 ?        SLl  Dec14   0:01      |   \_ /var/lib/juju/tools/unit-postgresql-1/jujud unit --data-dir /var/lib/juju --unit-name postgresql/1 --debug
1000000     2304  0.0  0.0  16416  2292 ?        Ss+  Dec14   0:00      \_ /sbin/agetty -o -p -- \u --noclear --keep-baud console 115200,38400,9600 linux
1000000     2314  0.0  0.0 288884  6596 ?        Ssl  Dec14   0:00      \_ /usr/lib/policykit-1/polkitd --no-debug
1000000     2323  0.0  0.0  72304  5572 ?        Ss   Dec14   0:00      \_ /usr/sbin/sshd -D
1000111     2372  0.0  0.7 4357760 117808 ?      S    Dec14   0:00      \_ /usr/lib/postgresql/10/bin/postgres -D /var/lib/postgresql/10/main -c config_file=/etc/postgresql/10/main/postgresql.conf
1000111     2406  0.0  0.2 4357860 38032 ?       Ss   Dec14   0:00          \_ postgres: 10/main: checkpointer process   
1000111     2407  0.0  0.2 4357760 36068 ?       Ss   Dec14   0:00          \_ postgres: 10/main: writer process   
1000111     2408  0.0  0.1 4357760 21456 ?       Ss   Dec14   0:00          \_ postgres: 10/main: wal writer process   
1000111     2409  0.0  0.0 4358176 6940 ?        Ss   Dec14   0:00          \_ postgres: 10/main: autovacuum launcher process   
1000111     2410  0.0  0.0 172060  3524 ?        Ss   Dec14   0:00          \_ postgres: 10/main: archiver process   
1000111     2411  0.0  0.0 172336  4412 ?        Ss   Dec14   0:00          \_ postgres: 10/main: stats collector process   
1000111     2412  0.0  0.0 4358060 5028 ?        Ss   Dec14   0:00          \_ postgres: 10/main: bgworker: logical replication launcher   
lxduser     2971  0.0  0.0  18848 10088 ?        Ss   Dec14   0:00 /lib/systemd/systemd --user
lxduser     2974  0.0  0.0 169300  3764 ?        S    Dec14   0:00  \_ (sd-pam)

bmweller · December 14, 2020, 11:35pm

Active Internet connections (only servers)
Proto Recv-Q Send-Q Local Address           Foreign Address         State       PID/Program name    
tcp        0      0 127.0.0.53:53           0.0.0.0:*               LISTEN      834/systemd-resolve 
tcp        0      0 0.0.0.0:22              0.0.0.0:*               LISTEN      940/sshd: /usr/sbin 
tcp6       0      0 :::22                   :::*                    LISTEN      940/sshd: /usr/sbin 
tcp6       0      0 :::8443                 :::*                    LISTEN      1296/lxd            
udp        0      0 127.0.0.53:53           0.0.0.0:*                           834/systemd-resolve 
udp        0      0 192.168.2.253:68        0.0.0.0:*                           831/systemd-network 
udp        0      0 192.168.3.253:68        0.0.0.0:*                           831/systemd-network 
udp        0      0 192.168.0.14:68         0.0.0.0:*                           831/systemd-network 
raw6       0      0 :::58                   :::*                    7           831/systemd-network 
raw6       0      0 :::58                   :::*                    7           831/systemd-network 
raw6       0      0 :::58                   :::*                    7           831/systemd-network 
Active UNIX domain sockets (only servers)
Proto RefCnt Flags       Type       State         I-Node   PID/Program name     Path
unix  2      [ ACC ]     STREAM     LISTENING     26496    1296/lxd             /var/snap/lxd/common/lxd/devlxd/sock
unix  2      [ ACC ]     SEQPACKET  LISTENING     478      1/init               /run/udev/control
unix  2      [ ACC ]     STREAM     LISTENING     52227    2971/systemd         /run/user/1000/systemd/private
unix  2      [ ACC ]     STREAM     LISTENING     52232    2971/systemd         /run/user/1000/bus
unix  2      [ ACC ]     STREAM     LISTENING     52233    2971/systemd         /run/user/1000/gnupg/S.dirmngr
unix  2      [ ACC ]     STREAM     LISTENING     52234    2971/systemd         /run/user/1000/gnupg/S.gpg-agent.browser
unix  2      [ ACC ]     STREAM     LISTENING     52235    2971/systemd         /run/user/1000/gnupg/S.gpg-agent.extra
unix  2      [ ACC ]     STREAM     LISTENING     462      1/init               @/org/kernel/linux/storage/multipathd
unix  2      [ ACC ]     STREAM     LISTENING     52236    2971/systemd         /run/user/1000/gnupg/S.gpg-agent.ssh
unix  2      [ ACC ]     STREAM     LISTENING     52237    2971/systemd         /run/user/1000/gnupg/S.gpg-agent
unix  2      [ ACC ]     STREAM     LISTENING     52238    2971/systemd         /run/user/1000/pk-debconf-socket
unix  2      [ ACC ]     STREAM     LISTENING     52239    2971/systemd         /run/user/1000/snapd-session-agent.socket
unix  2      [ ACC ]     STREAM     LISTENING     26190    1/init               /run/dbus/system_bus_socket
unix  2      [ ACC ]     STREAM     LISTENING     26195    1/init               /run/snapd.socket
unix  2      [ ACC ]     STREAM     LISTENING     26197    1/init               /run/snapd-snap.socket
unix  2      [ ACC ]     STREAM     LISTENING     26199    1/init               /run/uuidd/request
unix  2      [ ACC ]     STREAM     LISTENING     37255    1736/[lxc monitor]   @/var/snap/lxd/common/lxd/containers/juju-ea203b-1/command
unix  2      [ ACC ]     STREAM     LISTENING     59500    4939/tmux            /tmp/tmux-1000/default
unix  2      [ ACC ]     STREAM     LISTENING     25199    889/irqbalance       /run/irqbalance//irqbalance889.sock
unix  2      [ ACC ]     STREAM     LISTENING     34177    1579/[lxc monitor]   @/var/snap/lxd/common/lxd/containers/juju-1d3465-0/command
unix  2      [ ACC ]     STREAM     LISTENING     449      1/init               /run/systemd/private
unix  2      [ ACC ]     STREAM     LISTENING     451      1/init               /run/systemd/userdb/io.systemd.DynamicUser
unix  2      [ ACC ]     STREAM     LISTENING     460      1/init               /run/lvm/lvmpolld.socket
unix  2      [ ACC ]     STREAM     LISTENING     473      1/init               /run/systemd/journal/stdout
unix  2      [ ACC ]     STREAM     LISTENING     17958    458/systemd-journal  /run/systemd/journal/io.systemd.journal
unix  2      [ ACC ]     SEQPACKET  LISTENING     32369    1296/lxd             /var/snap/lxd/common/lxd/seccomp.socket
unix  2      [ ACC ]     STREAM     LISTENING     26192    1/init               @ISCSIADM_ABSTRACT_NAMESPACE
unix  2      [ ACC ]     STREAM     LISTENING     26193    1/init               /var/snap/lxd/common/lxd/unix.socket
unix  2      [ ACC ]     STREAM     LISTENING     32152    1296/lxd             @00014

bmweller · December 14, 2020, 11:38pm

Dec 14 23:01:02 lxdhost systemd-udevd[847]: lxdbr0: Could not generate persistent MAC: No data available    
Dec 14 23:01:03 lxdhost systemd-networkd[831]: lxdbr0: Link UP
Dec 14 23:01:03 lxdhost kernel: [   30.996283] lxdbr0: port 1(veth2f4404ae) entered blocking state
Dec 14 23:01:03 lxdhost kernel: [   30.996285] lxdbr0: port 1(veth2f4404ae) entered disabled state
Dec 14 23:01:03 lxdhost kernel: [   30.996376] lxdbr0: port 1(veth2f4404ae) entered blocking state
Dec 14 23:01:03 lxdhost kernel: [   30.996377] lxdbr0: port 1(veth2f4404ae) entered forwarding state
Dec 14 23:01:03 lxdhost kernel: [   31.000492] lxdbr0: port 1(veth2f4404ae) entered disabled state
Dec 14 23:01:03 lxdhost systemd-networkd[831]: lxdbr0: Gained carrier
Dec 14 23:01:03 lxdhost kernel: [   31.191435] lxdbr0: port 1(veth2f4404ae) entered blocking state
Dec 14 23:01:03 lxdhost kernel: [   31.191437] lxdbr0: port 1(veth2f4404ae) entered forwarding state
Dec 14 23:01:03 lxdhost kernel: [   31.191514] IPv6: ADDRCONF(NETDEV_CHANGE): lxdbr0: link becomes ready
Dec 14 23:01:04 lxdhost kernel: [   31.333026] lxdbr0: port 2(vethd34eabe7) entered blocking state
Dec 14 23:01:04 lxdhost kernel: [   31.333027] lxdbr0: port 2(vethd34eabe7) entered disabled state
Dec 14 23:01:04 lxdhost kernel: [   31.333109] lxdbr0: port 2(vethd34eabe7) entered blocking state
Dec 14 23:01:04 lxdhost kernel: [   31.333109] lxdbr0: port 2(vethd34eabe7) entered forwarding state
Dec 14 23:01:04 lxdhost kernel: [   31.335122] lxdbr0: port 2(vethd34eabe7) entered disabled state
Dec 14 23:01:04 lxdhost kernel: [   31.603724] lxdbr0: port 2(vethd34eabe7) entered blocking state
Dec 14 23:01:04 lxdhost kernel: [   31.603726] lxdbr0: port 2(vethd34eabe7) entered forwarding state
Dec 14 23:01:05 lxdhost systemd-networkd[831]: lxdbr0: Gained IPv6LLDec 14 23:01:02 lxdhost systemd-udevd[847]: lxdbr0: Could not generate persistent MAC: No data available
Dec 14 23:01:03 lxdhost systemd-networkd[831]: lxdbr0: Link UP
Dec 14 23:01:03 lxdhost kernel: [   30.996283] lxdbr0: port 1(veth2f4404ae) entered blocking state
Dec 14 23:01:03 lxdhost kernel: [   30.996285] lxdbr0: port 1(veth2f4404ae) entered disabled state
Dec 14 23:01:03 lxdhost kernel: [   30.996376] lxdbr0: port 1(veth2f4404ae) entered blocking state
Dec 14 23:01:03 lxdhost kernel: [   30.996377] lxdbr0: port 1(veth2f4404ae) entered forwarding state
Dec 14 23:01:03 lxdhost kernel: [   31.000492] lxdbr0: port 1(veth2f4404ae) entered disabled state
Dec 14 23:01:03 lxdhost systemd-networkd[831]: lxdbr0: Gained carrier
Dec 14 23:01:03 lxdhost kernel: [   31.191435] lxdbr0: port 1(veth2f4404ae) entered blocking state
Dec 14 23:01:03 lxdhost kernel: [   31.191437] lxdbr0: port 1(veth2f4404ae) entered forwarding state
Dec 14 23:01:03 lxdhost kernel: [   31.191514] IPv6: ADDRCONF(NETDEV_CHANGE): lxdbr0: link becomes ready
Dec 14 23:01:04 lxdhost kernel: [   31.333026] lxdbr0: port 2(vethd34eabe7) entered blocking state
Dec 14 23:01:04 lxdhost kernel: [   31.333027] lxdbr0: port 2(vethd34eabe7) entered disabled state
Dec 14 23:01:04 lxdhost kernel: [   31.333109] lxdbr0: port 2(vethd34eabe7) entered blocking state
Dec 14 23:01:04 lxdhost kernel: [   31.333109] lxdbr0: port 2(vethd34eabe7) entered forwarding state
Dec 14 23:01:04 lxdhost kernel: [   31.335122] lxdbr0: port 2(vethd34eabe7) entered disabled state
Dec 14 23:01:04 lxdhost kernel: [   31.603724] lxdbr0: port 2(vethd34eabe7) entered blocking state
Dec 14 23:01:04 lxdhost kernel: [   31.603726] lxdbr0: port 2(vethd34eabe7) entered forwarding state
Dec 14 23:01:05 lxdhost systemd-networkd[831]: lxdbr0: Gained IPv6LL

bmweller · December 14, 2020, 11:40pm

no docker installed

stgraber · December 14, 2020, 11:51pm

This truncated output isn’t useful, I’m not looking for the containers, I’m looking for everything except the containers.

stgraber · December 14, 2020, 11:51pm

Same thing, this output isn’t useful, a normal netstat -lnp run as root will show you all ports, sockets AND the PID that binds them.

stgraber · December 14, 2020, 11:52pm

That grep doesn’t show any message from dnsmasq, so that may be the issue.
Try running:

lxc network set bridge.mtu 1480
lxc network unset bridge.mtu

That would force dnsmasq to be restarted and may get you an error.

bmweller · December 15, 2020, 12:33am

ran the following:

lxc network set lxdbr0 bridge.mtu=1480
lxc network unset lxdbr0 bridge.mtu

Dec 15 00:29:47 lxdhost systemd-networkd[831]: lxdbr0-mtu: Link UP
Dec 15 00:29:47 lxdhost systemd-networkd[831]: lxdbr0-mtu: Gained carrier
Dec 15 00:29:47 lxdhost systemd-networkd[831]: lxdbr0-mtu: Gained IPv6LL
Dec 15 00:29:47 lxdhost systemd-udevd[80505]: lxdbr0-mtu: Could not generate persistent MAC: No data available
Dec 15 00:29:47 lxdhost kernel: [ 5354.909011] lxdbr0: port 3(lxdbr0-mtu) entered blocking state
Dec 15 00:29:47 lxdhost kernel: [ 5354.909013] lxdbr0: port 3(lxdbr0-mtu) entered disabled state
Dec 15 00:29:47 lxdhost kernel: [ 5354.909073] device lxdbr0-mtu entered promiscuous mode
Dec 15 00:29:47 lxdhost kernel: [ 5354.909091] lxdbr0: port 3(lxdbr0-mtu) entered blocking state
Dec 15 00:29:47 lxdhost kernel: [ 5354.909093] lxdbr0: port 3(lxdbr0-mtu) entered forwarding state
Dec 15 00:29:47 lxdhost kernel: [ 5354.946540] audit: type=1400 audit(1607992187.649:202): apparmor="STATUS" operation="profile_replace" info="same as current profile, skipping" profile="unconfined" name="lxd_dnsmasq-lxdbr0_</var/snap/lxd/common/lxd>" pid=80535 comm="apparmor_parser"
Dec 15 00:29:48 lxdhost dnsmasq-dhcp[80536]: DHCP, sockets bound exclusively to interface lxdbr0
Dec 15 00:29:48 lxdhost dnsmasq-dhcp[80536]: read /var/snap/lxd/common/lxd/networks/lxdbr0/dnsmasq.hosts/juju-1d3465-0
Dec 15 00:29:48 lxdhost dnsmasq-dhcp[80536]: read /var/snap/lxd/common/lxd/networks/lxdbr0/dnsmasq.hosts/juju-ea203b-1
Dec 15 00:30:00 lxdhost systemd-networkd[831]: lxdbr0-mtu: Link DOWN
Dec 15 00:30:00 lxdhost systemd-networkd[831]: lxdbr0-mtu: Lost carrier
Dec 15 00:30:00 lxdhost kernel: [ 5367.600250] lxdbr0: port 3(lxdbr0-mtu) entered disabled state
Dec 15 00:30:00 lxdhost kernel: [ 5367.601176] device lxdbr0-mtu left promiscuous mode
Dec 15 00:30:00 lxdhost kernel: [ 5367.601178] lxdbr0: port 3(lxdbr0-mtu) entered disabled state
Dec 15 00:30:00 lxdhost kernel: [ 5367.718275] audit: type=1400 audit(1607992200.421:203): apparmor="STATUS" operation="profile_replace" info="same as current profile, skipping" profile="unconfined" name="lxd_dnsmasq-lxdbr0_</var/snap/lxd/common/lxd>" pid=80598 comm="apparmor_parser"
Dec 15 00:30:00 lxdhost dnsmasq-dhcp[80599]: DHCP, sockets bound exclusively to interface lxdbr0
Dec 15 00:30:00 lxdhost dnsmasq-dhcp[80599]: read /var/snap/lxd/common/lxd/networks/lxdbr0/dnsmasq.hosts/juju-1d3465-0
Dec 15 00:30:00 lxdhost dnsmasq-dhcp[80599]: read /var/snap/lxd/common/lxd/networks/lxdbr0/dnsmasq.hosts/juju-ea203b-1

bmweller · December 15, 2020, 12:34am

revised above

bmweller · December 15, 2020, 12:35am

done, quoted above

stgraber · December 15, 2020, 1:09am

Hmm, is dnsmasq now running?

The earlier output doesn’t show it running but your recent syslog output shows it running.

davidfavor · December 15, 2020, 5:24pm

Be sure to check route -n to make sure all routes are still active.

LXD tends to group routes in many cases, as a side effect of upgrades.