Ipv4 broken as of today

I restarted my Ubuntu server 19.10 machine today, and now none of my lxd containers can get an ipv4 address anymore. They get ipv6 addresses, but not ipv4.

All I did is apt update and reboot.

I noticed that lxd got updated to 4.0 recently, so I tried downgrading to 3.23, but that didn’t help.

I have a second machine that’s still working fine (running 4.0), but I’m afraid to reboot it for fear it will break as well…

Usually that means a conflicting bind9/dnsmasq or something on the host preventing the LXD dnsmasq from starting up.

How do I diagnose what the problem is? What would cause those programs to misbehave? I’ve never heard of them let alone configured them…

Can you show netstat -lnp?

Sure thing:

root@thor:/var/snap/lxd# netstat -lnp
Active Internet connections (only servers)
Proto Recv-Q Send-Q Local Address           Foreign Address         State       PID/Program name    
tcp        0      0 0.0.0.0:139             0.0.0.0:*               LISTEN      8477/smbd           
tcp        0      0 10.198.145.1:53         0.0.0.0:*               LISTEN      3219/dnsmasq        
tcp        0      0 192.168.122.1:53        0.0.0.0:*               LISTEN      3051/dnsmasq        
tcp        0      0 127.0.0.53:53           0.0.0.0:*               LISTEN      1922/systemd-resolv 
tcp        0      0 0.0.0.0:22              0.0.0.0:*               LISTEN      2280/sshd           
tcp        0      0 127.0.0.1:25            0.0.0.0:*               LISTEN      2565/master         
tcp        0      0 0.0.0.0:445             0.0.0.0:*               LISTEN      8477/smbd           
tcp6       0      0 :::139                  :::*                    LISTEN      8477/smbd           
tcp6       0      0 :::22                   :::*                    LISTEN      2280/sshd           
tcp6       0      0 ::1:25                  :::*                    LISTEN      2565/master         
tcp6       0      0 :::445                  :::*                    LISTEN      8477/smbd           
udp        0      0 0.0.0.0:5353            0.0.0.0:*                           2184/avahi-daemon:  
udp        0      0 0.0.0.0:55752           0.0.0.0:*                           2184/avahi-daemon:  
udp        0      0 10.198.145.1:53         0.0.0.0:*                           3219/dnsmasq        
udp        0      0 192.168.122.1:53        0.0.0.0:*                           3051/dnsmasq        
udp        0      0 127.0.0.53:53           0.0.0.0:*                           1922/systemd-resolv 
udp        0      0 0.0.0.0:67              0.0.0.0:*                           3219/dnsmasq        
udp        0      0 0.0.0.0:67              0.0.0.0:*                           3051/dnsmasq        
udp        0      0 192.168.111.230:68      0.0.0.0:*                           1918/systemd-networ 
udp        0      0 172.17.255.255:137      0.0.0.0:*                           8604/nmbd           
udp        0      0 172.17.0.1:137          0.0.0.0:*                           8604/nmbd           
udp        0      0 172.18.255.255:137      0.0.0.0:*                           8604/nmbd           
udp        0      0 172.18.0.1:137          0.0.0.0:*                           8604/nmbd           
udp        0      0 192.168.111.255:137     0.0.0.0:*                           8604/nmbd           
udp        0      0 192.168.111.230:137     0.0.0.0:*                           8604/nmbd           
udp        0      0 192.168.122.255:137     0.0.0.0:*                           8604/nmbd           
udp        0      0 192.168.122.1:137       0.0.0.0:*                           8604/nmbd           
udp        0      0 10.198.145.255:137      0.0.0.0:*                           8604/nmbd           
udp        0      0 10.198.145.1:137        0.0.0.0:*                           8604/nmbd           
udp        0      0 0.0.0.0:137             0.0.0.0:*                           8604/nmbd           
udp        0      0 172.17.255.255:138      0.0.0.0:*                           8604/nmbd           
udp        0      0 172.17.0.1:138          0.0.0.0:*                           8604/nmbd           
udp        0      0 172.18.255.255:138      0.0.0.0:*                           8604/nmbd           
udp        0      0 172.18.0.1:138          0.0.0.0:*                           8604/nmbd           
udp        0      0 192.168.111.255:138     0.0.0.0:*                           8604/nmbd           
udp        0      0 192.168.111.230:138     0.0.0.0:*                           8604/nmbd           
udp        0      0 192.168.122.255:138     0.0.0.0:*                           8604/nmbd           
udp        0      0 192.168.122.1:138       0.0.0.0:*                           8604/nmbd           
udp        0      0 10.198.145.255:138      0.0.0.0:*                           8604/nmbd           
udp        0      0 10.198.145.1:138        0.0.0.0:*                           8604/nmbd           
udp        0      0 0.0.0.0:138             0.0.0.0:*                           8604/nmbd           
udp6       0      0 :::5353                 :::*                                2184/avahi-daemon:  
udp6       0      0 :::47233                :::*                                2184/avahi-daemon:  
udp6       0      0 fe80::8c79:43ff:fe2:546 :::*                                1918/systemd-networ 
raw6       0      0 :::58                   :::*                    7           1918/systemd-networ 
Active UNIX domain sockets (only servers)
Proto RefCnt Flags       Type       State         I-Node   PID/Program name     Path
unix  2      [ ACC ]     STREAM     LISTENING     64126    17983/lxd            /var/snap/lxd/common/lxd/devlxd/sock
unix  2      [ ACC ]     SEQPACKET  LISTENING     869      1/init               /run/udev/control
unix  2      [ ACC ]     STREAM     LISTENING     116310   22810/systemd        /run/user/1000/systemd/private
unix  2      [ ACC ]     STREAM     LISTENING     116315   22810/systemd        /run/user/1000/gnupg/S.gpg-agent
unix  2      [ ACC ]     STREAM     LISTENING     116316   22810/systemd        /run/user/1000/snapd-session-agent.socket
unix  2      [ ACC ]     STREAM     LISTENING     116317   22810/systemd        /run/user/1000/gnupg/S.gpg-agent.extra
unix  2      [ ACC ]     STREAM     LISTENING     116318   22810/systemd        /run/user/1000/gnupg/S.dirmngr
unix  2      [ ACC ]     STREAM     LISTENING     116319   22810/systemd        /run/user/1000/pk-debconf-socket
unix  2      [ ACC ]     STREAM     LISTENING     116320   22810/systemd        /run/user/1000/gnupg/S.gpg-agent.ssh
unix  2      [ ACC ]     STREAM     LISTENING     116321   22810/systemd        /run/user/1000/gnupg/S.gpg-agent.browser
unix  2      [ ACC ]     STREAM     LISTENING     116322   22810/systemd        /run/user/1000/bus
unix  2      [ ACC ]     STREAM     LISTENING     864      1/init               @/org/kernel/linux/storage/multipathd
unix  2      [ ACC ]     STREAM     LISTENING     43951    4367/[lxc monitor]   @/var/snap/lxd/common/lxd/containers/thor-shared/command
unix  2      [ ACC ]     STREAM     LISTENING     30022    1/init               /run/dbus/system_bus_socket
unix  2      [ ACC ]     STREAM     LISTENING     30024    1/init               /run/libvirt/virtlogd-sock
unix  2      [ ACC ]     STREAM     LISTENING     30028    1/init               /run/uuidd/request
unix  2      [ ACC ]     STREAM     LISTENING     30030    1/init               /run/snapd.socket
unix  2      [ ACC ]     STREAM     LISTENING     30032    1/init               /run/snapd-snap.socket
unix  2      [ ACC ]     STREAM     LISTENING     30034    1/init               /run/libvirt/virtlockd-admin-sock
unix  2      [ ACC ]     STREAM     LISTENING     30036    1/init               /run/libvirt/virtlogd-admin-sock
unix  2      [ ACC ]     STREAM     LISTENING     30039    1/init               /run/docker.sock
unix  2      [ ACC ]     STREAM     LISTENING     30041    1/init               /run/libvirt/virtlockd-sock
unix  2      [ ACC ]     STREAM     LISTENING     31649    2182/irqbalance      /run/irqbalance//irqbalance2182.sock
unix  2      [ ACC ]     STREAM     LISTENING     44087    3730/[lxc monitor]   @/var/snap/lxd/common/lxd/containers/media/command
unix  2      [ ACC ]     STREAM     LISTENING     90478    5815/[lxc monitor]   @/var/snap/lxd/common/lxd/containers/odin/command
unix  2      [ ACC ]     STREAM     LISTENING     45590    4801/[lxc monitor]   @/var/snap/lxd/common/lxd/containers/thor-tx/command
unix  2      [ ACC ]     STREAM     LISTENING     134940   8604/nmbd            /var/run/samba/nmbd/unexpected
unix  2      [ ACC ]     STREAM     LISTENING     43791    4133/[lxc monitor]   @/var/snap/lxd/common/lxd/containers/thor-crd/command
unix  2      [ ACC ]     STREAM     LISTENING     36721    2158/multipassd      /var/snap/multipass/common/multipass_socket
unix  2      [ ACC ]     STREAM     LISTENING     30697    2214/containerd      /run/containerd/containerd.sock
unix  2      [ ACC ]     STREAM     LISTENING     64631    1/init               /var/snap/lxd/common/lxd/unix.socket
unix  2      [ ACC ]     STREAM     LISTENING     47663    5415/[lxc monitor]   @/var/snap/lxd/common/lxd/containers/transmission/command
unix  2      [ ACC ]     STREAM     LISTENING     34719    2257/dockerd         /var/run/docker/metrics.sock
unix  2      [ ACC ]     STREAM     LISTENING     64687    17983/lxd            @0006b
unix  2      [ ACC ]     STREAM     LISTENING     854      1/init               /run/systemd/private
unix  2      [ ACC ]     STREAM     LISTENING     867      1/init               /run/lvm/lvmpolld.socket
unix  2      [ ACC ]     STREAM     LISTENING     871      1/init               /run/systemd/journal/stdout
unix  2      [ ACC ]     STREAM     LISTENING     34768    2565/master          public/pickup
unix  2      [ ACC ]     STREAM     LISTENING     34772    2565/master          public/cleanup
unix  2      [ ACC ]     STREAM     LISTENING     34775    2565/master          public/qmgr
unix  2      [ ACC ]     STREAM     LISTENING     34779    2565/master          private/tlsmgr
unix  2      [ ACC ]     STREAM     LISTENING     34782    2565/master          private/rewrite
unix  2      [ ACC ]     STREAM     LISTENING     30038    1/init               @ISCSIADM_ABSTRACT_NAMESPACE
unix  2      [ ACC ]     STREAM     LISTENING     34785    2565/master          private/bounce
unix  2      [ ACC ]     STREAM     LISTENING     34788    2565/master          private/defer
unix  2      [ ACC ]     STREAM     LISTENING     34791    2565/master          private/trace
unix  2      [ ACC ]     STREAM     LISTENING     34794    2565/master          private/verify
unix  2      [ ACC ]     STREAM     LISTENING     34797    2565/master          public/flush
unix  2      [ ACC ]     STREAM     LISTENING     34800    2565/master          private/proxymap
unix  2      [ ACC ]     STREAM     LISTENING     34803    2565/master          private/proxywrite
unix  2      [ ACC ]     STREAM     LISTENING     37477    2257/dockerd         /var/run/docker/libnetwork/bd870f40cb92.sock
unix  2      [ ACC ]     STREAM     LISTENING     34806    2565/master          private/smtp
unix  2      [ ACC ]     STREAM     LISTENING     36236    2613/libvirtd        /var/run/libvirt/libvirt-sock
unix  2      [ ACC ]     STREAM     LISTENING     34809    2565/master          private/relay
unix  2      [ ACC ]     STREAM     LISTENING     36237    2613/libvirtd        /var/run/libvirt/libvirt-sock-ro
unix  2      [ ACC ]     STREAM     LISTENING     34812    2565/master          public/showq
unix  2      [ ACC ]     STREAM     LISTENING     36238    2613/libvirtd        /var/run/libvirt/libvirt-admin-sock
unix  2      [ ACC ]     STREAM     LISTENING     34815    2565/master          private/error
unix  2      [ ACC ]     STREAM     LISTENING     37890    2565/master          private/retry
unix  2      [ ACC ]     STREAM     LISTENING     37893    2565/master          private/discard
unix  2      [ ACC ]     STREAM     LISTENING     37896    2565/master          private/local
unix  2      [ ACC ]     STREAM     LISTENING     37899    2565/master          private/virtual
unix  2      [ ACC ]     STREAM     LISTENING     37902    2565/master          private/lmtp
unix  2      [ ACC ]     STREAM     LISTENING     37905    2565/master          private/anvil
unix  2      [ ACC ]     STREAM     LISTENING     37908    2565/master          private/scache
unix  2      [ ACC ]     SEQPACKET  LISTENING     64166    17983/lxd            /var/snap/lxd/common/lxd/seccomp.socket
unix  2      [ ACC ]     STREAM     LISTENING     37914    2565/master          private/maildrop
unix  2      [ ACC ]     STREAM     LISTENING     37917    2565/master          private/uucp
unix  2      [ ACC ]     STREAM     LISTENING     37920    2565/master          private/ifmail
unix  2      [ ACC ]     STREAM     LISTENING     37923    2565/master          private/bsmtp
unix  2      [ ACC ]     STREAM     LISTENING     36314    2184/avahi-daemon:   /run/avahi-daemon/socket
unix  2      [ ACC ]     STREAM     LISTENING     37926    2565/master          private/scalemail-backend
unix  2      [ ACC ]     STREAM     LISTENING     37929    2565/master          private/mailman
root@thor:/var/snap/lxd#

dnsmasq appears properly configured in this case.

Can you show:

  • lxc info
  • lxc network list
  • ps fauxww

lxc info:

$ lxc info
config: {}
api_extensions:
- storage_zfs_remove_snapshots
- container_host_shutdown_timeout
- container_stop_priority
- container_syscall_filtering
- auth_pki
- container_last_used_at
- etag
- patch
- usb_devices
- https_allowed_credentials
- image_compression_algorithm
- directory_manipulation
- container_cpu_time
- storage_zfs_use_refquota
- storage_lvm_mount_options
- network
- profile_usedby
- container_push
- container_exec_recording
- certificate_update
- container_exec_signal_handling
- gpu_devices
- container_image_properties
- migration_progress
- id_map
- network_firewall_filtering
- network_routes
- storage
- file_delete
- file_append
- network_dhcp_expiry
- storage_lvm_vg_rename
- storage_lvm_thinpool_rename
- network_vlan
- image_create_aliases
- container_stateless_copy
- container_only_migration
- storage_zfs_clone_copy
- unix_device_rename
- storage_lvm_use_thinpool
- storage_rsync_bwlimit
- network_vxlan_interface
- storage_btrfs_mount_options
- entity_description
- image_force_refresh
- storage_lvm_lv_resizing
- id_map_base
- file_symlinks
- container_push_target
- network_vlan_physical
- storage_images_delete
- container_edit_metadata
- container_snapshot_stateful_migration
- storage_driver_ceph
- storage_ceph_user_name
- resource_limits
- storage_volatile_initial_source
- storage_ceph_force_osd_reuse
- storage_block_filesystem_btrfs
- resources
- kernel_limits
- storage_api_volume_rename
- macaroon_authentication
- network_sriov
- console
- restrict_devlxd
- migration_pre_copy
- infiniband
- maas_network
- devlxd_events
- proxy
- network_dhcp_gateway
- file_get_symlink
- network_leases
- unix_device_hotplug
- storage_api_local_volume_handling
- operation_description
- clustering
- event_lifecycle
- storage_api_remote_volume_handling
- nvidia_runtime
- container_mount_propagation
- container_backup
- devlxd_images
- container_local_cross_pool_handling
- proxy_unix
- proxy_udp
- clustering_join
- proxy_tcp_udp_multi_port_handling
- network_state
- proxy_unix_dac_properties
- container_protection_delete
- unix_priv_drop
- pprof_http
- proxy_haproxy_protocol
- network_hwaddr
- proxy_nat
- network_nat_order
- container_full
- candid_authentication
- backup_compression
- candid_config
- nvidia_runtime_config
- storage_api_volume_snapshots
- storage_unmapped
- projects
- candid_config_key
- network_vxlan_ttl
- container_incremental_copy
- usb_optional_vendorid
- snapshot_scheduling
- container_copy_project
- clustering_server_address
- clustering_image_replication
- container_protection_shift
- snapshot_expiry
- container_backup_override_pool
- snapshot_expiry_creation
- network_leases_location
- resources_cpu_socket
- resources_gpu
- resources_numa
- kernel_features
- id_map_current
- event_location
- storage_api_remote_volume_snapshots
- network_nat_address
- container_nic_routes
- rbac
- cluster_internal_copy
- seccomp_notify
- lxc_features
- container_nic_ipvlan
- network_vlan_sriov
- storage_cephfs
- container_nic_ipfilter
- resources_v2
- container_exec_user_group_cwd
- container_syscall_intercept
- container_disk_shift
- storage_shifted
- resources_infiniband
- daemon_storage
- instances
- image_types
- resources_disk_sata
- clustering_roles
- images_expiry
- resources_network_firmware
- backup_compression_algorithm
- ceph_data_pool_name
- container_syscall_intercept_mount
- compression_squashfs
- container_raw_mount
- container_nic_routed
- container_syscall_intercept_mount_fuse
- container_disk_ceph
- virtual-machines
- image_profiles
- clustering_architecture
- resources_disk_id
- storage_lvm_stripes
- vm_boot_priority
- unix_hotplug_devices
- api_filtering
- instance_nic_network
- clustering_sizing
- firewall_driver
- projects_limits
- container_syscall_intercept_hugetlbfs
- limits_hugepages
- container_nic_routed_gateway
- projects_restrictions
- custom_volume_snapshot_expiry
- volume_snapshot_scheduling
- trust_ca_certificates
- snapshot_disk_usage
- clustering_edit_roles
- container_nic_routed_host_address
- container_nic_ipvlan_gateway
- resources_usb_pci
- resources_cpu_threads_numa
api_status: stable
api_version: "1.0"
auth: trusted
public: false
auth_methods:
- tls
environment:
  addresses: []
  architectures:
  - x86_64
  - i686
  certificate: |
    -----BEGIN CERTIFICATE-----
    MIICFTCCAZugAwIBAgIQI7kB/scwa3vfvSijsqJh6jAKBggqhkjOPQQDAzAyMRww
    GgYDVQQKExNsaW51eGNvbnRhaW5lcnMub3JnMRIwEAYDVQQDDAlyb290QHRob3Iw
    HhcNMTkxMDIwMTM1NDI2WhcNMjkxMDE3MTM1NDI2WjAyMRwwGgYDVQQKExNsaW51
    eGNvbnRhaW5lcnMub3JnMRIwEAYDVQQDDAlyb290QHRob3IwdjAQBgcqhkjOPQIB
    BgUrgQQAIgNiAATbFSroXYrJvHcdyLtbfQSBLVs8+C0e0tvGheVz9hc+IvTEQeuB
    z+E7dAYNAZQU/+pE7NsS/vcwIJ3smtVYML5fZkrVTKKn/he1hs8dgh0Jx85TjjIA
    fkfQFYPQdTSWf3GjdjB0MA4GA1UdDwEB/wQEAwIFoDATBgNVHSUEDDAKBggrBgEF
    BQcDATAMBgNVHRMBAf8EAjAAMD8GA1UdEQQ4MDaCBHRob3KHBMCob+aHEP10mjdl
    PgAAAAAAAAAABbiHEP10mjdlPgAAjHlD//4kDIaHBKwRAAEwCgYIKoZIzj0EAwMD
    aAAwZQIxAL1idZq37X50MjB+1YZWDB+zfj6WuORTqfNv6fevnH7lnkXCdNqAPj2x
    O7Xj2FAbBgIwcIpW1QcEtSiIgvKePOIZjUs4t6VMDr2+ToA4zd6YtKdokkjwK6wk
    YJGNBCWV5Txh
    -----END CERTIFICATE-----
  certificate_fingerprint: 46dd3afbea2e8975d3426dc0eb754410c3400271c26e77d90b483ee1999cf11a
  driver: lxc
  driver_version: 4.0.0
  firewall: xtables
  kernel: Linux
  kernel_architecture: x86_64
  kernel_features:
    netnsid_getifaddrs: "true"
    seccomp_listener: "true"
    seccomp_listener_continue: "true"
    shiftfs: "false"
    uevent_injection: "true"
    unpriv_fscaps: "true"
  kernel_version: 5.3.0-45-generic
  lxc_features:
    cgroup2: "true"
    mount_injection_file: "true"
    network_gateway_device_route: "true"
    network_ipvlan: "true"
    network_l2proxy: "true"
    network_phys_macvlan_mtu: "true"
    network_veth_router: "true"
    seccomp_notify: "true"
  project: default
  server: lxd
  server_clustered: false
  server_name: thor
  server_pid: 17983
  server_version: 4.0.0
  storage: zfs
  storage_version: 0.8.1-1ubuntu14.3

lxc network list:

$ lxc network list
+-----------------+----------+---------+-------------+---------+
|      NAME       |   TYPE   | MANAGED | DESCRIPTION | USED BY |
+-----------------+----------+---------+-------------+---------+
| br-a4556923b60f | bridge   | NO      |             | 0       |
+-----------------+----------+---------+-------------+---------+
| br0             | bridge   | NO      |             | 9       |
+-----------------+----------+---------+-------------+---------+
| docker0         | bridge   | NO      |             | 0       |
+-----------------+----------+---------+-------------+---------+
| eno1            | physical | NO      |             | 0       |
+-----------------+----------+---------+-------------+---------+
| mpqemubr0       | bridge   | NO      |             | 0       |
+-----------------+----------+---------+-------------+---------+
| virbr0          | bridge   | NO      |             | 0       |
+-----------------+----------+---------+-------------+---------+
| wlp58s0         | physical | NO      |             | 0       |
+-----------------+----------+---------+-------------+---------+

ps fauxww:

$ ps fauxww
USER       PID %CPU %MEM    VSZ   RSS TTY      STAT START   TIME COMMAND
root         2  0.0  0.0      0     0 ?        S    16:33   0:04 [kthreadd]
root         3  0.0  0.0      0     0 ?        I<   16:33   0:00  \_ [rcu_gp]
root         4  0.0  0.0      0     0 ?        I<   16:33   0:00  \_ [rcu_par_gp]
root         6  0.0  0.0      0     0 ?        I<   16:33   0:00  \_ [kworker/0:0H-kblockd]
root         9  0.0  0.0      0     0 ?        I<   16:33   0:00  \_ [mm_percpu_wq]
root        10  0.0  0.0      0     0 ?        S    16:33   0:00  \_ [ksoftirqd/0]
root        11  0.0  0.0      0     0 ?        I    16:33   0:10  \_ [rcu_sched]
root        12  0.0  0.0      0     0 ?        S    16:33   0:00  \_ [migration/0]
root        13  0.0  0.0      0     0 ?        S    16:33   0:00  \_ [idle_inject/0]
root        14  0.0  0.0      0     0 ?        S    16:33   0:00  \_ [cpuhp/0]
root        15  0.0  0.0      0     0 ?        S    16:33   0:00  \_ [cpuhp/1]
root        16  0.0  0.0      0     0 ?        S    16:33   0:00  \_ [idle_inject/1]
root        17  0.0  0.0      0     0 ?        S    16:33   0:00  \_ [migration/1]
root        18  0.0  0.0      0     0 ?        S    16:33   0:00  \_ [ksoftirqd/1]
root        20  0.0  0.0      0     0 ?        I<   16:33   0:00  \_ [kworker/1:0H-kblockd]
root        21  0.0  0.0      0     0 ?        S    16:33   0:00  \_ [cpuhp/2]
root        22  0.0  0.0      0     0 ?        S    16:33   0:00  \_ [idle_inject/2]
root        23  0.0  0.0      0     0 ?        S    16:33   0:00  \_ [migration/2]
root        24  0.0  0.0      0     0 ?        S    16:33   0:00  \_ [ksoftirqd/2]
root        26  0.0  0.0      0     0 ?        I<   16:33   0:00  \_ [kworker/2:0H-kblockd]
root        27  0.0  0.0      0     0 ?        S    16:33   0:00  \_ [cpuhp/3]
root        28  0.0  0.0      0     0 ?        S    16:33   0:00  \_ [idle_inject/3]
root        29  0.0  0.0      0     0 ?        S    16:33   0:00  \_ [migration/3]
root        30  0.0  0.0      0     0 ?        S    16:33   0:00  \_ [ksoftirqd/3]
root        32  0.0  0.0      0     0 ?        I<   16:33   0:00  \_ [kworker/3:0H-kblockd]
root        33  0.0  0.0      0     0 ?        S    16:33   0:00  \_ [kdevtmpfs]
root        34  0.0  0.0      0     0 ?        I<   16:33   0:00  \_ [netns]
root        35  0.0  0.0      0     0 ?        S    16:33   0:00  \_ [rcu_tasks_kthre]
root        36  0.0  0.0      0     0 ?        S    16:33   0:00  \_ [kauditd]
root        39  0.0  0.0      0     0 ?        S    16:33   0:00  \_ [khungtaskd]
root        40  0.0  0.0      0     0 ?        S    16:33   0:00  \_ [oom_reaper]
root        41  0.0  0.0      0     0 ?        I<   16:33   0:00  \_ [writeback]
root        42  0.0  0.0      0     0 ?        S    16:33   0:00  \_ [kcompactd0]
root        43  0.0  0.0      0     0 ?        SN   16:33   0:00  \_ [ksmd]
root        44  0.0  0.0      0     0 ?        SN   16:33   0:00  \_ [khugepaged]
root       136  0.0  0.0      0     0 ?        I<   16:33   0:00  \_ [kintegrityd]
root       137  0.0  0.0      0     0 ?        I<   16:33   0:00  \_ [kblockd]
root       138  0.0  0.0      0     0 ?        I<   16:33   0:00  \_ [blkcg_punt_bio]
root       140  0.0  0.0      0     0 ?        I<   16:33   0:00  \_ [tpm_dev_wq]
root       141  0.0  0.0      0     0 ?        I<   16:33   0:00  \_ [ata_sff]
root       142  0.0  0.0      0     0 ?        I<   16:33   0:00  \_ [md]
root       143  0.0  0.0      0     0 ?        I<   16:33   0:00  \_ [edac-poller]
root       144  0.0  0.0      0     0 ?        I<   16:33   0:00  \_ [devfreq_wq]
root       145  0.0  0.0      0     0 ?        S    16:33   0:00  \_ [watchdogd]
root       148  0.0  0.0      0     0 ?        S    16:33   0:00  \_ [kswapd0]
root       149  0.0  0.0      0     0 ?        I<   16:33   0:00  \_ [kworker/u9:0-hci0]
root       150  0.0  0.0      0     0 ?        S    16:33   0:00  \_ [ecryptfs-kthrea]
root       153  0.0  0.0      0     0 ?        I<   16:33   0:00  \_ [kthrotld]
root       154  0.0  0.0      0     0 ?        I<   16:33   0:00  \_ [acpi_thermal_pm]
root       157  0.0  0.0      0     0 ?        I<   16:33   0:00  \_ [ipv6_addrconf]
root       168  0.0  0.0      0     0 ?        I<   16:33   0:00  \_ [kstrp]
root       188  0.0  0.0      0     0 ?        I<   16:33   0:00  \_ [charger_manager]
root       254  0.0  0.0      0     0 ?        I<   16:33   0:00  \_ [cryptd]
root       257  0.0  0.0      0     0 ?        S    16:33   0:00  \_ [scsi_eh_0]
root       258  0.0  0.0      0     0 ?        I<   16:33   0:00  \_ [scsi_tmf_0]
root       271  0.0  0.0      0     0 ?        S    16:33   0:00  \_ [scsi_eh_1]
root       272  0.0  0.0      0     0 ?        I<   16:33   0:00  \_ [scsi_tmf_1]
root       273  0.0  0.0      0     0 ?        S    16:33   0:00  \_ [scsi_eh_2]
root       274  0.0  0.0      0     0 ?        I<   16:33   0:00  \_ [scsi_tmf_2]
root       311  0.0  0.0      0     0 ?        S    16:33   0:00  \_ [scsi_eh_3]
root       312  0.0  0.0      0     0 ?        I<   16:33   0:00  \_ [scsi_tmf_3]
root       313  0.0  0.0      0     0 ?        S    16:33   0:03  \_ [usb-storage]
root       314  0.0  0.0      0     0 ?        I<   16:33   0:00  \_ [e1000e]
root       315  0.0  0.0      0     0 ?        I<   16:33   0:00  \_ [kworker/1:1H-kblockd]
root       323  0.0  0.0      0     0 ?        I<   16:33   0:00  \_ [kworker/0:1H-kblockd]
root       325  0.0  0.0      0     0 ?        I<   16:33   0:00  \_ [kworker/3:1H-kblockd]
root       326  0.0  0.0      0     0 ?        I<   16:33   0:00  \_ [kworker/2:1H-kblockd]
root       370  0.0  0.0      0     0 ?        I<   16:33   0:00  \_ [raid5wq]
root       411  0.0  0.0      0     0 ?        S    16:33   0:00  \_ [jbd2/sda2-8]
root       412  0.0  0.0      0     0 ?        I<   16:33   0:00  \_ [ext4-rsv-conver]
root       562  0.0  0.0      0     0 ?        I<   16:33   0:00  \_ [kmemstick]
root       565  0.0  0.0      0     0 ?        S    16:33   0:00  \_ [irq/130-mei_me]
root       572  0.0  0.0      0     0 ?        I<   16:33   0:00  \_ [cfg80211]
root       575  0.0  0.0      0     0 ?        S    16:33   0:00  \_ [rc0]
root       596  0.0  0.0      0     0 ?        I<   16:33   0:00  \_ [kworker/u9:1-hci0]
root       598  0.0  0.0      0     0 ?        S    16:33   0:00  \_ [irq/131-iwlwifi]
root       722  0.0  0.0      0     0 ?        S<   16:33   0:00  \_ [spl_system_task]
root       723  0.0  0.0      0     0 ?        S<   16:33   0:00  \_ [spl_delay_taskq]
root       724  0.0  0.0      0     0 ?        S<   16:33   0:02  \_ [spl_dynamic_tas]
root       725  0.0  0.0      0     0 ?        S<   16:33   0:00  \_ [spl_kmem_cache]
root       788  0.0  0.0      0     0 ?        S<   16:33   0:00  \_ [zvol]
root       789  0.0  0.0      0     0 ?        S    16:33   0:00  \_ [arc_prune]
root       790  0.0  0.0      0     0 ?        SN   16:33   0:00  \_ [zthr_procedure]
root       791  0.0  0.0      0     0 ?        SN   16:33   0:00  \_ [zthr_procedure]
root       792  0.0  0.0      0     0 ?        S    16:33   0:00  \_ [dbu_evict]
root       793  0.0  0.0      0     0 ?        SN   16:33   0:00  \_ [dbuf_evict]
root       794  0.0  0.0      0     0 ?        SN   16:33   0:00  \_ [z_vdev_file]
root       795  0.0  0.0      0     0 ?        S    16:33   0:00  \_ [l2arc_feed]
root       826  0.0  0.0      0     0 ?        I<   16:33   0:00  \_ [kaluad]
root       828  0.0  0.0      0     0 ?        I<   16:33   0:00  \_ [kmpath_rdacd]
root       829  0.0  0.0      0     0 ?        I<   16:33   0:00  \_ [kmpathd]
root       830  0.0  0.0      0     0 ?        I<   16:33   0:00  \_ [kmpath_handlerd]
root       900  0.0  0.0      0     0 ?        S<   16:33   0:00  \_ [loop0]
root       908  0.0  0.0      0     0 ?        S<   16:33   0:00  \_ [loop1]
root       909  0.0  0.0      0     0 ?        S<   16:33   0:00  \_ [loop2]
root       910  0.0  0.0      0     0 ?        S<   16:33   0:00  \_ [loop3]
root       911  0.0  0.0      0     0 ?        S<   16:33   0:00  \_ [loop4]
root       912  0.0  0.0      0     0 ?        S<   16:33   0:00  \_ [loop5]
root       922  0.0  0.0      0     0 ?        S<   16:33   0:00  \_ [loop6]
root       923  0.0  0.0      0     0 ?        S<   16:33   0:00  \_ [loop7]
root       926  0.0  0.0      0     0 ?        S<   16:33   0:00  \_ [loop8]
root      1010  0.0  0.0      0     0 ?        S<   16:33   0:00  \_ [z_null_iss]
root      1011  0.0  0.0      0     0 ?        S<   16:33   0:00  \_ [z_null_int]
root      1012  0.0  0.0      0     0 ?        S<   16:33   0:00  \_ [z_rd_iss]
root      1013  0.0  0.0      0     0 ?        S<   16:33   0:01  \_ [z_rd_int]
root      1014  0.0  0.0      0     0 ?        S<   16:33   0:01  \_ [z_rd_int]
root      1015  0.0  0.0      0     0 ?        S<   16:33   0:01  \_ [z_rd_int]
root      1016  0.0  0.0      0     0 ?        S<   16:33   0:01  \_ [z_rd_int]
root      1017  0.0  0.0      0     0 ?        S<   16:33   0:01  \_ [z_rd_int]
root      1018  0.0  0.0      0     0 ?        S<   16:33   0:01  \_ [z_rd_int]
root      1019  0.0  0.0      0     0 ?        S<   16:33   0:01  \_ [z_rd_int]
root      1020  0.0  0.0      0     0 ?        S<   16:33   0:01  \_ [z_rd_int]
root      1021  0.0  0.0      0     0 ?        S<   16:33   0:00  \_ [z_wr_iss]
root      1022  0.0  0.0      0     0 ?        S<   16:33   0:00  \_ [z_wr_iss]
root      1023  0.0  0.0      0     0 ?        S<   16:33   0:00  \_ [z_wr_iss]
root      1024  0.0  0.0      0     0 ?        S<   16:33   0:00  \_ [z_wr_iss_h]
root      1025  0.0  0.0      0     0 ?        S<   16:33   0:00  \_ [z_wr_int]
root      1026  0.0  0.0      0     0 ?        S<   16:33   0:00  \_ [z_wr_int]
root      1027  0.0  0.0      0     0 ?        S<   16:33   0:00  \_ [z_wr_int]
root      1028  0.0  0.0      0     0 ?        S<   16:33   0:00  \_ [z_wr_int]
root      1029  0.0  0.0      0     0 ?        S<   16:33   0:00  \_ [z_wr_int]
root      1030  0.0  0.0      0     0 ?        S<   16:33   0:00  \_ [z_wr_int]
root      1031  0.0  0.0      0     0 ?        S<   16:33   0:00  \_ [z_wr_int]
root      1032  0.0  0.0      0     0 ?        S<   16:33   0:00  \_ [z_wr_int]
root      1033  0.0  0.0      0     0 ?        S<   16:33   0:00  \_ [z_wr_int_h]
root      1034  0.0  0.0      0     0 ?        S<   16:33   0:00  \_ [z_fr_iss]
root      1035  0.0  0.0      0     0 ?        S<   16:33   0:00  \_ [z_fr_iss]
root      1036  0.0  0.0      0     0 ?        S<   16:33   0:00  \_ [z_fr_iss]
root      1037  0.0  0.0      0     0 ?        S<   16:33   0:00  \_ [z_fr_iss]
root      1038  0.0  0.0      0     0 ?        S<   16:33   0:00  \_ [z_fr_iss]
root      1039  0.0  0.0      0     0 ?        S<   16:33   0:00  \_ [z_fr_iss]
root      1040  0.0  0.0      0     0 ?        S<   16:33   0:00  \_ [z_fr_iss]
root      1041  0.0  0.0      0     0 ?        S<   16:33   0:00  \_ [z_fr_iss]
root      1042  0.0  0.0      0     0 ?        S<   16:33   0:00  \_ [z_fr_int]
root      1043  0.0  0.0      0     0 ?        S<   16:33   0:00  \_ [z_cl_iss]
root      1044  0.0  0.0      0     0 ?        S<   16:33   0:00  \_ [z_cl_int]
root      1045  0.0  0.0      0     0 ?        S<   16:33   0:00  \_ [z_ioctl_iss]
root      1046  0.0  0.0      0     0 ?        S<   16:33   0:00  \_ [z_ioctl_int]
root      1047  0.0  0.0      0     0 ?        S<   16:33   0:00  \_ [z_trim_iss]
root      1048  0.0  0.0      0     0 ?        S<   16:33   0:00  \_ [z_trim_int]
root      1049  0.0  0.0      0     0 ?        S    16:33   0:00  \_ [z_zvol]
root      1050  0.0  0.0      0     0 ?        S    16:33   0:00  \_ [z_prefetch]
root      1051  0.0  0.0      0     0 ?        S    16:33   0:00  \_ [z_upgrade]
root      1067  0.0  0.0      0     0 ?        SN   16:33   0:00  \_ [dp_sync_taskq]
root      1068  0.0  0.0      0     0 ?        SN   16:33   0:00  \_ [dp_sync_taskq]
root      1069  0.0  0.0      0     0 ?        SN   16:33   0:00  \_ [dp_sync_taskq]
root      1070  0.0  0.0      0     0 ?        SN   16:33   0:00  \_ [dp_zil_clean_ta]
root      1071  0.0  0.0      0     0 ?        SN   16:33   0:00  \_ [dp_zil_clean_ta]
root      1072  0.0  0.0      0     0 ?        SN   16:33   0:00  \_ [dp_zil_clean_ta]
root      1073  0.0  0.0      0     0 ?        SN   16:33   0:00  \_ [dp_zil_clean_ta]
root      1074  0.0  0.0      0     0 ?        S    16:33   0:00  \_ [z_iput]
root      1075  0.0  0.0      0     0 ?        S    16:33   0:00  \_ [z_unlinked_drai]
root      1097  0.0  0.0      0     0 ?        S<   16:33   0:00  \_ [metaslab_group_]
root      1098  0.0  0.0      0     0 ?        S<   16:33   0:00  \_ [metaslab_group_]
root      1193  0.0  0.0      0     0 ?        S    16:33   0:00  \_ [txg_quiesce]
root      1194  0.0  0.0      0     0 ?        S    16:33   0:00  \_ [txg_sync]
root      1195  0.0  0.0      0     0 ?        S    16:33   0:00  \_ [mmp]
root      1355  0.0  0.0      0     0 ?        SN   16:33   0:00  \_ [zthr_procedure]
root      1356  0.0  0.0      0     0 ?        SN   16:33   0:00  \_ [zthr_procedure]
root      1594  0.0  0.0      0     0 ?        S<   16:33   0:00  \_ [z_null_iss]
root      1595  0.0  0.0      0     0 ?        S<   16:33   0:00  \_ [z_null_int]
root      1596  0.0  0.0      0     0 ?        S<   16:33   0:00  \_ [z_rd_iss]
root      1597  0.0  0.0      0     0 ?        S<   16:33   0:00  \_ [z_rd_int]
root      1598  0.0  0.0      0     0 ?        S<   16:33   0:00  \_ [z_rd_int]
root      1599  0.0  0.0      0     0 ?        S<   16:33   0:00  \_ [z_rd_int]
root      1600  0.0  0.0      0     0 ?        S<   16:33   0:00  \_ [z_rd_int]
root      1601  0.0  0.0      0     0 ?        S<   16:33   0:00  \_ [z_rd_int]
root      1602  0.0  0.0      0     0 ?        S<   16:33   0:00  \_ [z_rd_int]
root      1603  0.0  0.0      0     0 ?        S<   16:33   0:00  \_ [z_rd_int]
root      1604  0.0  0.0      0     0 ?        S<   16:33   0:00  \_ [z_rd_int]
root      1605  0.1  0.0      0     0 ?        S<   16:33   0:21  \_ [z_wr_iss]
root      1606  0.1  0.0      0     0 ?        S<   16:33   0:21  \_ [z_wr_iss]
root      1607  0.1  0.0      0     0 ?        S<   16:33   0:21  \_ [z_wr_iss]
root      1608  0.0  0.0      0     0 ?        S<   16:33   0:00  \_ [z_wr_iss_h]
root      1609  0.0  0.0      0     0 ?        S<   16:33   0:02  \_ [z_wr_int]
root      1610  0.0  0.0      0     0 ?        S<   16:33   0:02  \_ [z_wr_int]
root      1611  0.0  0.0      0     0 ?        S<   16:33   0:02  \_ [z_wr_int]
root      1612  0.0  0.0      0     0 ?        S<   16:33   0:02  \_ [z_wr_int]
root      1613  0.0  0.0      0     0 ?        S<   16:33   0:02  \_ [z_wr_int]
root      1614  0.0  0.0      0     0 ?        S<   16:33   0:02  \_ [z_wr_int]
root      1615  0.0  0.0      0     0 ?        S<   16:33   0:02  \_ [z_wr_int]
root      1616  0.0  0.0      0     0 ?        S<   16:33   0:02  \_ [z_wr_int]
root      1617  0.0  0.0      0     0 ?        S<   16:33   0:00  \_ [z_wr_int_h]
root      1618  0.0  0.0      0     0 ?        S<   16:33   0:00  \_ [z_fr_iss]
root      1619  0.0  0.0      0     0 ?        S<   16:33   0:00  \_ [z_fr_iss]
root      1620  0.0  0.0      0     0 ?        S<   16:33   0:00  \_ [z_fr_iss]
root      1621  0.0  0.0      0     0 ?        S<   16:33   0:00  \_ [z_fr_iss]
root      1622  0.0  0.0      0     0 ?        S<   16:33   0:00  \_ [z_fr_iss]
root      1623  0.0  0.0      0     0 ?        S<   16:33   0:00  \_ [z_fr_iss]
root      1624  0.0  0.0      0     0 ?        S<   16:33   0:00  \_ [z_fr_iss]
root      1625  0.0  0.0      0     0 ?        S<   16:33   0:00  \_ [z_fr_iss]
root      1626  0.0  0.0      0     0 ?        S<   16:33   0:00  \_ [z_fr_int]
root      1627  0.0  0.0      0     0 ?        S<   16:33   0:00  \_ [z_cl_iss]
root      1628  0.0  0.0      0     0 ?        S<   16:33   0:00  \_ [z_cl_int]
root      1629  0.0  0.0      0     0 ?        S<   16:33   0:00  \_ [z_ioctl_iss]
root      1630  0.0  0.0      0     0 ?        S<   16:33   0:00  \_ [z_ioctl_int]
root      1631  0.0  0.0      0     0 ?        S<   16:33   0:00  \_ [z_trim_iss]
root      1632  0.0  0.0      0     0 ?        S<   16:33   0:00  \_ [z_trim_int]
root      1633  0.0  0.0      0     0 ?        S    16:33   0:00  \_ [z_zvol]
root      1634  0.0  0.0      0     0 ?        S    16:33   0:00  \_ [z_prefetch]
root      1635  0.0  0.0      0     0 ?        S    16:33   0:00  \_ [z_upgrade]
root      1637  0.0  0.0      0     0 ?        SN   16:33   0:02  \_ [dp_sync_taskq]
root      1638  0.0  0.0      0     0 ?        SN   16:33   0:02  \_ [dp_sync_taskq]
root      1639  0.0  0.0      0     0 ?        SN   16:33   0:02  \_ [dp_sync_taskq]
root      1640  0.0  0.0      0     0 ?        SN   16:33   0:00  \_ [dp_zil_clean_ta]
root      1641  0.0  0.0      0     0 ?        SN   16:33   0:00  \_ [dp_zil_clean_ta]
root      1642  0.0  0.0      0     0 ?        SN   16:33   0:00  \_ [dp_zil_clean_ta]
root      1643  0.0  0.0      0     0 ?        SN   16:33   0:00  \_ [dp_zil_clean_ta]
root      1644  0.0  0.0      0     0 ?        S    16:33   0:00  \_ [z_iput]
root      1645  0.0  0.0      0     0 ?        S    16:33   0:00  \_ [z_unlinked_drai]
root      1647  0.0  0.0      0     0 ?        S<   16:33   0:00  \_ [metaslab_group_]
root      1685  0.0  0.0      0     0 ?        S    16:33   0:00  \_ [txg_quiesce]
root      1686  0.0  0.0      0     0 ?        S    16:33   0:07  \_ [txg_sync]
root      1687  0.0  0.0      0     0 ?        S    16:33   0:00  \_ [mmp]
root      1723  0.0  0.0      0     0 ?        SN   16:33   0:00  \_ [zthr_procedure]
root      1724  0.0  0.0      0     0 ?        SN   16:33   0:00  \_ [zthr_procedure]
root      2603  0.0  0.0   2480   776 ?        S    16:34   0:00  \_ bpfilter_umh
root      5388  0.0  0.0      0     0 ?        I<   16:34   0:00  \_ [rpciod]
root      5390  0.0  0.0      0     0 ?        I<   16:34   0:00  \_ [xprtiod]
root     16699  0.0  0.0      0     0 ?        I    16:47   0:00  \_ [kworker/1:1-cgroup_destroy]
root     16700  0.0  0.0      0     0 ?        I    16:47   0:02  \_ [kworker/0:1-events]
root      3288  0.0  0.0      0     0 ?        I    18:03   0:01  \_ [kworker/1:2-events]
root      4027  0.0  0.0      0     0 ?        I    18:04   0:01  \_ [kworker/3:2-events]
root      4666  0.0  0.0      0     0 ?        I    19:33   0:00  \_ [kworker/0:0-events]
root      4667  0.0  0.0      0     0 ?        I    19:33   0:00  \_ [kworker/2:1-events]
root     10856  0.0  0.0      0     0 ?        I    20:08   0:00  \_ [kworker/u8:2-events_unbound]
root      2507  0.0  0.0      0     0 ?        I    21:00   0:00  \_ [kworker/u8:3-flush-zfs-2]
root      3871  0.0  0.0      0     0 ?        I    21:01   0:00  \_ [kworker/2:0-events]
root      4629  0.0  0.0      0     0 ?        I    21:02   0:00  \_ [kworker/3:1-mm_percpu_wq]
root     13493  0.0  0.0      0     0 ?        I    21:10   0:00  \_ [kworker/u8:1-flush-zfs-7]
root     18020  0.0  0.0      0     0 ?        I    21:14   0:00  \_ [kworker/1:0]
root     18037  0.0  0.0      0     0 ?        I    21:14   0:00  \_ [kworker/3:0]
root     18221  0.0  0.0      0     0 ?        I    21:14   0:00  \_ [kworker/0:2-events]
root     18230  0.0  0.0      0     0 ?        I    21:14   0:00  \_ [kworker/0:3-events]
root         1  0.0  0.0 168652 12516 ?        Ss   16:33   0:02 /sbin/init
root       496  0.0  0.1  83452 45632 ?        S<s  16:33   0:00 /lib/systemd/systemd-journald
root       512  0.0  0.0  20564  5064 ?        Ss   16:33   0:01 /lib/systemd/systemd-udevd
root       831  0.0  0.0 280084 17888 ?        SLsl 16:33   0:01 /sbin/multipathd -d -s
systemd+  1863  0.0  0.0  89956  6308 ?        Ssl  16:34   0:00 /lib/systemd/systemd-timesyncd
systemd+  1918  0.0  0.0  34396  7488 ?        Ss   16:34   0:00 /lib/systemd/systemd-networkd
systemd+  1922  0.0  0.0  20672  8588 ?        Ss   16:34   0:00 /lib/systemd/systemd-resolved
root      2158  0.0  0.1 839912 48824 ?        Ssl  16:34   0:06 /snap/multipass/1784/bin/multipassd --verbosity debug --logger platform
root      2173  0.0  0.0  11184  6168 ?        Ss   16:34   0:00 /usr/sbin/smartd -n
root      2174  0.0  0.0 235796  7776 ?        Ssl  16:34   0:00 /usr/lib/accountsservice/accounts-daemon
root      2176  0.0  0.0 122268  9968 ?        Ssl  16:34   0:01 /usr/sbin/thermald --no-daemon --dbus-enable
root      2178  0.1  0.0 229572  5316 ?        Ssl  16:34   0:27 /usr/sbin/zed -F
message+  2180  0.0  0.0   7560  4792 ?        Ss   16:34   0:00 /usr/bin/dbus-daemon --system --address=systemd: --nofork --nopidfile --systemd-activation --syslog-only
syslog    2181  0.0  0.0 224360  5148 ?        Ssl  16:34   0:00 /usr/sbin/rsyslogd -n -iNONE
root      2182  0.0  0.0  81852  3800 ?        Ssl  16:34   0:00 /usr/sbin/irqbalance --foreground
root      2184  0.0  0.0  42984  3800 ?        Ss   16:34   0:00 avahi-daemon: running [thor.local]
root      2194  0.0  0.0   6760  3080 ?        Ss   16:34   0:00 /usr/sbin/cron -f
root      2199  0.0  0.0  28652 18040 ?        Ss   16:34   0:00 /usr/bin/python3 /usr/bin/networkd-dispatcher --run-startup-triggers
root      2203  0.0  0.0  16464  7376 ?        Ss   16:34   0:00 /lib/systemd/systemd-logind
root      2210  0.0  0.0 1367020 31768 ?       Ssl  16:34   0:07 /usr/lib/snapd/snapd
root      2214  0.1  0.1 1186976 42508 ?       Ssl  16:34   0:22 /usr/bin/containerd
daemon    2243  0.0  0.0   3740  2184 ?        Ss   16:34   0:00 /usr/sbin/atd -f
root      2257  0.0  0.2 1159464 84392 ?       Ssl  16:34   0:04 /usr/bin/dockerd -H fd:// --containerd=/run/containerd/containerd.sock
root      2280  0.0  0.0  12032  7232 ?        Ss   16:34   0:00 /usr/sbin/sshd -D
root     18744  0.0  0.0  13224  8628 ?        Ss   21:15   0:00  \_ sshd: karl [priv]
karl     18867  0.0  0.0  13224  4848 ?        S    21:15   0:00      \_ sshd: karl@pts/0
karl     18868  0.0  0.0  10152  5588 pts/0    Ss   21:15   0:00          \_ -bash
karl     20389  0.0  0.0  11432  4080 pts/0    R+   21:16   0:00              \_ ps fauxww
root      2283  0.0  0.0   5820  1784 tty1     Ss+  16:34   0:00 /sbin/agetty -o -p -- \u --noclear tty1 linux
root      2332  0.0  0.0 232580  6816 ?        Ssl  16:34   0:00 /usr/lib/policykit-1/polkitd --no-debug
root      2565  0.0  0.0  37184  3872 ?        Ss   16:34   0:00 /usr/lib/postfix/sbin/master -w
postfix   2567  0.0  0.0  37576  5460 ?        S    16:34   0:00  \_ qmgr -l -t unix -u
postfix  24740  0.0  0.0  37540  5384 ?        S    19:52   0:00  \_ pickup -l -t unix -u -c
root      2613  0.0  0.1 1558712 38352 ?       Ssl  16:34   0:01 /usr/sbin/libvirtd
root      2614  0.0  0.0 107728 21068 ?        Ssl  16:34   0:00 /usr/bin/python3 /usr/share/unattended-upgrades/unattended-upgrade-shutdown --wait-for-signal
libvirt+  3051  0.0  0.0   9168  2088 ?        S    16:34   0:00 /usr/sbin/dnsmasq --conf-file=/var/lib/libvirt/dnsmasq/default.conf --leasefile-ro --dhcp-script=/usr/lib/libvirt/libvirt_leaseshelper
root      3052  0.0  0.0   9140   332 ?        S    16:34   0:00  \_ /usr/sbin/dnsmasq --conf-file=/var/lib/libvirt/dnsmasq/default.conf --leasefile-ro --dhcp-script=/usr/lib/libvirt/libvirt_leaseshelper
nobody    3219  0.0  0.0  46664   456 ?        S    16:34   0:00 /snap/multipass/1784/usr/sbin/dnsmasq --strict-order --bind-interfaces --pid-file=/var/snap/multipass/common/data/multipassd/network/dnsmasq.pid --domain=multipass --local=/multipass/ --except-interface=lo --interface=mpqemubr0 --listen-address=10.198.145.1 --dhcp-no-override --dhcp-authoritative --dhcp-leasefile=/var/snap/multipass/common/data/multipassd/network/dnsmasq.leases --dhcp-hostsfile=/var/snap/multipass/common/data/multipassd/network/dnsmasq.hosts --dhcp-range 10.198.145.2,10.198.145.254,infinite
root      3312  0.0  0.0 310896  1780 ?        Sl   16:34   0:00 lxcfs /var/snap/lxd/common/var/lib/lxcfs -p /var/snap/lxd/common/lxcfs.pid
root      3730  0.0  0.0 897384 12848 ?        Ss   16:34   0:00 [lxc monitor] /var/snap/lxd/common/lxd/containers media
1000000   3744  0.0  0.0   1460   332 ?        Ss   16:34   0:00  \_ /sbin/init
1000000   4677  0.0  0.0   1464    40 ?        Ss   16:34   0:00      \_ /sbin/syslogd -Z
1000000   9538  0.0  0.0   1460    40 ?        Ss   16:34   0:00      \_ udhcpc -b -p /var/run/udhcpc.eth0.pid -i eth0 -x hostname:media
1000086   9569  0.0  0.0   1800   752 ?        S    16:34   0:00      \_ avahi-daemon: running [media.local]
1000086   9570  0.0  0.0   1712    92 ?        S    16:34   0:00      |   \_ avahi-daemon: chroot helper
1000000   9757  0.0  0.0   1468    44 ?        Ss   16:34   0:00      \_ /usr/sbin/crond -c /etc/crontabs
1000000  10113  0.0  0.0  35168  7288 ?        Ss   16:34   0:00      \_ /usr/sbin/smbd -D
1000000  10128  0.0  0.0  32068  2688 ?        S    16:34   0:00      |   \_ /usr/sbin/smbd -D
1000000  10130  0.0  0.0  32060  1440 ?        S    16:34   0:00      |   \_ /usr/sbin/smbd -D
1000000  10498  0.0  0.0  21472  2268 ?        Ss   16:34   0:00      \_ /usr/sbin/nmbd -D
1000000  10499  0.0  0.0  21472  1124 ?        S    16:34   0:00      |   \_ /usr/sbin/nmbd -D
1000000  10506  0.0  0.0   1460     4 pts/0    Ss+  16:34   0:00      \_ /sbin/getty 38400 console
root      4133  0.0  0.0 897128 13516 ?        Ss   16:34   0:00 [lxc monitor] /var/snap/lxd/common/lxd/containers thor-crd
1000000   4169  0.0  0.0 225192  6276 ?        Ss   16:34   0:00  \_ /sbin/init
1000000   4900  0.0  0.0 103028 12004 ?        Ss   16:34   0:00      \_ /lib/systemd/systemd-journald
1000000   4972  0.0  0.0  46092  2916 ?        Ss   16:34   0:00      \_ /lib/systemd/systemd-udevd
1000100   5245  0.0  0.0  71848  3932 ?        Ss   16:34   0:00      \_ /lib/systemd/systemd-networkd
1000101   5332  0.0  0.0  70632  4072 ?        Ss   16:34   0:00      \_ /lib/systemd/systemd-resolved
1000000   5470  0.0  0.0 111728  4544 ?        Ss   16:34   0:00      \_ /usr/sbin/cupsd -l
1000102   5475  0.0  0.0 199700  2812 ?        Ssl  16:34   0:00      \_ /usr/sbin/rsyslogd -n
1000000   5478  0.0  0.0 169544 13788 ?        Ssl  16:34   0:00      \_ /usr/bin/python3 /usr/bin/networkd-dispatcher --run-startup-triggers
1000103   5484  0.0  0.0  50564  3248 ?        Ss   16:34   0:00      \_ /usr/bin/dbus-daemon --system --address=systemd: --nofork --nopidfile --systemd-activation --syslog-only
1000000   5595  0.0  0.0 479588 10512 ?        Ssl  16:34   0:00      \_ /usr/sbin/NetworkManager --no-daemon
1000000   5596  0.0  0.0 286556  4700 ?        Ssl  16:34   0:00      \_ /usr/lib/accountsservice/accounts-daemon
1000000   5598  0.0  0.0 502440  6540 ?        Ssl  16:34   0:00      \_ /usr/lib/udisks2/udisksd
1000117   5601  0.0  0.0  47280  2576 ?        Ss   16:34   0:00      \_ avahi-daemon: running [thor-crd.local]
1000117   5706  0.0  0.0  47076   344 ?        S    16:34   0:00      |   \_ avahi-daemon: chroot helper
1000001   5608  0.0  0.0  28328  1532 ?        Ss   16:34   0:00      \_ /usr/sbin/atd -f
1000000   5613  0.0  0.0  70604  4168 ?        Ss   16:34   0:00      \_ /lib/systemd/systemd-logind
1000000   5634  0.0  0.0  45228  3364 ?        Ss   16:34   0:00      \_ /sbin/wpa_supplicant -u -s -O /run/wpa_supplicant
1000000   5647  0.0  0.0  30328  1924 ?        Ss   16:34   0:00      \_ /usr/sbin/cron -f
1000000   5649  0.0  0.0 434328  6676 ?        Ssl  16:34   0:00      \_ /usr/sbin/ModemManager --filter-policy=strict
1000000   5756  0.0  0.0 290608  6324 ?        Ssl  16:34   0:00      \_ /usr/lib/policykit-1/polkitd --no-debug
1000000   6255  0.1  0.0  68884 17364 ?        S    16:34   0:24      \_ /usr/bin/perl /usr/sbin/x2gocleansessions
1000115  29193  0.0  0.0 462356  8600 ?        Ssl  16:36   0:00      \_ /usr/bin/whoopsie -f
1000111  29196  0.0  0.0  56940  1964 ?        Ss   16:36   0:00      \_ /usr/sbin/kerneloops --test
karl     29200  0.0  0.0  76776  6060 ?        Ss   16:36   0:00      \_ /lib/systemd/systemd --user
karl     29229  0.0  0.0 261264  3108 ?        S    16:36   0:00      |   \_ (sd-pam)
karl     29999  0.0  0.0  49924  2916 ?        Ss   16:36   0:00      |   \_ /usr/bin/dbus-daemon --session --address=systemd: --nofork --nopidfile --systemd-activation --syslog-only
karl     30004  0.0  0.0 283872  4888 ?        Ssl  16:36   0:00      |   \_ /usr/lib/gvfs/gvfsd
karl     30014  0.0  0.0 350576  4520 ?        Sl   16:36   0:00      |   \_ /usr/lib/gvfs/gvfsd-fuse /run/user/1000/gvfs -f -o big_writes
karl     30051  0.0  0.0 349476  4820 ?        Ssl  16:36   0:00      |   \_ /usr/lib/at-spi2-core/at-spi-bus-launcher
karl     30058  0.0  0.0  49796  2792 ?        S    16:36   0:00      |   |   \_ /usr/bin/dbus-daemon --config-file=/usr/share/defaults/at-spi2/accessibility.conf --nofork --print-address 3
karl     30063  0.0  0.0 220644  4964 ?        Sl   16:36   0:00      |   \_ /usr/lib/at-spi2-core/at-spi2-registryd --use-gnome-session
1000000  29206  0.0  0.0  14964  1452 ?        Ss+  16:36   0:00      \_ /sbin/agetty -o -p -- \u --noclear --keep-baud console 115200,38400,9600 linux
1000000  29224  0.0  0.0  72296  3716 ?        Ss   16:36   0:00      \_ /usr/sbin/sshd -D
1000111  29237  0.0  0.0  56940   424 ?        Ss   16:36   0:00      \_ /usr/sbin/kerneloops
1000000  29374  0.0  0.0  68556  3196 ?        S    16:36   0:00      \_ /opt/google/chrome-remote-desktop/user-session start -- --config=/home/karl/.config/chrome-remote-desktop/host#d546641b9f220ba667169872cd80bbb0.json --start
karl     29386  0.0  0.0 133880 12496 ?        Sl   16:36   0:00      |   \_ /usr/bin/python2 /opt/google/chrome-remote-desktop/chrome-remote-desktop --start --child-process --config=/home/karl/.config/chrome-remote-desktop/host#d546641b9f220ba667169872cd80bbb0.json --start
karl     29526  0.0  0.1 532996 64948 ?        Sl   16:36   0:00      |       \_ Xvfb :20 -auth /home/karl/.Xauthority -nolisten tcp -noreset -screen 0 3840x2560x24
karl     29936  0.0  0.1 451036 42420 ?        Sl   16:36   0:00      |       \_ /opt/google/chrome-remote-desktop/chrome-remote-desktop-host --type=xsession_chooser
karl     29938  0.0  0.1 579752 41300 ?        Sl   16:36   0:02      |       \_ /opt/google/chrome-remote-desktop/chrome-remote-desktop-host --host-config=- --audio-pipe-name=/home/karl/.config/chrome-remote-desktop/pulseaudio#d546641b9f/fifo_output --server-supports-exact-resize --ssh-auth-sockname=/tmp/chromoting.karl.ssh_auth_sock --signal-parent
1000000  16661  0.0  0.0 1360452 17524 ?       Ssl  16:47   0:04      \_ /usr/lib/lxd/lxd --group lxd --logfile=/var/log/lxd/lxd.log
root      4367  0.0  0.0 1020036 13096 ?       Ss   16:34   0:00 [lxc monitor] /var/snap/lxd/common/lxd/containers thor-shared
1000000   4463  0.0  0.0   1512   336 ?        Ss   16:34   0:00  \_ /sbin/init
1000000   5379  0.0  0.0   1516    44 ?        Ss   16:34   0:00      \_ /sbin/syslogd -Z
1000000   9881  0.0  0.0   1512    48 ?        Ss   16:34   0:00      \_ udhcpc -b -p /var/run/udhcpc.eth0.pid -i eth0 -x hostname:thor-shared
1000086   9927  0.0  0.0  16056   756 ?        S    16:34   0:00      \_ avahi-daemon: running [thor-shared.local]
1000086   9928  0.0  0.0  15944   104 ?        S    16:34   0:00      |   \_ avahi-daemon: chroot helper
1000000  10178  0.0  0.0   1516    80 ?        Ss   16:34   0:00      \_ /usr/sbin/crond -c /etc/crontabs
1000000  10526  0.0  0.0 269848  8928 ?        Ss   16:34   0:00      \_ /usr/sbin/smbd -D
1000000  10534  0.0  0.0 266904  3032 ?        S    16:34   0:00      |   \_ /usr/sbin/smbd -D
1000000  10535  0.0  0.0 266896  1936 ?        S    16:34   0:00      |   \_ /usr/sbin/smbd -D
1000000  10658  0.0  0.0 202100  2664 ?        Ss   16:34   0:00      \_ /usr/sbin/nmbd -D
1000000  10659  0.0  0.0 202100  1520 ?        S    16:34   0:00      |   \_ /usr/sbin/nmbd -D
1000000  10666  0.0  0.0   1512     4 ?        Ss+  16:34   0:00      \_ /sbin/getty 38400 console
root      4801  0.0  0.0 987252 12936 ?        Ss   16:34   0:00 [lxc monitor] /var/snap/lxd/common/lxd/containers thor-tx
root      5108  0.0  0.0 225388  6448 ?        Ss   16:34   0:00  \_ /sbin/init
root      5367  0.0  0.0 119416 14356 ?        S<s  16:34   0:00      \_ /lib/systemd/systemd-journald
root      5516  0.0  0.0  15708  1116 ?        Ss   16:34   0:00      \_ snapfuse /var/lib/snapd/snaps/sublime-text_85.snap /snap/sublime-text/85 -o ro,nodev,allow_other,suid
root      5517  0.0  0.0  15864  1516 ?        Ss   16:34   0:01      \_ snapfuse /var/lib/snapd/snaps/core_8935.snap /snap/core/8935 -o ro,nodev,allow_other,suid
root      5518  0.0  0.0  15576   152 ?        Ss   16:34   0:00      \_ snapfuse /var/lib/snapd/snaps/core_8689.snap /snap/core/8689 -o ro,nodev,allow_other,suid
root      5519  0.0  0.0  15576   152 ?        Ss   16:34   0:00      \_ snapfuse /var/lib/snapd/snaps/sublime-text_77.snap /snap/sublime-text/77 -o ro,nodev,allow_other,suid
systemd+  5527  0.0  0.0  71848  3888 ?        Ss   16:34   0:00      \_ /lib/systemd/systemd-networkd
root      5636  0.0  0.0  47600  2116 ?        Ss   16:34   0:00      \_ /sbin/rpcbind -f -w
systemd+  5639  0.0  0.0  70632  4132 ?        Ss   16:34   0:00      \_ /lib/systemd/systemd-resolved
root      5806  0.0  0.0 502440  6496 ?        Ssl  16:34   0:00      \_ /usr/lib/udisks2/udisksd
systemd+  5807  0.0  0.0 269336  2796 ?        Ssl  16:34   0:00      \_ /usr/sbin/rsyslogd -n
root      5808  0.0  0.0  70604  4168 ?        Ss   16:34   0:00      \_ /lib/systemd/systemd-logind
message+  5810  0.0  0.0  50580  3320 ?        Ss   16:34   0:00      \_ /usr/bin/dbus-daemon --system --address=systemd: --nofork --nopidfile --systemd-activation --syslog-only
root      5960  0.0  0.0 434320  6668 ?        Ssl  16:34   0:00      \_ /usr/sbin/ModemManager --filter-policy=strict
root      5961  0.0  0.0 169500 14020 ?        Ssl  16:34   0:00      \_ /usr/bin/python3 /usr/bin/networkd-dispatcher --run-startup-triggers
daemon    5962  0.0  0.0  28328  1492 ?        Ss   16:34   0:00      \_ /usr/sbin/atd -f
root      5964  0.0  0.0  30328  1896 ?        Ss   16:34   0:00      \_ /usr/sbin/cron -f
root      5966  0.0  0.0 111728  4612 ?        Ss   16:34   0:00      \_ /usr/sbin/cupsd -l
root      5969  0.0  0.0 286632  4680 ?        Ssl  16:34   0:00      \_ /usr/lib/accountsservice/accounts-daemon
root      5971  0.0  0.0  45228  3344 ?        Ss   16:34   0:00      \_ /sbin/wpa_supplicant -u -s -O /run/wpa_supplicant
117       5974  0.0  0.0  47268  2476 ?        Ss   16:34   0:00      \_ avahi-daemon: running [thor-tx.local]
117       6059  0.0  0.0  47076   340 ?        S    16:34   0:00      |   \_ avahi-daemon: chroot helper
root      5976  0.0  0.0 1076944 22792 ?       Ssl  16:34   0:01      \_ /usr/lib/snapd/snapd
root      5980  0.0  0.0 405768 10292 ?        Ssl  16:34   0:00      \_ /usr/sbin/NetworkManager --no-daemon
root      6086  0.0  0.0 290940  6504 ?        Ssl  16:34   0:00      \_ /usr/lib/policykit-1/polkitd --no-debug
root      6582  0.1  0.0  68888 17420 ?        S    16:34   0:23      \_ /usr/bin/perl /usr/sbin/x2gocleansessions
root     29329  0.0  0.0  10200  2612 ?        Ss   16:36   0:00      \_ /usr/sbin/purevpnd
root     29453  0.0  0.0 139712 15056 ?        Sl   16:36   0:01      |   \_ /usr/sbin/purevpnd
115      29338  0.0  0.0 388672  8584 ?        Ssl  16:36   0:00      \_ /usr/bin/whoopsie -f
dnsmasq  29345  0.0  0.0  56940  1956 ?        Ss   16:36   0:00      \_ /usr/sbin/kerneloops --test
karl     29346  0.0  0.0  76792  6192 ?        Ss   16:36   0:00      \_ /lib/systemd/systemd --user
karl     29369  0.0  0.0 261316  2420 ?        S    16:36   0:00      |   \_ (sd-pam)
karl     30134  0.0  0.0  49928  2656 ?        Ss   16:36   0:00      |   \_ /usr/bin/dbus-daemon --session --address=systemd: --nofork --nopidfile --systemd-activation --syslog-only
karl     30172  0.0  0.0 283872  4972 ?        Ssl  16:36   0:00      |   \_ /usr/lib/gvfs/gvfsd
karl     30179  0.0  0.0 350576  4468 ?        Sl   16:36   0:00      |   \_ /usr/lib/gvfs/gvfsd-fuse /run/user/1000/gvfs -f -o big_writes
karl     30190  0.0  0.0 349504  4548 ?        Ssl  16:36   0:00      |   \_ /usr/lib/at-spi2-core/at-spi-bus-launcher
karl     30196  0.0  0.0  49796  2800 ?        S    16:36   0:00      |   |   \_ /usr/bin/dbus-daemon --config-file=/usr/share/defaults/at-spi2/accessibility.conf --nofork --print-address 3
karl     30201  0.0  0.0 220644  4920 ?        Sl   16:36   0:00      |   \_ /usr/lib/at-spi2-core/at-spi2-registryd --use-gnome-session
root     29354  0.0  0.0  14964  1488 ?        Ss+  16:36   0:00      \_ /sbin/agetty -o -p -- \u --noclear --keep-baud console 115200,38400,9600 vt220
root     29378  0.0  0.0  72296  3768 ?        Ss   16:36   0:00      \_ /usr/sbin/sshd -D
dnsmasq  29384  0.0  0.0  56940   416 ?        Ss   16:36   0:00      \_ /usr/sbin/kerneloops
root     29538  0.0  0.0  68564  3132 ?        S    16:36   0:00      \_ /opt/google/chrome-remote-desktop/user-session start -- --config=/home/karl/.config/chrome-remote-desktop/host#b39074feca4382ba85200a53e1b07d50.json --start
karl     29539  0.0  0.0 135148 12528 ?        Sl   16:36   0:00          \_ /usr/bin/python2 /opt/google/chrome-remote-desktop/chrome-remote-desktop --start --child-process --config=/home/karl/.config/chrome-remote-desktop/host#b39074feca4382ba85200a53e1b07d50.json --start
karl     29629  0.0  0.1 532996 64924 ?        Sl   16:36   0:00              \_ Xvfb :20 -auth /home/karl/.Xauthority -nolisten tcp -noreset -screen 0 3840x2560x24
karl     30064  0.0  0.1 444916 41840 ?        Sl   16:36   0:00              \_ /opt/google/chrome-remote-desktop/chrome-remote-desktop-host --type=xsession_chooser
karl     30066  0.0  0.1 573584 40324 ?        Sl   16:36   0:02              \_ /opt/google/chrome-remote-desktop/chrome-remote-desktop-host --host-config=- --audio-pipe-name=/home/karl/.config/chrome-remote-desktop/pulseaudio#b39074feca/fifo_output --server-supports-exact-resize --ssh-auth-sockname=/tmp/chromoting.karl.ssh_auth_sock --signal-parent
root      5415  0.0  0.0 887524 13268 ?        Ss   16:34   0:00 [lxc monitor] /var/snap/lxd/common/lxd/containers transmission
1000000   5514  0.0  0.0  77580  6036 ?        Ss   16:34   0:03  \_ /sbin/init
1000000   6180  0.0  0.0 102976  9592 ?        Ss   16:34   0:00      \_ /lib/systemd/systemd-journald
1000000   6239  0.0  0.0  42104  2264 ?        Ss   16:34   0:00      \_ /lib/systemd/systemd-udevd
1000100   6744  0.0  0.0  71856  3984 ?        Ss   16:34   0:00      \_ /lib/systemd/systemd-networkd
1000101   6779  0.0  0.0  71032  4304 ?        Ss   16:34   0:00      \_ /lib/systemd/systemd-resolved
1000102  30573  0.0  0.0 197632  2832 ?        Ssl  16:36   0:00      \_ /usr/sbin/rsyslogd -n
1000103  30576  0.0  0.0  50040  2892 ?        Ss   16:36   0:00      \_ /usr/bin/dbus-daemon --system --address=systemd: --nofork --nopidfile --systemd-activation --syslog-only
1000001  30583  0.0  0.0  28328  1636 ?        Ss   16:36   0:00      \_ /usr/sbin/atd -f
1000000  30584  0.0  0.0  10200  2540 ?        Ss   16:36   0:00      \_ /usr/sbin/purevpnd
1000000  30642  0.0  0.0 137596 15084 ?        Sl   16:36   0:01      |   \_ /usr/sbin/purevpnd
1000000  30586  0.0  0.0  30328  1908 ?        Ss   16:36   0:00      \_ /usr/sbin/cron -f
1000000  30587  0.0  0.0 286556  4396 ?        Ssl  16:36   0:00      \_ /usr/lib/accountsservice/accounts-daemon
karl     30589  0.0  0.0 775240 12344 ?        Ssl  16:36   0:11      \_ /usr/bin/transmission-daemon -f --log-error
1000000  30590  0.0  0.0  62108  4024 ?        Ss   16:36   0:00      \_ /lib/systemd/systemd-logind
1000000  30591  0.0  0.0 169440 14032 ?        Ssl  16:36   0:00      \_ /usr/bin/python3 /usr/bin/networkd-dispatcher --run-startup-triggers
1000000  30598  0.0  0.0  14964  1428 ?        Ss+  16:36   0:00      \_ /sbin/agetty -o -p -- \u --noclear --keep-baud console 115200,38400,9600 linux
1000000  30606  0.0  0.0 288880  4552 ?        Ssl  16:36   0:00      \_ /usr/lib/policykit-1/polkitd --no-debug
1000000  30607  0.0  0.0  72296  3616 ?        Ss   16:36   0:00      \_ /usr/sbin/sshd -D
1000000  30614  0.0  0.0 186140 15732 ?        Ssl  16:36   0:00      \_ /usr/bin/python3 /usr/share/unattended-upgrades/unattended-upgrade-shutdown --wait-for-signal
root     17873  0.0  0.0   4500  1684 ?        Ss   16:35   0:00 /bin/sh /snap/lxd/14194/commands/daemon.start
root     17983  0.0  0.6 1779276 202024 ?      SLl  16:35   0:16  \_ lxd --logfile /var/snap/lxd/common/lxd/logs/lxd.log --group lxd
root      5815  0.0  0.0 832652 16188 ?        Ss   16:39   0:00 [lxc monitor] /var/snap/lxd/common/lxd/containers odin
1000000   5829  0.0  0.0   1568   332 ?        Ss   16:39   0:00  \_ /sbin/init
1000000   6079  0.0  0.0   1572    48 ?        Ss   16:39   0:00      \_ /sbin/syslogd -t
1000000   6160  0.0  0.0   1572    44 ?        Ss   16:39   0:00      \_ /usr/sbin/crond -c /etc/crontabs
1000000   7148  0.0  0.0   1568    44 ?        Ss   16:39   0:00      \_ udhcpc -b -R -p /var/run/udhcpc.eth0.pid -i eth0 -x hostname:odin
1000000   7160  0.0  0.0   1568     4 ?        Ss+  16:39   0:00      \_ /sbin/getty 38400 console
root      8477  0.0  0.0  48648 22740 ?        Ss   17:09   0:00 /usr/sbin/smbd --foreground --no-process-group
root      8490  0.0  0.0  46404  7640 ?        S    17:09   0:00  \_ /usr/sbin/smbd --foreground --no-process-group
root      8491  0.0  0.0  46420  5564 ?        S    17:09   0:00  \_ /usr/sbin/smbd --foreground --no-process-group
root      8492  0.0  0.0  48632  7744 ?        S    17:09   0:00  \_ /usr/sbin/smbd --foreground --no-process-group
root      8711  0.0  0.0  48900 15240 ?        S    17:09   0:00  \_ /usr/sbin/smbd --foreground --no-process-group
root      8801  0.0  0.0  48820 13408 ?        S    17:09   0:00  \_ /usr/sbin/smbd --foreground --no-process-group
root      8885  0.0  0.0  48916 15244 ?        S    17:09   0:00  \_ /usr/sbin/smbd --foreground --no-process-group
root     21332  0.0  0.0  70356 17248 ?        S    18:20   0:05  \_ /usr/sbin/smbd --foreground --no-process-group
root     21026  0.1  0.0  60352 17428 ?        S    19:48   0:05  \_ /usr/sbin/smbd --foreground --no-process-group
root      8604  0.0  0.0  33844 13832 ?        Ss   17:09   0:00 /usr/sbin/nmbd --foreground --no-process-group
karl     18765  0.0  0.0  18424  9620 ?        Ss   21:15   0:00 /lib/systemd/systemd --user
karl     18766  0.0  0.0 170012  4708 ?        S    21:15   0:00  \_ (sd-pam)

Ok, so none of those bridges are managed by LXD.

Can you show ‘lxc config show --expanded NAME’ for an affected container?

Yes, I set up a direct bridge to the ethernet port so that they can participate in the LAN directly. I’ve been using it for a couple of years now:

$ cat /etc/netplan/01-netcfg.yaml 
network:
  version: 2
  renderer: networkd
  ethernets:
    eno1:
      dhcp4: false
      dhcp6: false
  bridges:
    br0:
      interfaces: [eno1]
      dhcp4: true
      dhcp6: true
      parameters:
        stp: false
        forward-delay: 0

All 9 LXC containers are affected by the ipv4 thing, regardless of guest os.

lxc config for thor-crd:

$ lxc config show --expanded thor-crd
architecture: x86_64
config:
  boot.autostart: "1"
  image.architecture: amd64
  image.description: ubuntu 18.04 LTS amd64 (daily) (20191018)
  image.label: daily
  image.os: ubuntu
  image.release: bionic
  image.serial: "20191018"
  image.type: squashfs
  image.version: "18.04"
  raw.idmap: |-
    uid 1000 1000
    gid 1000 1000
  volatile.base_image: bf26d67d822adf3efe2fd555ec4d67ea9d400d85b232279f8f00e87f8c773a8d
  volatile.eth0.host_name: veth17dbdd58
  volatile.eth0.hwaddr: 00:16:3e:d2:bd:c8
  volatile.idmap.base: "0"
  volatile.idmap.current: '[{"Isuid":true,"Isgid":false,"Hostid":1000000,"Nsid":0,"Maprange":1000},{"Isuid":true,"Isgid":false,"Hostid":1000,"Nsid":1000,"Maprange":1},{"Isuid":true,"Isgid":false,"Hostid":1001001,"Nsid":1001,"Maprange":999998999},{"Isuid":false,"Isgid":true,"Hostid":1000000,"Nsid":0,"Maprange":1000},{"Isuid":false,"Isgid":true,"Hostid":1000,"Nsid":1000,"Maprange":1},{"Isuid":false,"Isgid":true,"Hostid":1001001,"Nsid":1001,"Maprange":999998999}]'
  volatile.idmap.next: '[{"Isuid":true,"Isgid":false,"Hostid":1000000,"Nsid":0,"Maprange":1000},{"Isuid":true,"Isgid":false,"Hostid":1000,"Nsid":1000,"Maprange":1},{"Isuid":true,"Isgid":false,"Hostid":1001001,"Nsid":1001,"Maprange":999998999},{"Isuid":false,"Isgid":true,"Hostid":1000000,"Nsid":0,"Maprange":1000},{"Isuid":false,"Isgid":true,"Hostid":1000,"Nsid":1000,"Maprange":1},{"Isuid":false,"Isgid":true,"Hostid":1001001,"Nsid":1001,"Maprange":999998999}]'
  volatile.last_state.idmap: '[{"Isuid":true,"Isgid":false,"Hostid":1000000,"Nsid":0,"Maprange":1000},{"Isuid":true,"Isgid":false,"Hostid":1000,"Nsid":1000,"Maprange":1},{"Isuid":true,"Isgid":false,"Hostid":1001001,"Nsid":1001,"Maprange":999998999},{"Isuid":false,"Isgid":true,"Hostid":1000000,"Nsid":0,"Maprange":1000},{"Isuid":false,"Isgid":true,"Hostid":1000,"Nsid":1000,"Maprange":1},{"Isuid":false,"Isgid":true,"Hostid":1001001,"Nsid":1001,"Maprange":999998999}]'
  volatile.last_state.power: RUNNING
devices:
  eth0:
    name: eth0
    nictype: bridged
    parent: br0
    type: nic
  home:
    path: /home/karl
    source: /virtual/lxc-homes/thor-crd
    type: disk
  lib-modules:
    path: /lib/modules
    source: /lib/modules
    type: disk
  root:
    path: /
    pool: default
    type: disk
ephemeral: false
profiles:
- default
stateful: false
description: ""

What distribution are you using for your containers?

I’ve just checked a fresh LXD 4.0 install on an ubuntu 18.04 host with an ubuntu 18.04 container using an external bridge like you describe and DHCP is working as expected.

I’ll test on 19.10 now too.

My host system is Ubuntu server 19.10, using the 4.0 lxd snap, running on a NUC7i5BNK.

The guests are Ubuntu 18.04 (for remote desktop based) and Alpine edge for smaller things.

OK, here’s my setup that is working on 19.10 host:

snap refresh lxd
lxd init # I accepted the defaults for testing

Modified /etc/netplan/50-cloud-init.yaml

network:
  version: 2
  renderer: networkd
  ethernets:
    enp5s0:
      dhcp4: no
      match:
        macaddress: 00:16:3e:2e:f4:3d
      set-name: enp5s0
  bridges:
    br0:
      dhcp4: yes
      interfaces:
        - enp5s0
netplan apply
ip a show br0
4: br0: <BROADCAST,MULTICAST,UP,LOWER_UP> mtu 1500 qdisc noqueue state UP group default qlen 1000
    link/ether 4a:13:70:7f:3e:2e brd ff:ff:ff:ff:ff:ff
    inet 10.238.31.155/24 brd 10.238.31.255 scope global dynamic br0
       valid_lft 3366sec preferred_lft 3366sec
    inet6 fd42:be3f:a937:9505:4813:70ff:fe7f:3e2e/64 scope global dynamic mngtmpaddr noprefixroute 
       valid_lft 3590sec preferred_lft 3590sec
    inet6 fe80::4813:70ff:fe7f:3e2e/64 scope link 
       valid_lft forever preferred_lft forever
lxc init ubuntu:18.04 c1
lxc config device add c1 eth0 nic nictype=bridged parent=br0
lxc start c1
lxc exec c1 -- ping -4 google.com -c 3
lxc exec c1 -- ping -6 google.com -c 3

I tested using a couple of containers concurrently too:

lxc ls
+------+---------+----------------------+-----------------------------------------------+-----------+-----------+
| NAME |  STATE  |         IPV4         |                     IPV6                      |   TYPE    | SNAPSHOTS |
+------+---------+----------------------+-----------------------------------------------+-----------+-----------+
| c1   | RUNNING | 10.238.31.204 (eth0) | fd42:be3f:a937:9505:216:3eff:feea:3107 (eth0) | CONTAINER | 0         |
+------+---------+----------------------+-----------------------------------------------+-----------+-----------+
| c2   | RUNNING | 10.238.31.17 (eth0)  | fd42:be3f:a937:9505:216:3eff:fe9f:7288 (eth0) | CONTAINER | 0         |
+------+---------+----------------------+-----------------------------------------------+-----------+-----------+

So it seems the general case is working OK for a fresh install with fresh images.

Can you get a tcpdump or similar trace on your br0 showing DHCP requests from the containers when starting up? And equally, can you confirm that those packets are leave your host’s external network interface?

Thanks

OK, I created a container the same as what you posted, then started dhcpdump and started the container:

$ sudo dhcpdump -i br0
  TIME: 2020-04-06 08:56:14.518
    IP: 0.0.0.0 (0:16:3e:4b:39:75) > 255.255.255.255 (ff:ff:ff:ff:ff:ff)
    OP: 1 (BOOTPREQUEST)
 HTYPE: 1 (Ethernet)
  HLEN: 6
  HOPS: 0
   XID: 614ac752
  SECS: 1
 FLAGS: 0
CIADDR: 0.0.0.0
YIADDR: 0.0.0.0
SIADDR: 0.0.0.0
GIADDR: 0.0.0.0
CHADDR: 00:16:3e:4b:39:75:00:00:00:00:00:00:00:00:00:00
 SNAME: .
 FNAME: .
OPTION:  53 (  1) DHCP message type         1 (DHCPDISCOVER)
OPTION:  61 ( 19) Client-identifier         ff:88:41:2d:30:00:02:00:00:ab:11:d5:6c:dc:5f:eb:fe:3b:b6
OPTION:  55 (  9) Parameter Request List      1 (Subnet mask)
					      3 (Routers)
					     12 (Host name)
					     15 (Domainname)
					      6 (DNS server)
					     26 (Interface MTU)
					     33 (Static route)
					    121 (Classless Static Route)
					     42 (NTP servers)
					    
OPTION:  57 (  2) Maximum DHCP message size 576
OPTION:  12 (  2) Host name                 c2
---------------------------------------------------------------------------

  TIME: 2020-04-06 08:56:17.534
    IP: 0.0.0.0 (0:16:3e:4b:39:75) > 255.255.255.255 (ff:ff:ff:ff:ff:ff)
    OP: 1 (BOOTPREQUEST)
 HTYPE: 1 (Ethernet)
  HLEN: 6
  HOPS: 0
   XID: 614ac752
  SECS: 3
 FLAGS: 0
CIADDR: 0.0.0.0
YIADDR: 0.0.0.0
SIADDR: 0.0.0.0
GIADDR: 0.0.0.0
CHADDR: 00:16:3e:4b:39:75:00:00:00:00:00:00:00:00:00:00
 SNAME: .
 FNAME: .
OPTION:  53 (  1) DHCP message type         1 (DHCPDISCOVER)
OPTION:  61 ( 19) Client-identifier         ff:88:41:2d:30:00:02:00:00:ab:11:d5:6c:dc:5f:eb:fe:3b:b6
OPTION:  55 (  9) Parameter Request List      1 (Subnet mask)
					      3 (Routers)
					     12 (Host name)
					     15 (Domainname)
					      6 (DNS server)
					     26 (Interface MTU)
					     33 (Static route)
					    121 (Classless Static Route)
					     42 (NTP servers)
					    
OPTION:  57 (  2) Maximum DHCP message size 576
OPTION:  12 (  2) Host name                 c2
---------------------------------------------------------------------------

It continues to send these requests every 5 seconds but dhcpdump doesn’t show a response. The strange thing is that the containers are getting ipv6 addresses (but not ipv4), and I can confirm this at the router. All non-LXC systems are getting both ipv4 and ipv6 addresses from the router (as did the LXC containers before yesterday).

And using the same tool do you see those requests leaving the host’s external network interface (which I presume is where you are running the DHCP server)?

I don’t see anything going out via dhcpdump -i eno1 if that’s what you mean. The DHCP server is on an external device, so both the host and the guests are receiving their addresses via this external device. The external device is somehow assigning ipv6 addresses to the lxc containers without me being able to see the DHCP messages for some reason (confirmed using lxc list and checking on the router itself to see what it has assigned, in this case I see an ipv6 entry for “c2” on openwrt’s assigned addresses list, which is the name of the lxc container I made).

OK so if the DHCP requests aren’t leaving the host to the external DHCP server then that is the issue.

Are you running any firewall on the host?

Can you show the output of iptables -L -v -n and nft list ruleset please?

By default IPv6 doesn’t use DHCPv6 for IP configuration, it uses router advertisements, so that may explain it. It may be also that the dhcpdump tool you are using doesn’t detect DHCPv6 packets.

I wasn’t able to see DHCPv6 packets via tcpdump, either. And yet somehow the router became aware of “c2”, and “c2” got an ipv6 address.

I have no firewall set up. The host install is a pretty basic Ubuntu server 19.10 with lxc, docker, multipass, libvirt, and samba. Everything else runs in containers or VMs.

# iptables -L -v -n
Chain INPUT (policy ACCEPT 4317 packets, 5679K bytes)
 pkts bytes target     prot opt in     out     source               destination         
1894K  142M LIBVIRT_INP  all  --  *      *       0.0.0.0/0            0.0.0.0/0           

Chain FORWARD (policy DROP 149 packets, 26365 bytes)
 pkts bytes target     prot opt in     out     source               destination         
 210K   60M LIBVIRT_FWX  all  --  *      *       0.0.0.0/0            0.0.0.0/0           
 210K   60M LIBVIRT_FWI  all  --  *      *       0.0.0.0/0            0.0.0.0/0           
 210K   60M LIBVIRT_FWO  all  --  *      *       0.0.0.0/0            0.0.0.0/0           
 210K   60M DOCKER-USER  all  --  *      *       0.0.0.0/0            0.0.0.0/0           
 210K   60M DOCKER-ISOLATION-STAGE-1  all  --  *      *       0.0.0.0/0            0.0.0.0/0           
    0     0 ACCEPT     all  --  *      docker0  0.0.0.0/0            0.0.0.0/0            ctstate RELATED,ESTABLISHED
    0     0 DOCKER     all  --  *      docker0  0.0.0.0/0            0.0.0.0/0           
    0     0 ACCEPT     all  --  docker0 !docker0  0.0.0.0/0            0.0.0.0/0           
    0     0 ACCEPT     all  --  docker0 docker0  0.0.0.0/0            0.0.0.0/0           
    0     0 ACCEPT     all  --  *      br-a4556923b60f  0.0.0.0/0            0.0.0.0/0            ctstate RELATED,ESTABLISHED
    0     0 DOCKER     all  --  *      br-a4556923b60f  0.0.0.0/0            0.0.0.0/0           
    0     0 ACCEPT     all  --  br-a4556923b60f !br-a4556923b60f  0.0.0.0/0            0.0.0.0/0           
    0     0 ACCEPT     all  --  br-a4556923b60f br-a4556923b60f  0.0.0.0/0            0.0.0.0/0           

Chain OUTPUT (policy ACCEPT 3266 packets, 212K bytes)
 pkts bytes target     prot opt in     out     source               destination         
 696K 5505M LIBVIRT_OUT  all  --  *      *       0.0.0.0/0            0.0.0.0/0           

Chain DOCKER (2 references)
 pkts bytes target     prot opt in     out     source               destination         

Chain DOCKER-ISOLATION-STAGE-1 (1 references)
 pkts bytes target     prot opt in     out     source               destination         
    0     0 DOCKER-ISOLATION-STAGE-2  all  --  docker0 !docker0  0.0.0.0/0            0.0.0.0/0           
    0     0 DOCKER-ISOLATION-STAGE-2  all  --  br-a4556923b60f !br-a4556923b60f  0.0.0.0/0            0.0.0.0/0           
 210K   60M RETURN     all  --  *      *       0.0.0.0/0            0.0.0.0/0           

Chain DOCKER-ISOLATION-STAGE-2 (2 references)
 pkts bytes target     prot opt in     out     source               destination         
    0     0 DROP       all  --  *      docker0  0.0.0.0/0            0.0.0.0/0           
    0     0 DROP       all  --  *      br-a4556923b60f  0.0.0.0/0            0.0.0.0/0           
    0     0 RETURN     all  --  *      *       0.0.0.0/0            0.0.0.0/0           

Chain DOCKER-USER (1 references)
 pkts bytes target     prot opt in     out     source               destination         
 210K   60M RETURN     all  --  *      *       0.0.0.0/0            0.0.0.0/0           

Chain LIBVIRT_FWI (1 references)
 pkts bytes target     prot opt in     out     source               destination         
    0     0 ACCEPT     all  --  *      virbr0  0.0.0.0/0            192.168.122.0/24     ctstate RELATED,ESTABLISHED
    0     0 REJECT     all  --  *      virbr0  0.0.0.0/0            0.0.0.0/0            reject-with icmp-port-unreachable

Chain LIBVIRT_FWO (1 references)
 pkts bytes target     prot opt in     out     source               destination         
    0     0 ACCEPT     all  --  virbr0 *       192.168.122.0/24     0.0.0.0/0           
    0     0 REJECT     all  --  virbr0 *       0.0.0.0/0            0.0.0.0/0            reject-with icmp-port-unreachable

Chain LIBVIRT_FWX (1 references)
 pkts bytes target     prot opt in     out     source               destination         
    0     0 ACCEPT     all  --  virbr0 virbr0  0.0.0.0/0            0.0.0.0/0           

Chain LIBVIRT_INP (1 references)
 pkts bytes target     prot opt in     out     source               destination         
    0     0 ACCEPT     udp  --  virbr0 *       0.0.0.0/0            0.0.0.0/0            udp dpt:53
    0     0 ACCEPT     tcp  --  virbr0 *       0.0.0.0/0            0.0.0.0/0            tcp dpt:53
    0     0 ACCEPT     udp  --  virbr0 *       0.0.0.0/0            0.0.0.0/0            udp dpt:67
    0     0 ACCEPT     tcp  --  virbr0 *       0.0.0.0/0            0.0.0.0/0            tcp dpt:67

Chain LIBVIRT_OUT (1 references)
 pkts bytes target     prot opt in     out     source               destination         
    0     0 ACCEPT     udp  --  *      virbr0  0.0.0.0/0            0.0.0.0/0            udp dpt:68
root@thor:/home/karl# nft list ruleset

Command 'nft' not found, but can be installed with:

apt install nftables

Thanks, can you also show the output of ebtables -L.

What arguments did you use with tcpdump? Also, as I mentioned, it maybe that there are no DHCPv6 packets and IPv6 auto configuration is working normally using router advertisements.

But its encouraging that that is working, as it strongly indicates your bridge is working fine.