Running virtual machines with LXD 4.0

mgaerber · August 2, 2020, 6:41pm

I tried Win10 and it works - only there is no network card.

+-------+---------+------+------+-----------------+-----------+
| NAME  |  STATE  | IPV4 | IPV6 |      TYPE       | SNAPSHOTS |
+-------+---------+------+------+-----------------+-----------+
| win10 | RUNNING |      |      | VIRTUAL-MACHINE | 0         |
+-------+---------+------+------+-----------------+-----------+

config:
  limits.cpu: "8"
  limits.memory: 10GB
  raw.qemu: -device virtio-vga -vnc :1 -drive file=/home/mgaerber/Downloads/Win10_2004_English_x64.iso,index=0,media=cdrom,if=ide -drive file=/home/mgaerber/Downloads/virtio-win-0.1.173.iso,index=1,media=cdrom,if=ide
  security.secureboot: "false"
  volatile.eth0.host_name: tap02192319
  volatile.eth0.hwaddr: 00:16:3e:3a:7e:4a
  volatile.last_state.power: RUNNING
  volatile.vm.uuid: 1fda3fd0-6e71-4575-99ad-0229a4800f76
devices:
  root:
    path: /
    pool: default
    size: 60GB
    type: disk
ephemeral: false
profiles:
- default
stateful: false
description: ""

stgraber · August 3, 2020, 1:17am

Normally your default profile will have a network card attached to some kind of bridge.

Can you show lxc config show --expanded win10? This may then show it there.

On the Windows side, the network card will be using virtio-net but that’s supported by the drivers on the ISO. If you haven’t already, make sure that all drivers are installed in the VM, this will make a big difference in the whole experience.

will · August 5, 2020, 3:23am

Is it expected/intentional that the official ubuntu images don’t have a default netplan to setup dhcp like the linuxcontainers images? Thanks.

$ lxc launch ubuntu:20.04 ubvm --vm
$ lxc launch images:ubuntu/focal ubvmlx --vm
$ lxc list
+--------+---------+------------------------+-------------------------------------------------+-----------------+-----------+
|  NAME  |  STATE  |          IPV4          |                      IPV6                       |      TYPE       | SNAPSHOTS |
+--------+---------+------------------------+-------------------------------------------------+-----------------+-----------+
| devenv | RUNNING | 10.190.236.11 (eth0)   | fd42:2077:2dea:ddf0:216:3eff:fe56:cb96 (eth0)   | CONTAINER       | 0         |
+--------+---------+------------------------+-------------------------------------------------+-----------------+-----------+
| guienv | STOPPED |                        |                                                 | CONTAINER       | 0         |
+--------+---------+------------------------+-------------------------------------------------+-----------------+-----------+
| ubvm   | RUNNING |                        |                                                 | VIRTUAL-MACHINE | 0         |
+--------+---------+------------------------+-------------------------------------------------+-----------------+-----------+
| ubvmlx | RUNNING | 10.190.236.48 (enp5s0) | fd42:2077:2dea:ddf0:216:3eff:fef7:4ef0 (enp5s0) | VIRTUAL-MACHINE | 0         |
+--------+---------+------------------------+-------------------------------------------------+-----------------+-----------+
$ lxc exec ubvm -- ip addr
1: lo: <LOOPBACK,UP,LOWER_UP> mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000
    link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00
    inet 127.0.0.1/8 scope host lo
       valid_lft forever preferred_lft forever
    inet6 ::1/128 scope host 
       valid_lft forever preferred_lft forever
2: enp5s0: <BROADCAST,MULTICAST> mtu 1500 qdisc noop state DOWN group default qlen 1000
    link/ether 00:16:3e:c9:3d:2b brd ff:ff:ff:ff:ff:ff

tomp · August 5, 2020, 7:49am

Yes they should I believe, I am looking into this now.

tomp · August 5, 2020, 9:51am

If you add the cloud-init:config disk to your VM it should allow cloud-init inside the VM to get access to the templates required for network configuration:

lxc config device add ubvm config disk source=cloud-init:config

will · August 5, 2020, 4:01pm

@tomp Thanks! That works. I think an unintended consequence of the agent now being integrated in to the official images is that it’s easier to get in to your VM without any cloud-init config drive, and then run in to this issue

I’ve been studying the source and I can’t seem find why is it that the images:ubuntu/focal/cloud can work without a cidata disk, but the ubuntu official images need the drive attached.

If I boot the official image with cidata disk attached I get cloud-init log in /var/log… however without the volume there is no cloud-init log at all, not even showing cloud-init probing and not finding any nocloud data source. It seems cloud-init in this case is driven by systemd and there is some mechanism in systemd decided whether to run cloud-init at all.

Booting images:ubuntu/focal/cloud always finds data in /var/lib/cloud/seed. This is empty in the root.img. It appears to be populated by LXD via the agent early in the first boot based on this code.

Given the agent is now installed in official images and the metadata for templating out the seed directory is almost the same between images:ubuntu/focal/cloud and ubuntu:20.04, why is that agent-based template mechanism not being applied while booting the official images too?

tomp · August 5, 2020, 4:21pm

@stgraber explained this to me today.

The issue is that by the time cloud-init runs on the official Ubuntu cloud images LXD has already tried to boot the VM once (and the VM panicked due to the generic kernel which comes in an initrdless config in those images).

Subsequently, LXD then removes the first-boot cloud-init templates and by the 2nd boot (which is the first time cloud-init actually gets to run) the templates are no longer there and so a netplan configuration isn’t generated.

The LXD images:ubuntu/focal image doesn’t have this problem because it comes with the correct kernel and is also built with a basic netplan config so it doesn’t need cloud-init at all.

The fix for this is to move to the uefi images instead which use the linux-kvm kernel instead. This is something we are working with the Ubuntu team to resolve.

vvolas · August 6, 2020, 8:22am

Finally publish your VM as an image with:
lxc publish win10 --alias win10

Anyone tried this on lxd cluster? I made windows10-image
normally this windows10 image in the making boots like this

BdsDxe: loading Boot0009 “Windows Boot Manager” from HD(1,GPT,64400D7F-0526-4A7A-B40F-7EC28CECECED,0x800,0x32000)/\EFI\Microsoft\Boot\bootmgfw.efi
BdsDxe: starting Boot0009 “Windows Boot Manager” from HD(1,GPT,64400D7F-0526-4A7A-B40F-7EC28CECECED,0x800,0x32000)/\EFI\Microsoft\Boot\bootmgfw.efi

after making and launching new virtual machine from windows10-image on same lxd node it fails to boot like this

BdsDxe: loading Boot0001 "UEFI QEMU QEMU HARDDISK " from PciRoot(0x0)/Pci(0x1,0x1)/Pci(0x0,0x0)/Scsi(0x0,0x1)
BdsDxe: starting Boot0001 "UEFI QEMU QEMU HARDDISK " from PciRoot(0x0)/Pci(0x1,0x1)/Pci(0x0,0x0)/Scsi(0x0,0x1)

Something uefi/boot drivers related, I have same problems when trying to convert existing virtualbox image to lxd-qemu compatible.

I tried launching on different lxd node and output is completely empty and no errors. It just times out? after like 20s.

root@universe-linux:/var/lib# lxc start w10-rbsql; lxc console w10-rbsql
To detach from the console, press: +a q
root@universe-linux:/var/lib#

I didint run sysprep tho.

qno · August 19, 2020, 9:24pm

Hi,

thank you for this work and I just tried to install Windows Server 2k19 according to this steps with current LXD 4.4 snap on Ubuntu 20.04 host system.

I just want to add here that it doesn’t work anymore exactly like this because the provided qemu in the LXD snap seem to have no VNC support anymore. I got this error when I tried to start the VM:

Error: Failed to run: /snap/lxd/current/bin/lxd forklimits limit=memlock:unlimited:unlimited -- /snap/lxd/16889/bin/qemu-system-x86_64 -S -name win2k19 -uuid 83dbbd18-28ba-4300-a29b-1ccb04435338 -daemonize -cpu host -nographic -serial chardev:console -nodefaults -no-reboot -no-user-config -sandbox on,obsolete=deny,elevateprivileges=allow,spawn=deny,resourcecontrol=deny -readconfig /var/snap/lxd/common/lxd/logs/win2k19/qemu.conf -pidfile /var/snap/lxd/common/lxd/logs/win2k19/qemu.pid -D /var/snap/lxd/common/lxd/logs/win2k19/qemu.log -chroot /var/snap/lxd/common/lxd/virtual-machines/win2k19 -smbios type=2,manufacturer=Canonical Ltd.,product=LXD -runas lxd -device virtio-vga -vnc :1 -drive file=/home/user/17763.737.190906-2324.rs5_release_svc_refresh_SERVER_EVAL_x64FRE_en-us_1.iso,index=0,media=cdrom,if=ide -drive file=/home/user/Downloads/virtio-win-0.1.185.iso,index=1,media=cdrom,if=ide: qemu-system-x86_64: -vnc :1: VNC support is disabled: exit status 1

I tried then to set spice as remote display by adding this param -spice port=5900,disable-ticketing, so now it looks like:

echo -n '-device virtio-vga -spice port=5900,disable-ticketing -boot menu=on -drive file=/var/lib/snapd/hostfs/home/user/17763.737.190906-2324.rs5_release_svc_refresh_SERVER_EVAL_x64FRE_en-us_1.iso,index=0,media=cdrom,if=ide -drive file=/var/lib/snapd/hostfs/home/user/Downloads/virtio-win-0.1.185.iso,index=1,media=cdrom,if=ide' | lxc config set win2k19 raw.qemu -

Then the VM was booting and I was able to select the boot drive in qemu BIOS and start the system but I wasn’t able to connect with a spice client to the desktop. But then, after I found this LXD 4.4 has been released, I tried to start and connect to the system with lxc start win2k19;lxc console --type=vga win2k19 I finally could install the system in the VM. I just had to install sudo apt install spice-client-gtk before this and reboot the host, so lxc can find the program.

I’m even not sure if the parameter -spice port=5900,disable-ticketing is even necessary for qemu with LXD 4.4.

Again, thank you for all the work on LXD and I just wanted to add this information here in case someone else will need this.

stgraber · August 19, 2020, 9:52pm

Note that the instructions have been updated to no longer mention vnc.

LXD has native SPICE support and can spawn the client for you even remotely by using lxc console NAME --type=vga

davecore82 · August 20, 2020, 8:48pm

If hammering ESC doesn’t work for you and you get a shell after it fails to boot the network, you can type exit and it will bring you to the boot menu where you can choose boot manager.

ykazakov · September 15, 2020, 8:27am

I have problems similar to @will with running VMs on the latest snap LXD 4.4 (with clustering mode):

snap-id:      J60k4JY0HppjwOjW8dZdYc8obXKxujRu
tracking:     latest/stable/ubuntu-20.04
installed:          4.4                    (16926) 74MB -

A simple ubuntu VM does not start:

$ lxc launch images:ubuntu/focal ubuntu3 --vm --target myhost && lxc console ubuntu3
To detach from the console, press: <ctrl>+a q
BdsDxe: loading Boot0001 "UEFI QEMU QEMU HARDDISK " from PciRoot(0x0)/Pci(0x1,0x1)/Pci(0x0,0x0)/Scsi(0x0,0x1)
BdsDxe: starting Boot0001 "UEFI QEMU QEMU HARDDISK " from PciRoot(0x0)/Pci(0x1,0x1)/Pci(0x0,0x0)/Scsi(0x0,0x1)
error: file `/boot/' not found.
error: no such device: /.disk/info.
error: no such device: /.disk/mini-info.

[    0.356526] Initramfs unpacking failed: Decoding failed
[    0.968238] init[1]: segfault at 8 ip 00007f1a3142cf19 sp 00007ffdb89ab1d0 error 4 in ld-2.31.so[7f1a3141b000+23000]
[    0.971122] Code: 8b 44 24 08 4c 8b 40 08 41 80 38 00 75 18 48 8b 05 fc a6 01 00 4c 8b 00 48 8d 05 84 21 01 00 4d 85 c0 4c 0f 44 c0 48 8b 45 68 <48> 8b 40 08 48 89 04 24 48 8d 05 f8 a6 01 00 f6 00 10 0f 85 c7 01
[    0.976284] Kernel panic - not syncing: Attempted to kill init! exitcode=0x0000000b
[    0.978191] CPU: 0 PID: 1 Comm: init Not tainted 5.4.0-47-generic #51-Ubuntu
[    0.980346] Hardware name: QEMU Standard PC (Q35 + ICH9, 2009)/LXD, BIOS 0.0.0 02/06/2015
[    0.981535] Call Trace:
[    0.981848]  dump_stack+0x6d/0x9a
[    0.982264]  panic+0x101/0x2e3
[    0.982651]  do_exit.cold+0x9b/0xb5
[    0.983089]  do_group_exit+0x47/0xb0
[    0.983539]  get_signal+0x169/0x890
[    0.983986]  do_signal+0x34/0x6c0
[    0.984399]  ? bad_area+0x47/0x50
[    0.984833]  ? do_user_addr_fault+0x34f/0x450
[    0.985482]  exit_to_usermode_loop+0xbf/0x160
[    0.986237]  prepare_exit_to_usermode+0x77/0xa0
[    0.986795]  retint_user+0x8/0x8
[    0.987180] RIP: 0033:0x7f1a3142cf19
[    0.987608] Code: 8b 44 24 08 4c 8b 40 08 41 80 38 00 75 18 48 8b 05 fc a6 01 00 4c 8b 00 48 8d 05 84 21 01 00 4d 85 c0 4c 0f 44 c0 48 8b 45 68 <48> 8b 40 08 48 89 04 24 48 8d 05 f8 a6 01 00 f6 00 10 0f 85 c7 01
[    0.989824] RSP: 002b:00007ffdb89ab1d0 EFLAGS: 00010202
[    0.990502] RAX: 0000000000000000 RBX: 00007f1a310026d0 RCX: 0000000000000000
[    0.991759] RDX: 0000000000000004 RSI: 00007f1a30e13ecf RDI: 00007f1a30fed440
[    0.992669] RBP: 00007f1a30e13a20 R08: 00007f1a31418570 R09: 000000000000000f
[    0.993514] R10: fffffffffffffedf R11: 0000000000000246 R12: 00007f1a3100060c
[    0.994362] R13: 000000000e41b830 R14: 0000000000000029 R15: 00007f1a31442cc0
[    0.995235] Kernel Offset: 0x13c00000 from 0xffffffff81000000 (relocation range: 0xffffffff80000000-0xffffffffbfffffff)
[    0.996929] ---[ end Kernel panic - not syncing: Attempted to kill init! exitcode=0x0000000b ]---

Here is the kernel of the host (Ubuntu 20.04):

$ uname -a
Linux myhost 5.4.0-47-generic #51-Ubuntu SMP Fri Sep 4 19:50:52 UTC 2020 x86_64 x86_64 x86_64 GNU/Linux

This is the content of /var/snap/lxd/common/lxd/logs/ubuntu3/qemu.conf:

# Machine
[machine]
graphics = "off"
type = "q35"
accel = "kvm"
usb = "off"
graphics = "off"

[global]
driver = "ICH9-LPC"
property = "disable_s3"
value = "1"

[global]
driver = "ICH9-LPC"
property = "disable_s4"
value = "1"
[boot-opts]
strict = "on"

# Console
[chardev "console"]
backend = "pty"

# Graphical console
[spice]
unix = "on"
addr = "/var/snap/lxd/common/lxd/logs/ubuntu3/qemu.spice"
disable-ticketing = "on"

# Memory
[memory]
size = "1024M"

# CPU
[smp-opts]
cpus = "1"
sockets = "1"
cores = "1"
threads = "1"


[object "mem0"]

qom-type = "memory-backend-ram"
size = "1024M"

[numa]
type = "node"
nodeid = "0"
memdev = "mem0"

Here is my storage config:

$ lxc storage list
+-------+-------------+--------+---------+---------+
| NAME  | DESCRIPTION | DRIVER |  STATE  | USED BY |
+-------+-------------+--------+---------+---------+
| local |             | btrfs  | CREATED | 18      |
+-------+-------------+--------+---------+---------+
$ lxc storage show local --target myhost
config:
  btrfs.mount_options: noatime,nodiratime,compress=lzo,user_subvol_rm_allowed
  size: 15GB
  source: /dev/bcache0
  volatile.initial_source: /dev/bcache0
description: ""
name: local
driver: btrfs

I do not think the size value is correct though, it shows the same value also for other hosts on the cluster. Here is a config for another host which does not use bcache and for which the same problem takes place:

$ lxc storage show local --target myotherhost
config:
  btrfs.mount_options: noatime,nodiratime,compress=lzo,user_subvol_rm_allowed
  size: 15GB
  source: /dev/ubuntu-vg/lxd-lv
  volatile.initial_source: /dev/ubuntu-vg/lxd-lv
description: ""
name: local
driver: btrfs

Thanks in advance!

ykazakov · September 15, 2020, 8:47am

I had more luck in running the official ubuntu images, but if I copy the VM to another host, it does not boot:

$ lxc launch ubuntu:focal ubuntu4 --vm --target myhost && lxc console ubuntu4
Creating ubuntu4
Starting ubuntu4
To detach from the console, press: <ctrl>+a q
BdsDxe: loading Boot0001 "UEFI QEMU QEMU HARDDISK " from PciRoot(0x0)/Pci(0x1,0x1)/Pci(0x0,0x0)/Scsi(0x0,0x1)
BdsDxe: starting Boot0001 "UEFI QEMU QEMU HARDDISK " from PciRoot(0x0)/Pci(0x1,0x1)/Pci(0x0,0x0)/Scsi(0x0,0x1)
error: can't find command `hwmatch'.
EFI stub: UEFI Secure Boot is enabled.
[    0.000000] Linux version 5.4.0-47-generic (buildd@lcy01-amd64-014) (gcc version 9.3.0 (Ubuntu 9.3.0-10ubuntu2)) #51-Ubuntu SMP Fri Sep 4 19:50:52 UTC 2020 (Ubuntu 5.4.0-47.51-generic 5.4.55)
[    0.000000] Command line: BOOT_IMAGE=/boot/vmlinuz-5.4.0-47-generic root=PARTUUID=a97b4610-d527-40a0-8bbf-0df5b5a71b91 ro console=tty1 console=ttyS0 panic=-1
[    0.000000] KERNEL supported cpus:
[    0.000000]   Intel GenuineIntel
[    0.000000]   AMD AuthenticAMD
[    0.000000]   Hygon HygonGenuine
[    0.000000]   Centaur CentaurHauls
[    0.000000]   zhaoxin   Shanghai  
[    0.000000] x86/fpu: Supporting XSAVE feature 0x001: 'x87 floating point registers'
[    0.000000] x86/fpu: Supporting XSAVE feature 0x002: 'SSE registers'
[    0.000000] x86/fpu: Supporting XSAVE feature 0x004: 'AVX registers'
[    0.000000] x86/fpu: Supporting XSAVE feature 0x008: 'MPX bounds registers'
[    0.000000] x86/fpu: Supporting XSAVE feature 0x010: 'MPX CSR'
[    0.000000] x86/fpu: Supporting XSAVE feature 0x020: 'AVX-512 opmask'
[    0.000000] x86/fpu: Supporting XSAVE feature 0x040: 'AVX-512 Hi256'
[    0.000000] x86/fpu: Supporting XSAVE feature 0x080: 'AVX-512 ZMM_Hi256'
[    0.000000] x86/fpu: Supporting XSAVE feature 0x200: 'Protection Keys User registers'
[    0.000000] x86/fpu: xstate_offset[2]:  576, xstate_sizes[2]:  256
[    0.000000] x86/fpu: xstate_offset[3]:  832, xstate_sizes[3]:   64
[    0.000000] x86/fpu: xstate_offset[4]:  896, xstate_sizes[4]:   64
[    0.000000] x86/fpu: xstate_offset[5]:  960, xstate_sizes[5]:   64
[    0.000000] x86/fpu: xstate_offset[6]: 1024, xstate_sizes[6]:  512
[    0.000000] x86/fpu: xstate_offset[7]: 1536, xstate_sizes[7]: 1024
[    0.000000] x86/fpu: xstate_offset[9]: 2560, xstate_sizes[9]:    8
[    0.000000] x86/fpu: Enabled xstate features 0x2ff, context size is 2568 bytes, using 'compacted' format.
[    0.000000] BIOS-provided physical RAM map:
[    0.000000] BIOS-e820: [mem 0x0000000000000000-0x000000000009ffff] usable
[    0.000000] BIOS-e820: [mem 0x0000000000100000-0x000000003ee6afff] usable
[    0.000000] BIOS-e820: [mem 0x000000003ee6b000-0x000000003ef2bfff] reserved
[    0.000000] BIOS-e820: [mem 0x000000003ef2c000-0x000000003f8eefff] usable
[    0.000000] BIOS-e820: [mem 0x000000003f8ef000-0x000000003faeefff] reserved
[    0.000000] BIOS-e820: [mem 0x000000003faef000-0x000000003fb73fff] usable
[    0.000000] BIOS-e820: [mem 0x000000003fb74000-0x000000003fb7efff] ACPI data
[    0.000000] BIOS-e820: [mem 0x000000003fb7f000-0x000000003fbfefff] ACPI NVS
[    0.000000] BIOS-e820: [mem 0x000000003fbff000-0x000000003ffdffff] usable
[    0.000000] BIOS-e820: [mem 0x000000003ffe0000-0x000000003fffffff] reserved
[    0.000000] BIOS-e820: [mem 0x00000000b0000000-0x00000000bfffffff] reserved
[    0.000000] BIOS-e820: [mem 0x00000000ffe00000-0x00000000ffffffff] reserved
[    0.000000] NX (Execute Disable) protection: active
[    0.000000] extended physical RAM map:
[    0.000000] reserve setup_data: [mem 0x0000000000000000-0x000000000009ffff] usable
[    0.000000] reserve setup_data: [mem 0x0000000000100000-0x000000003df8e017] usable
[    0.000000] reserve setup_data: [mem 0x000000003df8e018-0x000000003dfc9457] usable
[    0.000000] reserve setup_data: [mem 0x000000003dfc9458-0x000000003e687017] usable
[    0.000000] reserve setup_data: [mem 0x000000003e687018-0x000000003e690a57] usable
[    0.000000] reserve setup_data: [mem 0x000000003e690a58-0x000000003ee6afff] usable
[    0.000000] reserve setup_data: [mem 0x000000003ee6b000-0x000000003ef2bfff] reserved
[    0.000000] reserve setup_data: [mem 0x000000003ef2c000-0x000000003f8eefff] usable
[    0.000000] reserve setup_data: [mem 0x000000003f8ef000-0x000000003faeefff] reserved
[    0.000000] reserve setup_data: [mem 0x000000003faef000-0x000000003fb73fff] usable
[    0.000000] reserve setup_data: [mem 0x000000003fb74000-0x000000003fb7efff] ACPI data
[    0.000000] reserve setup_data: [mem 0x000000003fb7f000-0x000000003fbfefff] ACPI NVS
[    0.000000] reserve setup_data: [mem 0x000000003fbff000-0x000000003ffdffff] usable
[    0.000000] reserve setup_data: [mem 0x000000003ffe0000-0x000000003fffffff] reserved
[    0.000000] reserve setup_data: [mem 0x00000000b0000000-0x00000000bfffffff] reserved
[    0.000000] reserve setup_data: [mem 0x00000000ffe00000-0x00000000ffffffff] reserved
[    0.000000] efi: EFI v2.70 by EDK II
[    0.000000] efi:  SMBIOS=0x3f915000  ACPI=0x3fb7e000  ACPI 2.0=0x3fb7e014  MEMATTR=0x3e10c518 
[    0.000000] secureboot: Secure boot enabled
[    0.000000] Kernel is locked down from EFI Secure Boot mode; see man kernel_lockdown.7
[    0.000000] SMBIOS 2.8 present.
[    0.000000] DMI: QEMU Standard PC (Q35 + ICH9, 2009)/LXD, BIOS 0.0.0 02/06/2015
[    0.000000] Hypervisor detected: KVM
[    0.000000] kvm-clock: Using msrs 4b564d01 and 4b564d00
[    0.000000] kvm-clock: cpu 0, msr 1f601001, primary cpu clock
[    0.000000] kvm-clock: using sched offset of 4895333496 cycles
[    0.000005] clocksource: kvm-clock: mask: 0xffffffffffffffff max_cycles: 0x1cd42e4dffb, max_idle_ns: 881590591483 ns
[    0.000009] tsc: Detected 3491.796 MHz processor
[    0.000210] last_pfn = 0x3ffe0 max_arch_pfn = 0x400000000
[    0.000257] x86/PAT: Configuration [0-7]: WB  WC  UC- UC  WB  WP  UC- WT  
[    0.009826] check: Scanning 1 areas for low memory corruption
[    0.009855] Using GB pages for direct mapping
[    0.010011] secureboot: Secure boot enabled
[    0.010033] ACPI: Early table checksum verification disabled
[    0.010047] ACPI: RSDP 0x000000003FB7E014 000024 (v02 BOCHS )
[    0.010050] ACPI: XSDT 0x000000003FB7D0E8 00005C (v01 BOCHS  BXPCFACP 00000001      01000013)
[    0.010055] ACPI: FACP 0x000000003FB7A000 0000F4 (v03 BOCHS  BXPCFACP 00000001 BXPC 00000001)
[    0.010059] ACPI: DSDT 0x000000003FB7B000 001D99 (v01 BOCHS  BXPCDSDT 00000001 BXPC 00000001)
[    0.010065] ACPI: FACS 0x000000003FBDD000 000040
[    0.010068] ACPI: APIC 0x000000003FB79000 000078 (v01 BOCHS  BXPCAPIC 00000001 BXPC 00000001)
[    0.010071] ACPI: HPET 0x000000003FB78000 000038 (v01 BOCHS  BXPCHPET 00000001 BXPC 00000001)
[    0.010076] ACPI: SRAT 0x000000003FB77000 0000B8 (v01 BOCHS  BXPCSRAT 00000001 BXPC 00000001)
[    0.010079] ACPI: MCFG 0x000000003FB76000 00003C (v01 BOCHS  BXPCMCFG 00000001 BXPC 00000001)
[    0.010082] ACPI: WAET 0x000000003FB75000 000028 (v01 BOCHS  BXPCWAET 00000001 BXPC 00000001)
[    0.010084] ACPI: BGRT 0x000000003FB74000 000038 (v01 INTEL  EDK2     00000002      01000013)
[    0.010169] SRAT: PXM 0 -> APIC 0x00 -> Node 0
[    0.010171] ACPI: SRAT: Node 0 PXM 0 [mem 0x00000000-0x0009ffff]
[    0.010172] ACPI: SRAT: Node 0 PXM 0 [mem 0x00100000-0x3fffffff]
[    0.010173] NUMA: Node 0 [mem 0x00000000-0x0009ffff] + [mem 0x00100000-0x3ffdffff] -> [mem 0x00000000-0x3ffdffff]
[    0.010180] NODE_DATA(0) allocated [mem 0x3ff58000-0x3ff82fff]
[    0.010413] Zone ranges:
[    0.010413]   DMA      [mem 0x0000000000001000-0x0000000000ffffff]
[    0.010414]   DMA32    [mem 0x0000000001000000-0x000000003ffdffff]
[    0.010415]   Normal   empty
[    0.010416]   Device   empty
[    0.010416] Movable zone start for each node
[    0.010418] Early memory node ranges
[    0.010419]   node   0: [mem 0x0000000000001000-0x000000000009ffff]
[    0.010420]   node   0: [mem 0x0000000000100000-0x000000003ee6afff]
[    0.010420]   node   0: [mem 0x000000003ef2c000-0x000000003f8eefff]
[    0.010421]   node   0: [mem 0x000000003faef000-0x000000003fb73fff]
[    0.010421]   node   0: [mem 0x000000003fbff000-0x000000003ffdffff]
[    0.010927] Zeroed struct page in unavailable ranges: 973 pages
[    0.010928] Initmem setup node 0 [mem 0x0000000000001000-0x000000003ffdffff]
[    0.016741] ACPI: PM-Timer IO Port: 0x608
[    0.016752] ACPI: LAPIC_NMI (acpi_id[0xff] dfl dfl lint[0x1])
[    0.016785] IOAPIC[0]: apic_id 0, version 17, address 0xfec00000, GSI 0-23
[    0.016787] ACPI: INT_SRC_OVR (bus 0 bus_irq 0 global_irq 2 dfl dfl)
[    0.016788] ACPI: INT_SRC_OVR (bus 0 bus_irq 5 global_irq 5 high level)
[    0.016788] ACPI: INT_SRC_OVR (bus 0 bus_irq 9 global_irq 9 high level)
[    0.016792] ACPI: INT_SRC_OVR (bus 0 bus_irq 10 global_irq 10 high level)
[    0.016792] ACPI: INT_SRC_OVR (bus 0 bus_irq 11 global_irq 11 high level)
[    0.016796] Using ACPI (MADT) for SMP configuration information
[    0.016798] ACPI: HPET id: 0x8086a201 base: 0xfed00000
[    0.016821] TSC deadline timer available
[    0.016822] smpboot: Allowing 1 CPUs, 0 hotplug CPUs
[    0.016834] KVM setup pv sched yield
[    0.016844] PM: Registered nosave memory: [mem 0x00000000-0x00000fff]
[    0.016845] PM: Registered nosave memory: [mem 0x000a0000-0x000fffff]
[    0.016846] PM: Registered nosave memory: [mem 0x3df8e000-0x3df8efff]
[    0.016847] PM: Registered nosave memory: [mem 0x3dfc9000-0x3dfc9fff]
[    0.016848] PM: Registered nosave memory: [mem 0x3dfca000-0x3e00efff]
[    0.016849] PM: Registered nosave memory: [mem 0x3e687000-0x3e687fff]
[    0.016850] PM: Registered nosave memory: [mem 0x3e690000-0x3e690fff]
[    0.016851] PM: Registered nosave memory: [mem 0x3ee6b000-0x3ef2bfff]
[    0.016852] PM: Registered nosave memory: [mem 0x3f8ef000-0x3faeefff]
[    0.016853] PM: Registered nosave memory: [mem 0x3fb74000-0x3fb7efff]
[    0.016853] PM: Registered nosave memory: [mem 0x3fb7f000-0x3fbfefff]
[    0.016855] [mem 0x40000000-0xafffffff] available for PCI devices
[    0.016856] Booting paravirtualized kernel on KVM
[    0.016860] clocksource: refined-jiffies: mask: 0xffffffff max_cycles: 0xffffffff, max_idle_ns: 7645519600211568 ns
[    0.016864] setup_percpu: NR_CPUS:8192 nr_cpumask_bits:1 nr_cpu_ids:1 nr_node_ids:1
[    0.017206] percpu: Embedded 54 pages/cpu s184320 r8192 d28672 u2097152
[    0.017230] KVM setup async PF for cpu 0
[    0.017234] kvm-stealtime: cpu 0, msr 3e22c040
[    0.017240] Built 1 zonelists, mobility grouping on.  Total pages: 255036
[    0.017241] Policy zone: DMA32
[    0.017242] Kernel command line: BOOT_IMAGE=/boot/vmlinuz-5.4.0-47-generic root=PARTUUID=a97b4610-d527-40a0-8bbf-0df5b5a71b91 ro console=tty1 console=ttyS0 panic=-1
[    0.017770] Dentry cache hash table entries: 131072 (order: 8, 1048576 bytes, linear)
[    0.018009] Inode-cache hash table entries: 65536 (order: 7, 524288 bytes, linear)
[    0.018040] mem auto-init: stack:off, heap alloc:on, heap free:off
[    0.019395] Memory: 959116K/1044684K available (14339K kernel code, 2398K rwdata, 4956K rodata, 2716K init, 4988K bss, 85568K reserved, 0K cma-reserved)
[    0.019409] random: get_random_u64 called from kmem_cache_open+0x2d/0x410 with crng_init=0
[    0.019980] SLUB: HWalign=64, Order=0-3, MinObjects=0, CPUs=1, Nodes=1
[    0.019993] Kernel/User page tables isolation: enabled
[    0.020008] ftrace: allocating 44505 entries in 174 pages
[    0.035025] rcu: Hierarchical RCU implementation.
[    0.035026] rcu: 	RCU restricting CPUs from NR_CPUS=8192 to nr_cpu_ids=1.
[    0.035027] 	Tasks RCU enabled.
[    0.035028] rcu: RCU calculated value of scheduler-enlistment delay is 25 jiffies.
[    0.035028] rcu: Adjusting geometry for rcu_fanout_leaf=16, nr_cpu_ids=1
[    0.036779] NR_IRQS: 524544, nr_irqs: 256, preallocated irqs: 16
[    0.036951] random: crng done (trusting CPU's manufacturer)
[    0.036976] Console: colour dummy device 80x25
[    0.037093] printk: console [tty1] enabled
[    0.170109] printk: console [ttyS0] enabled
[    0.170647] ACPI: Core revision 20190816
[    0.171257] clocksource: hpet: mask: 0xffffffff max_cycles: 0xffffffff, max_idle_ns: 19112604467 ns
[    0.172586] APIC: Switch to symmetric I/O mode setup
[    0.173648] x2apic enabled
[    0.174193] Switched APIC routing to physical x2apic.
[    0.174813] KVM setup pv IPIs
[    0.176170] ..TIMER: vector=0x30 apic1=0 pin1=2 apic2=-1 pin2=-1
[    0.176966] clocksource: tsc-early: mask: 0xffffffffffffffff max_cycles: 0x32550af6217, max_idle_ns: 440795356282 ns
[    0.178231] Calibrating delay loop (skipped) preset value.. 6983.59 BogoMIPS (lpj=13967184)
[    0.179566] pid_max: default: 32768 minimum: 301
[    0.183243] LSM: Security Framework initializing
[    0.183800] Yama: becoming mindful.
[    0.184243] AppArmor: AppArmor initialized
[    0.184743] Mount-cache hash table entries: 2048 (order: 2, 16384 bytes, linear)
[    0.185611] Mountpoint-cache hash table entries: 2048 (order: 2, 16384 bytes, linear)
[    0.186241] *** VALIDATE tmpfs ***
[    0.186861] *** VALIDATE proc ***
[    0.187460] *** VALIDATE cgroup1 ***
[    0.188160] *** VALIDATE cgroup2 ***
[    0.188880] x86/cpu: User Mode Instruction Prevention (UMIP) activated
[    0.189921] Last level iTLB entries: 4KB 0, 2MB 0, 4MB 0
[    0.190883] Last level dTLB entries: 4KB 0, 2MB 0, 4MB 0, 1GB 0
[    0.191582] Spectre V1 : Mitigation: usercopy/swapgs barriers and __user pointer sanitization
[    0.192596] Spectre V2 : Mitigation: Full generic retpoline
[    0.193312] Spectre V2 : Spectre v2 / SpectreRSB mitigation: Filling RSB on context switch
[    0.194230] Spectre V2 : Enabling Restricted Speculation for firmware calls
[    0.195087] Spectre V2 : mitigation: Enabling conditional Indirect Branch Prediction Barrier
[    0.196075] Speculative Store Bypass: Mitigation: Speculative Store Bypass disabled via prctl and seccomp
[    0.197201] TAA: Mitigation: Clear CPU buffers
[    0.198229] MDS: Mitigation: Clear CPU buffers
[    0.202749] Freeing SMP alternatives memory: 40K
[    0.205452] smpboot: CPU0: Intel(R) Xeon(R) Gold 6144 CPU @ 3.50GHz (family: 0x6, model: 0x55, stepping: 0x4)
[    0.206228] Performance Events: Skylake events, Intel PMU driver.
[    0.206228] ... version:                2
[    0.206228] ... bit width:              48
[    0.206228] ... generic registers:      4
[    0.206231] ... value mask:             0000ffffffffffff
[    0.206852] ... max period:             000000007fffffff
[    0.207481] ... fixed-purpose events:   3
[    0.207965] ... event mask:             000000070000000f
[    0.208648] rcu: Hierarchical SRCU implementation.
[    0.210151] smp: Bringing up secondary CPUs ...
[    0.210234] smp: Brought up 1 node, 1 CPU
[    0.210965] smpboot: Max logical packages: 1
[    0.211495] smpboot: Total of 1 processors activated (6983.59 BogoMIPS)
[    0.212441] devtmpfs: initialized
[    0.212887] x86/mm: Memory block size: 128MB
[    0.213562] PM: Registering ACPI NVS region [mem 0x3fb7f000-0x3fbfefff] (524288 bytes)
[    0.214281] clocksource: jiffies: mask: 0xffffffff max_cycles: 0xffffffff, max_idle_ns: 7645041785100000 ns
[    0.215496] futex hash table entries: 256 (order: 2, 16384 bytes, linear)
[    0.216780] pinctrl core: initialized pinctrl subsystem
[    0.217486] PM: RTC time: 08:36:27, date: 2020-09-15
[    0.218148] NET: Registered protocol family 16
[    0.218287] audit: initializing netlink subsys (disabled)
[    0.219006] EISA bus registered
[    0.219421] cpuidle: using governor ladder
[    0.219945] cpuidle: using governor menu
[    0.220466] KVM setup pv remote TLB flush
[    0.220932] ACPI: bus type PCI registered
[    0.221412] acpiphp: ACPI Hot Plug PCI Controller Driver version: 0.5
[    0.222240] audit: type=2000 audit(1600158988.811:1): state=initialized audit_enabled=0 res=1
[    0.223261] PCI: MMCONFIG for domain 0000 [bus 00-ff] at [mem 0xb0000000-0xbfffffff] (base 0xb0000000)
[    0.224446] PCI: MMCONFIG at [mem 0xb0000000-0xbfffffff] reserved in E820
[    0.225309] PCI: Using configuration type 1 for base access
[    0.227297] HugeTLB registered 1.00 GiB page size, pre-allocated 0 pages
[    0.228232] HugeTLB registered 2.00 MiB page size, pre-allocated 0 pages
[    0.229570] fbcon: Taking over console
[    0.230148] ACPI: Added _OSI(Module Device)
[    0.230233] ACPI: Added _OSI(Processor Device)
[    0.230764] ACPI: Added _OSI(3.0 _SCP Extensions)
[    0.231359] ACPI: Added _OSI(Processor Aggregator Device)
[    0.232152] ACPI: Added _OSI(Linux-Dell-Video)
[    0.232884] ACPI: Added _OSI(Linux-Lenovo-NV-HDMI-Audio)
[    0.233707] ACPI: Added _OSI(Linux-HPI-Hybrid-Graphics)
[    0.235270] ACPI: 1 ACPI AML tables successfully acquired and loaded
[    0.236494] ACPI: Interpreter enabled
[    0.237039] ACPI: (supports S0 S5)
[    0.237449] ACPI: Using IOAPIC for interrupt routing
[    0.238053] PCI: Using host bridge windows from ACPI; if necessary, use "pci=nocrs" and report a bug
[    0.238299] ACPI: Enabled 1 GPEs in block 00 to 3F
[    0.240455] ACPI: PCI Root Bridge [PCI0] (domain 0000 [bus 00-ff])
[    0.241236] acpi PNP0A08:00: _OSC: OS supports [ExtendedConfig ASPM ClockPM Segments MSI HPX-Type3]
[    0.242344] acpi PNP0A08:00: _OSC: platform does not support [LTR]
[    0.243171] acpi PNP0A08:00: _OSC: OS now controls [PCIeHotplug SHPCHotplug PME AER PCIeCapability]
[    0.244436] PCI host bridge to bus 0000:00
[    0.245114] pci_bus 0000:00: root bus resource [io  0x0000-0x0cf7 window]
[    0.246236] pci_bus 0000:00: root bus resource [io  0x0d00-0xffff window]
[    0.247096] pci_bus 0000:00: root bus resource [mem 0x000a0000-0x000bffff window]
[    0.248029] pci_bus 0000:00: root bus resource [mem 0x40000000-0xafffffff window]
[    0.248957] pci_bus 0000:00: root bus resource [mem 0xc0000000-0xfebfffff window]
[    0.249898] pci_bus 0000:00: root bus resource [mem 0x800000000-0xfffffffff window]
[    0.250242] pci_bus 0000:00: root bus resource [bus 00-ff]
[    0.250998] pci 0000:00:00.0: [8086:29c0] type 00 class 0x060000
[    0.252417] pci 0000:00:01.0: [1b36:000c] type 01 class 0x060400
[    0.255746] pci 0000:00:01.0: reg 0x10: [mem 0xc1245000-0xc1245fff]
[    0.260711] pci 0000:00:01.1: [1b36:000c] type 01 class 0x060400
[    0.263802] pci 0000:00:01.1: reg 0x10: [mem 0xc1244000-0xc1244fff]
[    0.269893] pci 0000:00:01.2: [1b36:000c] type 01 class 0x060400
[    0.272103] pci 0000:00:01.2: reg 0x10: [mem 0xc1243000-0xc1243fff]
[    0.279287] pci 0000:00:01.3: [1b36:000c] type 01 class 0x060400
[    0.283660] pci 0000:00:01.3: reg 0x10: [mem 0xc1242000-0xc1242fff]
[    0.293137] pci 0000:00:01.4: [1b36:000c] type 01 class 0x060400
[    0.295523] pci 0000:00:01.4: reg 0x10: [mem 0xc1241000-0xc1241fff]
[    0.308967] pci 0000:00:1f.0: [8086:2918] type 00 class 0x060100
[    0.310143] pci 0000:00:1f.0: quirk: [io  0x0600-0x067f] claimed by ICH6 ACPI/GPIO/TCO
[    0.310434] pci 0000:00:1f.2: [8086:2922] type 00 class 0x010601
[    0.316205] pci 0000:00:1f.2: reg 0x20: [io  0xa240-0xa25f]
[    0.317976] pci 0000:00:1f.2: reg 0x24: [mem 0xc1240000-0xc1240fff]
[    0.322348] pci 0000:00:1f.3: [8086:2930] type 00 class 0x0c0500
[    0.325831] pci 0000:00:1f.3: reg 0x20: [io  0xa200-0xa23f]
[    0.328060] pci 0000:01:00.0: [1af4:1045] type 00 class 0x00ff00
[    0.331556] pci 0000:01:00.0: reg 0x20: [mem 0x800014000-0x800017fff 64bit pref]
[    0.335562] pci 0000:01:00.1: [1af4:1044] type 00 class 0x00ff00
[    0.339045] pci 0000:01:00.1: reg 0x20: [mem 0x800010000-0x800013fff 64bit pref]
[    0.341320] pci 0000:01:00.2: [1af4:1052] type 00 class 0x090000
[    0.345575] pci 0000:01:00.2: reg 0x14: [mem 0xc1003000-0xc1003fff]
[    0.349024] pci 0000:01:00.2: reg 0x20: [mem 0x80000c000-0x80000ffff 64bit pref]
[    0.351292] pci 0000:01:00.3: [1af4:1052] type 00 class 0x098000
[    0.354074] pci 0000:01:00.3: reg 0x14: [mem 0xc1002000-0xc1002fff]
[    0.357144] pci 0000:01:00.3: reg 0x20: [mem 0x800008000-0x80000bfff 64bit pref]
[    0.359259] pci 0000:01:00.4: [1af4:1053] type 00 class 0x078000
[    0.362030] pci 0000:01:00.4: reg 0x14: [mem 0xc1001000-0xc1001fff]
[    0.367928] pci 0000:01:00.4: reg 0x20: [mem 0x800004000-0x800007fff 64bit pref]
[    0.370746] pci 0000:01:00.5: [1af4:1043] type 00 class 0x078000
[    0.373637] pci 0000:01:00.5: reg 0x14: [mem 0xc1000000-0xc1000fff]
[    0.378768] pci 0000:01:00.5: reg 0x20: [mem 0x800000000-0x800003fff 64bit pref]
[    0.388185] pci 0000:00:01.0: PCI bridge to [bus 01]
[    0.389578] pci 0000:00:01.0:   bridge window [io  0xa000-0xafff]
[    0.390244] pci 0000:00:01.0:   bridge window [mem 0xc1000000-0xc11fffff]
[    0.391245] pci 0000:00:01.0:   bridge window [mem 0x800000000-0x8000fffff 64bit pref]
[    0.393163] pci 0000:02:00.0: [1af4:1048] type 00 class 0x010000
[    0.395571] pci 0000:02:00.0: reg 0x14: [mem 0xc0e00000-0xc0e00fff]
[    0.401287] pci 0000:02:00.0: reg 0x20: [mem 0x800100000-0x800103fff 64bit pref]
[    0.409669] pci 0000:00:01.1: PCI bridge to [bus 02]
[    0.410251] pci 0000:00:01.1:   bridge window [io  0x9000-0x9fff]
[    0.411044] pci 0000:00:01.1:   bridge window [mem 0xc0e00000-0xc0ffffff]
[    0.411892] pci 0000:00:01.1:   bridge window [mem 0x800100000-0x8001fffff 64bit pref]
[    0.413621] pci 0000:03:00.0: [1af4:1049] type 00 class 0x000200
[    0.416106] pci 0000:03:00.0: reg 0x14: [mem 0xc0c00000-0xc0c00fff]
[    0.419677] pci 0000:03:00.0: reg 0x20: [mem 0x800200000-0x800203fff 64bit pref]
[    0.429958] pci 0000:00:01.2: PCI bridge to [bus 03]
[    0.430243] pci 0000:00:01.2:   bridge window [io  0x8000-0x8fff]
[    0.431013] pci 0000:00:01.2:   bridge window [mem 0xc0c00000-0xc0dfffff]
[    0.431871] pci 0000:00:01.2:   bridge window [mem 0x800200000-0x8002fffff 64bit pref]
[    0.434051] pci 0000:04:00.0: [1af4:1050] type 00 class 0x030000
[    0.435915] pci 0000:04:00.0: reg 0x10: [mem 0xc0000000-0xc07fffff pref]
[    0.439737] pci 0000:04:00.0: reg 0x18: [mem 0x800300000-0x800303fff 64bit pref]
[    0.443156] pci 0000:04:00.0: reg 0x20: [mem 0xc0800000-0xc0800fff]
[    0.446257] pci 0000:04:00.0: reg 0x30: [mem 0xffff0000-0xffffffff pref]
[    0.447289] pci 0000:04:00.0: BAR 0: assigned to efifb
[    0.455589] pci 0000:00:01.3: PCI bridge to [bus 04]
[    0.456208] pci 0000:00:01.3:   bridge window [io  0x7000-0x7fff]
[    0.456966] pci 0000:00:01.3:   bridge window [mem 0xc0000000-0xc08fffff]
[    0.457813] pci 0000:00:01.3:   bridge window [mem 0x800300000-0x8003fffff 64bit pref]
[    0.459380] pci 0000:05:00.0: [1af4:1041] type 00 class 0x020000
[    0.462233] pci 0000:05:00.0: reg 0x14: [mem 0xc0a00000-0xc0a00fff]
[    0.467114] pci 0000:05:00.0: reg 0x20: [mem 0x800400000-0x800403fff 64bit pref]
[    0.468871] pci 0000:05:00.0: reg 0x30: [mem 0xfffc0000-0xffffffff pref]
[    0.476234] pci 0000:00:01.4: PCI bridge to [bus 05]
[    0.477080] pci 0000:00:01.4:   bridge window [io  0x6000-0x6fff]
[    0.477820] pci 0000:00:01.4:   bridge window [mem 0xc0a00000-0xc0bfffff]
[    0.478254] pci 0000:00:01.4:   bridge window [mem 0x800400000-0x8004fffff 64bit pref]
[    0.482823] ACPI: PCI Interrupt Link [LNKA] (IRQs 5 *10 11)
[    0.483579] ACPI: PCI Interrupt Link [LNKB] (IRQs 5 *10 11)
[    0.484314] ACPI: PCI Interrupt Link [LNKC] (IRQs 5 10 *11)
[    0.485054] ACPI: PCI Interrupt Link [LNKD] (IRQs 5 10 *11)
[    0.485783] ACPI: PCI Interrupt Link [LNKE] (IRQs 5 *10 11)
[    0.486295] ACPI: PCI Interrupt Link [LNKF] (IRQs 5 *10 11)
[    0.487029] ACPI: PCI Interrupt Link [LNKG] (IRQs 5 10 *11)
[    0.488138] ACPI: PCI Interrupt Link [LNKH] (IRQs 5 10 *11)
[    0.489175] ACPI: PCI Interrupt Link [GSIA] (IRQs *16)
[    0.489799] ACPI: PCI Interrupt Link [GSIB] (IRQs *17)
[    0.490239] ACPI: PCI Interrupt Link [GSIC] (IRQs *18)
[    0.490851] ACPI: PCI Interrupt Link [GSID] (IRQs *19)
[    0.491466] ACPI: PCI Interrupt Link [GSIE] (IRQs *20)
[    0.492074] ACPI: PCI Interrupt Link [GSIF] (IRQs *21)
[    0.492684] ACPI: PCI Interrupt Link [GSIG] (IRQs *22)
[    0.493321] ACPI: PCI Interrupt Link [GSIH] (IRQs *23)
[    0.494482] iommu: Default domain type: Translated 
[    0.495738] SCSI subsystem initialized
[    0.496537] pci 0000:04:00.0: vgaarb: setting as boot VGA device
[    0.497531] pci 0000:04:00.0: vgaarb: VGA device added: decodes=io+mem,owns=io+mem,locks=none
[    0.498231] pci 0000:04:00.0: vgaarb: bridge control possible
[    0.498913] vgaarb: loaded
[    0.499260] ACPI: bus type USB registered
[    0.499753] usbcore: registered new interface driver usbfs
[    0.500501] usbcore: registered new interface driver hub
[    0.501546] usbcore: registered new device driver usb
[    0.502262] pps_core: LinuxPPS API ver. 1 registered
[    0.502839] pps_core: Software ver. 5.3.6 - Copyright 2005-2007 Rodolfo Giometti <giometti@linux.it>
[    0.503879] PTP clock support registered
[    0.504371] EDAC MC: Ver: 3.0.0
[    0.505159] Registered efivars operations
[    0.505677] PCI: Using ACPI for IRQ routing
[    0.597317] pci 0000:00:1f.2: can't claim BAR 4 [io  0xa240-0xa25f]: address conflict with PCI Bus 0000:01 [io  0xa000-0xafff]
[    0.598245] pci 0000:00:1f.3: can't claim BAR 4 [io  0xa200-0xa23f]: address conflict with PCI Bus 0000:01 [io  0xa000-0xafff]
[    0.600595] NetLabel: Initializing
[    0.601008] NetLabel:  domain hash size = 128
[    0.601535] NetLabel:  protocols = UNLABELED CIPSOv4 CALIPSO
[    0.602234] NetLabel:  unlabeled traffic allowed by default
[    0.603023] hpet0: at MMIO 0xfed00000, IRQs 2, 8, 0
[    0.603624] hpet0: 3 comparators, 64-bit 100.000000 MHz counter
[    0.610248] clocksource: Switched to clocksource kvm-clock
[    0.619809] *** VALIDATE bpf ***
[    0.620261] VFS: Disk quotas dquot_6.6.0
[    0.620759] VFS: Dquot-cache hash table entries: 512 (order 0, 4096 bytes)
[    0.621933] *** VALIDATE ramfs ***
[    0.622588] *** VALIDATE hugetlbfs ***
[    0.623129] AppArmor: AppArmor Filesystem Enabled
[    0.623706] pnp: PnP ACPI init
[    0.624440] pnp: PnP ACPI: found 4 devices
[    0.625590] thermal_sys: Registered thermal governor 'fair_share'
[    0.625590] thermal_sys: Registered thermal governor 'bang_bang'
[    0.626321] thermal_sys: Registered thermal governor 'step_wise'
[    0.627031] thermal_sys: Registered thermal governor 'user_space'
[    0.627747] thermal_sys: Registered thermal governor 'power_allocator'
[    0.633024] clocksource: acpi_pm: mask: 0xffffff max_cycles: 0xffffff, max_idle_ns: 2085701024 ns
[    0.634831] pci 0000:04:00.0: can't claim BAR 6 [mem 0xffff0000-0xffffffff pref]: no compatible bridge window
[    0.635980] pci 0000:05:00.0: can't claim BAR 6 [mem 0xfffc0000-0xffffffff pref]: no compatible bridge window
[    0.637226] pci 0000:00:1f.3: BAR 4: assigned [io  0x1000-0x103f]
[    0.639285] pci 0000:00:1f.2: BAR 4: assigned [io  0x1040-0x105f]
[    0.640921] pci 0000:00:01.0: PCI bridge to [bus 01]
[    0.641596] pci 0000:00:01.0:   bridge window [io  0xa000-0xafff]
[    0.643687] pci 0000:00:01.0:   bridge window [mem 0xc1000000-0xc11fffff]
[    0.646277] pci 0000:00:01.0:   bridge window [mem 0x800000000-0x8000fffff 64bit pref]
[    0.649304] pci 0000:00:01.1: PCI bridge to [bus 02]
[    0.651288] pci 0000:00:01.1:   bridge window [io  0x9000-0x9fff]
[    0.653000] pci 0000:00:01.1:   bridge window [mem 0xc0e00000-0xc0ffffff]
[    0.654438] pci 0000:00:01.1:   bridge window [mem 0x800100000-0x8001fffff 64bit pref]
[    0.656562] pci 0000:00:01.2: PCI bridge to [bus 03]
[    0.657163] pci 0000:00:01.2:   bridge window [io  0x8000-0x8fff]
[    0.659336] pci 0000:00:01.2:   bridge window [mem 0xc0c00000-0xc0dfffff]
[    0.660972] pci 0000:00:01.2:   bridge window [mem 0x800200000-0x8002fffff 64bit pref]
[    0.665035] pci 0000:04:00.0: BAR 6: assigned [mem 0xc0810000-0xc081ffff pref]
[    0.665891] pci 0000:00:01.3: PCI bridge to [bus 04]
[    0.666496] pci 0000:00:01.3:   bridge window [io  0x7000-0x7fff]
[    0.668172] pci 0000:00:01.3:   bridge window [mem 0xc0000000-0xc08fffff]
[    0.669982] pci 0000:00:01.3:   bridge window [mem 0x800300000-0x8003fffff 64bit pref]
[    0.672095] pci 0000:05:00.0: BAR 6: assigned [mem 0xc0a40000-0xc0a7ffff pref]
[    0.674810] pci 0000:00:01.4: PCI bridge to [bus 05]
[    0.675407] pci 0000:00:01.4:   bridge window [io  0x6000-0x6fff]
[    0.677135] pci 0000:00:01.4:   bridge window [mem 0xc0a00000-0xc0bfffff]
[    0.678468] pci 0000:00:01.4:   bridge window [mem 0x800400000-0x8004fffff 64bit pref]
[    0.680919] pci_bus 0000:00: resource 4 [io  0x0000-0x0cf7 window]
[    0.681987] pci_bus 0000:00: resource 5 [io  0x0d00-0xffff window]
[    0.682737] pci_bus 0000:00: resource 6 [mem 0x000a0000-0x000bffff window]
[    0.683561] pci_bus 0000:00: resource 7 [mem 0x40000000-0xafffffff window]
[    0.684475] pci_bus 0000:00: resource 8 [mem 0xc0000000-0xfebfffff window]
[    0.685313] pci_bus 0000:00: resource 9 [mem 0x800000000-0xfffffffff window]
[    0.686150] pci_bus 0000:01: resource 0 [io  0xa000-0xafff]
[    0.687019] pci_bus 0000:01: resource 1 [mem 0xc1000000-0xc11fffff]
[    0.688205] pci_bus 0000:01: resource 2 [mem 0x800000000-0x8000fffff 64bit pref]
[    0.689060] pci_bus 0000:02: resource 0 [io  0x9000-0x9fff]
[    0.689710] pci_bus 0000:02: resource 1 [mem 0xc0e00000-0xc0ffffff]
[    0.690457] pci_bus 0000:02: resource 2 [mem 0x800100000-0x8001fffff 64bit pref]
[    0.691340] pci_bus 0000:03: resource 0 [io  0x8000-0x8fff]
[    0.692008] pci_bus 0000:03: resource 1 [mem 0xc0c00000-0xc0dfffff]
[    0.693104] pci_bus 0000:03: resource 2 [mem 0x800200000-0x8002fffff 64bit pref]
[    0.694226] pci_bus 0000:04: resource 0 [io  0x7000-0x7fff]
[    0.694883] pci_bus 0000:04: resource 1 [mem 0xc0000000-0xc08fffff]
[    0.695608] pci_bus 0000:04: resource 2 [mem 0x800300000-0x8003fffff 64bit pref]
[    0.696494] pci_bus 0000:05: resource 0 [io  0x6000-0x6fff]
[    0.697139] pci_bus 0000:05: resource 1 [mem 0xc0a00000-0xc0bfffff]
[    0.697863] pci_bus 0000:05: resource 2 [mem 0x800400000-0x8004fffff 64bit pref]
[    0.699066] NET: Registered protocol family 2
[    0.699986] tcp_listen_portaddr_hash hash table entries: 512 (order: 1, 8192 bytes, linear)
[    0.700962] TCP established hash table entries: 8192 (order: 4, 65536 bytes, linear)
[    0.701871] TCP bind hash table entries: 8192 (order: 5, 131072 bytes, linear)
[    0.702708] TCP: Hash tables configured (established 8192 bind 8192)
[    0.703488] UDP hash table entries: 512 (order: 2, 16384 bytes, linear)
[    0.704368] UDP-Lite hash table entries: 512 (order: 2, 16384 bytes, linear)
[    0.705757] NET: Registered protocol family 1
[    0.706295] NET: Registered protocol family 44
[    0.706962] pci 0000:04:00.0: Video device with shadowed ROM at [mem 0x000c0000-0x000dffff]
[    0.707944] PCI: CLS 0 bytes, default 64
[    0.708502] clocksource: tsc: mask: 0xffffffffffffffff max_cycles: 0x32550af6217, max_idle_ns: 440795356282 ns
[    0.709689] check: Scanning for low memory corruption every 60 seconds
[    0.710716] Initialise system trusted keyrings
[    0.711246] Key type blacklist registered
[    0.711763] workingset: timestamp_bits=36 max_order=18 bucket_order=0
[    0.713279] zbud: loaded
[    0.713814] squashfs: version 4.0 (2009/01/31) Phillip Lougher
[    0.714686] fuse: init (API version 7.31)
[    0.715167] *** VALIDATE fuse ***
[    0.715557] *** VALIDATE fuse ***
[    0.716016] Platform Keyring initialized
[    0.718489] Key type asymmetric registered
[    0.718973] Asymmetric key parser 'x509' registered
[    0.719545] Block layer SCSI generic (bsg) driver version 0.4 loaded (major 244)
[    0.720435] io scheduler mq-deadline registered
[    0.721275] PCI Interrupt Link [GSIF] enabled at IRQ 21
[    0.722528] pcieport 0000:00:01.0: PME: Signaling with IRQ 24
[    0.723327] pcieport 0000:00:01.0: AER: enabled with IRQ 24
[    0.724036] pcieport 0000:00:01.0: pciehp: Slot #0 AttnBtn+ PwrCtrl+ MRL- AttnInd+ PwrInd+ HotPlug+ Surprise+ Interlock+ NoCompl- LLActRep+
[    0.727964] pcieport 0000:00:01.1: PME: Signaling with IRQ 25
[    0.728761] pcieport 0000:00:01.1: AER: enabled with IRQ 25
[    0.729470] pcieport 0000:00:01.1: pciehp: Slot #0 AttnBtn+ PwrCtrl+ MRL- AttnInd+ PwrInd+ HotPlug+ Surprise+ Interlock+ NoCompl- LLActRep+
[    0.731977] pcieport 0000:00:01.2: PME: Signaling with IRQ 26
[    0.732772] pcieport 0000:00:01.2: AER: enabled with IRQ 26
[    0.733495] pcieport 0000:00:01.2: pciehp: Slot #0 AttnBtn+ PwrCtrl+ MRL- AttnInd+ PwrInd+ HotPlug+ Surprise+ Interlock+ NoCompl- LLActRep+
[    0.736728] pcieport 0000:00:01.3: PME: Signaling with IRQ 27
[    0.737997] pcieport 0000:00:01.3: AER: enabled with IRQ 27
[    0.738805] pcieport 0000:00:01.3: pciehp: Slot #0 AttnBtn+ PwrCtrl+ MRL- AttnInd+ PwrInd+ HotPlug+ Surprise+ Interlock+ NoCompl- LLActRep+
[    0.741535] pcieport 0000:00:01.4: PME: Signaling with IRQ 28
[    0.742642] pcieport 0000:00:01.4: AER: enabled with IRQ 28
[    0.743567] pcieport 0000:00:01.4: pciehp: Slot #0 AttnBtn+ PwrCtrl+ MRL- AttnInd+ PwrInd+ HotPlug+ Surprise+ Interlock+ NoCompl- LLActRep+
[    0.746028] shpchp: Standard Hot Plug PCI Controller Driver version: 0.4
[    0.747018] efifb: probing for efifb
[    0.747530] efifb: framebuffer at 0xc0000000, using 1876k, total 1875k
[    0.748411] efifb: mode is 800x600x32, linelength=3200, pages=1
[    0.749199] efifb: scrolling: redraw
[    0.749689] efifb: Truecolor: size=8:8:8:8, shift=24:16:8:0
[    0.750627] Console: switching to colour frame buffer device 100x37
[    0.753031] fb0: EFI VGA frame buffer device
[    0.753833] input: Power Button as /devices/LNXSYSTM:00/LNXPWRBN:00/input/input0
[    0.755071] ACPI: Power Button [PWRF]
[    0.766303] Serial: 8250/16550 driver, 32 ports, IRQ sharing enabled
[    0.791520] 00:02: ttyS0 at I/O 0x3f8 (irq = 4, base_baud = 115200) is a 16550A
[    0.813610] Linux agpgart interface v0.103
[    0.816113] loop: module loaded
[    0.816999] libphy: Fixed MDIO Bus: probed
[    0.817788] tun: Universal TUN/TAP device driver, 1.6
[    0.818861] PPP generic driver version 2.4.2
[    0.820097] VFIO - User Level meta-driver version: 0.3
[    0.821108] ehci_hcd: USB 2.0 'Enhanced' Host Controller (EHCI) Driver
[    0.823054] ehci-pci: EHCI PCI platform driver
[    0.824317] ehci-platform: EHCI generic platform driver
[    0.825256] ohci_hcd: USB 1.1 'Open' Host Controller (OHCI) Driver
[    0.826376] ohci-pci: OHCI PCI platform driver
[    0.827631] ohci-platform: OHCI generic platform driver
[    0.829054] uhci_hcd: USB Universal Host Controller Interface driver
[    0.830173] i8042: PNP: PS/2 Controller [PNP0303:KBD,PNP0f13:MOU] at 0x60,0x64 irq 1,12
[    0.832079] serio: i8042 KBD port at 0x60,0x64 irq 1
[    0.832999] serio: i8042 AUX port at 0x60,0x64 irq 12
[    0.833993] mousedev: PS/2 mouse device common for all mice
[    0.835174] input: AT Translated Set 2 keyboard as /devices/platform/i8042/serio0/input/input1
[    0.836905] rtc_cmos 00:03: RTC can wake from S4
[    0.838457] rtc_cmos 00:03: registered as rtc0
[    0.839302] rtc_cmos 00:03: alarms up to one day, y3k, 242 bytes nvram, hpet irqs
[    0.840498] i2c /dev entries driver
[    0.841266] device-mapper: uevent: version 1.0.3
[    0.842252] device-mapper: ioctl: 4.41.0-ioctl (2019-09-16) initialised: dm-devel@redhat.com
[    0.845744] platform eisa.0: Probing EISA bus 0
[    0.846604] platform eisa.0: EISA: Cannot allocate resource for mainboard
[    0.848008] platform eisa.0: Cannot allocate resource for EISA slot 1
[    0.849389] platform eisa.0: Cannot allocate resource for EISA slot 2
[    0.850484] platform eisa.0: Cannot allocate resource for EISA slot 3
[    0.851561] platform eisa.0: Cannot allocate resource for EISA slot 4
[    0.852624] platform eisa.0: Cannot allocate resource for EISA slot 5
[    0.853709] platform eisa.0: Cannot allocate resource for EISA slot 6
[    0.854807] platform eisa.0: Cannot allocate resource for EISA slot 7
[    0.856716] platform eisa.0: Cannot allocate resource for EISA slot 8
[    0.858507] platform eisa.0: EISA: Detected 0 cards
[    0.859954] intel_pstate: CPU model not supported
[    0.861217] ledtrig-cpu: registered to indicate activity on CPUs
[    0.862711] EFI Variables Facility v0.08 2004-May-17
[    0.864558] drop_monitor: Initializing network drop monitor service
[    0.866388] NET: Registered protocol family 10
[    0.868179] Segment Routing with IPv6
[    0.869370] NET: Registered protocol family 17
[    0.870783] Key type dns_resolver registered
[    0.872231] RAS: Correctable Errors collector initialized.
[    0.873670] IPI shorthand broadcast: enabled
[    0.876809] sched_clock: Marking stable (739470556, 137313828)->(915326016, -38541632)
[    0.878600] registered taskstats version 1
[    0.879741] Loading compiled-in X.509 certificates
[    0.881368] Loaded X.509 cert 'Build time autogenerated kernel key: 52d16be8a47f13ed569e4734dd7da053d9d3759d'
[    0.883775] zswap: loaded using pool lzo/zbud
[    0.884622] Key type ._fscrypt registered
[    0.885370] Key type .fscrypt registered
[    0.886278] Key type big_key registered
[    0.887566] Key type encrypted registered
[    0.888303] AppArmor: AppArmor sha1 policy hashing enabled
[    0.889243] integrity: Loading X.509 certificate: UEFI:db
[    0.890512] integrity: Loaded X.509 cert 'Microsoft Windows Production PCA 2011: a92902398e16c49778cd90f99e4f9ae17c55af53'
[    0.892583] integrity: Loading X.509 certificate: UEFI:db
[    0.893486] integrity: Loaded X.509 cert 'Microsoft Corporation UEFI CA 2011: 13adbf4309bd82709c8cd54f316ed522988a1bd4'
[    0.895312] ima: No TPM chip found, activating TPM-bypass!
[    0.896230] ima: Allocated hash algorithm: sha1
[    0.897031] ima: No architecture policies found
[    0.897839] evm: Initialising EVM extended attributes:
[    0.899035] evm: security.selinux
[    0.900026] evm: security.SMACK64
[    0.900691] evm: security.SMACK64EXEC
[    0.901401] evm: security.SMACK64TRANSMUTE
[    0.902165] evm: security.SMACK64MMAP
[    0.902902] evm: security.apparmor
[    0.903588] evm: security.ima
[    0.904220] evm: security.capability
[    0.904935] evm: HMAC attrs: 0x1
[    0.907381] PM:   Magic number: 4:573:624
[    0.908608] rtc_cmos 00:03: setting system clock to 2020-09-15T08:36:28 UTC (1600158988)
[    0.910517] Lockdown: swapper/0: hibernation is restricted; see man kernel_lockdown.7
[    0.912244] md: Waiting for all devices to be available before autodetect
[    0.913322] md: If you don't use raid, use raid=noautodetect
[    0.914400] md: Autodetecting RAID arrays.
[    0.915165] md: autorun ...
[    0.915770] md: ... autorun DONE.
[    0.916534] VFS: Cannot open root device "PARTUUID=a97b4610-d527-40a0-8bbf-0df5b5a71b91" or unknown-block(0,0): error -6
[    0.918779] Please append a correct "root=" boot option; here are the available partitions:
[    0.920233] Kernel panic - not syncing: VFS: Unable to mount root fs on unknown-block(0,0)
[    0.921660] CPU: 0 PID: 1 Comm: swapper/0 Not tainted 5.4.0-47-generic #51-Ubuntu
[    0.923117] Hardware name: QEMU Standard PC (Q35 + ICH9, 2009)/LXD, BIOS 0.0.0 02/06/2015
[    0.924865] Call Trace:
[    0.925462]  dump_stack+0x6d/0x9a
[    0.926148]  panic+0x101/0x2e3
[    0.926805]  mount_block_root+0x23f/0x2e8
[    0.927568]  mount_root+0x38/0x3a
[    0.928255]  prepare_namespace+0x13f/0x194
[    0.929066]  kernel_init_freeable+0x231/0x255
[    0.929921]  ? rest_init+0xb0/0xb0
[    0.930864]  kernel_init+0xe/0x100
[    0.931748]  ret_from_fork+0x35/0x40
[    0.932453] Kernel Offset: 0x10400000 from 0xffffffff81000000 (relocation range: 0xffffffff80000000-0xffffffffbfffffff)
[    0.934243] ACPI MEMORY or I/O RESET_REG.

The VM seem to work fine:

$ lxc exec ubuntu4 -- ls /
bin  boot  dev	etc  home  lib	lib32  lib64  libx32  lost+found  media  mnt  opt  proc  root  run  sbin  snap	srv  sys  tmp  usr  var

But not after copying to another host:

$ lxc stop ubuntu4
$ lxc cp ubuntu4 ubuntu5 --target myotherhost
$ lxc start ubuntu5 && lxc console ubuntu5
To detach from the console, press: <ctrl>+a q
BdsDxe: loading Boot0001 "UEFI QEMU QEMU HARDDISK " from PciRoot(0x0)/Pci(0x1,0x1)/Pci(0x0,0x0)/Scsi(0x0,0x1)
BdsDxe: starting Boot0001 "UEFI QEMU QEMU HARDDISK " from PciRoot(0x0)/Pci(0x1,0x1)/Pci(0x0,0x0)/Scsi(0x0,0x1)
error: can't find command `hwmatch'.
EFI stub: UEFI Secure Boot is enabled.
[    0.000000] Linux version 5.4.0-47-generic (buildd@lcy01-amd64-014) (gcc version 9.3.0 (Ubuntu 9.3.0-10ubuntu2)) #51-Ubuntu SMP Fri Sep 4 19:50:52 UTC 2020 (Ubuntu 5.4.0-47.51-generic 5.4.55)
[    0.000000] Command line: BOOT_IMAGE=/boot/vmlinuz-5.4.0-47-generic root=PARTUUID=a97b4610-d527-40a0-8bbf-0df5b5a71b91 ro console=tty1 console=ttyS0 panic=-1
[    0.000000] KERNEL supported cpus:
[    0.000000]   Intel GenuineIntel
[    0.000000]   AMD AuthenticAMD
[    0.000000]   Hygon HygonGenuine
[    0.000000]   Centaur CentaurHauls
[    0.000000]   zhaoxin   Shanghai  
[    0.000000] x86/fpu: Supporting XSAVE feature 0x001: 'x87 floating point registers'
[    0.000000] x86/fpu: Supporting XSAVE feature 0x002: 'SSE registers'
[    0.000000] x86/fpu: Supporting XSAVE feature 0x004: 'AVX registers'
[    0.000000] x86/fpu: xstate_offset[2]:  576, xstate_sizes[2]:  256
[    0.000000] x86/fpu: Enabled xstate features 0x7, context size is 832 bytes, using 'standard' format.
[    0.000000] BIOS-provided physical RAM map:
[    0.000000] BIOS-e820: [mem 0x0000000000000000-0x000000000009ffff] usable
[    0.000000] BIOS-e820: [mem 0x0000000000100000-0x000000003ee6afff] usable
[    0.000000] BIOS-e820: [mem 0x000000003ee6b000-0x000000003ef2bfff] reserved
[    0.000000] BIOS-e820: [mem 0x000000003ef2c000-0x000000003f8eefff] usable
[    0.000000] BIOS-e820: [mem 0x000000003f8ef000-0x000000003faeefff] reserved
[    0.000000] BIOS-e820: [mem 0x000000003faef000-0x000000003fb73fff] usable
[    0.000000] BIOS-e820: [mem 0x000000003fb74000-0x000000003fb7efff] ACPI data
[    0.000000] BIOS-e820: [mem 0x000000003fb7f000-0x000000003fbfefff] ACPI NVS
[    0.000000] BIOS-e820: [mem 0x000000003fbff000-0x000000003ffdffff] usable
[    0.000000] BIOS-e820: [mem 0x000000003ffe0000-0x000000003fffffff] reserved
[    0.000000] BIOS-e820: [mem 0x00000000b0000000-0x00000000bfffffff] reserved
[    0.000000] BIOS-e820: [mem 0x00000000ffe00000-0x00000000ffffffff] reserved
[    0.000000] NX (Execute Disable) protection: active
[    0.000000] extended physical RAM map:
[    0.000000] reserve setup_data: [mem 0x0000000000000000-0x000000000009ffff] usable
[    0.000000] reserve setup_data: [mem 0x0000000000100000-0x000000003df8c017] usable
[    0.000000] reserve setup_data: [mem 0x000000003df8c018-0x000000003dfc7457] usable
[    0.000000] reserve setup_data: [mem 0x000000003dfc7458-0x000000003e687017] usable
[    0.000000] reserve setup_data: [mem 0x000000003e687018-0x000000003e690a57] usable
[    0.000000] reserve setup_data: [mem 0x000000003e690a58-0x000000003ee6afff] usable
[    0.000000] reserve setup_data: [mem 0x000000003ee6b000-0x000000003ef2bfff] reserved
[    0.000000] reserve setup_data: [mem 0x000000003ef2c000-0x000000003f8eefff] usable
[    0.000000] reserve setup_data: [mem 0x000000003f8ef000-0x000000003faeefff] reserved
[    0.000000] reserve setup_data: [mem 0x000000003faef000-0x000000003fb73fff] usable
[    0.000000] reserve setup_data: [mem 0x000000003fb74000-0x000000003fb7efff] ACPI data
[    0.000000] reserve setup_data: [mem 0x000000003fb7f000-0x000000003fbfefff] ACPI NVS
[    0.000000] reserve setup_data: [mem 0x000000003fbff000-0x000000003ffdffff] usable
[    0.000000] reserve setup_data: [mem 0x000000003ffe0000-0x000000003fffffff] reserved
[    0.000000] reserve setup_data: [mem 0x00000000b0000000-0x00000000bfffffff] reserved
[    0.000000] reserve setup_data: [mem 0x00000000ffe00000-0x00000000ffffffff] reserved
[    0.000000] efi: EFI v2.70 by EDK II
[    0.000000] efi:  SMBIOS=0x3f915000  ACPI=0x3fb7e000  ACPI 2.0=0x3fb7e014  MEMATTR=0x3e00d098 
[    0.000000] secureboot: Secure boot enabled
[    0.000000] Kernel is locked down from EFI Secure Boot mode; see man kernel_lockdown.7
[    0.000000] SMBIOS 2.8 present.
[    0.000000] DMI: QEMU Standard PC (Q35 + ICH9, 2009)/LXD, BIOS 0.0.0 02/06/2015
[    0.000000] Hypervisor detected: KVM
[    0.000000] kvm-clock: Using msrs 4b564d01 and 4b564d00
[    0.000000] kvm-clock: cpu 0, msr 15601001, primary cpu clock
[    0.000000] kvm-clock: using sched offset of 13072028263 cycles
[    0.000007] clocksource: kvm-clock: mask: 0xffffffffffffffff max_cycles: 0x1cd42e4dffb, max_idle_ns: 881590591483 ns
[    0.000011] tsc: Detected 2599.990 MHz processor
[    0.000184] last_pfn = 0x3ffe0 max_arch_pfn = 0x400000000
[    0.000244] x86/PAT: Configuration [0-7]: WB  WC  UC- UC  WB  WP  UC- WT  
[    0.015382] check: Scanning 1 areas for low memory corruption
[    0.015446] Using GB pages for direct mapping
[    0.015589] secureboot: Secure boot enabled
[    0.015615] ACPI: Early table checksum verification disabled
[    0.015630] ACPI: RSDP 0x000000003FB7E014 000024 (v02 BOCHS )
[    0.015635] ACPI: XSDT 0x000000003FB7D0E8 00005C (v01 BOCHS  BXPCFACP 00000001      01000013)
[    0.015645] ACPI: FACP 0x000000003FB7A000 0000F4 (v03 BOCHS  BXPCFACP 00000001 BXPC 00000001)
[    0.015655] ACPI: DSDT 0x000000003FB7B000 001D99 (v01 BOCHS  BXPCDSDT 00000001 BXPC 00000001)
[    0.015662] ACPI: FACS 0x000000003FBDD000 000040
[    0.015669] ACPI: APIC 0x000000003FB79000 000078 (v01 BOCHS  BXPCAPIC 00000001 BXPC 00000001)
[    0.015675] ACPI: HPET 0x000000003FB78000 000038 (v01 BOCHS  BXPCHPET 00000001 BXPC 00000001)
[    0.015681] ACPI: SRAT 0x000000003FB77000 0000B8 (v01 BOCHS  BXPCSRAT 00000001 BXPC 00000001)
[    0.015688] ACPI: MCFG 0x000000003FB76000 00003C (v01 BOCHS  BXPCMCFG 00000001 BXPC 00000001)
[    0.015694] ACPI: WAET 0x000000003FB75000 000028 (v01 BOCHS  BXPCWAET 00000001 BXPC 00000001)
[    0.015698] ACPI: BGRT 0x000000003FB74000 000038 (v01 INTEL  EDK2     00000002      01000013)
[    0.015772] SRAT: PXM 0 -> APIC 0x00 -> Node 0
[    0.015775] ACPI: SRAT: Node 0 PXM 0 [mem 0x00000000-0x0009ffff]
[    0.015776] ACPI: SRAT: Node 0 PXM 0 [mem 0x00100000-0x3fffffff]
[    0.015779] NUMA: Node 0 [mem 0x00000000-0x0009ffff] + [mem 0x00100000-0x3ffdffff] -> [mem 0x00000000-0x3ffdffff]
[    0.015788] NODE_DATA(0) allocated [mem 0x3ff58000-0x3ff82fff]
[    0.016144] Zone ranges:
[    0.016145]   DMA      [mem 0x0000000000001000-0x0000000000ffffff]
[    0.016147]   DMA32    [mem 0x0000000001000000-0x000000003ffdffff]
[    0.016148]   Normal   empty
[    0.016148]   Device   empty
[    0.016149] Movable zone start for each node
[    0.016152] Early memory node ranges
[    0.016153]   node   0: [mem 0x0000000000001000-0x000000000009ffff]
[    0.016154]   node   0: [mem 0x0000000000100000-0x000000003ee6afff]
[    0.016155]   node   0: [mem 0x000000003ef2c000-0x000000003f8eefff]
[    0.016156]   node   0: [mem 0x000000003faef000-0x000000003fb73fff]
[    0.016156]   node   0: [mem 0x000000003fbff000-0x000000003ffdffff]
[    0.016667] Zeroed struct page in unavailable ranges: 973 pages
[    0.016668] Initmem setup node 0 [mem 0x0000000000001000-0x000000003ffdffff]
[    0.023281] ACPI: PM-Timer IO Port: 0x608
[    0.023299] ACPI: LAPIC_NMI (acpi_id[0xff] dfl dfl lint[0x1])
[    0.023357] IOAPIC[0]: apic_id 0, version 17, address 0xfec00000, GSI 0-23
[    0.023361] ACPI: INT_SRC_OVR (bus 0 bus_irq 0 global_irq 2 dfl dfl)
[    0.023363] ACPI: INT_SRC_OVR (bus 0 bus_irq 5 global_irq 5 high level)
[    0.023363] ACPI: INT_SRC_OVR (bus 0 bus_irq 9 global_irq 9 high level)
[    0.023365] ACPI: INT_SRC_OVR (bus 0 bus_irq 10 global_irq 10 high level)
[    0.023366] ACPI: INT_SRC_OVR (bus 0 bus_irq 11 global_irq 11 high level)
[    0.023372] Using ACPI (MADT) for SMP configuration information
[    0.023374] ACPI: HPET id: 0x8086a201 base: 0xfed00000
[    0.023423] TSC deadline timer available
[    0.023430] smpboot: Allowing 1 CPUs, 0 hotplug CPUs
[    0.023450] KVM setup pv sched yield
[    0.023480] PM: Registered nosave memory: [mem 0x00000000-0x00000fff]
[    0.023481] PM: Registered nosave memory: [mem 0x000a0000-0x000fffff]
[    0.023483] PM: Registered nosave memory: [mem 0x3df8c000-0x3df8cfff]
[    0.023484] PM: Registered nosave memory: [mem 0x3dfc7000-0x3dfc7fff]
[    0.023485] PM: Registered nosave memory: [mem 0x3dfc8000-0x3e00cfff]
[    0.023487] PM: Registered nosave memory: [mem 0x3e687000-0x3e687fff]
[    0.023488] PM: Registered nosave memory: [mem 0x3e690000-0x3e690fff]
[    0.023489] PM: Registered nosave memory: [mem 0x3ee6b000-0x3ef2bfff]
[    0.023491] PM: Registered nosave memory: [mem 0x3f8ef000-0x3faeefff]
[    0.023492] PM: Registered nosave memory: [mem 0x3fb74000-0x3fb7efff]
[    0.023493] PM: Registered nosave memory: [mem 0x3fb7f000-0x3fbfefff]
[    0.023495] [mem 0x40000000-0xafffffff] available for PCI devices
[    0.023496] Booting paravirtualized kernel on KVM
[    0.023501] clocksource: refined-jiffies: mask: 0xffffffff max_cycles: 0xffffffff, max_idle_ns: 7645519600211568 ns
[    0.023508] setup_percpu: NR_CPUS:8192 nr_cpumask_bits:1 nr_cpu_ids:1 nr_node_ids:1
[    0.023905] percpu: Embedded 54 pages/cpu s184320 r8192 d28672 u2097152
[    0.023959] KVM setup async PF for cpu 0
[    0.023965] kvm-stealtime: cpu 0, msr 3e22c040
[    0.023987] Built 1 zonelists, mobility grouping on.  Total pages: 255036
[    0.023988] Policy zone: DMA32
[    0.023989] Kernel command line: BOOT_IMAGE=/boot/vmlinuz-5.4.0-47-generic root=PARTUUID=a97b4610-d527-40a0-8bbf-0df5b5a71b91 ro console=tty1 console=ttyS0 panic=-1
[    0.024638] Dentry cache hash table entries: 131072 (order: 8, 1048576 bytes, linear)
[    0.024934] Inode-cache hash table entries: 65536 (order: 7, 524288 bytes, linear)
[    0.024984] mem auto-init: stack:off, heap alloc:on, heap free:off
[    0.027130] Memory: 959116K/1044684K available (14339K kernel code, 2398K rwdata, 4956K rodata, 2716K init, 4988K bss, 85568K reserved, 0K cma-reserved)
[    0.027150] random: get_random_u64 called from kmem_cache_open+0x2d/0x410 with crng_init=0
[    0.027776] SLUB: HWalign=64, Order=0-3, MinObjects=0, CPUs=1, Nodes=1
[    0.027794] Kernel/User page tables isolation: enabled
[    0.027820] ftrace: allocating 44505 entries in 174 pages
[    0.045461] rcu: Hierarchical RCU implementation.
[    0.045463] rcu: 	RCU restricting CPUs from NR_CPUS=8192 to nr_cpu_ids=1.
[    0.045463] 	Tasks RCU enabled.
[    0.045464] rcu: RCU calculated value of scheduler-enlistment delay is 25 jiffies.
[    0.045465] rcu: Adjusting geometry for rcu_fanout_leaf=16, nr_cpu_ids=1
[    0.048215] NR_IRQS: 524544, nr_irqs: 256, preallocated irqs: 16
[    0.048425] Console: colour dummy device 80x25
[    0.048592] printk: console [tty1] enabled
[    0.262761] printk: console [ttyS0] enabled
[    0.263658] ACPI: Core revision 20190816
[    0.264749] clocksource: hpet: mask: 0xffffffff max_cycles: 0xffffffff, max_idle_ns: 19112604467 ns
[    0.267121] APIC: Switch to symmetric I/O mode setup
[    0.268686] x2apic enabled
[    0.269619] Switched APIC routing to physical x2apic.
[    0.270621] KVM setup pv IPIs
[    0.273785] ..TIMER: vector=0x30 apic1=0 pin1=2 apic2=-1 pin2=-1
[    0.275005] clocksource: tsc-early: mask: 0xffffffffffffffff max_cycles: 0x257a329839b, max_idle_ns: 440795202126 ns
[    0.277154] Calibrating delay loop (skipped) preset value.. 5199.98 BogoMIPS (lpj=10399960)
[    0.281156] pid_max: default: 32768 minimum: 301
[    0.284120] LSM: Security Framework initializing
[    0.285168] Yama: becoming mindful.
[    0.285896] AppArmor: AppArmor initialized
[    0.286761] Mount-cache hash table entries: 2048 (order: 2, 16384 bytes, linear)
[    0.288525] Mountpoint-cache hash table entries: 2048 (order: 2, 16384 bytes, linear)
[    0.289179] *** VALIDATE tmpfs ***
[    0.290026] *** VALIDATE proc ***
[    0.290753] *** VALIDATE cgroup1 ***
[    0.291458] *** VALIDATE cgroup2 ***
[    0.293265] x86/cpu: User Mode Instruction Prevention (UMIP) activated
[    0.295186] Last level iTLB entries: 4KB 0, 2MB 0, 4MB 0
[    0.296234] Last level dTLB entries: 4KB 0, 2MB 0, 4MB 0, 1GB 0
[    0.297161] Spectre V1 : Mitigation: usercopy/swapgs barriers and __user pointer sanitization
[    0.298824] Spectre V2 : Mitigation: Full generic retpoline
[    0.301153] Spectre V2 : Spectre v2 / SpectreRSB mitigation: Filling RSB on context switch
[    0.303244] Spectre V2 : Enabling Restricted Speculation for firmware calls
[    0.305156] Spectre V2 : mitigation: Enabling conditional Indirect Branch Prediction Barrier
[    0.307575] Speculative Store Bypass: Mitigation: Speculative Store Bypass disabled via prctl and seccomp
[    0.309157] MDS: Mitigation: Clear CPU buffers
[    0.318878] Freeing SMP alternatives memory: 40K
[    0.322906] smpboot: CPU0: Intel(R) Xeon(R) CPU E5-2670 0 @ 2.60GHz (family: 0x6, model: 0x2d, stepping: 0x7)
[    0.325025] Performance Events: SandyBridge events, Intel PMU driver.
[    0.325150] core: PEBS disabled due to CPU errata, please upgrade microcode
[    0.325165] ... version:                2
[    0.326381] ... bit width:              48
[    0.327279] ... generic registers:      4
[    0.328120] ... value mask:             0000ffffffffffff
[    0.329171] ... max period:             000000007fffffff
[    0.330405] ... fixed-purpose events:   3
[    0.331209] ... event mask:             000000070000000f
[    0.332417] rcu: Hierarchical SRCU implementation.
[    0.333905] smp: Bringing up secondary CPUs ...
[    0.334989] smp: Brought up 1 node, 1 CPU
[    0.336221] smpboot: Max logical packages: 1
[    0.337162] smpboot: Total of 1 processors activated (5199.98 BogoMIPS)
[    0.338734] devtmpfs: initialized
[    0.339458] x86/mm: Memory block size: 128MB
[    0.340602] PM: Registering ACPI NVS region [mem 0x3fb7f000-0x3fbfefff] (524288 bytes)
[    0.341240] clocksource: jiffies: mask: 0xffffffff max_cycles: 0xffffffff, max_idle_ns: 7645041785100000 ns
[    0.343963] futex hash table entries: 256 (order: 2, 16384 bytes, linear)
[    0.345264] pinctrl core: initialized pinctrl subsystem
[    0.346686] PM: RTC time: 08:42:34, date: 2020-09-15
[    0.348301] NET: Registered protocol family 16
[    0.349245] audit: initializing netlink subsys (disabled)
[    0.350451] EISA bus registered
[    0.351073] cpuidle: using governor ladder
[    0.351891] cpuidle: using governor menu
[    0.353222] KVM setup pv remote TLB flush
[    0.354320] ACPI: bus type PCI registered
[    0.355092] acpiphp: ACPI Hot Plug PCI Controller Driver version: 0.5
[    0.356521] PCI: MMCONFIG for domain 0000 [bus 00-ff] at [mem 0xb0000000-0xbfffffff] (base 0xb0000000)
[    0.357167] audit: type=2000 audit(1600159354.690:1): state=initialized audit_enabled=0 res=1
[    0.359274] PCI: MMCONFIG at [mem 0xb0000000-0xbfffffff] reserved in E820
[    0.360629] PCI: Using configuration type 1 for base access
[    0.361190] core: PMU erratum BJ122, BV98, HSD29 workaround disabled, HT off
[    0.364666] HugeTLB registered 1.00 GiB page size, pre-allocated 0 pages
[    0.365162] HugeTLB registered 2.00 MiB page size, pre-allocated 0 pages
[    0.367610] fbcon: Taking over console
[    0.368417] ACPI: Added _OSI(Module Device)
[    0.369163] ACPI: Added _OSI(Processor Device)
[    0.370271] ACPI: Added _OSI(3.0 _SCP Extensions)
[    0.371213] ACPI: Added _OSI(Processor Aggregator Device)
[    0.372314] ACPI: Added _OSI(Linux-Dell-Video)
[    0.373235] ACPI: Added _OSI(Linux-Lenovo-NV-HDMI-Audio)
[    0.374762] ACPI: Added _OSI(Linux-HPI-Hybrid-Graphics)
[    0.377582] ACPI: 1 ACPI AML tables successfully acquired and loaded
[    0.379676] ACPI: Interpreter enabled
[    0.380476] ACPI: (supports S0 S5)
[    0.381144] ACPI: Using IOAPIC for interrupt routing
[    0.381210] PCI: Using host bridge windows from ACPI; if necessary, use "pci=nocrs" and report a bug
[    0.383776] ACPI: Enabled 1 GPEs in block 00 to 3F
[    0.386892] ACPI: PCI Root Bridge [PCI0] (domain 0000 [bus 00-ff])
[    0.388102] acpi PNP0A08:00: _OSC: OS supports [ExtendedConfig ASPM ClockPM Segments MSI HPX-Type3]
[    0.389365] acpi PNP0A08:00: _OSC: platform does not support [LTR]
[    0.390708] acpi PNP0A08:00: _OSC: OS now controls [PCIeHotplug SHPCHotplug PME AER PCIeCapability]
[    0.392635] PCI host bridge to bus 0000:00
[    0.393159] pci_bus 0000:00: root bus resource [io  0x0000-0x0cf7 window]
[    0.394857] pci_bus 0000:00: root bus resource [io  0x0d00-0xffff window]
[    0.396153] pci_bus 0000:00: root bus resource [mem 0x000a0000-0x000bffff window]
[    0.397158] pci_bus 0000:00: root bus resource [mem 0x40000000-0xafffffff window]
[    0.399210] pci_bus 0000:00: root bus resource [mem 0xc0000000-0xfebfffff window]
[    0.400708] pci_bus 0000:00: root bus resource [mem 0x800000000-0xfffffffff window]
[    0.401159] pci_bus 0000:00: root bus resource [bus 00-ff]
[    0.402260] pci 0000:00:00.0: [8086:29c0] type 00 class 0x060000
[    0.404852] pci 0000:00:01.0: [1b36:000c] type 01 class 0x060400
[    0.408939] pci 0000:00:01.0: reg 0x10: [mem 0xc1245000-0xc1245fff]
[    0.417171] pci 0000:00:01.1: [1b36:000c] type 01 class 0x060400
[    0.421161] pci 0000:00:01.1: reg 0x10: [mem 0xc1244000-0xc1244fff]
[    0.428554] pci 0000:00:01.2: [1b36:000c] type 01 class 0x060400
[    0.431118] pci 0000:00:01.2: reg 0x10: [mem 0xc1243000-0xc1243fff]
[    0.437831] pci 0000:00:01.3: [1b36:000c] type 01 class 0x060400
[    0.442942] pci 0000:00:01.3: reg 0x10: [mem 0xc1242000-0xc1242fff]
[    0.452998] pci 0000:00:01.4: [1b36:000c] type 01 class 0x060400
[    0.457858] pci 0000:00:01.4: reg 0x10: [mem 0xc1241000-0xc1241fff]
[    0.473147] pci 0000:00:1f.0: [8086:2918] type 00 class 0x060100
[    0.473817] pci 0000:00:1f.0: quirk: [io  0x0600-0x067f] claimed by ICH6 ACPI/GPIO/TCO
[    0.475783] pci 0000:00:1f.2: [8086:2922] type 00 class 0x010601
[    0.487223] pci 0000:00:1f.2: reg 0x20: [io  0xa240-0xa25f]
[    0.490446] pci 0000:00:1f.2: reg 0x24: [mem 0xc1240000-0xc1240fff]
[    0.493440] pci 0000:00:1f.3: [8086:2930] type 00 class 0x0c0500
[    0.500708] pci 0000:00:1f.3: reg 0x20: [io  0xa200-0xa23f]
[    0.503866] pci 0000:01:00.0: [1af4:1045] type 00 class 0x00ff00
[    0.508807] pci 0000:01:00.0: reg 0x20: [mem 0x800014000-0x800017fff 64bit pref]
[    0.511606] pci 0000:01:00.1: [1af4:1044] type 00 class 0x00ff00
[    0.516289] pci 0000:01:00.1: reg 0x20: [mem 0x800010000-0x800013fff 64bit pref]
[    0.518852] pci 0000:01:00.2: [1af4:1052] type 00 class 0x090000
[    0.522948] pci 0000:01:00.2: reg 0x14: [mem 0xc1003000-0xc1003fff]
[    0.529803] pci 0000:01:00.2: reg 0x20: [mem 0x80000c000-0x80000ffff 64bit pref]
[    0.533427] pci 0000:01:00.3: [1af4:1052] type 00 class 0x098000
[    0.537927] pci 0000:01:00.3: reg 0x14: [mem 0xc1002000-0xc1002fff]
[    0.544805] pci 0000:01:00.3: reg 0x20: [mem 0x800008000-0x80000bfff 64bit pref]
[    0.547364] pci 0000:01:00.4: [1af4:1053] type 00 class 0x078000
[    0.552594] pci 0000:01:00.4: reg 0x14: [mem 0xc1001000-0xc1001fff]
[    0.556779] pci 0000:01:00.4: reg 0x20: [mem 0x800004000-0x800007fff 64bit pref]
[    0.559383] pci 0000:01:00.5: [1af4:1043] type 00 class 0x078000
[    0.562884] pci 0000:01:00.5: reg 0x14: [mem 0xc1000000-0xc1000fff]
[    0.569160] pci 0000:01:00.5: reg 0x20: [mem 0x800000000-0x800003fff 64bit pref]
[    0.581527] pci 0000:00:01.0: PCI bridge to [bus 01]
[    0.582504] pci 0000:00:01.0:   bridge window [io  0xa000-0xafff]
[    0.585178] pci 0000:00:01.0:   bridge window [mem 0xc1000000-0xc11fffff]
[    0.586510] pci 0000:00:01.0:   bridge window [mem 0x800000000-0x8000fffff 64bit pref]
[    0.590135] pci 0000:02:00.0: [1af4:1048] type 00 class 0x010000
[    0.594945] pci 0000:02:00.0: reg 0x14: [mem 0xc0e00000-0xc0e00fff]
[    0.602408] pci 0000:02:00.0: reg 0x20: [mem 0x800100000-0x800103fff 64bit pref]
[    0.615338] pci 0000:00:01.1: PCI bridge to [bus 02]
[    0.616357] pci 0000:00:01.1:   bridge window [io  0x9000-0x9fff]
[    0.617178] pci 0000:00:01.1:   bridge window [mem 0xc0e00000-0xc0ffffff]
[    0.618529] pci 0000:00:01.1:   bridge window [mem 0x800100000-0x8001fffff 64bit pref]
[    0.622111] pci 0000:03:00.0: [1af4:1049] type 00 class 0x000200
[    0.627040] pci 0000:03:00.0: reg 0x14: [mem 0xc0c00000-0xc0c00fff]
[    0.633831] pci 0000:03:00.0: reg 0x20: [mem 0x800200000-0x800203fff 64bit pref]
[    0.646452] pci 0000:00:01.2: PCI bridge to [bus 03]
[    0.647747] pci 0000:00:01.2:   bridge window [io  0x8000-0x8fff]
[    0.649191] pci 0000:00:01.2:   bridge window [mem 0xc0c00000-0xc0dfffff]
[    0.651065] pci 0000:00:01.2:   bridge window [mem 0x800200000-0x8002fffff 64bit pref]
[    0.654061] pci 0000:04:00.0: [1af4:1050] type 00 class 0x030000
[    0.658600] pci 0000:04:00.0: reg 0x10: [mem 0xc0000000-0xc07fffff pref]
[    0.665203] pci 0000:04:00.0: reg 0x18: [mem 0x800300000-0x800303fff 64bit pref]
[    0.669144] pci 0000:04:00.0: reg 0x20: [mem 0xc0800000-0xc0800fff]
[    0.675103] pci 0000:04:00.0: reg 0x30: [mem 0xffff0000-0xffffffff pref]
[    0.676856] pci 0000:04:00.0: BAR 0: assigned to efifb
[    0.687175] pci 0000:00:01.3: PCI bridge to [bus 04]
[    0.688192] pci 0000:00:01.3:   bridge window [io  0x7000-0x7fff]
[    0.689179] pci 0000:00:01.3:   bridge window [mem 0xc0000000-0xc08fffff]
[    0.690535] pci 0000:00:01.3:   bridge window [mem 0x800300000-0x8003fffff 64bit pref]
[    0.693556] pci 0000:05:00.0: [1af4:1041] type 00 class 0x020000
[    0.697159] pci 0000:05:00.0: reg 0x14: [mem 0xc0a00000-0xc0a00fff]
[    0.703739] pci 0000:05:00.0: reg 0x20: [mem 0x800400000-0x800403fff 64bit pref]
[    0.706369] pci 0000:05:00.0: reg 0x30: [mem 0xfffc0000-0xffffffff pref]
[    0.718421] pci 0000:00:01.4: PCI bridge to [bus 05]
[    0.719458] pci 0000:00:01.4:   bridge window [io  0x6000-0x6fff]
[    0.720664] pci 0000:00:01.4:   bridge window [mem 0xc0a00000-0xc0bfffff]
[    0.721200] pci 0000:00:01.4:   bridge window [mem 0x800400000-0x8004fffff 64bit pref]
[    0.730061] ACPI: PCI Interrupt Link [LNKA] (IRQs 5 *10 11)
[    0.731374] ACPI: PCI Interrupt Link [LNKB] (IRQs 5 *10 11)
[    0.732599] ACPI: PCI Interrupt Link [LNKC] (IRQs 5 10 *11)
[    0.733318] ACPI: PCI Interrupt Link [LNKD] (IRQs 5 10 *11)
[    0.734529] ACPI: PCI Interrupt Link [LNKE] (IRQs 5 *10 11)
[    0.736152] ACPI: PCI Interrupt Link [LNKF] (IRQs 5 *10 11)
[    0.737297] ACPI: PCI Interrupt Link [LNKG] (IRQs 5 10 *11)
[    0.738862] ACPI: PCI Interrupt Link [LNKH] (IRQs 5 10 *11)
[    0.740603] ACPI: PCI Interrupt Link [GSIA] (IRQs *16)
[    0.741207] ACPI: PCI Interrupt Link [GSIB] (IRQs *17)
[    0.742468] ACPI: PCI Interrupt Link [GSIC] (IRQs *18)
[    0.743671] ACPI: PCI Interrupt Link [GSID] (IRQs *19)
[    0.744721] ACPI: PCI Interrupt Link [GSIE] (IRQs *20)
[    0.745172] ACPI: PCI Interrupt Link [GSIF] (IRQs *21)
[    0.746215] ACPI: PCI Interrupt Link [GSIG] (IRQs *22)
[    0.747675] ACPI: PCI Interrupt Link [GSIH] (IRQs *23)
[    0.749350] iommu: Default domain type: Translated 
[    0.750677] SCSI subsystem initialized
[    0.751626] pci 0000:04:00.0: vgaarb: setting as boot VGA device
[    0.752846] pci 0000:04:00.0: vgaarb: VGA device added: decodes=io+mem,owns=io+mem,locks=none
[    0.753159] pci 0000:04:00.0: vgaarb: bridge control possible
[    0.755103] vgaarb: loaded
[    0.755685] ACPI: bus type USB registered
[    0.756524] usbcore: registered new interface driver usbfs
[    0.757178] usbcore: registered new interface driver hub
[    0.758510] usbcore: registered new device driver usb
[    0.759857] pps_core: LinuxPPS API ver. 1 registered
[    0.760825] pps_core: Software ver. 5.3.6 - Copyright 2005-2007 Rodolfo Giometti <giometti@linux.it>
[    0.761161] PTP clock support registered
[    0.762165] EDAC MC: Ver: 3.0.0
[    0.763820] Registered efivars operations
[    0.764750] PCI: Using ACPI for IRQ routing
[    0.909536] pci 0000:00:1f.2: can't claim BAR 4 [io  0xa240-0xa25f]: address conflict with PCI Bus 0000:01 [io  0xa000-0xafff]
[    0.911976] pci 0000:00:1f.3: can't claim BAR 4 [io  0xa200-0xa23f]: address conflict with PCI Bus 0000:01 [io  0xa000-0xafff]
[    0.913680] NetLabel: Initializing
[    0.914375] NetLabel:  domain hash size = 128
[    0.915250] NetLabel:  protocols = UNLABELED CIPSOv4 CALIPSO
[    0.916422] NetLabel:  unlabeled traffic allowed by default
[    0.917484] hpet0: at MMIO 0xfed00000, IRQs 2, 8, 0
[    0.918647] hpet0: 3 comparators, 64-bit 100.000000 MHz counter
[    0.923281] clocksource: Switched to clocksource kvm-clock
[    0.935187] *** VALIDATE bpf ***
[    0.935990] VFS: Disk quotas dquot_6.6.0
[    0.936790] VFS: Dquot-cache hash table entries: 512 (order 0, 4096 bytes)
[    0.938453] *** VALIDATE ramfs ***
[    0.939683] *** VALIDATE hugetlbfs ***
[    0.940549] AppArmor: AppArmor Filesystem Enabled
[    0.941512] pnp: PnP ACPI init
[    0.942673] pnp: PnP ACPI: found 4 devices
[    0.944835] thermal_sys: Registered thermal governor 'fair_share'
[    0.944836] thermal_sys: Registered thermal governor 'bang_bang'
[    0.946038] thermal_sys: Registered thermal governor 'step_wise'
[    0.947366] thermal_sys: Registered thermal governor 'user_space'
[    0.948914] thermal_sys: Registered thermal governor 'power_allocator'
[    0.954704] clocksource: acpi_pm: mask: 0xffffff max_cycles: 0xffffff, max_idle_ns: 2085701024 ns
[    0.957943] pci 0000:04:00.0: can't claim BAR 6 [mem 0xffff0000-0xffffffff pref]: no compatible bridge window
[    0.959946] pci 0000:05:00.0: can't claim BAR 6 [mem 0xfffc0000-0xffffffff pref]: no compatible bridge window
[    0.961945] pci 0000:00:1f.3: BAR 4: assigned [io  0x1000-0x103f]
[    0.964424] pci 0000:00:1f.2: BAR 4: assigned [io  0x1040-0x105f]
[    0.966775] pci 0000:00:01.0: PCI bridge to [bus 01]
[    0.967841] pci 0000:00:01.0:   bridge window [io  0xa000-0xafff]
[    0.970866] pci 0000:00:01.0:   bridge window [mem 0xc1000000-0xc11fffff]
[    0.973235] pci 0000:00:01.0:   bridge window [mem 0x800000000-0x8000fffff 64bit pref]
[    0.977434] pci 0000:00:01.1: PCI bridge to [bus 02]
[    0.978800] pci 0000:00:01.1:   bridge window [io  0x9000-0x9fff]
[    0.982796] pci 0000:00:01.1:   bridge window [mem 0xc0e00000-0xc0ffffff]
[    0.986744] pci 0000:00:01.1:   bridge window [mem 0x800100000-0x8001fffff 64bit pref]
[    0.989726] pci 0000:00:01.2: PCI bridge to [bus 03]
[    0.990687] pci 0000:00:01.2:   bridge window [io  0x8000-0x8fff]
[    0.993322] pci 0000:00:01.2:   bridge window [mem 0xc0c00000-0xc0dfffff]
[    0.995732] pci 0000:00:01.2:   bridge window [mem 0x800200000-0x8002fffff 64bit pref]
[    0.999633] pci 0000:04:00.0: BAR 6: assigned [mem 0xc0810000-0xc081ffff pref]
[    1.001058] pci 0000:00:01.3: PCI bridge to [bus 04]
[    1.002113] pci 0000:00:01.3:   bridge window [io  0x7000-0x7fff]
[    1.005136] pci 0000:00:01.3:   bridge window [mem 0xc0000000-0xc08fffff]
[    1.007174] pci 0000:00:01.3:   bridge window [mem 0x800300000-0x8003fffff 64bit pref]
[    1.010774] pci 0000:05:00.0: BAR 6: assigned [mem 0xc0a40000-0xc0a7ffff pref]
[    1.012218] pci 0000:00:01.4: PCI bridge to [bus 05]
[    1.013218] pci 0000:00:01.4:   bridge window [io  0x6000-0x6fff]
[    1.015804] pci 0000:00:01.4:   bridge window [mem 0xc0a00000-0xc0bfffff]
[    1.019866] pci 0000:00:01.4:   bridge window [mem 0x800400000-0x8004fffff 64bit pref]
[    1.023475] pci_bus 0000:00: resource 4 [io  0x0000-0x0cf7 window]
[    1.024761] pci_bus 0000:00: resource 5 [io  0x0d00-0xffff window]
[    1.026055] pci_bus 0000:00: resource 6 [mem 0x000a0000-0x000bffff window]
[    1.027414] pci_bus 0000:00: resource 7 [mem 0x40000000-0xafffffff window]
[    1.029228] pci_bus 0000:00: resource 8 [mem 0xc0000000-0xfebfffff window]
[    1.030572] pci_bus 0000:00: resource 9 [mem 0x800000000-0xfffffffff window]
[    1.031947] pci_bus 0000:01: resource 0 [io  0xa000-0xafff]
[    1.033066] pci_bus 0000:01: resource 1 [mem 0xc1000000-0xc11fffff]
[    1.035036] pci_bus 0000:01: resource 2 [mem 0x800000000-0x8000fffff 64bit pref]
[    1.036751] pci_bus 0000:02: resource 0 [io  0x9000-0x9fff]
[    1.038170] pci_bus 0000:02: resource 1 [mem 0xc0e00000-0xc0ffffff]
[    1.039739] pci_bus 0000:02: resource 2 [mem 0x800100000-0x8001fffff 64bit pref]
[    1.041659] pci_bus 0000:03: resource 0 [io  0x8000-0x8fff]
[    1.042761] pci_bus 0000:03: resource 1 [mem 0xc0c00000-0xc0dfffff]
[    1.043981] pci_bus 0000:03: resource 2 [mem 0x800200000-0x8002fffff 64bit pref]
[    1.045703] pci_bus 0000:04: resource 0 [io  0x7000-0x7fff]
[    1.046906] pci_bus 0000:04: resource 1 [mem 0xc0000000-0xc08fffff]
[    1.048633] pci_bus 0000:04: resource 2 [mem 0x800300000-0x8003fffff 64bit pref]
[    1.050098] pci_bus 0000:05: resource 0 [io  0x6000-0x6fff]
[    1.051174] pci_bus 0000:05: resource 1 [mem 0xc0a00000-0xc0bfffff]
[    1.052413] pci_bus 0000:05: resource 2 [mem 0x800400000-0x8004fffff 64bit pref]
[    1.054724] NET: Registered protocol family 2
[    1.056024] tcp_listen_portaddr_hash hash table entries: 512 (order: 1, 8192 bytes, linear)
[    1.058244] TCP established hash table entries: 8192 (order: 4, 65536 bytes, linear)
[    1.060487] TCP bind hash table entries: 8192 (order: 5, 131072 bytes, linear)
[    1.061964] TCP: Hash tables configured (established 8192 bind 8192)
[    1.063318] UDP hash table entries: 512 (order: 2, 16384 bytes, linear)
[    1.064632] UDP-Lite hash table entries: 512 (order: 2, 16384 bytes, linear)
[    1.066879] NET: Registered protocol family 1
[    1.067765] NET: Registered protocol family 44
[    1.068957] pci 0000:04:00.0: Video device with shadowed ROM at [mem 0x000c0000-0x000dffff]
[    1.070734] PCI: CLS 0 bytes, default 64
[    1.071839] clocksource: tsc: mask: 0xffffffffffffffff max_cycles: 0x257a329839b, max_idle_ns: 440795202126 ns
[    1.074207] check: Scanning for low memory corruption every 60 seconds
[    1.076117] Initialise system trusted keyrings
[    1.077086] Key type blacklist registered
[    1.078027] workingset: timestamp_bits=36 max_order=18 bucket_order=0
[    1.081689] zbud: loaded
[    1.082578] squashfs: version 4.0 (2009/01/31) Phillip Lougher
[    1.083905] fuse: init (API version 7.31)
[    1.084767] *** VALIDATE fuse ***
[    1.085524] *** VALIDATE fuse ***
[    1.086452] Platform Keyring initialized
[    1.091367] Key type asymmetric registered
[    1.092206] Asymmetric key parser 'x509' registered
[    1.093177] Block layer SCSI generic (bsg) driver version 0.4 loaded (major 244)
[    1.094733] io scheduler mq-deadline registered
[    1.096456] PCI Interrupt Link [GSIF] enabled at IRQ 21
[    1.098899] pcieport 0000:00:01.0: PME: Signaling with IRQ 24
[    1.100431] pcieport 0000:00:01.0: AER: enabled with IRQ 24
[    1.101678] pcieport 0000:00:01.0: pciehp: Slot #0 AttnBtn+ PwrCtrl+ MRL- AttnInd+ PwrInd+ HotPlug+ Surprise+ Interlock+ NoCompl- LLActRep+
[    1.106599] pcieport 0000:00:01.1: PME: Signaling with IRQ 25
[    1.107929] pcieport 0000:00:01.1: AER: enabled with IRQ 25
[    1.109080] pcieport 0000:00:01.1: pciehp: Slot #0 AttnBtn+ PwrCtrl+ MRL- AttnInd+ PwrInd+ HotPlug+ Surprise+ Interlock+ NoCompl- LLActRep+
[    1.113867] pcieport 0000:00:01.2: PME: Signaling with IRQ 26
[    1.115254] pcieport 0000:00:01.2: AER: enabled with IRQ 26
[    1.116407] pcieport 0000:00:01.2: pciehp: Slot #0 AttnBtn+ PwrCtrl+ MRL- AttnInd+ PwrInd+ HotPlug+ Surprise+ Interlock+ NoCompl- LLActRep+
[    1.121329] pcieport 0000:00:01.3: PME: Signaling with IRQ 27
[    1.123122] pcieport 0000:00:01.3: AER: enabled with IRQ 27
[    1.124538] pcieport 0000:00:01.3: pciehp: Slot #0 AttnBtn+ PwrCtrl+ MRL- AttnInd+ PwrInd+ HotPlug+ Surprise+ Interlock+ NoCompl- LLActRep+
[    1.129857] pcieport 0000:00:01.4: PME: Signaling with IRQ 28
[    1.131437] pcieport 0000:00:01.4: AER: enabled with IRQ 28
[    1.132827] pcieport 0000:00:01.4: pciehp: Slot #0 AttnBtn+ PwrCtrl+ MRL- AttnInd+ PwrInd+ HotPlug+ Surprise+ Interlock+ NoCompl- LLActRep+
[    1.136444] shpchp: Standard Hot Plug PCI Controller Driver version: 0.4
[    1.137898] efifb: probing for efifb
[    1.138619] efifb: framebuffer at 0xc0000000, using 1876k, total 1875k
[    1.140239] efifb: mode is 800x600x32, linelength=3200, pages=1
[    1.141857] efifb: scrolling: redraw
[    1.142559] efifb: Truecolor: size=8:8:8:8, shift=24:16:8:0
[    1.143870] Console: switching to colour frame buffer device 100x37
[    1.146803] fb0: EFI VGA frame buffer device
[    1.148064] input: Power Button as /devices/LNXSYSTM:00/LNXPWRBN:00/input/input0
[    1.150685] ACPI: Power Button [PWRF]
[    1.169859] Serial: 8250/16550 driver, 32 ports, IRQ sharing enabled
[    1.197552] 00:02: ttyS0 at I/O 0x3f8 (irq = 4, base_baud = 115200) is a 16550A
[    1.228853] Linux agpgart interface v0.103
[    1.233712] loop: module loaded
[    1.235210] libphy: Fixed MDIO Bus: probed
[    1.236666] tun: Universal TUN/TAP device driver, 1.6
[    1.238447] PPP generic driver version 2.4.2
[    1.239677] VFIO - User Level meta-driver version: 0.3
[    1.240802] ehci_hcd: USB 2.0 'Enhanced' Host Controller (EHCI) Driver
[    1.243122] ehci-pci: EHCI PCI platform driver
[    1.244578] ehci-platform: EHCI generic platform driver
[    1.246281] ohci_hcd: USB 1.1 'Open' Host Controller (OHCI) Driver
[    1.248210] ohci-pci: OHCI PCI platform driver
[    1.250055] ohci-platform: OHCI generic platform driver
[    1.251505] uhci_hcd: USB Universal Host Controller Interface driver
[    1.253420] i8042: PNP: PS/2 Controller [PNP0303:KBD,PNP0f13:MOU] at 0x60,0x64 irq 1,12
[    1.256500] serio: i8042 KBD port at 0x60,0x64 irq 1
[    1.258350] serio: i8042 AUX port at 0x60,0x64 irq 12
[    1.263421] mousedev: PS/2 mouse device common for all mice
[    1.265536] input: AT Translated Set 2 keyboard as /devices/platform/i8042/serio0/input/input1
[    1.268447] rtc_cmos 00:03: RTC can wake from S4
[    1.270750] rtc_cmos 00:03: registered as rtc0
[    1.272133] rtc_cmos 00:03: alarms up to one day, y3k, 242 bytes nvram, hpet irqs
[    1.274784] i2c /dev entries driver
[    1.276192] device-mapper: uevent: version 1.0.3
[    1.277830] device-mapper: ioctl: 4.41.0-ioctl (2019-09-16) initialised: dm-devel@redhat.com
[    1.280665] platform eisa.0: Probing EISA bus 0
[    1.282221] platform eisa.0: EISA: Cannot allocate resource for mainboard
[    1.284147] platform eisa.0: Cannot allocate resource for EISA slot 1
[    1.286415] platform eisa.0: Cannot allocate resource for EISA slot 2
[    1.288647] platform eisa.0: Cannot allocate resource for EISA slot 3
[    1.290631] platform eisa.0: Cannot allocate resource for EISA slot 4
[    1.295132] platform eisa.0: Cannot allocate resource for EISA slot 5
[    1.297208] platform eisa.0: Cannot allocate resource for EISA slot 6
[    1.299524] platform eisa.0: Cannot allocate resource for EISA slot 7
[    1.301231] platform eisa.0: Cannot allocate resource for EISA slot 8
[    1.303083] platform eisa.0: EISA: Detected 0 cards
[    1.304447] intel_pstate: CPU model not supported
[    1.306153] ledtrig-cpu: registered to indicate activity on CPUs
[    1.308155] EFI Variables Facility v0.08 2004-May-17
[    1.310303] drop_monitor: Initializing network drop monitor service
[    1.312215] NET: Registered protocol family 10
[    1.314217] Segment Routing with IPv6
[    1.315505] NET: Registered protocol family 17
[    1.317237] Key type dns_resolver registered
[    1.318744] RAS: Correctable Errors collector initialized.
[    1.320305] IPI shorthand broadcast: enabled
[    1.322143] sched_clock: Marking stable (1105311092, 216786990)->(1392593579, -70495497)
[    1.327569] registered taskstats version 1
[    1.328861] Loading compiled-in X.509 certificates
[    1.331184] Loaded X.509 cert 'Build time autogenerated kernel key: 52d16be8a47f13ed569e4734dd7da053d9d3759d'
[    1.334229] zswap: loaded using pool lzo/zbud
[    1.335634] Key type ._fscrypt registered
[    1.336898] Key type .fscrypt registered
[    1.338864] Key type big_key registered
[    1.340817] Key type encrypted registered
[    1.342102] AppArmor: AppArmor sha1 policy hashing enabled
[    1.343656] integrity: Loading X.509 certificate: UEFI:db
[    1.345486] integrity: Loaded X.509 cert 'Microsoft Windows Production PCA 2011: a92902398e16c49778cd90f99e4f9ae17c55af53'
[    1.349100] integrity: Loading X.509 certificate: UEFI:db
[    1.350660] integrity: Loaded X.509 cert 'Microsoft Corporation UEFI CA 2011: 13adbf4309bd82709c8cd54f316ed522988a1bd4'
[    1.354518] ima: No TPM chip found, activating TPM-bypass!
[    1.358671] ima: Allocated hash algorithm: sha1
[    1.360013] ima: No architecture policies found
[    1.361386] evm: Initialising EVM extended attributes:
[    1.363137] evm: security.selinux
[    1.364608] evm: security.SMACK64
[    1.365776] evm: security.SMACK64EXEC
[    1.366908] evm: security.SMACK64TRANSMUTE
[    1.368123] evm: security.SMACK64MMAP
[    1.369527] evm: security.apparmor
[    1.371263] evm: security.ima
[    1.372247] evm: security.capability
[    1.373361] evm: HMAC attrs: 0x1
[    1.374750] PM:   Magic number: 4:676:725
[    1.375914] block loop5: hash matches
[    1.377037] virtio-pci 0000:01:00.0: hash matches
[    1.378587] rtc_cmos 00:03: setting system clock to 2020-09-15T08:42:35 UTC (1600159355)
[    1.381642] Lockdown: swapper/0: hibernation is restricted; see man kernel_lockdown.7
[    1.384440] md: Waiting for all devices to be available before autodetect
[    1.387076] md: If you don't use raid, use raid=noautodetect
[    1.390211] md: Autodetecting RAID arrays.
[    1.391648] md: autorun ...
[    1.392766] md: ... autorun DONE.
[    1.394112] VFS: Cannot open root device "PARTUUID=a97b4610-d527-40a0-8bbf-0df5b5a71b91" or unknown-block(0,0): error -6
[    1.397639] Please append a correct "root=" boot option; here are the available partitions:
[    1.399974] Kernel panic - not syncing: VFS: Unable to mount root fs on unknown-block(0,0)
[    1.402462] CPU: 0 PID: 1 Comm: swapper/0 Not tainted 5.4.0-47-generic #51-Ubuntu
[    1.404496] Hardware name: QEMU Standard PC (Q35 + ICH9, 2009)/LXD, BIOS 0.0.0 02/06/2015
[    1.407169] Call Trace:
[    1.408460]  dump_stack+0x6d/0x9a
[    1.409649]  panic+0x101/0x2e3
[    1.410714]  mount_block_root+0x23f/0x2e8
[    1.411952]  mount_root+0x38/0x3a
[    1.413067]  prepare_namespace+0x13f/0x194
[    1.414933]  kernel_init_freeable+0x231/0x255
[    1.416599]  ? rest_init+0xb0/0xb0
[    1.420104]  kernel_init+0xe/0x100
[    1.421274]  ret_from_fork+0x35/0x40
[    1.422971] Kernel Offset: 0xb400000 from 0xffffffff81000000 (relocation range: 0xffffffff80000000-0xffffffffbfffffff)
[    1.426730] ACPI MEMORY or I/O RESET_REG.

It looks like the disk device UUID of the copy VM is identical to the original VM. Is it suppose to be like that?

[    1.394112]  VFS: Cannot open root device "PARTUUID=a97b4610-d527-40a0-8bbf-0df5b5a71b91" or unknown-block(0,0): error -6
[    1.397639] Please append a correct "root=" boot option; here are the available partitions:
[    1.399974] Kernel panic - not syncing: VFS: Unable to mount root fs on unknown-block(0,0)

stgraber · September 15, 2020, 3:34pm

Yeah, the partition UUIDs won’t change on company, that’s normal.
I’m not sure why the copy is breaking the block device though.

Anything relevant in dmesg on the hosts?

You could also do a sanity check of the raw disk file on source and target to see if it’s the same size and maybe even hash it to confirm it’s identical. If not, then we may have some kind of migration problem, though that’d be a bit confusing given we use native btrfs send/receive for such copies…

ykazakov · September 15, 2020, 7:11pm

Sorry, scratch my previous post. It does not show the problem with the copy. Although there is an error with the root device (which actually happens on both VMs) the VMs seem to boot fine.

However, now I think I can reliably reproduce the real problem. I think the problem appears when I create a snapshot while the VM is running:

$ lxc launch ubuntu:focal ubuntu1 --vm --target host1
Creating ubuntu1
Starting ubuntu1
$ lxc snapshot ubuntu1 test
$ lxc stop ubuntu1
$ lxc cp ubuntu1 ubuntu2 --target host2
$ lxc start ubuntu2 && lxc console ubuntu2
To detach from the console, press: <ctrl>+a q
BdsDxe: loading Boot0001 "UEFI QEMU QEMU HARDDISK " from PciRoot(0x0)/Pci(0x1,0x1)/Pci(0x0,0x0)/Scsi(0x0,0x1)
BdsDxe: starting Boot0001 "UEFI QEMU QEMU HARDDISK " from PciRoot(0x0)/Pci(0x1,0x1)/Pci(0x0,0x0)/Scsi(0x0,0x1)
error: unknown filesystem.
error: no such device: /.disk/info.
error: no such device: /.disk/mini-info.


                             GNU GRUB  version 2.04

   Minimal BASH-like line editing is supported. For the first word, TAB   
   lists possible command completions. Anywhere else TAB lists possible   
   device or file completions.                                            


grub>

Note that I do not copy the snapshot but the whole VM after it was stopped. So I am not sure why a snapshot can cause a problem.

stgraber · September 15, 2020, 8:47pm

@tomp can you look into this?

tomp · September 16, 2020, 7:48am

Looking into now.

tomp · September 16, 2020, 10:28am

@stgraber

I’ve recreated the issue, it appears to be exacerbated by the btrfs.mount_options: compress=lzo setting when used with the optimised BTRFS send migration method. Although I’ve seen it occur (although much less frequently) when using no compression and with compression of zlib too.

I was able to recreate it by copying a VM between two local BTRFS storage pools (called btrfs1 and btrfs2) and then doing a lxc copy v1 v2 -s btrfs2 as this uses the same migration protocol as used when copying between remote hosts.

However, note, simply removing the compress option is not sufficient for it to be removed. One must either unmount the pool and restart LXD or use the compress=no option.

Additionally, any VMs created whilst compression was enabled will still exhibit the issue even with compression turned off (presumably because the files themselves are still compressed and the mount option only affects new files/blocks).

I tried the same approach we used to get stability when using VM image files on top of ZFS, by enabling the aio threads mode and using writeback cache mode and have not been able to reproduced since making that change (even when using both lzo compression and no compression).

ykazakov · September 16, 2020, 10:38am

@tomp Wow, thanks a lot for the excellent research!
Could the compression also explain why I cannot seem to lunch the images:ubuntu/focal VM and also the missing root device error in the console for the ubuntu:focal VM?

tomp · September 16, 2020, 11:18am

Yes potentially, have you tried launching it on a non-btrfs or btrfs without compression pool?