Hi Simos,
Thanks for the detailed and helpful write up. Frustratingly I still can’t get the inner VM to boot, it gets stuck a little further down the line in the boot process.
I believe I have followed the steps in the article as closely as possible and I suspect there is something in my particular hardware config that is causing the problem, given that it worked for you.
Here is the output of virt-host-validate inside the outervm
root@outervm:~# virt-host-validate
QEMU: Checking for hardware virtualization : PASS
QEMU: Checking if device /dev/kvm exists : PASS
QEMU: Checking if device /dev/kvm is accessible : PASS
QEMU: Checking if device /dev/vhost-net exists : PASS
QEMU: Checking if device /dev/net/tun exists : PASS
QEMU: Checking for cgroup 'cpu' controller support : PASS
QEMU: Checking for cgroup 'cpuacct' controller support : PASS
QEMU: Checking for cgroup 'cpuset' controller support : PASS
QEMU: Checking for cgroup 'memory' controller support : PASS
QEMU: Checking for cgroup 'devices' controller support : PASS
QEMU: Checking for cgroup 'blkio' controller support : PASS
QEMU: Checking for device assignment IOMMU support : WARN (No ACPI IVRS table found, IOMMU either disabled in BIOS or not supported by this hardware platform)
QEMU: Checking for secure guest support : WARN (Unknown if this platform has Secure Guest support)
LXC: Checking for Linux >= 2.6.26 : PASS
LXC: Checking for namespace ipc : PASS
LXC: Checking for namespace mnt : PASS
LXC: Checking for namespace pid : PASS
LXC: Checking for namespace uts : PASS
LXC: Checking for namespace net : PASS
LXC: Checking for namespace user : PASS
LXC: Checking for cgroup 'cpu' controller support : PASS
LXC: Checking for cgroup 'cpuacct' controller support : PASS
LXC: Checking for cgroup 'cpuset' controller support : PASS
LXC: Checking for cgroup 'memory' controller support : PASS
LXC: Checking for cgroup 'devices' controller support : PASS
LXC: Checking for cgroup 'freezer' controller support : PASS
LXC: Checking for cgroup 'blkio' controller support : PASS
LXC: Checking if device /sys/fs/fuse/connections exists : PASS
The kernel cmdline
root@outervm:~# cat /proc/cmdline
BOOT_IMAGE=/boot/vmlinuz-6.1.0-18-amd64 root=UUID=6242d71c-4a8f-4891-b80f-69ab0b5592e8 ro quiet amd_iommu=on systemd.unified_cgroup_hierarchy=0 console=tty1 console=ttyS0
and the boot log when launching the inner VM with --console
BdsDxe: loading Boot0001 "UEFI QEMU QEMU HARDDISK " from PciRoot(0x0)/Pci(0x1,0x1)/Pci(0x0,0x0)/Scsi(0x0,0x1)
BdsDxe: starting Boot0001 "UEFI QEMU QEMU HARDDISK " from PciRoot(0x0)/Pci(0x1,0x1)/Pci(0x0,0x0)/Scsi(0x0,0x1)
Booting `Alpine Linux v3.19'
Loading Linux virt ...
Loading initial ramdisk ...
EFI stub: Loaded initrd from LINUX_EFI_INITRD_MEDIA_GUID device path
[ 0.000000] Linux version 6.6.22-1-virt (buildozer@build-edge-x86_64) (gcc (Alpine 13.2.1_git20240309) 13.2.1 20240309, GNU ld (GNU Binutils) 2.42) #2-Alpine SMP PREEMPT_DYNAMIC Thu, 14 Mar 2024 02:12:52 +0000
[ 0.000000] Command line: BOOT_IMAGE=/boot/vmlinuz-virt root=UUID=8cf64ddd-9d2e-4f85-ab17-5fff228581e2 ro console=tty1 console=ttyS0 modules=sd-mod,usb-storage,ext4 rootfstype=ext4
[ 0.000000] BIOS-provided physical RAM map:
[ 0.000000] BIOS-e820: [mem 0x0000000000000000-0x000000000009ffff] usable
[ 0.000000] BIOS-e820: [mem 0x0000000000100000-0x000000003ecaffff] usable
[ 0.000000] BIOS-e820: [mem 0x000000003ecb0000-0x000000003ed70fff] reserved
[ 0.000000] BIOS-e820: [mem 0x000000003ed71000-0x000000003f23bfff] usable
[ 0.000000] BIOS-e820: [mem 0x000000003f23c000-0x000000003f27cfff] reserved
[ 0.000000] BIOS-e820: [mem 0x000000003f27d000-0x000000003f8ecfff] usable
[ 0.000000] BIOS-e820: [mem 0x000000003f8ed000-0x000000003faecfff] reserved
[ 0.000000] BIOS-e820: [mem 0x000000003faed000-0x000000003fb6efff] usable
[ 0.000000] BIOS-e820: [mem 0x000000003fb6f000-0x000000003fb7efff] ACPI data
[ 0.000000] BIOS-e820: [mem 0x000000003fb7f000-0x000000003fbfefff] ACPI NVS
[ 0.000000] BIOS-e820: [mem 0x000000003fbff000-0x000000003ff7bfff] usable
[ 0.000000] BIOS-e820: [mem 0x000000003ff7c000-0x000000003fffffff] reserved
[ 0.000000] BIOS-e820: [mem 0x00000000e0000000-0x00000000efffffff] reserved
[ 0.000000] BIOS-e820: [mem 0x00000000feffc000-0x00000000feffffff] reserved
[ 0.000000] BIOS-e820: [mem 0x00000000ffc00000-0x00000000ffffffff] reserved
[ 0.000000] BIOS-e820: [mem 0x000000fd00000000-0x000000ffffffffff] reserved
[ 0.000000] NX (Execute Disable) protection: active
[ 0.000000] APIC: Static calls initialized
[ 0.000000] extended physical RAM map:
[ 0.000000] reserve setup_data: [mem 0x0000000000000000-0x000000000009ffff] usable
[ 0.000000] reserve setup_data: [mem 0x0000000000100000-0x000000003bfd6017] usable
[ 0.000000] reserve setup_data: [mem 0x000000003bfd6018-0x000000003bffd457] usable
[ 0.000000] reserve setup_data: [mem 0x000000003bffd458-0x000000003e452017] usable
[ 0.000000] reserve setup_data: [mem 0x000000003e452018-0x000000003e45ba57] usable
[ 0.000000] reserve setup_data: [mem 0x000000003e45ba58-0x000000003ecaffff] usable
[ 0.000000] reserve setup_data: [mem 0x000000003ecb0000-0x000000003ed70fff] reserved
[ 0.000000] reserve setup_data: [mem 0x000000003ed71000-0x000000003f23bfff] usable
[ 0.000000] reserve setup_data: [mem 0x000000003f23c000-0x000000003f27cfff] reserved
[ 0.000000] reserve setup_data: [mem 0x000000003f27d000-0x000000003f8ecfff] usable
[ 0.000000] reserve setup_data: [mem 0x000000003f8ed000-0x000000003faecfff] reserved
[ 0.000000] reserve setup_data: [mem 0x000000003faed000-0x000000003fb6efff] usable
[ 0.000000] reserve setup_data: [mem 0x000000003fb6f000-0x000000003fb7efff] ACPI data
[ 0.000000] reserve setup_data: [mem 0x000000003fb7f000-0x000000003fbfefff] ACPI NVS
[ 0.000000] reserve setup_data: [mem 0x000000003fbff000-0x000000003ff7bfff] usable
[ 0.000000] reserve setup_data: [mem 0x000000003ff7c000-0x000000003fffffff] reserved
[ 0.000000] reserve setup_data: [mem 0x00000000e0000000-0x00000000efffffff] reserved
[ 0.000000] reserve setup_data: [mem 0x00000000feffc000-0x00000000feffffff] reserved
[ 0.000000] reserve setup_data: [mem 0x00000000ffc00000-0x00000000ffffffff] reserved
[ 0.000000] reserve setup_data: [mem 0x000000fd00000000-0x000000ffffffffff] reserved
[ 0.000000] efi: EFI v2.7 by EDK II
[ 0.000000] efi: SMBIOS=0x3f91c000 SMBIOS 3.0=0x3f91a000 ACPI=0x3fb7e000 ACPI 2.0=0x3fb7e014 MEMATTR=0x3de71698 INITRD=0x3e45ce98 RNG=0x3fb71018
[ 0.000000] random: crng init done
[ 0.000000] efi: Remove mem137: MMIO range=[0xffc00000-0xffffffff] (4MB) from e820 map
[ 0.000000] SMBIOS 3.0.0 present.
[ 0.000000] DMI: QEMU Standard PC (Q35 + ICH9, 2009)/Incus, BIOS unknown 2/2/2022
[ 0.000000] Hypervisor detected: KVM
[ 0.000000] kvm-clock: Using msrs 4b564d01 and 4b564d00
[ 0.000000] kvm-clock: using sched offset of 6254323665 cycles
[ 0.000002] clocksource: kvm-clock: mask: 0xffffffffffffffff max_cycles: 0x1cd42e4dffb, max_idle_ns: 881590591483 ns
[ 0.000004] tsc: Detected 3393.624 MHz processor
[ 0.000551] last_pfn = 0x3ff7c max_arch_pfn = 0x400000000
[ 0.000711] MTRR map: 4 entries (2 fixed + 2 variable; max 18), built from 8 variable MTRRs
[ 0.000717] x86/PAT: Configuration [0-7]: WB WC UC- UC WB WP UC- WT
[ 0.000965] Using GB pages for direct mapping
[ 0.001464] Secure boot disabled
[ 0.001464] RAMDISK: [mem 0x3bffe000-0x3c917fff]
[ 0.001466] ACPI: Early table checksum verification disabled
[ 0.001469] ACPI: RSDP 0x000000003FB7E014 000024 (v02 BOCHS )
[ 0.001472] ACPI: XSDT 0x000000003FB7D0E8 000064 (v01 BOCHS BXPC 00000001 01000013)
[ 0.001475] ACPI: FACP 0x000000003FB79000 0000F4 (v03 BOCHS BXPC 00000001 BXPC 00000001)
[ 0.001495] ACPI: DSDT 0x000000003FB7A000 00296D (v01 BOCHS BXPC 00000001 BXPC 00000001)
[ 0.001510] ACPI: FACS 0x000000003FBDC000 000040
[ 0.001523] ACPI: APIC 0x000000003FB78000 000078 (v03 BOCHS BXPC 00000001 BXPC 00000001)
[ 0.001537] ACPI: SSDT 0x000000003FB77000 0000CA (v01 BOCHS VMGENID 00000001 BXPC 00000001)
[ 0.001551] ACPI: HPET 0x000000003FB76000 000038 (v01 BOCHS BXPC 00000001 BXPC 00000001)
[ 0.001565] ACPI: SRAT 0x000000003FB75000 0000B8 (v01 BOCHS BXPC 00000001 BXPC 00000001)
[ 0.001579] ACPI: MCFG 0x000000003FB74000 00003C (v01 BOCHS BXPC 00000001 BXPC 00000001)
[ 0.001593] ACPI: WAET 0x000000003FB73000 000028 (v01 BOCHS BXPC 00000001 BXPC 00000001)
[ 0.001607] ACPI: BGRT 0x000000003FB72000 000038 (v01 INTEL EDK2 00000002 01000013)
[ 0.001609] ACPI: Reserving FACP table memory at [mem 0x3fb79000-0x3fb790f3]
[ 0.001610] ACPI: Reserving DSDT table memory at [mem 0x3fb7a000-0x3fb7c96c]
[ 0.001611] ACPI: Reserving FACS table memory at [mem 0x3fbdc000-0x3fbdc03f]
[ 0.001611] ACPI: Reserving APIC table memory at [mem 0x3fb78000-0x3fb78077]
[ 0.001612] ACPI: Reserving SSDT table memory at [mem 0x3fb77000-0x3fb770c9]
[ 0.001612] ACPI: Reserving HPET table memory at [mem 0x3fb76000-0x3fb76037]
[ 0.001613] ACPI: Reserving SRAT table memory at [mem 0x3fb75000-0x3fb750b7]
[ 0.001613] ACPI: Reserving MCFG table memory at [mem 0x3fb74000-0x3fb7403b]
[ 0.001614] ACPI: Reserving WAET table memory at [mem 0x3fb73000-0x3fb73027]
[ 0.001614] ACPI: Reserving BGRT table memory at [mem 0x3fb72000-0x3fb72037]
[ 0.001864] Zone ranges:
[ 0.001865] DMA [mem 0x0000000000001000-0x0000000000ffffff]
[ 0.001866] DMA32 [mem 0x0000000001000000-0x000000003ff7bfff]
[ 0.001867] Normal empty
[ 0.001868] Movable zone start for each node
[ 0.001869] Early memory node ranges
[ 0.001869] node 0: [mem 0x0000000000001000-0x000000000009ffff]
[ 0.001870] node 0: [mem 0x0000000000100000-0x000000003ecaffff]
[ 0.001871] node 0: [mem 0x000000003ed71000-0x000000003f23bfff]
[ 0.001871] node 0: [mem 0x000000003f27d000-0x000000003f8ecfff]
[ 0.001872] node 0: [mem 0x000000003faed000-0x000000003fb6efff]
[ 0.001872] node 0: [mem 0x000000003fbff000-0x000000003ff7bfff]
[ 0.001873] Initmem setup node 0 [mem 0x0000000000001000-0x000000003ff7bfff]
[ 0.001877] On node 0, zone DMA: 1 pages in unavailable ranges
[ 0.001893] On node 0, zone DMA: 96 pages in unavailable ranges
[ 0.007362] On node 0, zone DMA32: 193 pages in unavailable ranges
[ 0.008312] On node 0, zone DMA32: 65 pages in unavailable ranges
[ 0.008681] On node 0, zone DMA32: 512 pages in unavailable ranges
[ 0.009271] On node 0, zone DMA32: 144 pages in unavailable ranges
[ 0.009345] On node 0, zone DMA32: 132 pages in unavailable ranges
[ 0.011646] ACPI: PM-Timer IO Port: 0x608
[ 0.011669] ACPI: LAPIC_NMI (acpi_id[0xff] dfl dfl lint[0x1])
[ 0.011737] IOAPIC[0]: apic_id 0, version 17, address 0xfec00000, GSI 0-23
[ 0.011740] ACPI: INT_SRC_OVR (bus 0 bus_irq 0 global_irq 2 dfl dfl)
[ 0.011742] ACPI: INT_SRC_OVR (bus 0 bus_irq 5 global_irq 5 high level)
[ 0.011743] ACPI: INT_SRC_OVR (bus 0 bus_irq 9 global_irq 9 high level)
[ 0.011743] ACPI: INT_SRC_OVR (bus 0 bus_irq 10 global_irq 10 high level)
[ 0.011744] ACPI: INT_SRC_OVR (bus 0 bus_irq 11 global_irq 11 high level)
[ 0.011746] ACPI: Using ACPI (MADT) for SMP configuration information
[ 0.011747] ACPI: HPET id: 0x8086a201 base: 0xfed00000
[ 0.011770] efi_bgrt: Ignoring BGRT: Incorrect BMP magic number 0x0 (expected 0x4d42)
[ 0.011772] TSC deadline timer available
[ 0.011772] smpboot: Allowing 1 CPUs, 0 hotplug CPUs
[ 0.011797] kvm-guest: APIC: eoi() replaced with kvm_guest_apic_eoi_write()
[ 0.011848] [mem 0x40000000-0xdfffffff] available for PCI devices
[ 0.011849] Booting paravirtualized kernel on KVM
[ 0.011850] clocksource: refined-jiffies: mask: 0xffffffff max_cycles: 0xffffffff, max_idle_ns: 19112604462750000 ns
[ 0.014594] setup_percpu: NR_CPUS:256 nr_cpumask_bits:1 nr_cpu_ids:1 nr_node_ids:1
[ 0.026521] percpu: Embedded 57 pages/cpu s195496 r8192 d29784 u2097152
[ 0.026622] kvm-guest: PV spinlocks disabled, single CPU
[ 0.026624] Kernel command line: BOOT_IMAGE=/boot/vmlinuz-virt root=UUID=8cf64ddd-9d2e-4f85-ab17-5fff228581e2 ro console=tty1 console=ttyS0 modules=sd-mod,usb-storage,ext4 rootfstype=ext4
[ 0.026664] Unknown kernel command line parameters "BOOT_IMAGE=/boot/vmlinuz-virt modules=sd-mod,usb-storage,ext4", will be passed to user space.
[ 0.027364] Dentry cache hash table entries: 131072 (order: 8, 1048576 bytes, linear)
[ 0.029456] Inode-cache hash table entries: 65536 (order: 7, 524288 bytes, linear)
[ 0.029514] Built 1 zonelists, mobility grouping on. Total pages: 254730
[ 0.042864] mem auto-init: stack:all(zero), heap alloc:on, heap free:off
[ 0.045280] Memory: 941792K/1044004K available (14336K kernel code, 1784K rwdata, 8084K rodata, 2656K init, 2176K bss, 101956K reserved, 0K cma-reserved)
[ 0.045751] SLUB: HWalign=64, Order=0-3, MinObjects=0, CPUs=1, Nodes=1
[ 0.047582] Dynamic Preempt: none
[ 0.047697] rcu: Preemptible hierarchical RCU implementation.
[ 0.047697] rcu: RCU restricting CPUs from NR_CPUS=256 to nr_cpu_ids=1.
[ 0.047699] Trampoline variant of Tasks RCU enabled.
[ 0.047699] Tracing variant of Tasks RCU enabled.
[ 0.047700] rcu: RCU calculated value of scheduler-enlistment delay is 10 jiffies.
[ 0.047700] rcu: Adjusting geometry for rcu_fanout_leaf=16, nr_cpu_ids=1
[ 0.051081] NR_IRQS: 16640, nr_irqs: 256, preallocated irqs: 16
[ 0.051510] rcu: srcu_init: Setting srcu_struct sizes based on contention.
[ 0.051622] kfence: initialized - using 2097152 bytes for 255 objects at 0x(____ptrval____)-0x(____ptrval____)
[ 0.051676] Console: colour dummy device 80x25
[ 0.051678] printk: console [tty1] enabled
[ 0.051910] printk: console [ttyS0] enabled
[ 1.211702] ACPI: Core revision 20230628
[ 1.216820] clocksource: hpet: mask: 0xffffffff max_cycles: 0xffffffff, max_idle_ns: 19112604467 ns
[ 1.226793] APIC: Switch to symmetric I/O mode setup
[ 1.232719] x2apic enabled
[ 1.236804] APIC: Switched APIC routing to: physical x2apic
[ 1.245935] ..TIMER: vector=0x30 apic1=0 pin1=2 apic2=-1 pin2=-1
[ 1.253282] clocksource: tsc-early: mask: 0xffffffffffffffff max_cycles: 0x30eac774559, max_idle_ns: 440795212956 ns
[ 1.266225] Calibrating delay loop (skipped) preset value.. 6787.24 BogoMIPS (lpj=33936240)
[ 1.276651] x86/cpu: User Mode Instruction Prevention (UMIP) activated
[ 1.285046] Last level iTLB entries: 4KB 512, 2MB 255, 4MB 127
[ 1.286226] Last level dTLB entries: 4KB 512, 2MB 255, 4MB 127, 1GB 0
[ 1.296241] Spectre V1 : Mitigation: usercopy/swapgs barriers and __user pointer sanitization
[ 1.306228] Spectre V2 : Mitigation: Retpolines
[ 1.316226] Spectre V2 : Spectre v2 / SpectreRSB mitigation: Filling RSB on context switch
[ 1.326227] Spectre V2 : Spectre v2 / SpectreRSB : Filling RSB on VMEXIT
[ 1.333779] Spectre V2 : Enabling Restricted Speculation for firmware calls
[ 1.336230] Spectre V2 : mitigation: Enabling conditional Indirect Branch Prediction Barrier
[ 1.346228] Speculative Store Bypass: Mitigation: Speculative Store Bypass disabled via prctl
[ 1.356228] Speculative Return Stack Overflow: IBPB-extending microcode not applied!
[ 1.366227] Speculative Return Stack Overflow: WARNING: See https://kernel.org/doc/html/latest/admin-guide/hw-vuln/srso.html for mitigation options.
[ 1.366228] Speculative Return Stack Overflow: Vulnerable: Safe RET, no microcode
[ 1.386320] x86/fpu: Supporting XSAVE feature 0x001: 'x87 floating point registers'
[ 1.396248] x86/fpu: Supporting XSAVE feature 0x002: 'SSE registers'
[ 1.403851] x86/fpu: Supporting XSAVE feature 0x004: 'AVX registers'
[ 1.406227] x86/fpu: xstate_offset[2]: 576, xstate_sizes[2]: 256
[ 1.416226] x86/fpu: Enabled xstate features 0x7, context size is 832 bytes, using 'compacted' format.
[ 1.446567] Freeing SMP alternatives memory: 32K
[ 1.452562] pid_max: default: 32768 minimum: 301
[ 1.467455] LSM: initializing lsm=capability,landlock,lockdown,integrity
[ 1.476152] landlock: Up and running.
[ 1.476426] Mount-cache hash table entries: 2048 (order: 2, 16384 bytes, linear)
[ 1.486360] Mountpoint-cache hash table entries: 2048 (order: 2, 16384 bytes, linear)
[ 1.498174] smpboot: CPU0: AMD Ryzen 9 5950X 16-Core Processor (family: 0x19, model: 0x21, stepping: 0x0)
[ 1.508501] RCU Tasks: Setting shift to 0 and lim to 1 rcu_task_cb_adjust=1.
[ 1.516441] RCU Tasks Trace: Setting shift to 0 and lim to 1 rcu_task_cb_adjust=1.
[ 1.524904] Performance Events: Fam17h+ core perfctr, AMD PMU driver.
[ 1.526242] ... version: 0
[ 1.531429] ... bit width: 48
[ 1.536235] ... generic registers: 6
[ 1.541279] ... value mask: 0000ffffffffffff
[ 1.546235] ... max period: 00007fffffffffff
[ 1.552635] ... fixed-purpose events: 0
[ 1.556235] ... event mask: 000000000000003f
[ 1.562168] signal: max sigframe size: 1776
[ 1.566689] rcu: Hierarchical SRCU implementation.
[ 1.572096] rcu: Max phase no-delay instances is 1000.
[ 1.579347] smp: Bringing up secondary CPUs ...
[ 1.585001] smp: Brought up 1 node, 1 CPU
[ 1.586240] smpboot: Max logical packages: 1
[ 1.591237] ----------------
[ 1.594622] | NMI testsuite:
[ 1.596236] --------------------
[ 1.600525] remote IPI: ok |
[ 1.604626] local IPI: ok |
[ 1.606235] --------------------
[ 1.609971] Good, all 2 testcases passed! |
[ 1.615319] ---------------------------------
[ 1.616238] smpboot: Total of 1 processors activated (6787.24 BogoMIPS)
[ 1.625726] devtmpfs: initialized
[ 1.626367] x86/mm: Memory block size: 128MB
[ 1.632800] ACPI: PM: Registering ACPI NVS region [mem 0x3fb7f000-0x3fbfefff] (524288 bytes)
[ 1.636415] clocksource: jiffies: mask: 0xffffffff max_cycles: 0xffffffff, max_idle_ns: 19112604462750000 ns
[ 1.646427] futex hash table entries: 256 (order: 2, 16384 bytes, linear)
[ 1.668460] NET: Registered PF_NETLINK/PF_ROUTE protocol family
[ 1.675781] audit: initializing netlink subsys (disabled)
[ 1.676502] thermal_sys: Registered thermal governor 'step_wise'
[ 1.676535] audit: type=2000 audit(1711574986.619:1): state=initialized audit_enabled=0 res=1
[ 1.686241] cpuidle: using governor ladder
[ 1.690776] cpuidle: using governor menu
[ 1.696796] acpiphp: ACPI Hot Plug PCI Controller Driver version: 0.5
[ 1.705459] PCI: MMCONFIG for domain 0000 [bus 00-ff] at [mem 0xe0000000-0xefffffff] (base 0xe0000000)
[ 1.706239] PCI: MMCONFIG at [mem 0xe0000000-0xefffffff] reserved as E820 entry
[ 1.715242] PCI: Using configuration type 1 for base access
[ 1.716557] kprobes: kprobe jump-optimization is enabled. All kprobes are optimized if possible.
[ 1.729843] HugeTLB: registered 1.00 GiB page size, pre-allocated 0 pages
[ 1.736238] HugeTLB: 16380 KiB vmemmap can be freed for a 1.00 GiB page
[ 1.743431] HugeTLB: registered 2.00 MiB page size, pre-allocated 0 pages
[ 1.746235] HugeTLB: 28 KiB vmemmap can be freed for a 2.00 MiB page
[ 1.756026] ACPI: Added _OSI(Module Device)
[ 1.756258] ACPI: Added _OSI(Processor Device)
[ 1.762183] ACPI: Added _OSI(3.0 _SCP Extensions)
[ 1.766235] ACPI: Added _OSI(Processor Aggregator Device)
[ 1.774925] ACPI: 2 ACPI AML tables successfully acquired and loaded
[ 1.777141] ACPI: _OSC evaluation for CPUs failed, trying _PDC
[ 1.783360] ACPI: Interpreter enabled
[ 1.786243] ACPI: PM: (supports S0 S5)
[ 1.790405] ACPI: Using IOAPIC for interrupt routing
[ 1.796019] PCI: Using host bridge windows from ACPI; if necessary, use "pci=nocrs" and report a bug
[ 1.796236] PCI: Using E820 reservations for host bridge windows
[ 1.804392] ACPI: Enabled 3 GPEs in block 00 to 3F
[ 1.810823] ACPI: PCI Root Bridge [PCI0] (domain 0000 [bus 00-ff])
[ 1.816239] acpi PNP0A08:00: _OSC: OS supports [ExtendedConfig ASPM ClockPM Segments MSI HPX-Type3]
[ 1.826375] acpi PNP0A08:00: _OSC: platform does not support [PCIeHotplug LTR]
[ 1.836066] acpi PNP0A08:00: _OSC: OS now controls [PME PCIeCapability]
[ 1.836716] PCI host bridge to bus 0000:00
[ 1.841972] pci_bus 0000:00: root bus resource [io 0x0000-0x0cf7 window]
[ 1.846236] pci_bus 0000:00: root bus resource [io 0x0d00-0xffff window]
[ 1.854965] pci_bus 0000:00: root bus resource [mem 0x000a0000-0x000bffff window]
[ 1.856236] pci_bus 0000:00: root bus resource [mem 0x40000000-0xdfffffff window]
[ 1.865059] pci_bus 0000:00: root bus resource [mem 0xf0000000-0xfebfffff window]
[ 1.866236] pci_bus 0000:00: root bus resource [mem 0x380000000000-0x3847ffffffff window]
[ 1.876237] pci_bus 0000:00: root bus resource [bus 00-ff]
[ 1.883408] pci 0000:00:00.0: [8086:29c0] type 00 class 0x060000
[ 1.887221] pci 0000:00:01.0: [1b36:000c] type 01 class 0x060400
[ 1.896966] pci 0000:00:01.0: reg 0x10: [mem 0x81a49000-0x81a49fff]
[ 1.910682] pci 0000:00:01.1: [1b36:000c] type 01 class 0x060400
[ 1.918017] pci 0000:00:01.1: reg 0x10: [mem 0x81a48000-0x81a48fff]
[ 1.930291] pci 0000:00:01.2: [1b36:000c] type 01 class 0x060400
[ 1.937967] pci 0000:00:01.2: reg 0x10: [mem 0x81a47000-0x81a47fff]
[ 1.949995] pci 0000:00:01.3: [1b36:000c] type 01 class 0x060400
[ 1.962169] pci 0000:00:01.3: reg 0x10: [mem 0x81a46000-0x81a46fff]
[ 1.981397] pci 0000:00:01.4: [1b36:000c] type 01 class 0x060400
[ 1.988037] pci 0000:00:01.4: reg 0x10: [mem 0x81a45000-0x81a45fff]
[ 1.999997] pci 0000:00:01.5: [1b36:000c] type 01 class 0x060400
[ 2.007863] pci 0000:00:01.5: reg 0x10: [mem 0x81a44000-0x81a44fff]
[ 2.019077] pci 0000:00:01.6: [1b36:000c] type 01 class 0x060400
[ 2.027866] pci 0000:00:01.6: reg 0x10: [mem 0x81a43000-0x81a43fff]
[ 2.039751] pci 0000:00:01.7: [1b36:000c] type 01 class 0x060400
[ 2.047839] pci 0000:00:01.7: reg 0x10: [mem 0x81a42000-0x81a42fff]
[ 2.060127] pci 0000:00:02.0: [1b36:000c] type 01 class 0x060400
[ 2.067867] pci 0000:00:02.0: reg 0x10: [mem 0x81a41000-0x81a41fff]
[ 2.081379] pci 0000:00:1f.0: [8086:2918] type 00 class 0x060100
[ 2.087251] pci 0000:00:1f.0: quirk: [io 0x0600-0x067f] claimed by ICH6 ACPI/GPIO/TCO
[ 2.096874] pci 0000:00:1f.2: [8086:2922] type 00 class 0x010601
[ 2.108871] pci 0000:00:1f.2: reg 0x20: [io 0x6040-0x605f]
[ 2.117260] pci 0000:00:1f.2: reg 0x24: [mem 0x81a40000-0x81a40fff]
[ 2.126849] pci 0000:00:1f.3: [8086:2930] type 00 class 0x0c0500
[ 2.137650] pci 0000:00:1f.3: reg 0x20: [io 0x6000-0x603f]
[ 2.147464] acpiphp: Slot [0] registered
[ 2.153086] pci 0000:01:00.0: [1af4:1045] type 00 class 0x00ff00
[ 2.159093] pci 0000:01:00.0: reg 0x20: [mem 0x380000014000-0x380000017fff 64bit pref]
[ 2.170103] pci 0000:01:00.1: [1af4:1044] type 00 class 0x00ff00
[ 2.178190] pci 0000:01:00.1: reg 0x14: [mem 0x81808000-0x81808fff]
[ 2.189699] pci 0000:01:00.1: reg 0x20: [mem 0x380000010000-0x380000013fff 64bit pref]
[ 2.199652] pci 0000:01:00.2: [1af4:1052] type 00 class 0x090000
[ 2.208194] pci 0000:01:00.2: reg 0x14: [mem 0x81807000-0x81807fff]
[ 2.217790] pci 0000:01:00.2: reg 0x20: [mem 0x38000000c000-0x38000000ffff 64bit pref]
[ 2.229739] pci 0000:01:00.3: [1af4:1052] type 00 class 0x098000
[ 2.238240] pci 0000:01:00.3: reg 0x14: [mem 0x81806000-0x81806fff]
[ 2.249486] pci 0000:01:00.3: reg 0x20: [mem 0x380000008000-0x38000000bfff 64bit pref]
[ 2.259890] pci 0000:01:00.4: [1af4:1053] type 00 class 0x078000
[ 2.268165] pci 0000:01:00.4: reg 0x14: [mem 0x81805000-0x81805fff]
[ 2.279297] pci 0000:01:00.4: reg 0x20: [mem 0x380000004000-0x380000007fff 64bit pref]
[ 2.290605] pci 0000:01:00.5: [1af4:1043] type 00 class 0x078000
[ 2.298439] pci 0000:01:00.5: reg 0x14: [mem 0x81804000-0x81804fff]
[ 2.309462] pci 0000:01:00.5: reg 0x20: [mem 0x380000000000-0x380000003fff 64bit pref]
[ 2.319484] pci 0000:01:00.6: [1b36:000d] type 00 class 0x0c0330
[ 2.326949] pci 0000:01:00.6: reg 0x10: [mem 0x81800000-0x81803fff 64bit]
[ 2.340556] pci 0000:00:01.0: PCI bridge to [bus 01]
[ 2.346322] pci 0000:00:01.0: bridge window [mem 0x81800000-0x819fffff]
[ 2.355265] pci 0000:00:01.0: bridge window [mem 0x380000000000-0x3807ffffffff 64bit pref]
[ 2.357549] acpiphp: Slot [0-2] registered
[ 2.362742] pci 0000:02:00.0: [1af4:1048] type 00 class 0x010000
[ 2.369334] pci 0000:02:00.0: reg 0x14: [mem 0x81600000-0x81600fff]
[ 2.379511] pci 0000:02:00.0: reg 0x20: [mem 0x380800000000-0x380800003fff 64bit pref]
[ 2.389801] pci 0000:00:01.1: PCI bridge to [bus 02]
[ 2.396318] pci 0000:00:01.1: bridge window [mem 0x81600000-0x817fffff]
[ 2.404783] pci 0000:00:01.1: bridge window [mem 0x380800000000-0x380fffffffff 64bit pref]
[ 2.407211] acpiphp: Slot [0-3] registered
[ 2.412144] pci 0000:03:00.0: [1af4:1049] type 00 class 0x000200
[ 2.419468] pci 0000:03:00.0: reg 0x14: [mem 0x81401000-0x81401fff]
[ 2.429104] pci 0000:03:00.0: reg 0x20: [mem 0x381000004000-0x381000007fff 64bit pref]
[ 2.440986] pci 0000:03:00.1: [1af4:1049] type 00 class 0x000200
[ 2.448212] pci 0000:03:00.1: reg 0x14: [mem 0x81400000-0x81400fff]
[ 2.459019] pci 0000:03:00.1: reg 0x20: [mem 0x381000000000-0x381000003fff 64bit pref]
[ 2.470018] pci 0000:00:01.2: PCI bridge to [bus 03]
[ 2.476311] pci 0000:00:01.2: bridge window [mem 0x81400000-0x815fffff]
[ 2.484149] pci 0000:00:01.2: bridge window [mem 0x381000000000-0x3817ffffffff 64bit pref]
[ 2.487485] pci 0000:04:00.0: [1af4:1050] type 00 class 0x030000
[ 2.497595] pci 0000:04:00.0: reg 0x10: [mem 0x80000000-0x807fffff pref]
[ 2.510332] pci 0000:04:00.0: reg 0x18: [mem 0x381800000000-0x381800003fff 64bit pref]
[ 2.520792] pci 0000:04:00.0: reg 0x20: [mem 0x80800000-0x80800fff]
[ 2.533286] pci 0000:04:00.0: reg 0x30: [mem 0xffff0000-0xffffffff pref]
[ 2.537730] pci 0000:04:00.0: Video device with shadowed ROM at [mem 0x000c0000-0x000dffff]
[ 2.550413] pci 0000:00:01.3: PCI bridge to [bus 04]
[ 2.556356] pci 0000:00:01.3: bridge window [mem 0x80000000-0x808fffff]
[ 2.565180] pci 0000:00:01.3: bridge window [mem 0x381800000000-0x381fffffffff 64bit pref]
[ 2.568119] acpiphp: Slot [0-4] registered
[ 2.573434] pci 0000:05:00.0: [1af4:1041] type 00 class 0x020000
[ 2.579484] pci 0000:05:00.0: reg 0x14: [mem 0x81200000-0x81200fff]
[ 2.589645] pci 0000:05:00.0: reg 0x20: [mem 0x382000000000-0x382000003fff 64bit pref]
[ 2.597306] pci 0000:05:00.0: reg 0x30: [mem 0xfffc0000-0xffffffff pref]
[ 2.609165] pci 0000:00:01.4: PCI bridge to [bus 05]
[ 2.615657] pci 0000:00:01.4: bridge window [mem 0x81200000-0x813fffff]
[ 2.616339] pci 0000:00:01.4: bridge window [mem 0x382000000000-0x3827ffffffff 64bit pref]
[ 2.627376] acpiphp: Slot [0-5] registered
[ 2.632230] pci 0000:00:01.5: PCI bridge to [bus 06]
[ 2.636315] pci 0000:00:01.5: bridge window [mem 0x81000000-0x811fffff]
[ 2.646195] pci 0000:00:01.5: bridge window [mem 0x382800000000-0x382fffffffff 64bit pref]
[ 2.647609] acpiphp: Slot [0-6] registered
[ 2.653552] pci 0000:00:01.6: PCI bridge to [bus 07]
[ 2.656320] pci 0000:00:01.6: bridge window [mem 0x80e00000-0x80ffffff]
[ 2.665055] pci 0000:00:01.6: bridge window [mem 0x383000000000-0x3837ffffffff 64bit pref]
[ 2.667538] acpiphp: Slot [0-7] registered
[ 2.672483] pci 0000:00:01.7: PCI bridge to [bus 08]
[ 2.676340] pci 0000:00:01.7: bridge window [mem 0x80c00000-0x80dfffff]
[ 2.685354] pci 0000:00:01.7: bridge window [mem 0x383800000000-0x383fffffffff 64bit pref]
[ 2.687681] acpiphp: Slot [0-8] registered
[ 2.693369] pci 0000:00:02.0: PCI bridge to [bus 09]
[ 2.696317] pci 0000:00:02.0: bridge window [mem 0x80a00000-0x80bfffff]
[ 2.705122] pci 0000:00:02.0: bridge window [mem 0x384000000000-0x3847ffffffff 64bit pref]
[ 2.717858] ACPI: PCI: Interrupt link LNKA configured for IRQ 10
[ 2.725885] ACPI: PCI: Interrupt link LNKB configured for IRQ 10
[ 2.726402] ACPI: PCI: Interrupt link LNKC configured for IRQ 11
[ 2.733882] ACPI: PCI: Interrupt link LNKD configured for IRQ 11
[ 2.736380] ACPI: PCI: Interrupt link LNKE configured for IRQ 10
[ 2.744208] ACPI: PCI: Interrupt link LNKF configured for IRQ 10
[ 2.746433] ACPI: PCI: Interrupt link LNKG configured for IRQ 11
[ 2.754992] ACPI: PCI: Interrupt link LNKH configured for IRQ 11
[ 2.756339] ACPI: PCI: Interrupt link GSIA configured for IRQ 16
[ 2.764175] ACPI: PCI: Interrupt link GSIB configured for IRQ 17
[ 2.766292] ACPI: PCI: Interrupt link GSIC configured for IRQ 18
[ 2.773334] ACPI: PCI: Interrupt link GSID configured for IRQ 19
[ 2.776435] ACPI: PCI: Interrupt link GSIE configured for IRQ 20
[ 2.784176] ACPI: PCI: Interrupt link GSIF configured for IRQ 21
[ 2.786307] ACPI: PCI: Interrupt link GSIG configured for IRQ 22
[ 2.794094] ACPI: PCI: Interrupt link GSIH configured for IRQ 23
[ 2.798664] iommu: Default domain type: Translated
[ 2.804122] iommu: DMA domain TLB invalidation policy: lazy mode
[ 2.807815] SCSI subsystem initialized
[ 2.815431] pps_core: LinuxPPS API ver. 1 registered
[ 2.816235] pps_core: Software ver. 5.3.6 - Copyright 2005-2007 Rodolfo Giometti <giometti@linux.it>
[ 2.826241] PTP clock support registered
[ 2.832132] efivars: Registered efivars operations
[ 2.838476] PCI: Using ACPI for IRQ routing
[ 2.964259] clocksource: Switched to clocksource kvm-clock
[ 2.966222] VFS: Disk quotas dquot_6.6.0
[ 2.971082] VFS: Dquot-cache hash table entries: 512 (order 0, 4096 bytes)
[ 2.980788] pnp: PnP ACPI init
[ 2.985462] system 00:04: [mem 0xe0000000-0xefffffff window] has been reserved
[ 2.994830] pnp: PnP ACPI: found 5 devices
[ 3.015160] clocksource: acpi_pm: mask: 0xffffff max_cycles: 0xffffff, max_idle_ns: 2085701024 ns
[ 3.027004] NET: Registered PF_INET protocol family
[ 3.033690] IP idents hash table entries: 16384 (order: 5, 131072 bytes, linear)
[ 3.042735] tcp_listen_portaddr_hash hash table entries: 512 (order: 1, 8192 bytes, linear)
[ 3.053429] Table-perturb hash table entries: 65536 (order: 6, 262144 bytes, linear)
[ 3.062920] TCP established hash table entries: 8192 (order: 4, 65536 bytes, linear)
[ 3.073574] TCP bind hash table entries: 8192 (order: 6, 262144 bytes, linear)
[ 3.082352] TCP: Hash tables configured (established 8192 bind 8192)
[ 3.091296] MPTCP token hash table entries: 1024 (order: 2, 24576 bytes, linear)
[ 3.100261] UDP hash table entries: 512 (order: 2, 16384 bytes, linear)
[ 3.107377] UDP-Lite hash table entries: 512 (order: 2, 16384 bytes, linear)
[ 3.116860] NET: Registered PF_UNIX/PF_LOCAL protocol family
[ 3.124597] NET: Registered PF_XDP protocol family
[ 3.130712] pci 0000:05:00.0: can't claim BAR 6 [mem 0xfffc0000-0xffffffff pref]: no compatible bridge window
[ 3.141779] pci 0000:00:01.0: bridge window [io 0x1000-0x0fff] to [bus 01] add_size 1000
[ 3.151303] pci 0000:00:01.1: bridge window [io 0x1000-0x0fff] to [bus 02] add_size 1000
[ 3.161003] pci 0000:00:01.2: bridge window [io 0x1000-0x0fff] to [bus 03] add_size 1000
[ 3.171540] pci 0000:00:01.3: bridge window [io 0x1000-0x0fff] to [bus 04] add_size 1000
[ 3.182287] pci 0000:00:01.4: bridge window [io 0x1000-0x0fff] to [bus 05] add_size 1000
[ 3.193313] pci 0000:00:01.5: bridge window [io 0x1000-0x0fff] to [bus 06] add_size 1000
[ 3.203860] pci 0000:00:01.6: bridge window [io 0x1000-0x0fff] to [bus 07] add_size 1000
[ 3.215010] pci 0000:00:01.7: bridge window [io 0x1000-0x0fff] to [bus 08] add_size 1000
[ 3.224675] pci 0000:00:02.0: bridge window [io 0x1000-0x0fff] to [bus 09] add_size 1000
[ 3.234017] pci 0000:00:01.0: BAR 13: assigned [io 0x1000-0x1fff]
[ 3.241192] pci 0000:00:01.1: BAR 13: assigned [io 0x2000-0x2fff]
[ 3.248285] pci 0000:00:01.2: BAR 13: assigned [io 0x3000-0x3fff]
[ 3.255123] pci 0000:00:01.3: BAR 13: assigned [io 0x4000-0x4fff]
[ 3.261787] pci 0000:00:01.4: BAR 13: assigned [io 0x5000-0x5fff]
[ 3.268225] pci 0000:00:01.5: BAR 13: assigned [io 0x7000-0x7fff]
[ 3.276047] pci 0000:00:01.6: BAR 13: assigned [io 0x8000-0x8fff]
[ 3.284034] pci 0000:00:01.7: BAR 13: assigned [io 0x9000-0x9fff]
[ 3.292136] pci 0000:00:02.0: BAR 13: assigned [io 0xa000-0xafff]
[ 3.299705] pci 0000:00:01.0: PCI bridge to [bus 01]
[ 3.305725] pci 0000:00:01.0: bridge window [io 0x1000-0x1fff]
[ 3.314108] pci 0000:00:01.0: bridge window [mem 0x81800000-0x819fffff]
[ 3.322771] pci 0000:00:01.0: bridge window [mem 0x380000000000-0x3807ffffffff 64bit pref]
[ 3.334694] pci 0000:00:01.1: PCI bridge to [bus 02]
[ 3.341150] pci 0000:00:01.1: bridge window [io 0x2000-0x2fff]
[ 3.350477] pci 0000:00:01.1: bridge window [mem 0x81600000-0x817fffff]
[ 3.361053] pci 0000:00:01.1: bridge window [mem 0x380800000000-0x380fffffffff 64bit pref]
[ 3.373391] pci 0000:00:01.2: PCI bridge to [bus 03]
[ 3.379902] pci 0000:00:01.2: bridge window [io 0x3000-0x3fff]
[ 3.388615] pci 0000:00:01.2: bridge window [mem 0x81400000-0x815fffff]
[ 3.398233] pci 0000:00:01.2: bridge window [mem 0x381000000000-0x3817ffffffff 64bit pref]
[ 3.411007] pci 0000:00:01.3: PCI bridge to [bus 04]
[ 3.417556] pci 0000:00:01.3: bridge window [io 0x4000-0x4fff]
[ 3.426560] pci 0000:00:01.3: bridge window [mem 0x80000000-0x808fffff]
[ 3.435963] pci 0000:00:01.3: bridge window [mem 0x381800000000-0x381fffffffff 64bit pref]
[ 3.447992] pci 0000:05:00.0: BAR 6: assigned [mem 0x81240000-0x8127ffff pref]
[ 3.458034] pci 0000:00:01.4: PCI bridge to [bus 05]
[ 3.463795] pci 0000:00:01.4: bridge window [io 0x5000-0x5fff]
[ 3.473521] pci 0000:00:01.4: bridge window [mem 0x81200000-0x813fffff]
[ 3.482404] pci 0000:00:01.4: bridge window [mem 0x382000000000-0x3827ffffffff 64bit pref]
[ 3.493566] pci 0000:00:01.5: PCI bridge to [bus 06]
[ 3.499328] pci 0000:00:01.5: bridge window [io 0x7000-0x7fff]
[ 3.507501] pci 0000:00:01.5: bridge window [mem 0x81000000-0x811fffff]
[ 3.517197] pci 0000:00:01.5: bridge window [mem 0x382800000000-0x382fffffffff 64bit pref]
[ 3.527726] pci 0000:00:01.6: PCI bridge to [bus 07]
[ 3.533570] pci 0000:00:01.6: bridge window [io 0x8000-0x8fff]
[ 3.541149] pci 0000:00:01.6: bridge window [mem 0x80e00000-0x80ffffff]
[ 3.549834] pci 0000:00:01.6: bridge window [mem 0x383000000000-0x3837ffffffff 64bit pref]
[ 3.562575] pci 0000:00:01.7: PCI bridge to [bus 08]
[ 3.569141] pci 0000:00:01.7: bridge window [io 0x9000-0x9fff]
[ 3.578047] pci 0000:00:01.7: bridge window [mem 0x80c00000-0x80dfffff]
[ 3.587421] pci 0000:00:01.7: bridge window [mem 0x383800000000-0x383fffffffff 64bit pref]
[ 3.598477] pci 0000:00:02.0: PCI bridge to [bus 09]
[ 3.604174] pci 0000:00:02.0: bridge window [io 0xa000-0xafff]
[ 3.613665] pci 0000:00:02.0: bridge window [mem 0x80a00000-0x80bfffff]
[ 3.623060] pci 0000:00:02.0: bridge window [mem 0x384000000000-0x3847ffffffff 64bit pref]
[ 3.634246] pci_bus 0000:00: resource 4 [io 0x0000-0x0cf7 window]
[ 3.641485] pci_bus 0000:00: resource 5 [io 0x0d00-0xffff window]
[ 3.649482] pci_bus 0000:00: resource 6 [mem 0x000a0000-0x000bffff window]
[ 3.658302] pci_bus 0000:00: resource 7 [mem 0x40000000-0xdfffffff window]
[ 3.668050] pci_bus 0000:00: resource 8 [mem 0xf0000000-0xfebfffff window]
[ 3.676189] pci_bus 0000:00: resource 9 [mem 0x380000000000-0x3847ffffffff window]
[ 3.685460] pci_bus 0000:01: resource 0 [io 0x1000-0x1fff]
[ 3.691695] pci_bus 0000:01: resource 1 [mem 0x81800000-0x819fffff]
[ 3.699004] pci_bus 0000:01: resource 2 [mem 0x380000000000-0x3807ffffffff 64bit pref]
[ 3.707735] pci_bus 0000:02: resource 0 [io 0x2000-0x2fff]
[ 3.713930] pci_bus 0000:02: resource 1 [mem 0x81600000-0x817fffff]
[ 3.720710] pci_bus 0000:02: resource 2 [mem 0x380800000000-0x380fffffffff 64bit pref]
[ 3.729521] pci_bus 0000:03: resource 0 [io 0x3000-0x3fff]
[ 3.735421] pci_bus 0000:03: resource 1 [mem 0x81400000-0x815fffff]
[ 3.742275] pci_bus 0000:03: resource 2 [mem 0x381000000000-0x3817ffffffff 64bit pref]
[ 3.750849] pci_bus 0000:04: resource 0 [io 0x4000-0x4fff]
[ 3.757280] pci_bus 0000:04: resource 1 [mem 0x80000000-0x808fffff]
[ 3.765300] pci_bus 0000:04: resource 2 [mem 0x381800000000-0x381fffffffff 64bit pref]
[ 3.775501] pci_bus 0000:05: resource 0 [io 0x5000-0x5fff]
[ 3.782715] pci_bus 0000:05: resource 1 [mem 0x81200000-0x813fffff]
[ 3.791159] pci_bus 0000:05: resource 2 [mem 0x382000000000-0x3827ffffffff 64bit pref]
[ 3.800987] pci_bus 0000:06: resource 0 [io 0x7000-0x7fff]
[ 3.807380] pci_bus 0000:06: resource 1 [mem 0x81000000-0x811fffff]
[ 3.815662] pci_bus 0000:06: resource 2 [mem 0x382800000000-0x382fffffffff 64bit pref]
[ 3.824606] pci_bus 0000:07: resource 0 [io 0x8000-0x8fff]
[ 3.830827] pci_bus 0000:07: resource 1 [mem 0x80e00000-0x80ffffff]
[ 3.838519] pci_bus 0000:07: resource 2 [mem 0x383000000000-0x3837ffffffff 64bit pref]
[ 3.847616] pci_bus 0000:08: resource 0 [io 0x9000-0x9fff]
[ 3.854585] pci_bus 0000:08: resource 1 [mem 0x80c00000-0x80dfffff]
[ 3.861609] pci_bus 0000:08: resource 2 [mem 0x383800000000-0x383fffffffff 64bit pref]
[ 3.870888] pci_bus 0000:09: resource 0 [io 0xa000-0xafff]
[ 3.878082] pci_bus 0000:09: resource 1 [mem 0x80a00000-0x80bfffff]
[ 3.884913] pci_bus 0000:09: resource 2 [mem 0x384000000000-0x3847ffffffff 64bit pref]
[ 3.895684] ACPI: \_SB_.GSIF: Enabled at IRQ 21
[ 3.903929] PCI: CLS 0 bytes, default 64
[ 3.909407] clocksource: tsc: mask: 0xffffffffffffffff max_cycles: 0x30eac774559, max_idle_ns: 440795212956 ns
[ 3.923662] Initialise system trusted keyrings
[ 3.930147] Unpacking initramfs...
[ 4.142258] Freeing initrd memory: 9320K
[ 4.152131] workingset: timestamp_bits=46 max_order=18 bucket_order=0
[ 4.160452] zbud: loaded
[ 4.164044] Key type asymmetric registered
[ 4.169472] Asymmetric key parser 'x509' registered
[ 4.176561] Block layer SCSI generic (bsg) driver version 0.4 loaded (major 247)
[ 4.185509] io scheduler mq-deadline registered
[ 4.191089] io scheduler kyber registered
[ 4.195706] io scheduler bfq registered
[ 4.202143] pcieport 0000:00:01.0: PME: Signaling with IRQ 24
[ 4.212148] pcieport 0000:00:01.1: PME: Signaling with IRQ 25
[ 4.220898] pcieport 0000:00:01.2: PME: Signaling with IRQ 26
[ 4.229664] pcieport 0000:00:01.3: PME: Signaling with IRQ 27
[ 4.238829] pcieport 0000:00:01.4: PME: Signaling with IRQ 28
[ 4.248059] pcieport 0000:00:01.5: PME: Signaling with IRQ 29
[ 4.257828] pcieport 0000:00:01.6: PME: Signaling with IRQ 30
[ 4.266487] pcieport 0000:00:01.7: PME: Signaling with IRQ 31
[ 4.273997] ACPI: \_SB_.GSIG: Enabled at IRQ 22
[ 4.280356] pcieport 0000:00:02.0: PME: Signaling with IRQ 32
[ 4.288986] ERST DBG: ERST support is disabled.
[ 4.333817] Serial: 8250/16550 driver, 4 ports, IRQ sharing enabled
[ 4.342553] 00:02: ttyS0 at I/O 0x3f8 (irq = 4, base_baud = 115200) is a 16550A
[ 4.385595] VMware PVSCSI driver - version 1.0.7.0-k
[ 4.392893] ACPI: \_SB_.GSIA: Enabled at IRQ 16
[ 4.401233] ahci 0000:00:1f.2: AHCI 0001.0000 32 slots 6 ports 1.5 Gbps 0x3f impl SATA mode
[ 4.410838] ahci 0000:00:1f.2: flags: 64bit ncq only
[ 4.423115] scsi host0: ahci
[ 4.427532] scsi host1: ahci
[ 4.431379] scsi host2: ahci
[ 4.435326] scsi host3: ahci
[ 4.439019] scsi host4: ahci
[ 4.443392] scsi host5: ahci
[ 4.447647] ata1: SATA max UDMA/133 abar m4096@0x81a40000 port 0x81a40100 irq 35
[ 4.457253] ata2: SATA max UDMA/133 abar m4096@0x81a40000 port 0x81a40180 irq 35
[ 4.466888] ata3: SATA max UDMA/133 abar m4096@0x81a40000 port 0x81a40200 irq 35
[ 4.476686] ata4: SATA max UDMA/133 abar m4096@0x81a40000 port 0x81a40280 irq 35
[ 4.486420] ata5: SATA max UDMA/133 abar m4096@0x81a40000 port 0x81a40300 irq 35
[ 4.496103] ata6: SATA max UDMA/133 abar m4096@0x81a40000 port 0x81a40380 irq 35
[ 4.506324] i8042: PNP: PS/2 Controller [PNP0303:KBD,PNP0f13:MOU] at 0x60,0x64 irq 1,12
[ 4.517532] serio: i8042 KBD port at 0x60,0x64 irq 1
[ 4.523289] serio: i8042 AUX port at 0x60,0x64 irq 12
[ 4.528713] rtc_cmos 00:03: RTC can wake from S4
[ 4.536179] input: AT Translated Set 2 keyboard as /devices/platform/i8042/serio0/input/input0
[ 4.548471] rtc_cmos 00:03: registered as rtc0
[ 4.553686] rtc_cmos 00:03: setting system clock to 2024-03-27T21:29:50 UTC (1711574990)
[ 4.563693] rtc_cmos 00:03: alarms up to one day, y3k, 242 bytes nvram
[ 4.570729] amd_pstate: the _CPC object is not present in SBIOS or ACPI disabled
[ 4.580031] gre: GRE over IPv4 demultiplexor driver
[ 4.634310] Key type dns_resolver registered
[ 4.640380] IPI shorthand broadcast: enabled
[ 4.689798] registered taskstats version 1
[ 4.695166] Loading compiled-in X.509 certificates
[ 4.705100] Loaded X.509 cert 'alpinelinux.org: Alpine Linux kernel key: f26ad4d9d046747a7387326f273daab5db510ce8'
[ 4.720941] Key type .fscrypt registered
[ 4.725712] Key type fscrypt-provisioning registered
[ 4.731730] Unstable clock detected, switching default tracing clock to "global"
[ 4.731730] If you want to keep using the local clock, then add:
[ 4.731730] "trace_clock=local"
[ 4.731730] on the kernel command line
[ 4.878473] ata5: SATA link down (SStatus 0 SControl 300)
[ 4.892235] ata2: SATA link down (SStatus 0 SControl 300)
[ 4.898325] ata3: SATA link down (SStatus 0 SControl 300)
[ 4.903412] ata1: SATA link down (SStatus 0 SControl 300)
[ 4.909470] ata4: SATA link down (SStatus 0 SControl 300)
[ 4.956838] ata6: SATA link down (SStatus 0 SControl 300)
[ 4.984891] Freeing unused kernel image (initmem) memory: 2656K
[ 4.991294] Write protecting the kernel read-only data: 22528k
[ 4.997907] Freeing unused kernel image (rodata/data gap) memory: 108K
[ 5.005010] rodata_test: all tests were successful
[ 5.010293] Run /init as init process
[ 5.036455] Alpine Init 3.9.1-r0
Alpine Init 3.9.1-r0
[ 5.042139] Loading boot drivers...
* Loading boot drivers: [ 5.094820] ACPI: bus type USB registered
[ 5.099712] usbcore: registered new interface driver usbfs
[ 5.106400] usbcore: registered new interface driver hub
[ 5.112439] usbcore: registered new device driver usb
[ 5.119473] usbcore: registered new interface driver usb-storage
[ 5.186934] loop: module loaded
[ 5.216945] ACPI: bus type drm_connector registered
[ 5.238619] [drm] Initialized simpledrm 1.0.0 20200625 for simple-framebuffer.0 on minor 0
[ 5.323788] Console: switching to colour frame buffer device 160x50
[ 5.411490] simple-framebuffer simple-framebuffer.0: [drm] fb0: simpledrmdrmfb frame buffer device
[ 5.446559] Loading boot drivers: ok.
ok.
[ 5.458545] Mounting root...
* Mounting root: [ 5.547239] xhci_hcd 0000:01:00.6: xHCI Host Controller
[ 5.553587] xhci_hcd 0000:01:00.6: new USB bus registered, assigned bus number 1
[ 5.561852] xhci_hcd 0000:01:00.6: hcc params 0x00087001 hci version 0x100 quirks 0x0000000000000010
[ 5.572631] xhci_hcd 0000:01:00.6: xHCI Host Controller
[ 5.577998] xhci_hcd 0000:01:00.6: new USB bus registered, assigned bus number 2
[ 5.586194] xhci_hcd 0000:01:00.6: Host supports USB 3.0 SuperSpeed
[ 5.598224] usb usb1: New USB device found, idVendor=1d6b, idProduct=0002, bcdDevice= 6.06
[ 5.607384] usb usb1: New USB device strings: Mfr=3, Product=2, SerialNumber=1
[ 5.616777] usb usb1: Product: xHCI Host Controller
[ 5.625175] usb usb1: Manufacturer: Linux 6.6.22-1-virt xhci-hcd
[ 5.635267] usb usb1: SerialNumber: 0000:01:00.6
[ 5.646478] hub 1-0:1.0: USB hub found
[ 5.651451] hub 1-0:1.0: 8 ports detected
[ 5.657114] usb usb2: We don't know the algorithms for LPM for this host, disabling LPM.
[ 5.666342] usb usb2: New USB device found, idVendor=1d6b, idProduct=0003, bcdDevice= 6.06
[ 5.677949] usb usb2: New USB device strings: Mfr=3, Product=2, SerialNumber=1
[ 5.687740] usb usb2: Product: xHCI Host Controller
[ 5.696322] usb usb2: Manufacturer: Linux 6.6.22-1-virt xhci-hcd
[ 5.707201] usb usb2: SerialNumber: 0000:01:00.6
[ 5.720727] hub 2-0:1.0: USB hub found
[ 5.726022] hub 2-0:1.0: 8 ports detected
[ 5.745317] scsi host6: Virtio SCSI HBA
[ 5.800312] scsi 6:0:0:1: Direct-Access QEMU QEMU HARDDISK 2.5+ PQ: 0 ANSI: 5
The boot appears to get stuck at this point and execing into the VM fails predictably with a Error: VM agent isn't currently running
Kitchen sink of info about my setup that I am randomly guessing may be relevant
lscpu at the root host
Architecture: x86_64
CPU op-mode(s): 32-bit, 64-bit
Byte Order: Little Endian
Address sizes: 48 bits physical, 48 bits virtual
CPU(s): 32
On-line CPU(s) list: 0-31
Thread(s) per core: 2
Core(s) per socket: 16
Socket(s): 1
NUMA node(s): 1
Vendor ID: AuthenticAMD
CPU family: 25
Model: 33
Model name: AMD Ryzen 9 5950X 16-Core Processor
Stepping: 0
Frequency boost: enabled
CPU MHz: 2192.984
CPU max MHz: 3400.0000
CPU min MHz: 2200.0000
BogoMIPS: 6786.95
Virtualization: AMD-V
L1d cache: 512 KiB
L1i cache: 512 KiB
L2 cache: 8 MiB
L3 cache: 64 MiB
NUMA node0 CPU(s): 0-31
Vulnerability Gather data sampling: Not affected
Vulnerability Itlb multihit: Not affected
Vulnerability L1tf: Not affected
Vulnerability Mds: Not affected
Vulnerability Meltdown: Not affected
Vulnerability Mmio stale data: Not affected
Vulnerability Retbleed: Not affected
Vulnerability Spec store bypass: Mitigation; Speculative Store Bypass disabled via prctl and seccomp
Vulnerability Spectre v1: Mitigation; usercopy/swapgs barriers and __user pointer sanitization
Vulnerability Spectre v2: Mitigation; Retpolines, IBPB conditional, IBRS_FW, STIBP always-on, RSB filling, PBRSB-eIBRS Not affected
Vulnerability Srbds: Not affected
Vulnerability Tsx async abort: Not affected
Flags: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush mmx fxsr sse sse2 ht syscall nx mmxext fxsr_opt pdpe1gb rdtscp lm constant_tsc rep_good nopl nonstop_tsc cpuid extd_apicid aperfmperf pni pclmulqdq monitor s
sse3 fma cx16 sse4_1 sse4_2 x2apic movbe popcnt aes xsave avx f16c rdrand lahf_lm cmp_legacy svm extapic cr8_legacy abm sse4a misalignsse 3dnowprefetch osvw ibs skinit wdt tce topoext perfctr_core perfctr_nb bpext perfctr_llc mwaitx cpb
cat_l3 cdp_l3 hw_pstate ssbd mba ibrs ibpb stibp vmmcall fsgsbase bmi1 avx2 smep bmi2 erms invpcid cqm rdt_a rdseed adx smap clflushopt clwb sha_ni xsaveopt xsavec xgetbv1 xsaves cqm_llc cqm_occup_llc cqm_mbm_total cqm_mbm_local clzero i
rperf xsaveerptr wbnoinvd arat npt lbrv svm_lock nrip_save tsc_scale vmcb_clean flushbyasid decodeassists pausefilter pfthreshold avic v_vmsave_vmload vgif umip pku ospke vaes vpclmulqdq rdpid overflow_recov succor smca
lscpu inside the outer vm
root@outervm:~# lscpu
Architecture: x86_64
CPU op-mode(s): 32-bit, 64-bit
Address sizes: 48 bits physical, 48 bits virtual
Byte Order: Little Endian
CPU(s): 1
On-line CPU(s) list: 0
Vendor ID: AuthenticAMD
BIOS Vendor ID: QEMU
Model name: AMD Ryzen 9 5950X 16-Core Processor
BIOS Model name: pc-q35-8.2 CPU @ 2.0GHz
BIOS CPU family: 1
CPU family: 25
Model: 33
Thread(s) per core: 1
Core(s) per socket: 1
Socket(s): 1
Stepping: 0
BogoMIPS: 6787.24
Flags: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush mmx fxsr sse sse2 ht syscall nx mmxext fxsr_opt pdpe1gb rdtscp lm rep_good nopl cpuid extd_apicid tsc_known_freq pni pclmulqdq ssse3 fma cx16 sse4_1 sse4_2 x2apic movbe
popcnt tsc_deadline_timer aes xsave avx f16c rdrand hypervisor lahf_lm cmp_legacy svm cr8_legacy abm sse4a misalignsse 3dnowprefetch osvw perfctr_core ssbd ibrs ibpb stibp vmmcall fsgsbase tsc_adjust bmi1 avx2 smep bmi2 erms rdseed adx smap clflus
hopt clwb sha_ni xsaveopt xsavec xgetbv1 xsaves clzero xsaveerptr wbnoinvd arat npt nrip_save umip vaes vpclmulqdq rdpid fsrm arch_capabilities
Virtualization features:
Virtualization: AMD-V
Hypervisor vendor: KVM
Virtualization type: full
Caches (sum of all):
L1d: 64 KiB (1 instance)
L1i: 64 KiB (1 instance)
L2: 512 KiB (1 instance)
L3: 16 MiB (1 instance)
NUMA:
NUMA node(s): 1
NUMA node0 CPU(s): 0
Vulnerabilities:
Gather data sampling: Not affected
Itlb multihit: Not affected
L1tf: Not affected
Mds: Not affected
Meltdown: Not affected
Mmio stale data: Not affected
Retbleed: Not affected
Spec rstack overflow: Mitigation; safe RET, no microcode
Spec store bypass: Mitigation; Speculative Store Bypass disabled via prctl
Spectre v1: Mitigation; usercopy/swapgs barriers and __user pointer sanitization
Spectre v2: Mitigation; Retpolines, IBPB conditional, IBRS_FW, STIBP disabled, RSB filling, PBRSB-eIBRS Not affected
Srbds: Not affected
Tsx async abort: Not affected
-
Nested virtualization appears enabled in both, the root host and the outer vm with cat /sys/module/kvm_amd/parameters/nested returning a 1.
-
The root host is booted off of an NVMe SSD.
Appreciate the help!