VM fails to finish booting after kernel upgrade

Had a couple of Fedora 39 VMs, running 6.7.11-200.fc39.x86_64 kernel, with identical configuration done through ansible. Upgraded one of the VMs to the latest kernel, 6.8.4-200.fc39.x86_64, today. After restarting, it never finished booting and stood stuck at Job dev-loop0p2.device/start running (4min 53s / no limit). Not sure if this is an incus issue, hoping it is not, or the upgraded kernel issue.

Steps to reproduce

  1. Create a Fedora 39 VM using 06bb4305f08f VM images from remote (https://images.linuxcontainers.org)
  2. Exec into VM and upgrade to kernel (dnf distro-sync --refresh)
  3. Restart VM
  4. Check VM console for boot progress.

Required information

  • Distribution: Fedora (x86_64)
  • Distribution version: 39
  • The output of “incus info”
config:
  core.https_address: <redacted>:8443
api_extensions:
- storage_zfs_remove_snapshots
- container_host_shutdown_timeout
- container_stop_priority
- container_syscall_filtering
- auth_pki
- container_last_used_at
- etag
- patch
- usb_devices
- https_allowed_credentials
- image_compression_algorithm
- directory_manipulation
- container_cpu_time
- storage_zfs_use_refquota
- storage_lvm_mount_options
- network
- profile_usedby
- container_push
- container_exec_recording
- certificate_update
- container_exec_signal_handling
- gpu_devices
- container_image_properties
- migration_progress
- id_map
- network_firewall_filtering
- network_routes
- storage
- file_delete
- file_append
- network_dhcp_expiry
- storage_lvm_vg_rename
- storage_lvm_thinpool_rename
- network_vlan
- image_create_aliases
- container_stateless_copy
- container_only_migration
- storage_zfs_clone_copy
- unix_device_rename
- storage_lvm_use_thinpool
- storage_rsync_bwlimit
- network_vxlan_interface
- storage_btrfs_mount_options
- entity_description
- image_force_refresh
- storage_lvm_lv_resizing
- id_map_base
- file_symlinks
- container_push_target
- network_vlan_physical
- storage_images_delete
- container_edit_metadata
- container_snapshot_stateful_migration
- storage_driver_ceph
- storage_ceph_user_name
- resource_limits
- storage_volatile_initial_source
- storage_ceph_force_osd_reuse
- storage_block_filesystem_btrfs
- resources
- kernel_limits
- storage_api_volume_rename
- network_sriov
- console
- restrict_dev_incus
- migration_pre_copy
- infiniband
- dev_incus_events
- proxy
- network_dhcp_gateway
- file_get_symlink
- network_leases
- unix_device_hotplug
- storage_api_local_volume_handling
- operation_description
- clustering
- event_lifecycle
- storage_api_remote_volume_handling
- nvidia_runtime
- container_mount_propagation
- container_backup
- dev_incus_images
- container_local_cross_pool_handling
- proxy_unix
- proxy_udp
- clustering_join
- proxy_tcp_udp_multi_port_handling
- network_state
- proxy_unix_dac_properties
- container_protection_delete
- unix_priv_drop
- pprof_http
- proxy_haproxy_protocol
- network_hwaddr
- proxy_nat
- network_nat_order
- container_full
- backup_compression
- nvidia_runtime_config
- storage_api_volume_snapshots
- storage_unmapped
- projects
- network_vxlan_ttl
- container_incremental_copy
- usb_optional_vendorid
- snapshot_scheduling
- snapshot_schedule_aliases
- container_copy_project
- clustering_server_address
- clustering_image_replication
- container_protection_shift
- snapshot_expiry
- container_backup_override_pool
- snapshot_expiry_creation
- network_leases_location
- resources_cpu_socket
- resources_gpu
- resources_numa
- kernel_features
- id_map_current
- event_location
- storage_api_remote_volume_snapshots
- network_nat_address
- container_nic_routes
- cluster_internal_copy
- seccomp_notify
- lxc_features
- container_nic_ipvlan
- network_vlan_sriov
- storage_cephfs
- container_nic_ipfilter
- resources_v2
- container_exec_user_group_cwd
- container_syscall_intercept
- container_disk_shift
- storage_shifted
- resources_infiniband
- daemon_storage
- instances
- image_types
- resources_disk_sata
- clustering_roles
- images_expiry
- resources_network_firmware
- backup_compression_algorithm
- ceph_data_pool_name
- container_syscall_intercept_mount
- compression_squashfs
- container_raw_mount
- container_nic_routed
- container_syscall_intercept_mount_fuse
- container_disk_ceph
- virtual-machines
- image_profiles
- clustering_architecture
- resources_disk_id
- storage_lvm_stripes
- vm_boot_priority
- unix_hotplug_devices
- api_filtering
- instance_nic_network
- clustering_sizing
- firewall_driver
- projects_limits
- container_syscall_intercept_hugetlbfs
- limits_hugepages
- container_nic_routed_gateway
- projects_restrictions
- custom_volume_snapshot_expiry
- volume_snapshot_scheduling
- trust_ca_certificates
- snapshot_disk_usage
- clustering_edit_roles
- container_nic_routed_host_address
- container_nic_ipvlan_gateway
- resources_usb_pci
- resources_cpu_threads_numa
- resources_cpu_core_die
- api_os
- container_nic_routed_host_table
- container_nic_ipvlan_host_table
- container_nic_ipvlan_mode
- resources_system
- images_push_relay
- network_dns_search
- container_nic_routed_limits
- instance_nic_bridged_vlan
- network_state_bond_bridge
- usedby_consistency
- custom_block_volumes
- clustering_failure_domains
- resources_gpu_mdev
- console_vga_type
- projects_limits_disk
- network_type_macvlan
- network_type_sriov
- container_syscall_intercept_bpf_devices
- network_type_ovn
- projects_networks
- projects_networks_restricted_uplinks
- custom_volume_backup
- backup_override_name
- storage_rsync_compression
- network_type_physical
- network_ovn_external_subnets
- network_ovn_nat
- network_ovn_external_routes_remove
- tpm_device_type
- storage_zfs_clone_copy_rebase
- gpu_mdev
- resources_pci_iommu
- resources_network_usb
- resources_disk_address
- network_physical_ovn_ingress_mode
- network_ovn_dhcp
- network_physical_routes_anycast
- projects_limits_instances
- network_state_vlan
- instance_nic_bridged_port_isolation
- instance_bulk_state_change
- network_gvrp
- instance_pool_move
- gpu_sriov
- pci_device_type
- storage_volume_state
- network_acl
- migration_stateful
- disk_state_quota
- storage_ceph_features
- projects_compression
- projects_images_remote_cache_expiry
- certificate_project
- network_ovn_acl
- projects_images_auto_update
- projects_restricted_cluster_target
- images_default_architecture
- network_ovn_acl_defaults
- gpu_mig
- project_usage
- network_bridge_acl
- warnings
- projects_restricted_backups_and_snapshots
- clustering_join_token
- clustering_description
- server_trusted_proxy
- clustering_update_cert
- storage_api_project
- server_instance_driver_operational
- server_supported_storage_drivers
- event_lifecycle_requestor_address
- resources_gpu_usb
- clustering_evacuation
- network_ovn_nat_address
- network_bgp
- network_forward
- custom_volume_refresh
- network_counters_errors_dropped
- metrics
- image_source_project
- clustering_config
- network_peer
- linux_sysctl
- network_dns
- ovn_nic_acceleration
- certificate_self_renewal
- instance_project_move
- storage_volume_project_move
- cloud_init
- network_dns_nat
- database_leader
- instance_all_projects
- clustering_groups
- ceph_rbd_du
- instance_get_full
- qemu_metrics
- gpu_mig_uuid
- event_project
- clustering_evacuation_live
- instance_allow_inconsistent_copy
- network_state_ovn
- storage_volume_api_filtering
- image_restrictions
- storage_zfs_export
- network_dns_records
- storage_zfs_reserve_space
- network_acl_log
- storage_zfs_blocksize
- metrics_cpu_seconds
- instance_snapshot_never
- certificate_token
- instance_nic_routed_neighbor_probe
- event_hub
- agent_nic_config
- projects_restricted_intercept
- metrics_authentication
- images_target_project
- images_all_projects
- cluster_migration_inconsistent_copy
- cluster_ovn_chassis
- container_syscall_intercept_sched_setscheduler
- storage_lvm_thinpool_metadata_size
- storage_volume_state_total
- instance_file_head
- instances_nic_host_name
- image_copy_profile
- container_syscall_intercept_sysinfo
- clustering_evacuation_mode
- resources_pci_vpd
- qemu_raw_conf
- storage_cephfs_fscache
- network_load_balancer
- vsock_api
- instance_ready_state
- network_bgp_holdtime
- storage_volumes_all_projects
- metrics_memory_oom_total
- storage_buckets
- storage_buckets_create_credentials
- metrics_cpu_effective_total
- projects_networks_restricted_access
- storage_buckets_local
- loki
- acme
- internal_metrics
- cluster_join_token_expiry
- remote_token_expiry
- init_preseed
- storage_volumes_created_at
- cpu_hotplug
- projects_networks_zones
- network_txqueuelen
- cluster_member_state
- instances_placement_scriptlet
- storage_pool_source_wipe
- zfs_block_mode
- instance_generation_id
- disk_io_cache
- amd_sev
- storage_pool_loop_resize
- migration_vm_live
- ovn_nic_nesting
- oidc
- network_ovn_l3only
- ovn_nic_acceleration_vdpa
- cluster_healing
- instances_state_total
- auth_user
- security_csm
- instances_rebuild
- numa_cpu_placement
- custom_volume_iso
- network_allocations
- zfs_delegate
- storage_api_remote_volume_snapshot_copy
- operations_get_query_all_projects
- metadata_configuration
- syslog_socket
- event_lifecycle_name_and_project
- instances_nic_limits_priority
- disk_initial_volume_configuration
- operation_wait
- image_restriction_privileged
- cluster_internal_custom_volume_copy
- disk_io_bus
- storage_cephfs_create_missing
- instance_move_config
- ovn_ssl_config
- certificate_description
- disk_io_bus_virtio_blk
- loki_config_instance
- instance_create_start
- clustering_evacuation_stop_options
- boot_host_shutdown_action
- agent_config_drive
- network_state_ovn_lr
- image_template_permissions
- storage_bucket_backup
- storage_lvm_cluster
- shared_custom_block_volumes
- auth_tls_jwt
- oidc_claim
- device_usb_serial
- numa_cpu_balanced
- image_restriction_nesting
- network_integrations
api_status: stable
api_version: "1.0"
auth: trusted
public: false
auth_methods:
- tls
auth_user_name: srvadmin
auth_user_method: unix
environment:
  addresses:
  - <redacted>:8443
  architectures:
  - x86_64
  - i686
  certificate: <redacted>
  certificate_fingerprint: <redacted>
  driver: lxc | qemu
  driver_version: 5.0.3 | 8.1.3
  firewall: nftables
  kernel: Linux
  kernel_architecture: x86_64
  kernel_features:
    idmapped_mounts: "true"
    netnsid_getifaddrs: "true"
    seccomp_listener: "true"
    seccomp_listener_continue: "true"
    uevent_injection: "true"
    unpriv_binfmt: "true"
    unpriv_fscaps: "true"
  kernel_version: 6.7.10-200.fc39.x86_64
  lxc_features:
    cgroup2: "true"
    core_scheduling: "true"
    devpts_fd: "true"
    idmapped_mounts_v2: "true"
    mount_injection_file: "true"
    network_gateway_device_route: "true"
    network_ipvlan: "true"
    network_l2proxy: "true"
    network_phys_macvlan_mtu: "true"
    network_veth_router: "true"
    pidfd: "true"
    seccomp_allow_deny_syntax: "true"
    seccomp_notify: "true"
    seccomp_proxy_send_notify_fd: "true"
  os_name: Fedora Linux
  os_version: "39"
  project: default
  server: incus
  server_clustered: false
  server_event_mode: full-mesh
  server_name: <redacted>
  server_pid: 1586
  server_version: "0.7"
  storage: lvm
  storage_version: 2.03.23(2) (2023-11-21) / 1.02.197 (2023-11-21) / 4.48.0
  storage_supported_drivers:
  - name: btrfs
    version: "6.8"
    remote: false
  - name: dir
    version: "1"
    remote: false
  - name: lvm
    version: 2.03.23(2) (2023-11-21) / 1.02.197 (2023-11-21) / 4.48.0
    remote: false
  - name: lvmcluster
    version: 2.03.23(2) (2023-11-21) / 1.02.197 (2023-11-21) / 4.48.0
    remote: true
  • Incus VM console
BdsDxe: loading Boot0007 "Fedora" from HD(1,GPT,AD52830E-57C2-47FA-A1B2-C7E3989A80A8,0x800,0x32000)/\EFI\fedora\shimx64.efi
BdsDxe: starting Boot0007 "Fedora" from HD(1,GPT,AD52830E-57C2-47FA-A1B2-C7E3989A80A8,0x800,0x32000)/\EFI\fedora\shimx64.efi
error: ../../grub-core/fs/fshelp.c:257:file `/EFI/fedora/grubenv' not found.


  Booting `Fedora Linux (6.8.4-200.fc39.x86_64) 39'

[    0.000000] Linux version 6.8.4-200.fc39.x86_64 (mockbuild@ea9727ef4ac046558fb6c0e9fa407113) (gcc (GCC) 13.2.1 20240316 (Red Hat 13.2.1-7), GNU ld version 2.40-14.fc39) #1 SMP PREEMPT_DYNAMIC Thu Apr  4 20:45:21 UTC 2024
[    0.000000] Command line: BOOT_IMAGE=(hd0,gpt2)/boot/vmlinuz-6.8.4-200.fc39.x86_64 root=/dev/loop0p2 ro console=tty1 console=ttyS0
[    0.000000] BIOS-provided physical RAM map:
[    0.000000] BIOS-e820: [mem 0x0000000000000000-0x000000000009ffff] usable
[    0.000000] BIOS-e820: [mem 0x0000000000100000-0x000000007f8ecfff] usable
[    0.000000] BIOS-e820: [mem 0x000000007f8ed000-0x000000007fb6cfff] reserved
[    0.000000] BIOS-e820: [mem 0x000000007fb6d000-0x000000007fb7efff] ACPI data
[    0.000000] BIOS-e820: [mem 0x000000007fb7f000-0x000000007fbfefff] ACPI NVS
[    0.000000] BIOS-e820: [mem 0x000000007fbff000-0x000000007ffdffff] usable
[    0.000000] BIOS-e820: [mem 0x000000007ffe0000-0x000000007fffffff] reserved
[    0.000000] BIOS-e820: [mem 0x00000000e0000000-0x00000000efffffff] reserved
[    0.000000] BIOS-e820: [mem 0x00000000feffc000-0x00000000feffffff] reserved
[    0.000000] BIOS-e820: [mem 0x00000000ffe00000-0x00000000ffffffff] reserved
[    0.000000] BIOS-e820: [mem 0x0000000100000000-0x000000027fffffff] usable
[    0.000000] BIOS-e820: [mem 0x000000fd00000000-0x000000ffffffffff] reserved
[    0.000000] NX (Execute Disable) protection: active
[    0.000000] APIC: Static calls initialized
[    0.000000] extended physical RAM map:
[    0.000000] reserve setup_data: [mem 0x0000000000000000-0x000000000009ffff] usable
[    0.000000] reserve setup_data: [mem 0x0000000000100000-0x000000007e247017] usable
[    0.000000] reserve setup_data: [mem 0x00007e247018-0x000000007e27c657] usable
[    0.000000] reserve setup_data: [mem 0x000000007e27c658-0x000000007e27d017] usable
[    0.000000] reserve setup_data: [mem 0x000000007e27d018-0x000000007e286a57] usable
[    0.000000] reserve setup_data: [mem 0x000000007e286a58-0x000000007f8ecfff] usable
[    0.000000] reserve setup_data: [mem 0x000000007f8ed000-0x000000007fb6cfff] reserved
[    0.000000] reserve setup_data: [mem 0x000000007fb6d000-0x000000007fb7efff] ACPI data
[    0.000000] reserve setup_data: [mem 0x000000007fb7f000-0x000000007fbfefff] ACPI NVS
[    0.000000] reserve setup_data: [mem 0x000000007fbff000-0x000000007ffdffff] usable
[    0.000000] reserve setup_data: [mem 0x000000007ffe0000-0x000000007fffffff] reserved
[    0.000000] reserve setup_data: [mem 0x00000000e0000000-0x00000000efffffff] reserved
[    0.000000] reserve setup_data: [mem 0x00000000feffc000-0x00000000feffffff] reserved
[    0.000000] reserve setup_data: [mem 0x00000000ffe00000-0x00000000ffffffff] reserved
[    0.000000] reserve setup_data: [mem 0x0000000100000000-0x000000027fffffff] usable
[    0.000000] reserve setup_data: [mem 0x000000fd00000000-0x000000ffffffffff] reserved
[    0.000000] efi: EFI v2.7 by EDK II
[    0.000000] efi: SMBIOS=0x7f8f9000 SMBIOS 3.0=0x7f8f7000 ACPI=0x7fb7e000 ACPI 2.0=0x7fb7e014 MEMATTR=0x7e9ab198 MOKvar=0x7f8f3000 RNG=0x7fb70018 
[    0.000000] random: crng init done
[    0.000000] efi: Remove mem109: MMIO range=[0xffe00000-0xffffffff] (2MB) from e820 map
[    0.000000] secureboot: Secure boot disabled
[    0.000000] SMBIOS 3.0.0 present.
[    0.000000] DMI: QEMU Standard PC (Q35 + ICH9, 2009)/Incus, BIOS edk2-20240214-2.fc39 02/14/2024
[    0.000000] Hypervisor detected: KVM
[    0.000000] kvm-clock: Using msrs 4b564d01 and 4b564d00
[    0.000000] kvm-clock: using sched offset of 8894725213 cycles
[    0.000001] clocksource: kvm-clock: mask: 0xffffffffffffffff max_cycles: 0x1cd42e4dffb, max_idle_ns: 881590591483 ns
[    0.000003] tsc: Detected 4491.540 MHz processor
[    0.000078] last_pfn = 0x280000 max_arch_pfn = 0x400000000
[    0.000101] MTRR map: 4 entries (2 fixed + 2 variable; max 18), built from 8 variable MTRRs
[    0.000103] x86/PAT: Configuration [0-7]: WB  WC  UC- UC  WB  WP  UC- WT  
[    0.000131] last_pfn = 0x7ffe0 max_arch_pfn = 0x400000000
[    0.003011] Using GB pages for direct mapping
[    0.003183] secureboot: Secure boot disabled
[    0.003183] RAMDISK: [mem 0x7c741000-0x7d939fff]
[    0.003187] ACPI: Early table checksum verification disabled
[    0.003189] ACPI: RSDP 0x000000007FB7E014 000024 (v02 BOCHS )
[    0.003192] ACPI: XSDT 0x000000007FB7D0E8 000064 (v01 BOCHS  BXPC     00000001      01000013)
[    0.003195] ACPI: FACP 0x000000007FB78000 0000F4 (v03 BOCHS  BXPC     00000001 BXPC 00000001)
[    0.003199] ACPI: DSDT 0x000000007FB79000 003426 (v01 BOCHS  BXPC     00000001 BXPC 00000001)
[    0.003202] ACPI: FACS 0x000000007FBDC000 000040
[    0.003204] ACPI: APIC 0x000000007FB77000 000170 (v03 BOCHS  BXPC     00000001 BXPC 00000001)
[    0.003207] ACPI: SSDT 0x000000007FB76000 0000CA (v01 BOCHS  VMGENID  00000001 BXPC 00000001)
[    0.003209] ACPI: HPET 0x000000007FB75000 000038 (v01 BOCHS  BXPC     00000001 BXPC 00000001)
[    0.003211] ACPI: SRAT 0x000000007FB74000 0002A8 (v01 BOCHS  BXPC     00000001 BXPC 00000001)
[    0.003214] ACPI: MCFG 0x000000007FB73000 00003C (v01 BOCHS  BXPC     00000001 BXPC 00000001)
[    0.003216] ACPI: WAET 0x000000007FB72000 000028 (v01 BOCHS  BXPC     00000001 BXPC 00000001)
[    0.003218] ACPI: BGRT 0x000000007FB71000 000038 (v01 INTEL  EDK2     00000002      01000013)
[    0.003219] ACPI: Reserving FACP table memory at [mem 0x7fb78000-0x7fb780f3]
[    0.003220] ACPI: Reserving DSDT table memory at [mem 0x7fb79000-0x7fb7c425]
[    0.003221] ACPI: Reserving FACS table memory at [mem 0x7fbdc000-0x7fbdc03f]
[    0.003221] ACPI: Reserving APIC table memory at [mem 0x7fb77000-0x7fb7716f]
[    0.003221] ACPI: Reserving SSDT table memory at [mem 0x7fb76000-0x7fb760c9]
[    0.003222] ACPI: Reserving HPET table memory at [mem 0x7fb75000-0x7fb75037]
[    0.003222] ACPI: Reserving SRAT table memory at [mem 0x7fb74000-0x7fb742a7]
[    0.003223] ACPI: Reserving MCFG table memory at [mem 0x7fb73000-0x7fb7303b]
[    0.003223] ACPI: Reserving WAET table memory at [mem 0x7fb72000-0x7fb72027]
[    0.003223] ACPI: Reserving BGRT table memory at [mem 0x7fb71000-0x7fb71037]
[    0.003248] SRAT: PXM 0 -> APIC 0x00 -> Node 0
[    0.003249] SRAT: PXM 0 -> APIC 0x01 -> Node 0
[    0.003249] SRAT: PXM 0 -> APIC 0x02 -> Node 0
[    0.003250] SRAT: PXM 0 -> APIC 0x03 -> Node 0
[    0.003250] SRAT: PXM 0 -> APIC 0x04 -> Node 0
[    0.003250] SRAT: PXM 0 -> APIC 0x05 -> Node 0
[    0.003251] SRAT: PXM 0 -> APIC 0x06 -> Node 0
[    0.003251] SRAT: PXM 0 -> APIC 0x07 -> Node 0
[    0.003251] SRAT: PXM 0 -> APIC 0x08 -> Node 0
[    0.003252] SRAT: PXM 0 -> APIC 0x09 -> Node 0
[    0.003252] SRAT: PXM 0 -> APIC 0x0a -> Node 0
[    0.003252] SRAT: PXM 0 -> APIC 0x0b -> Node 0
[    0.003253] SRAT: PXM 0 -> APIC 0x0c -> Node 0
[    0.003253] SRAT: PXM 0 -> APIC 0x0d -> Node 0
[    0.003253] SRAT: PXM 0 -> APIC 0x0e -> Node 0
[    0.003254] SRAT: PXM 0 -> APIC 0x0f -> Node 0
[    0.003254] SRAT: PXM 0 -> APIC 0x10 -> Node 0
[    0.003254] SRAT: PXM 0 -> APIC 0x11 -> Node 0
[    0.003255] SRAT: PXM 0 -> APIC 0x12 -> Node 0
[    0.003255] SRAT: PXM 0 -> APIC 0x13 -> Node 0
[    0.003256] SRAT: PXM 0 -> APIC 0x14 -> Node 0
[    0.003256] SRAT: PXM 0 -> APIC 0x15 -> Node 0
[    0.003256] SRAT: PXM 0 -> APIC 0x16 -> Node 0
[    0.003257] SRAT: PXM 0 -> APIC 0x17 -> Node 0
[    0.003257] SRAT: PXM 0 -> APIC 0x18 -> Node 0
[    0.003257] SRAT: PXM 0 -> APIC 0x19 -> Node 0
[    0.003258] SRAT: PXM 0 -> APIC 0x1a -> Node 0
[    0.003258] SRAT: PXM 0 -> APIC 0x1b -> Node 0
[    0.003258] SRAT: PXM 0 -> APIC 0x1c -> Node 0
[    0.003259] SRAT: PXM 0 -> APIC 0x1d -> Node 0
[    0.003259] SRAT: PXM 0 -> APIC 0x1e -> Node 0
[    0.003259] SRAT: PXM 0 -> APIC 0x1f -> Node 0
[    0.003260] ACPI: SRAT: Node 0 PXM 0 [mem 0x00000000-0x0009ffff]
[    0.003261] ACPI: SRAT: Node 0 PXM 0 [mem 0x00100000-0x7fffffff]
[    0.003262] ACPI: SRAT: Node 0 PXM 0 [mem 0x100000000-0x27fffffff]
[    0.003264] NUMA: Node 0 [mem 0x00000000-0x0009ffff] + [mem 0x00100000-0x7fffffff] -> [mem 0x00000000-0x7fffffff]
[    0.003265] NUMA: Node 0 [mem 0x00000000-0x7fffffff] + [mem 0x100000000-0x27fffffff] -> [mem 0x00000000-0x27fffffff]
[    0.003269] NODE_DATA(0) allocated [mem 0x27ffd5000-0x27fffffff]
[    0.003502] Zone ranges:
[    0.003502]   DMA      [mem 0x0000000000001000-0x0000000000ffffff]
[    0.003503]   DMA32    [mem 0x0000000001000000-0x00000000ffffffff]
[    0.003504]   Normal   [mem 0x0000000100000000-0x000000027fffffff]
[    0.003505]   Device   empty
[    0.003506] Movable zone start for each node
[    0.003507] Early memory node ranges
[    0.003507]   node   0: [mem 0x0000000000001000-0x000000000009ffff]
[    0.003508]   node   0: [mem 0x0000000000100000-0x000000007f8ecfff]
[    0.003508]   node   0: [mem 0x000000007fbff000-0x000000007ffdffff]
[    0.003509]   node   0: [mem 0x0000000100000000-0x000000027fffffff]
[    0.003510] Initmem setup node 0 [mem 0x0000000000001000-0x000000027fffffff]
[    0.003523] On node 0, zone DMA: 1 pages in unavailable ranges
[    0.003683] On node 0, zone DMA: 96 pages in unavailable ranges
[    0.024600] On node 0, zone DMA32: 786 pages in unavailable ranges
[    0.086871] On node 0, zone Normal: 32 pages in unavailable ranges
[    0.087419] ACPI: PM-Timer IO Port: 0x608
[    0.087432] ACPI: LAPIC_NMI (acpi_id[0xff] dfl dfl lint[0x1])
[    0.087453] IOAPIC[0]: apic_id 0, version 17, address 0xfec00000, GSI 0-23
[    0.087455] ACPI: INT_SRC_OVR (bus 0 bus_irq 0 global_irq 2 dfl dfl)
[    0.087456] ACPI: INT_SRC_OVR (bus 0 bus_irq 5 global_irq 5 high level)
[    0.087456] ACPI: INT_SRC_OVR (bus 0 bus_irq 9 global_irq 9 high level)
[    0.087457] ACPI: INT_SRC_OVR (bus 0 bus_irq 10 global_irq 10 high level)
[    0.087458] ACPI: INT_SRC_OVR (bus 0 bus_irq 11 global_irq 11 high level)
[    0.087460] ACPI: Using ACPI (MADT) for SMP configuration information
[    0.087461] ACPI: HPET id: 0x8086a201 base: 0xfed00000
[    0.087485] TSC deadline timer available
[    0.087485] smpboot: Allowing 32 CPUs, 28 hotplug CPUs
[    0.087502] kvm-guest: APIC: eoi() replaced with kvm_guest_apic_eoi_write()
[    0.087515] kvm-guest: KVM setup pv remote TLB flush
[    0.087517] kvm-guest: setup PV sched yield
[    0.087524] PM: hibernation: Registered nosave memory: [mem 0x00000000-0x00000fff]
[    0.087525] PM: hibernation: Registered nosave memory: [mem 0x000a0000-0x000fffff]
[    0.087526] PM: hibernation: Registered nosave memory: [mem 0x7e247000-0x7e247fff]
[    0.087527] PM: hibernation: Registered nosave memory: [mem 0x7e27c000-0x7e27cfff]
[    0.087527] PM: hibernation: Registered nosave memory: [mem 0x7e27d000-0x7e27dfff]
[    0.087528] PM: hibernation: Registered nosave memory: [mem 0x7e286000-0x7e286fff]
[    0.087528] PM: hibernation: Registered nosave memory: [mem 0x7e287000-0x7e28ffff]
[    0.087529] PM: hibernation: Registered nosave memory: [mem 0x7f8ed000-0x7fb6cfff]
[    0.087529] PM: hibernation: Registered nosave memory: [mem 0x7fb6d000-0x7fb7efff]
[    0.087530] PM: hibernation: Registered nosave memory: [mem 0x7fb7f000-0x7fbfefff]
[    0.087533] PM: hibernation: Registered nosave memory: [mem 0x7ffe0000-0x7fffffff]
[    0.087533] PM: hibernation: Registered nosave memory: [mem 0x80000000-0xdfffffff]
[    0.087533] PM: hibernation: Registered nosave memory: [mem 0xe0000000-0xefffffff]
[    0.087534] PM: hibernation: Registered nosave memory: [mem 0xf0000000-0xfeffbfff]
[    0.087534] PM: hibernation: Registered nosave memory: [mem 0xfeffc000-0xfeffffff]
[    0.087535] PM: hibernation: Registered nosave memory: [mem 0xff000000-0xffffffff]
[    0.087536] [mem 0x80000000-0xdfffffff] available for PCI devices
[    0.087537] Booting paravirtualized kernel on KVM
[    0.087538] clocksource: refined-jiffies: mask: 0xffffffff max_cycles: 0xffffffff, max_idle_ns: 1910969940391419 ns
[    0.090936] setup_percpu: NR_CPUS:8192 nr_cpumask_bits:32 nr_cpu_ids:32 nr_node_ids:1
[    0.096286] percpu: Embedded 64 pages/cpu s225280 r8192 d28672 u262144
[    0.096322] kvm-guest: PV spinlocks enabled
[    0.096323] PV qspinlock hash table entries: 256 (order: 0, 4096 bytes, linear)
[    0.096325] Kernel command line: BOOT_IMAGE=(hd0,gpt2)/boot/vmlinuz-6.8.4-200.fc39.x86_64 root=/dev/loop0p2 ro console=tty1 console=ttyS0
[    0.096368] Unknown kernel command line parameters "BOOT_IMAGE=(hd0,gpt2)/boot/vmlinuz-6.8.4-200.fc39.x86_64", will be passed to user space.
[    0.101691] Dentry cache hash table entries: 1048576 (order: 11, 8388608 bytes, linear)
[    0.104212] Inode-cache hash table entries: 524288 (order: 10, 4194304 bytes, linear)
[    0.104474] Fallback order for Node 0: 0 
[    0.104477] Built 1 zonelists, mobility grouping on.  Total pages: 2061304
[    0.104478] Policy zone: Normal
[    0.106000] mem auto-init: stack:all(zero), heap alloc:off, heap free:off
[    0.106005] software IO TLB: area num 32.
[    0.139919] Memory: 8047144K/8384948K available (20480K kernel code, 3275K rwdata, 14800K rodata, 4620K init, 4824K bss, 337544K reserved, 0K cma-reserved)
[    0.140140] SLUB: HWalign=64, Order=0-3, MinObjects=0, CPUs=32, Nodes=1
[    0.140199] ftrace: allocating 54724 entries in 214 pages
[    0.149086] ftrace: allocated 214 pages with 5 groups
[    0.149905] Dynamic Preempt: voluntary
[    0.150039] rcu: Preemptible hierarchical RCU implementation.
[    0.150040] rcu:     RCU restricting CPUs from NR_CPUS=8192 to nr_cpu_ids=32.
[    0.150041]  Trampoline variant of Tasks RCU enabled.
[    0.150041]  Rude variant of Tasks RCU enabled.
[    0.150042]  Tracing variant of Tasks RCU enabled.
[    0.150042] rcu: RCU calculated value of scheduler-enlistment delay is 100 jiffies.
[    0.150043] rcu: Adjusting geometry for rcu_fanout_leaf=16, nr_cpu_ids=32
[    0.151969] NR_IRQS: 524544, nr_irqs: 680, preallocated irqs: 16
[    0.152177] rcu: srcu_init: Setting srcu_struct sizes based on contention.
[    0.152313] kfence: initialized - using 2097152 bytes for 255 objects at 0x(____ptrval____)-0x(____ptrval____)
[    0.152358] Console: colour dummy device 80x25
[    0.152360] printk: legacy console [tty1] enabled
[    0.152556] printk: legacy console [ttyS0] enabled
[    0.371680] ACPI: Core revision 20230628
[    0.372095] clocksource: hpet: mask: 0xffffffff max_cycles: 0xffffffff, max_idle_ns: 19112604467 ns
[    0.372874] APIC: Switch to symmetric I/O mode setup
[    0.373379] x2apic enabled
[    0.373773] APIC: Switched APIC routing to: physical x2apic
[    0.374212] kvm-guest: APIC: send_IPI_mask() replaced with kvm_send_ipi_mask()
[    0.374791] kvm-guest: APIC: send_IPI_mask_allbutself() replaced with kvm_send_ipi_mask_allbutself()
[    0.375489] kvm-guest: setup PV IPIs
[    0.376348] ..TIMER: vector=0x30 apic1=0 pin1=2 apic2=-1 pin2=-1
[    0.376873] tsc: Marking TSC unstable due to TSCs unsynchronized
[    0.377370] Calibrating delay loop (skipped) preset value.. 8983.08 BogoMIPS (lpj=4491540)
[    0.378421] x86/cpu: User Mode Instruction Prevention (UMIP) activated
[    0.379011] Last level iTLB entries: 4KB 512, 2MB 255, 4MB 127
[    0.379371] Last level dTLB entries: 4KB 512, 2MB 255, 4MB 127, 1GB 0
[    0.379914] Spectre V1 : Mitigation: usercopy/swapgs barriers and __user pointer sanitization
[    0.380373] Spectre V2 : Mitigation: Enhanced / Automatic IBRS
[    0.381370] Spectre V2 : Spectre v2 / SpectreRSB mitigation: Filling RSB on context switch
[    0.382060] Spectre V2 : mitigation: Enabling conditional Indirect Branch Prediction Barrier
[    0.382371] Speculative Store Bypass: Mitigation: Speculative Store Bypass disabled via prctl
[    0.383371] Speculative Return Stack Overflow: IBPB-extending microcode not applied!
[    0.384016] Speculative Return Stack Overflow: WARNING: See https://kernel.org/doc/html/latest/admin-guide/hw-vuln/srso.html for mitigation options.
[    0.384016] Speculative Return Stack Overflow: Vulnerable: Safe RET, no microcode
[    0.385385] x86/fpu: Supporting XSAVE feature 0x001: 'x87 floating point registers'
[    0.386370] x86/fpu: Supporting XSAVE feature 0x002: 'SSE registers'
[    0.386899] x86/fpu: Supporting XSAVE feature 0x004: 'AVX registers'
[    0.387370] x86/fpu: Supporting XSAVE feature 0x020: 'AVX-512 opmask'
[    0.387993] x86/fpu: Supporting XSAVE feature 0x040: 'AVX-512 Hi256'
[    0.388370] x86/fpu: Supporting XSAVE feature 0x080: 'AVX-512 ZMM_Hi256'
[    0.389370] x86/fpu: Supporting XSAVE feature 0x200: 'Protection Keys User registers'
[    0.390023] x86/fpu: xstate_offset[2]:  576, xstate_sizes[2]:  256
[    0.390370] x86/fpu: xstate_offset[5]:  832, xstate_sizes[5]:   64
[    0.390886] x86/fpu: xstate_offset[6]:  896, xstate_sizes[6]:  512
[    0.391370] x86/fpu: xstate_offset[7]: 1408, xstate_sizes[7]: 1024
[    0.391884] x86/fpu: xstate_offset[9]: 2432, xstate_sizes[9]:    8
[    0.392370] x86/fpu: Enabled xstate features 0x2e7, context size is 2440 bytes, using 'compacted' format.
[    0.410225] Freeing SMP alternatives memory: 48K
[    0.410373] pid_max: default: 32768 minimum: 301
[    0.412516] LSM: initializing lsm=lockdown,capability,yama,selinux,bpf,landlock,integrity
[    0.413219] Yama: becoming mindful.
[    0.413373] SELinux:  Initializing.
[    0.413696] LSM support for eBPF active
[    0.414027] landlock: Up and running.
[    0.414475] Mount-cache hash table entries: 16384 (order: 5, 131072 bytes, linear)
[    0.415192] Mountpoint-cache hash table entries: 16384 (order: 5, 131072 bytes, linear)
[    0.416418] smpboot: CPU0: AMD Ryzen 9 7950X 16-Core Processor (family: 0x19, model: 0x61, stepping: 0x2)
[    0.417556] RCU Tasks: Setting shift to 5 and lim to 1 rcu_task_cb_adjust=1.
[    0.418264] RCU Tasks Rude: Setting shift to 5 and lim to 1 rcu_task_cb_adjust=1.
[    0.418409] RCU Tasks Trace: Setting shift to 5 and lim to 1 rcu_task_cb_adjust=1.
[    0.419093] Performance Events: Fam17h+ core perfctr, AMD PMU driver.
[    0.419375] ... version:                0
[    0.419712] ... bit width:              48
[    0.420054] ... generic registers:      6
[    0.420372] ... value mask:             0000ffffffffffff
[    0.420813] ... max period:             00007fffffffffff
[    0.421260] ... fixed-purpose events:   0
[    0.421372] ... event mask:             000000000000003f
[    0.421894] signal: max sigframe size: 3376
[    0.422294] rcu: Hierarchical SRCU implementation.
[    0.422373] rcu:     Max phase no-delay instances is 400.
[    0.425535] smp: Bringing up secondary CPUs ...
[    0.426179] smpboot: x86: Booting SMP configuration:
[    0.426374] .... node  #0, CPUs:        #1  #2  #3
[    0.427417] smp: Brought up 1 node, 4 CPUs
[    0.428374] smpboot: Max logical packages: 8
[    0.428749] smpboot: Total of 4 processors activated (35932.32 BogoMIPS)
[    0.429600] devtmpfs: initialized
[    0.429677] x86/mm: Memory block size: 128MB
[    0.431382] ACPI: PM: Registering ACPI NVS region [mem 0x7fb7f000-0x7fbfefff] (524288 bytes)
[    0.432135] clocksource: jiffies: mask: 0xffffffff max_cycles: 0xffff, max_idle_ns: 1911260446275000 ns
[    0.432377] futex hash table entries: 8192 (order: 7, 524288 bytes, linear)
[    0.433323] pinctrl core: initialized pinctrl subsystem
[    0.433514] PM: RTC time: 14:00:31, date: 2024-04-06
[    0.435451] NET: Registered PF_NETLINK/PF_ROUTE protocol family
[    0.436052] DMA: preallocated 1024 KiB GFP_KERNEL pool for atomic allocations
[    0.436382] DMA: preallocated 1024 KiB GFP_KERNEL|GFP_DMA pool for atomic allocations
[    0.437008] DMA: preallocated 1024 KiB GFP_KERNEL|GFP_DMA32 pool for atomic allocations
[    0.437396] audit: initializing netlink subsys (disabled)
[    0.437873] audit: type=2000 audit(1712412032.173:1): state=initialized audit_enabled=0 res=1
[    0.437873] thermal_sys: Registered thermal governor 'fair_share'
[    0.438375] thermal_sys: Registered thermal governor 'bang_bang'
[    0.438867] thermal_sys: Registered thermal governor 'step_wise'
[    0.439346] thermal_sys: Registered thermal governor 'user_space'
[    0.439490] cpuidle: using governor menu
[    0.440543] acpiphp: ACPI Hot Plug PCI Controller Driver version: 0.5
[    0.441315] PCI: ECAM [mem 0xe0000000-0xefffffff] (base 0xe0000000) for domain 0000 [bus 00-ff]
[    0.441369] PCI: ECAM [mem 0xe0000000-0xefffffff] reserved as E820 entry
[    0.441369] PCI: Using configuration type 1 for base access
[    0.443408] kprobes: kprobe jump-optimization is enabled. All kprobes are optimized if possible.
[    0.444485] HugeTLB: registered 1.00 GiB page size, pre-allocated 0 pages
[    0.444995] HugeTLB: 16380 KiB vmemmap can be freed for a 1.00 GiB page
[    0.445369] HugeTLB: registered 2.00 MiB page size, pre-allocated 0 pages
[    0.445369] HugeTLB: 28 KiB vmemmap can be freed for a 2.00 MiB page
[    0.447443] cryptd: max_cpu_qlen set to 1000
[    0.448421] raid6: skipped pq benchmark and selected avx512x4
[    0.448421] raid6: using avx512x2 recovery algorithm
[    0.448952] fbcon: Taking over console
[    0.449374] ACPI: Added _OSI(Module Device)
[    0.449771] ACPI: Added _OSI(Processor Device)
[    0.450187] ACPI: Added _OSI(3.0 _SCP Extensions)
[    0.450373] ACPI: Added _OSI(Processor Aggregator Device)
[    0.452598] ACPI: 2 ACPI AML tables successfully acquired and loaded
[    0.461031] ACPI: _OSC evaluation for CPUs failed, trying _PDC
[    0.461557] ACPI: Interpreter enabled
[    0.461899] ACPI: PM: (supports S0 S5)
[    0.462246] ACPI: Using IOAPIC for interrupt routing
[    0.462564] PCI: Using host bridge windows from ACPI; if necessary, use "pci=nocrs" and report a bug
[    0.463374] PCI: Ignoring E820 reservations for host bridge windows
[    0.464055] ACPI: Enabled 3 GPEs in block 00 to 3F
[    0.467559] ACPI: PCI Root Bridge [PCI0] (domain 0000 [bus 00-ff])
[    0.468137] acpi PNP0A08:00: _OSC: OS supports [ExtendedConfig ASPM ClockPM Segments MSI EDR HPX-Type3]
[    0.469405] acpi PNP0A08:00: _OSC: platform does not support [PCIeHotplug LTR DPC]
[    0.470139] acpi PNP0A08:00: _OSC: OS now controls [SHPCHotplug PME AER PCIeCapability]
[    0.470548] PCI host bridge to bus 0000:00
[    0.470923] pci_bus 0000:00: root bus resource [io  0x0000-0x0cf7 window]
[    0.472374] pci_bus 0000:00: root bus resource [io  0x0d00-0xffff window]
[    0.472984] pci_bus 0000:00: root bus resource [mem 0x000a0000-0x000bffff window]
[    0.473373] pci_bus 0000:00: root bus resource [mem 0x80000000-0xdfffffff window]
[    0.474054] pci_bus 0000:00: root bus resource [mem 0xf0000000-0xfebfffff window]
[    0.474374] pci_bus 0000:00: root bus resource [mem 0x380000000000-0x3847ffffffff window]
[    0.475119] pci_bus 0000:00: root bus resource [bus 00-ff]
[    0.475407] pci 0000:00:00.0: [8086:29c0] type 00 class 0x060000 conventional PCI endpoint
[    0.476411] pci 0000:00:01.0: [1b36:000c] type 01 class 0x060400 PCIe Root Port
[    0.480037] pci 0000:00:01.0: BAR 0 [mem 0x81a49000-0x81a49fff]
[    0.483376] pci 0000:00:01.0: PCI bridge to [bus 01]
[    0.483901] pci 0000:00:01.0:   bridge window [mem 0x81800000-0x819fffff]
[    0.485158] pci 0000:00:01.0:   bridge window [mem 0x380000000000-0x3807ffffffff 64bit pref]
[    0.486157] pci 0000:00:01.1: [1b36:000c] type 01 class 0x060400 PCIe Root Port
[    0.489318] pci 0000:00:01.1: BAR 0 [mem 0x81a48000-0x81a48fff]
[    0.491376] pci 0000:00:01.1: PCI bridge to [bus 02]
[    0.491851] pci 0000:00:01.1:   bridge window [mem 0x81600000-0x817fffff]
[    0.492745] pci 0000:00:01.1:   bridge window [mem 0x380800000000-0x380fffffffff 64bit pref]
[    0.493932] pci 0000:00:01.2: [1b36:000c] type 01 class 0x060400 PCIe Root Port
[    0.496373] pci 0000:00:01.2: BAR 0 [mem 0x81a47000-0x81a47fff]
[    0.500371] pci 0000:00:01.2: PCI bridge to [bus 03]
[    0.500845] pci 0000:00:01.2:   bridge window [mem 0x81400000-0x815fffff]
[    0.501653] pci 0000:00:01.2:   bridge window [mem 0x381000000000-0x3817ffffffff 64bit pref]
[    0.502888] pci 0000:00:01.3: [1b36:000c] type 01 class 0x060400 PCIe Root Port
[    0.506390] pci 0000:00:01.3: BAR 0 [mem 0x81a46000-0x81a46fff]
[    0.509417] pci 0000:00:01.3: PCI bridge to [bus 04]
[    0.509994] pci 0000:00:01.3:   bridge window [mem 0x80000000-0x808fffff]
[    0.511684] pci 0000:00:01.3:   bridge window [mem 0x381800000000-0x381fffffffff 64bit pref]
[    0.513259] pci 0000:00:01.4: [1b36:000c] type 01 class 0x060400 PCIe Root Port
[    0.514372] pci 0000:00:01.4: BAR 0 [mem 0x81a45000-0x81a45fff]
[    0.517307] pci 0000:00:01.4: PCI bridge to [bus 05]
[    0.517391] pci 0000:00:01.4:   bridge window [mem 0x81200000-0x813fffff]
[    0.518294] pci 0000:00:01.4:   bridge window [mem 0x382000000000-0x3827ffffffff 64bit pref]
[    0.520066] pci 0000:00:01.5: [1b36:000c] type 01 class 0x060400 PCIe Root Port
[    0.521134] pci 0000:00:01.5: BAR 0 [mem 0x81a44000-0x81a44fff]
[    0.523372] pci 0000:00:01.5: PCI bridge to [bus 06]
[    0.523845] pci 0000:00:01.5:   bridge window [mem 0x81000000-0x811fffff]
[    0.524669] pci 0000:00:01.5:   bridge window [mem 0x382800000000-0x382fffffffff 64bit pref]
[    0.525908] pci 0000:00:01.6: [1b36:000c] type 01 class 0x060400 PCIe Root Port
[    0.528095] pci 0000:00:01.6: BAR 0 [mem 0x81a43000-0x81a43fff]
[    0.529266] pci 0000:00:01.6: PCI bridge to [bus 07]
[    0.530396] pci 0000:00:01.6:   bridge window [mem 0x80e00000-0x80ffffff]
[    0.531276] pci 0000:00:01.6:   bridge window [mem 0x383000000000-0x3837ffffffff 64bit pref]
[    0.531915] pci 0000:00:01.7: [1b36:000c] type 01 class 0x060400 PCIe Root Port
[    0.534088] pci 0000:00:01.7: BAR 0 [mem 0x81a42000-0x81a42fff]
[    0.535834] pci 0000:00:01.7: PCI bridge to [bus 08]
[    0.536292] pci 0000:00:01.7:   bridge window [mem 0x80c00000-0x80dfffff]
[    0.538658] pci 0000:00:01.7:   bridge window [mem 0x383800000000-0x383fffffffff 64bit pref]
[    0.539885] pci 0000:00:02.0: [1b36:000c] type 01 class 0x060400 PCIe Root Port
[    0.541123] pci 0000:00:02.0: BAR 0 [mem 0x81a41000-0x81a41fff]
[    0.542308] pci 0000:00:02.0: PCI bridge to [bus 09]
[    0.543391] pci 0000:00:02.0:   bridge window [mem 0x80a00000-0x80bfffff]
[    0.544281] pci 0000:00:02.0:   bridge window [mem 0x384000000000-0x3847ffffffff 64bit pref]
[    0.544997] pci 0000:00:1f.0: [8086:2918] type 00 class 0x060100 conventional PCI endpoint
[    0.546598] pci 0000:00:1f.0: quirk: [io  0x0600-0x067f] claimed by ICH6 ACPI/GPIO/TCO
[    0.547391] pci 0000:00:1f.2: [8086:2922] type 00 class 0x010601 conventional PCI endpoint
[    0.550589] pci 0000:00:1f.2: BAR 4 [io  0x6040-0x605f]
[    0.551371] pci 0000:00:1f.2: BAR 5 [mem 0x81a40000-0x81a40fff]
[    0.552481] pci 0000:00:1f.3: [8086:2930] type 00 class 0x0c0500 conventional PCI endpoint
[    0.556156] pci 0000:00:1f.3: BAR 4 [io  0x6000-0x603f]
[    0.558396] acpiphp: Slot [0] registered
[    0.558839] pci 0000:01:00.0: [1af4:1045] type 00 class 0x00ff00 PCIe Endpoint
[    0.562928] pci 0000:01:00.0: BAR 4 [mem 0x380000014000-0x380000017fff 64bit pref]
[    0.564512] pci 0000:01:00.1: [1af4:1044] type 00 class 0x00ff00 PCIe Endpoint
[    0.566302] pci 0000:01:00.1: BAR 1 [mem 0x81808000-0x81808fff]
[    0.567851] pci 0000:01:00.1: BAR 4 [mem 0x380000010000-0x380000013fff 64bit pref]
[    0.569733] pci 0000:01:00.2: [1af4:1052] type 00 class 0x090000 PCIe Endpoint
[    0.572824] pci 0000:01:00.2: BAR 1 [mem 0x81807000-0x81807fff]
[    0.575371] pci 0000:01:00.2: BAR 4 [mem 0x38000000c000-0x38000000ffff 64bit pref]
[    0.577187] pci 0000:01:00.3: [1af4:1052] type 00 class 0x098000 PCIe Endpoint
[    0.578321] pci 0000:01:00.3: BAR 1 [mem 0x81806000-0x81806fff]
[    0.581372] pci 0000:01:00.3: BAR 4 [mem 0x380000008000-0x38000000bfff 64bit pref]
[    0.585390] pci 0000:01:00.4: [1af4:1053] type 00 class 0x078000 PCIe Endpoint
[    0.586808] pci 0000:01:00.4: BAR 1 [mem 0x81805000-0x81805fff]
[    0.588371] pci 0000:01:00.4: BAR 4 [mem 0x380000004000-0x380000007fff 64bit pref]
[    0.591168] pci 0000:01:00.5: [1af4:1043] type 00 class 0x078000 PCIe Endpoint
[    0.592308] pci 0000:01:00.5: BAR 1 [mem 0x81804000-0x81804fff]
[    0.594365] pci 0000:01:00.5: BAR 4 [mem 0x380000000000-0x380000003fff 64bit pref]
[    0.598639] pci 0000:01:00.6: [1b36:000d] type 00 class 0x0c0330 PCIe Endpoint
[    0.599518] pci 0000:01:00.6: BAR 0 [mem 0x81800000-0x81803fff 64bit]
[    0.601988] pci 0000:00:01.0: PCI bridge to [bus 01]
[    0.602774] acpiphp: Slot [0-2] registered
[    0.603209] pci 0000:02:00.0: [1af4:1048] type 00 class 0x010000 PCIe Endpoint
[    0.604312] pci 0000:02:00.0: BAR 1 [mem 0x81600000-0x81600fff]
[    0.606626] pci 0000:02:00.0: BAR 4 [mem 0x380800000000-0x380800003fff 64bit pref]
[    0.609698] pci 0000:00:01.1: PCI bridge to [bus 02]
[    0.610466] acpiphp: Slot [0-3] registered
[    0.610937] pci 0000:03:00.0: [1af4:1049] type 00 class 0x000200 PCIe Endpoint
[    0.612372] pci 0000:03:00.0: BAR 1 [mem 0x81400000-0x81400fff]
[    0.615327] pci 0000:03:00.0: BAR 4 [mem 0x381000000000-0x381000003fff 64bit pref]
[    0.616691] pci 0000:00:01.2: PCI bridge to [bus 03]
[    0.617535] pci 0000:04:00.0: [1af4:1050] type 00 class 0x030000 PCIe Endpoint
[    0.620450] pci 0000:04:00.0: BAR 0 [mem 0x80000000-0x807fffff pref]
[    0.623400] pci 0000:04:00.0: BAR 2 [mem 0x381800000000-0x381800003fff 64bit pref]
[    0.624841] pci 0000:04:00.0: BAR 4 [mem 0x80800000-0x80800fff]
[    0.627865] pci 0000:04:00.0: ROM [mem 0xffff0000-0xffffffff pref]
[    0.628599] pci 0000:04:00.0: BAR 0: assigned to efifb
[    0.630393] pci 0000:04:00.0: Video device with shadowed ROM at [mem 0x000c0000-0x000dffff]
[    0.632098] pci 0000:00:01.3: PCI bridge to [bus 04]
[    0.632829] acpiphp: Slot [0-4] registered
[    0.633249] pci 0000:05:00.0: [1af4:1041] type 00 class 0x020000 PCIe Endpoint
[    0.635328] pci 0000:05:00.0: BAR 1 [mem 0x81200000-0x81200fff]
[    0.637615] pci 0000:05:00.0: BAR 4 [mem 0x382000000000-0x382000003fff 64bit pref]
[    0.638604] pci 0000:05:00.0: ROM [mem 0xfffc0000-0xffffffff pref]
[    0.640038] pci 0000:00:01.4: PCI bridge to [bus 05]
[    0.640767] acpiphp: Slot [0-5] registered
[    0.642382] pci 0000:00:01.5: PCI bridge to [bus 06]
[    0.643217] acpiphp: Slot [0-6] registered
[    0.643381] pci 0000:00:01.6: PCI bridge to [bus 07]
[    0.644177] acpiphp: Slot [0-7] registered
[    0.644381] pci 0000:00:01.7: PCI bridge to [bus 08]
[    0.645176] acpiphp: Slot [0-8] registered
[    0.645381] pci 0000:00:02.0: PCI bridge to [bus 09]
[    0.648332] ACPI: PCI: Interrupt link LNKA configured for IRQ 10
[    0.649423] ACPI: PCI: Interrupt link LNKB configured for IRQ 10
[    0.649972] ACPI: PCI: Interrupt link LNKC configured for IRQ 11
[    0.650418] ACPI: PCI: Interrupt link LNKD configured for IRQ 11
[    0.650966] ACPI: PCI: Interrupt link LNKE configured for IRQ 10
[    0.651417] ACPI: PCI: Interrupt link LNKF configured for IRQ 10
[    0.653419] ACPI: PCI: Interrupt link LNKG configured for IRQ 11
[    0.653960] ACPI: PCI: Interrupt link LNKH configured for IRQ 11
[    0.654391] ACPI: PCI: Interrupt link GSIA configured for IRQ 16
[    0.654892] ACPI: PCI: Interrupt link GSIB configured for IRQ 17
[    0.655379] ACPI: PCI: Interrupt link GSIC configured for IRQ 18
[    0.655880] ACPI: PCI: Interrupt link GSID configured for IRQ 19
[    0.656389] ACPI: PCI: Interrupt link GSIE configured for IRQ 20
[    0.656892] ACPI: PCI: Interrupt link GSIF configured for IRQ 21
[    0.657379] ACPI: PCI: Interrupt link GSIG configured for IRQ 22
[    0.657879] ACPI: PCI: Interrupt link GSIH configured for IRQ 23
[    0.660553] iommu: Default domain type: Translated
[    0.660788] iommu: DMA domain TLB invalidation policy: lazy mode
[    0.661573] SCSI subsystem initialized
[    0.661907] ACPI: bus type USB registered
[    0.662388] usbcore: registered new interface driver usbfs
[    0.662845] usbcore: registered new interface driver hub
[    0.663311] usbcore: registered new device driver usb
[    0.663411] pps_core: LinuxPPS API ver. 1 registered
[    0.663856] pps_core: Software ver. 5.3.6 - Copyright 2005-2007 Rodolfo Giometti <giometti@linux.it>
[    0.664375] PTP clock support registered
[    0.665419] EDAC MC: Ver: 3.0.0
[    0.666419] efivars: Registered efivars operations
[    0.666838] NetLabel: Initializing
[    0.666838] NetLabel:  domain hash size = 128
[    0.667158] NetLabel:  protocols = UNLABELED CIPSOv4 CALIPSO
[    0.668391] NetLabel:  unlabeled traffic allowed by default
[    0.668854] mctp: management component transport protocol core
[    0.669336] NET: Registered PF_MCTP protocol family
[    0.669381] PCI: Using ACPI for IRQ routing
[    0.696455] pci 0000:04:00.0: vgaarb: setting as boot VGA device
[    0.696893] pci 0000:04:00.0: vgaarb: bridge control possible
[    0.697367] pci 0000:04:00.0: vgaarb: VGA device added: decodes=io+mem,owns=io+mem,locks=none
[    0.698372] vgaarb: loaded
[    0.698601] hpet0: at MMIO 0xfed00000, IRQs 2, 8, 0
[    0.698961] hpet0: 3 comparators, 64-bit 100.000000 MHz counter
[    0.703453] clocksource: Switched to clocksource kvm-clock
[    0.705219] VFS: Disk quotas dquot_6.6.0
[    0.705563] VFS: Dquot-cache hash table entries: 512 (order 0, 4096 bytes)
[    0.706201] pnp: PnP ACPI init
[    0.706630] system 00:04: [mem 0xe0000000-0xefffffff window] has been reserved
[    0.707372] pnp: PnP ACPI: found 5 devices
[    0.713929] clocksource: acpi_pm: mask: 0xffffff max_cycles: 0xffffff, max_idle_ns: 2085701024 ns
[    0.714785] NET: Registered PF_INET protocol family
[    0.715902] IP idents hash table entries: 131072 (order: 8, 1048576 bytes, linear)
[    0.730010] tcp_listen_portaddr_hash hash table entries: 4096 (order: 4, 65536 bytes, linear)
[    0.730732] Table-perturb hash table entries: 65536 (order: 6, 262144 bytes, linear)
[    0.731374] TCP established hash table entries: 65536 (order: 7, 524288 bytes, linear)
[    0.732055] TCP bind hash table entries: 65536 (order: 9, 2097152 bytes, linear)
[    0.733991] TCP: Hash tables configured (established 65536 bind 65536)
[    0.734781] MPTCP token hash table entries: 8192 (order: 5, 196608 bytes, linear)
[    0.735413] UDP hash table entries: 4096 (order: 5, 131072 bytes, linear)
[    0.736053] UDP-Lite hash table entries: 4096 (order: 5, 131072 bytes, linear)
[    0.736808] NET: Registered PF_UNIX/PF_LOCAL protocol family
[    0.737286] NET: Registered PF_XDP protocol family
[    0.737686] pci 0000:05:00.0: ROM [mem 0xfffc0000-0xffffffff pref]: can't claim; no compatible bridge window
[    0.738497] pci 0000:00:01.0: bridge window [io  0x1000-0x0fff] to [bus 01] add_size 1000
[    0.739168] pci 0000:00:01.1: bridge window [io  0x1000-0x0fff] to [bus 02] add_size 1000
[    0.739843] pci 0000:00:01.2: bridge window [io  0x1000-0x0fff] to [bus 03] add_size 1000
[    0.740518] pci 0000:00:01.3: bridge window [io  0x1000-0x0fff] to [bus 04] add_size 1000
[    0.741205] pci 0000:00:01.4: bridge window [io  0x1000-0x0fff] to [bus 05] add_size 1000
[    0.741876] pci 0000:00:01.5: bridge window [io  0x1000-0x0fff] to [bus 06] add_size 1000
[    0.742548] pci 0000:00:01.6: bridge window [io  0x1000-0x0fff] to [bus 07] add_size 1000
[    0.743226] pci 0000:00:01.7: bridge window [io  0x1000-0x0fff] to [bus 08] add_size 1000
[    0.743897] pci 0000:00:02.0: bridge window [io  0x1000-0x0fff] to [bus 09] add_size 1000
[    0.744576] pci 0000:00:01.0: bridge window [io  0x1000-0x1fff]: assigned
[    0.745134] pci 0000:00:01.1: bridge window [io  0x2000-0x2fff]: assigned
[    0.745860] pci 0000:00:01.2: bridge window [io  0x3000-0x3fff]: assigned
[    0.746420] pci 0000:00:01.3: bridge window [io  0x4000-0x4fff]: assigned
[    0.746981] pci 0000:00:01.4: bridge window [io  0x5000-0x5fff]: assigned
[    0.747541] pci 0000:00:01.5: bridge window [io  0x7000-0x7fff]: assigned
[    0.748101] pci 0000:00:01.6: bridge window [io  0x8000-0x8fff]: assigned
[    0.748664] pci 0000:00:01.7: bridge window [io  0x9000-0x9fff]: assigned
[    0.749225] pci 0000:00:02.0: bridge window [io  0xa000-0xafff]: assigned
[    0.749785] pci 0000:00:01.0: PCI bridge to [bus 01]
[    0.750204] pci 0000:00:01.0:   bridge window [io  0x1000-0x1fff]
[    0.751641] pci 0000:00:01.0:   bridge window [mem 0x81800000-0x819fffff]
[    0.752755] pci 0000:00:01.0:   bridge window [mem 0x380000000000-0x3807ffffffff 64bit pref]
[    0.754532] pci 0000:00:01.1: PCI bridge to [bus 02]
[    0.754951] pci 0000:00:01.1:   bridge window [io  0x2000-0x2fff]
[    0.756358] pci 0000:00:01.1:   bridge window [mem 0x81600000-0x817fffff]
[    0.757474] pci 0000:00:01.1:   bridge window [mem 0x380800000000-0x380fffffffff 64bit pref]
[    0.759278] pci 0000:00:01.2: PCI bridge to [bus 03]
[    0.759694] pci 0000:00:01.2:   bridge window [io  0x3000-0x3fff]
[    0.761038] pci 0000:00:01.2:   bridge window [mem 0x81400000-0x815fffff]
[    0.762725] pci 0000:00:01.2:   bridge window [mem 0x381000000000-0x3817ffffffff 64bit pref]
[    0.763977] pci 0000:00:01.3: PCI bridge to [bus 04]
[    0.764399] pci 0000:00:01.3:   bridge window [io  0x4000-0x4fff]
[    0.765336] pci 0000:00:01.3:   bridge window [mem 0x80000000-0x808fffff]
[    0.766174] pci 0000:00:01.3:   bridge window [mem 0x381800000000-0x381fffffffff 64bit pref]
[    0.767455] pci 0000:05:00.0: ROM [mem 0x81240000-0x8127ffff pref]: assigned
[    0.768040] pci 0000:00:01.4: PCI bridge to [bus 05]
[    0.768460] pci 0000:00:01.4:   bridge window [io  0x5000-0x5fff]
[    0.769483] pci 0000:00:01.4:   bridge window [mem 0x81200000-0x813fffff]
[    0.770431] pci 0000:00:01.4:   bridge window [mem 0x382000000000-0x3827ffffffff 64bit pref]
[    0.771995] pci 0000:00:01.5: PCI bridge to [bus 06]
[    0.773298] pci 0000:00:01.5:   bridge window [io  0x7000-0x7fff]
[    0.774156] pci 0000:00:01.5:   bridge window [mem 0x81000000-0x811fffff]
[    0.774943] pci 0000:00:01.5:   bridge window [mem 0x382800000000-0x382fffffffff 64bit pref]
[    0.776332] pci 0000:00:01.6: PCI bridge to [bus 07]
[    0.776750] pci 0000:00:01.6:   bridge window [io  0x8000-0x8fff]
[    0.777622] pci 0000:00:01.6:   bridge window [mem 0x80e00000-0x80ffffff]
[    0.778417] pci 0000:00:01.6:   bridge window [mem 0x383000000000-0x3837ffffffff 64bit pref]
[    0.779612] pci 0000:00:01.7: PCI bridge to [bus 08]
[    0.780032] pci 0000:00:01.7:   bridge window [io  0x9000-0x9fff]
[    0.780907] pci 0000:00:01.7:   bridge window [mem 0x80c00000-0x80dfffff]
[    0.781772] pci 0000:00:01.7:   bridge window [mem 0x383800000000-0x383fffffffff 64bit pref]
[    0.783461] pci 0000:00:02.0: PCI bridge to [bus 09]
[    0.784694] pci 0000:00:02.0:   bridge window [io  0xa000-0xafff]
[    0.785556] pci 0000:00:02.0:   bridge window [mem 0x80a00000-0x80bfffff]
[    0.786346] pci 0000:00:02.0:   bridge window [mem 0x384000000000-0x3847ffffffff 64bit pref]
[    0.787562] pci_bus 0000:00: resource 4 [io  0x0000-0x0cf7 window]
[    0.788074] pci_bus 0000:00: resource 5 [io  0x0d00-0xffff window]
[    0.788586] pci_bus 0000:00: resource 6 [mem 0x000a0000-0x000bffff window]
[    0.789151] pci_bus 0000:00: resource 7 [mem 0x80000000-0xdfffffff window]
[    0.789722] pci_bus 0000:00: resource 8 [mem 0xf0000000-0xfebfffff window]
[    0.790289] pci_bus 0000:00: resource 9 [mem 0x380000000000-0x3847ffffffff window]
[    0.790911] pci_bus 0000:01: resource 0 [io  0x1000-0x1fff]
[    0.791373] pci_bus 0000:01: resource 1 [mem 0x81800000-0x819fffff]
[    0.791890] pci_bus 0000:01: resource 2 [mem 0x380000000000-0x3807ffffffff 64bit pref]
[    0.792541] pci_bus 0000:02: resource 0 [io  0x2000-0x2fff]
[    0.793001] pci_bus 0000:02: resource 1 [mem 0x81600000-0x817fffff]
[    0.793520] pci_bus 0000:02: resource 2 [mem 0x380800000000-0x380fffffffff 64bit pref]
[    0.794171] pci_bus 0000:03: resource 0 [io  0x3000-0x3fff]
[    0.794932] pci_bus 0000:03: resource 1 [mem 0x81400000-0x815fffff]
[    0.795453] pci_bus 0000:03: resource 2 [mem 0x381000000000-0x3817ffffffff 64bit pref]
[    0.796108] pci_bus 0000:04: resource 0 [io  0x4000-0x4fff]
[    0.796573] pci_bus 0000:04: resource 1 [mem 0x80000000-0x808fffff]
[    0.797093] pci_bus 0000:04: resource 2 [mem 0x381800000000-0x381fffffffff 64bit pref]
[    0.797751] pci_bus 0000:05: resource 0 [io  0x5000-0x5fff]
[    0.798216] pci_bus 0000:05: resource 1 [mem 0x81200000-0x813fffff]
[    0.798745] pci_bus 0000:05: resource 2 [mem 0x382000000000-0x3827ffffffff 64bit pref]
[    0.799401] pci_bus 0000:06: resource 0 [io  0x7000-0x7fff]
[    0.799864] pci_bus 0000:06: resource 1 [mem 0x81000000-0x811fffff]
[    0.800387] pci_bus 0000:06: resource 2 [mem 0x382800000000-0x382fffffffff 64bit pref]
[    0.801037] pci_bus 0000:07: resource 0 [io  0x8000-0x8fff]
[    0.801500] pci_bus 0000:07: resource 1 [mem 0x80e00000-0x80ffffff]
[    0.802023] pci_bus 0000:07: resource 2 [mem 0x383000000000-0x3837ffffffff 64bit pref]
[    0.802681] pci_bus 0000:08: resource 0 [io  0x9000-0x9fff]
[    0.803141] pci_bus 0000:08: resource 1 [mem 0x80c00000-0x80dfffff]
[    0.803665] pci_bus 0000:08: resource 2 [mem 0x383800000000-0x383fffffffff 64bit pref]
[    0.804321] pci_bus 0000:09: resource 0 [io  0xa000-0xafff]
[    0.804783] pci_bus 0000:09: resource 1 [mem 0x80a00000-0x80bfffff]
[    0.805328] pci_bus 0000:09: resource 2 [mem 0x384000000000-0x3847ffffffff 64bit pref]
[    0.806639] ACPI: \_SB_.GSIF: Enabled at IRQ 21
[    0.807793] PCI: CLS 0 bytes, default 64
[    0.808165] PCI-DMA: Using software bounce buffering for IO (SWIOTLB)
[    0.808261] Trying to unpack rootfs image as initramfs...
[    0.808703] software IO TLB: mapped [mem 0x0000000077f7f000-0x000000007bf7f000] (64MB)
[    0.812439] Initialise system trusted keyrings
[    0.812835] Key type blacklist registered
[    0.813260] workingset: timestamp_bits=36 max_order=21 bucket_order=0
[    0.813813] zbud: loaded
[    0.814625] integrity: Platform Keyring initialized
[    0.815043] integrity: Machine keyring initialized
[    0.821870] NET: Registered PF_ALG protocol family
[    0.822280] xor: automatically using best checksumming function   avx       
[    0.822867] Key type asymmetric registered
[    0.823213] Asymmetric key parser 'x509' registered
[    0.953439] Freeing initrd memory: 18404K
[    0.957002] Block layer SCSI generic (bsg) driver version 0.4 loaded (major 245)
[    0.957739] io scheduler mq-deadline registered
[    0.958131] io scheduler kyber registered
[    0.958486] io scheduler bfq registered
[    0.959879] atomic64_test: passed for x86-64 platform with CX8 and with SSE
[    0.961284] pcieport 0000:00:01.0: PME: Signaling with IRQ 24
[    0.961916] pcieport 0000:00:01.0: AER: enabled with IRQ 24
[    0.963208] pcieport 0000:00:01.1: PME: Signaling with IRQ 25
[    0.963796] pcieport 0000:00:01.1: AER: enabled with IRQ 25
[    0.965015] pcieport 0000:00:01.2: PME: Signaling with IRQ 26
[    0.965619] pcieport 0000:00:01.2: AER: enabled with IRQ 26
[    0.966835] pcieport 0000:00:01.3: PME: Signaling with IRQ 27
[    0.967422] pcieport 0000:00:01.3: AER: enabled with IRQ 27
[    0.968642] pcieport 0000:00:01.4: PME: Signaling with IRQ 28
[    0.969238] pcieport 0000:00:01.4: AER: enabled with IRQ 28
[    0.970470] pcieport 0000:00:01.5: PME: Signaling with IRQ 29
[    0.971043] pcieport 0000:00:01.5: AER: enabled with IRQ 29
[    0.972256] pcieport 0000:00:01.6: PME: Signaling with IRQ 30
[    0.972860] pcieport 0000:00:01.6: AER: enabled with IRQ 30
[    0.974071] pcieport 0000:00:01.7: PME: Signaling with IRQ 31
[    0.974666] pcieport 0000:00:01.7: AER: enabled with IRQ 31
[    0.975479] ACPI: \_SB_.GSIG: Enabled at IRQ 22
[    0.976338] pcieport 0000:00:02.0: PME: Signaling with IRQ 32
[    0.976920] pcieport 0000:00:02.0: AER: enabled with IRQ 32
[    0.977550] shpchp: Standard Hot Plug PCI Controller Driver version: 0.4
[    0.978200] input: Power Button as /devices/LNXSYSTM:00/LNXPWRBN:00/input/input0
[    0.978871] ACPI: button: Power Button [PWRF]
[    0.984739] Serial: 8250/16550 driver, 32 ports, IRQ sharing enabled
[    0.985407] 00:02: ttyS0 at I/O 0x3f8 (irq = 4, base_baud = 115200) is a 16550A
[    0.988072] Non-volatile memory driver v1.3
[    0.988812] Linux agpgart interface v0.103
[    0.989295] ACPI: bus type drm_connector registered
[    0.990341] ACPI: \_SB_.GSIA: Enabled at IRQ 16
[    0.991141] ahci 0000:00:1f.2: AHCI 0001.0000 32 slots 6 ports 1.5 Gbps 0x3f impl SATA mode
[    0.991849] ahci 0000:00:1f.2: flags: 64bit ncq only 
[    0.993168] scsi host0: ahci
[    0.993616] scsi host1: ahci
[    0.994058] scsi host2: ahci
[    0.994439] scsi host3: ahci
[    0.994807] scsi host4: ahci
[    0.995190] scsi host5: ahci
[    0.995490] ata1: SATA max UDMA/133 abar m4096@0x81a40000 port 0x81a40100 irq 35 lpm-pol 0
[    0.996176] ata2: SATA max UDMA/133 abar m4096@0x81a40000 port 0x81a40180 irq 35 lpm-pol 0
[    0.996865] ata3: SATA max UDMA/133 abar m4096@0x81a40000 port 0x81a40200 irq 35 lpm-pol 0
[    0.997548] ata4: SATA max UDMA/133 abar m4096@0x81a40000 port 0x81a40280 irq 35 lpm-pol 0
[    0.998235] ata5: SATA max UDMA/133 abar m4096@0x81a40000 port 0x81a40300 irq 35 lpm-pol 0
[    0.998918] ata6: SATA max UDMA/133 abar m4096@0x81a40000 port 0x81a40380 irq 35 lpm-pol 0
[    1.000509] xhci_hcd 0000:01:00.6: xHCI Host Controller
[    1.001004] xhci_hcd 0000:01:00.6: new USB bus registered, assigned bus number 1
[    1.002165] xhci_hcd 0000:01:00.6: hcc params 0x00087001 hci version 0x100 quirks 0x0000000000000010
[    1.003338] xhci_hcd 0000:01:00.6: xHCI Host Controller
[    1.003837] xhci_hcd 0000:01:00.6: new USB bus registered, assigned bus number 2
[    1.004459] xhci_hcd 0000:01:00.6: Host supports USB 3.0 SuperSpeed
[    1.005032] usb usb1: New USB device found, idVendor=1d6b, idProduct=0002, bcdDevice= 6.08
[    1.005722] usb usb1: New USB device strings: Mfr=3, Product=2, SerialNumber=1
[    1.006325] usb usb1: Product: xHCI Host Controller
[    1.006743] usb usb1: Manufacturer: Linux 6.8.4-200.fc39.x86_64 xhci-hcd
[    1.007302] usb usb1: SerialNumber: 0000:01:00.6
[    1.007813] hub 1-0:1.0: USB hub found
[    1.008151] hub 1-0:1.0: 8 ports detected
[    1.008731] usb usb2: We don't know the algorithms for LPM for this host, disabling LPM.
[    1.009428] usb usb2: New USB device found, idVendor=1d6b, idProduct=0003, bcdDevice= 6.08
[    1.010115] usb usb2: New USB device strings: Mfr=3, Product=2, SerialNumber=1
[    1.010721] usb usb2: Product: xHCI Host Controller
[    1.011140] usb usb2: Manufacturer: Linux 6.8.4-200.fc39.x86_64 xhci-hcd
[    1.011699] usb usb2: SerialNumber: 0000:01:00.6
[    1.012172] hub 2-0:1.0: USB hub found
[    1.012511] hub 2-0:1.0: 8 ports detected
[    1.013074] usbcore: registered new interface driver usbserial_generic
[    1.013625] usbserial: USB Serial support registered for generic
[    1.014157] i8042: PNP: PS/2 Controller [PNP0303:KBD,PNP0f13:MOU] at 0x60,0x64 irq 1,12
[    1.015316] serio: i8042 KBD port at 0x60,0x64 irq 1
[    1.015903] serio: i8042 AUX port at 0x60,0x64 irq 12
[    1.016388] mousedev: PS/2 mouse device common for all mice
[    1.016941] rtc_cmos 00:03: RTC can wake from S4
[    1.017549] input: AT Translated Set 2 keyboard as /devices/platform/i8042/serio0/input/input1
[    1.018446] rtc_cmos 00:03: registered as rtc0
[    1.018864] rtc_cmos 00:03: setting system clock to 2024-04-06T14:00:32 UTC (1712412032)
[    1.019575] rtc_cmos 00:03: alarms up to one day, y3k, 242 bytes nvram
[    1.020130] device-mapper: core: CONFIG_IMA_DISABLE_HTABLE is disabled. Duplicate IMA measurements will not be recorded in the IMA log.
[    1.021154] device-mapper: uevent: version 1.0.3
[    1.021784] device-mapper: ioctl: 4.48.0-ioctl (2023-03-01) initialised: dm-devel@redhat.com
[    1.022642] input: VirtualPS/2 VMware VMMouse as /devices/platform/i8042/serio1/input/input4
[    1.023511] amd_pstate: the _CPC object is not present in SBIOS or ACPI disabled
[    1.023523] input: VirtualPS/2 VMware VMMouse as /devices/platform/i8042/serio1/input/input3
[    1.024415] [drm] Initialized simpledrm 1.0.0 20200625 for simple-framebuffer.0 on minor 0
[    1.032890] Console: switching to colour frame buffer device 160x50
[    1.033931] simple-framebuffer simple-framebuffer.0: [drm] fb0: simpledrmdrmfb frame buffer device
[    1.035053] hid: raw HID events driver (C) Jiri Kosina
[    1.035650] usbcore: registered new interface driver usbhid
[    1.036111] usbhid: USB HID core driver
[    1.036568] drop_monitor: Initializing network drop monitor service
[    1.037160] Initializing XFRM netlink socket
[    1.037574] NET: Registered PF_INET6 protocol family
[    1.041665] Segment Routing with IPv6
[    1.042000] RPL Segment Routing with IPv6
[    1.042358] In-situ OAM (IOAM) with IPv6
[    1.042729] mip6: Mobile IPv6
[    1.042983] NET: Registered PF_PACKET protocol family
[    1.043808] IPI shorthand broadcast: enabled
[    1.044192] AVX2 version of gcm_enc/dec engaged.
[    1.044627] AES CTR mode by8 optimization enabled
[    1.047106] sched_clock: Marking stable (824000940, 222186181)->(1169148429, -122961308)
[    1.048461] registered taskstats version 1
[    1.049450] Loading compiled-in X.509 certificates
[    1.054365] Loaded X.509 cert 'Fedora kernel signing key: 850daac805510654994f4e4c7ecd8132257a7c81'
[    1.058373] page_owner is disabled
[    1.058784] Key type .fscrypt registered
[    1.059146] Key type fscrypt-provisioning registered
[    1.060456] Btrfs loaded, zoned=yes, fsverity=yes
[    1.060896] Key type big_key registered
[    1.073576] Key type encrypted registered
[    1.075245] ima: No TPM chip found, activating TPM-bypass!
[    1.075957] Loading compiled-in module X.509 certificates
[    1.076848] Loaded X.509 cert 'Fedora kernel signing key: 850daac805510654994f4e4c7ecd8132257a7c81'
[    1.078820] ima: Allocated hash algorithm: sha256
[    1.079838] ima: No architecture policies found
[    1.080571] evm: Initialising EVM extended attributes:
[    1.081166] evm: security.selinux
[    1.081632] evm: security.SMACK64 (disabled)
[    1.082145] evm: security.SMACK64EXEC (disabled)
[    1.082693] evm: security.SMACK64TRANSMUTE (disabled)
[    1.083268] evm: security.SMACK64MMAP (disabled)
[    1.083810] evm: security.apparmor (disabled)
[    1.084328] evm: security.ima
[    1.084729] evm: security.capability
[    1.085174] evm: HMAC attrs: 0x1
[    1.113487] alg: No test for 842 (842-scomp)
[    1.115225] alg: No test for 842 (842-generic)
[    1.174419] PM:   Magic number: 4:882:29
[    1.175091] memory memory69: hash matches
[    1.179736] RAS: Correctable Errors collector initialized.
[    1.180941] clk: Disabling unused clocks
B^[[B^[[B^[[B^[[A^[[A[    1.308035] ata6: SATA link down (SStatus 0 SControl 300)
[    1.308927] ata1: SATA link down (SStatus 0 SControl 300)
[    1.309549] ata4: SATA link down (SStatus 0 SControl 300)
[    1.310129] ata5: SATA link down (SStatus 0 SControl 300)
[    1.310699] ata3: SATA link down (SStatus 0 SControl 300)
[    1.311653] ata2: SATA link down (SStatus 0 SControl 300)
[    1.313445] Freeing unused decrypted memory: 2028K
[    1.315189] Freeing unused kernel image (initmem) memory: 4620K
[    1.315883] Write protecting the kernel read-only data: 36864k
[    1.317234] Freeing unused kernel image (rodata/data gap) memory: 1584K
[    1.346232] x86/mm: Checked W+X mappings: passed, no W+X pages found.
[    1.347829] Run /init as init process
[    1.363154] systemd[1]: systemd 254.10-1.fc39 running in system mode (+PAM +AUDIT +SELINUX -APPARMOR +IMA +SMACK +SECCOMP -GCRYPT +GNUTLS +OPENSSL +ACL +BLKID +CURL +ELFUTILS +FIDO2 +IDN2 -IDN -IPTC +KMOD +LIBCRYPTSETUP +LIBFDISK +PCRE2 +PWQUALITY +P11KIT +QRENCODE +TPM2 +BZIP2 +LZ4 +XZ +ZLIB +ZSTD +BPF_FRAMEWORK +XKBCOMMON +UTMP +SYSVINIT default-hierarchy=unified)
[    1.365743] systemd[1]: Detected virtualization kvm.
[    1.367262] systemd[1]: Detected architecture x86-64.
[    1.367890] systemd[1]: Running in initrd.

Welcome to Fedora Linux 39 dracut-059-16.fc39 (Initramfs)!

[    1.369212] systemd[1]: Hostname set to <k8s-01-001>.
[    1.410798] systemd[1]: Queued start job for default target initrd.target.
[    1.418569] systemd[1]: Started systemd-ask-password-console.path - Dispatch Password Requests to Console Directory Watch.
[  OK  ] Started systemd-ask-password-conso…equests to Console Directory Watch.
[    1.420278] systemd[1]: Expecting device dev-loop0p2.device - /dev/loop0p2...
         Expecting device dev-loop0p2.device - /dev/loop0p2...
[    1.421456] systemd[1]: Reached target initrd-usr-fs.target - Initrd /usr File System.
[  OK  ] Reached target initrd-usr-fs.target - Initrd /usr File System.
[    1.422967] systemd[1]: Reached target paths.target - Path Units.
[  OK  ] Reached target paths.target - Path Units.
[    1.424233] systemd[1]: Reached target slices.target - Slice Units.
[  OK  ] Reached target slices.target - Slice Units.
[    1.425495] systemd[1]: Reached target swap.target - Swaps.
[  OK  ] Reached target swap.target - Swaps.
[    1.426668] systemd[1]: Reached target timers.target - Timer Units.
[  OK  ] Reached target timers.target - Timer Units.
[    1.428032] systemd[1]: Listening on systemd-journald-dev-log.socket - Journal Socket (/dev/log).
[  OK  ] Listening on systemd-journald-dev-…socket - Journal Socket (/dev/log).
[    1.429784] systemd[1]: Listening on systemd-journald.socket - Journal Socket.
[  OK  ] Listening on systemd-journald.socket - Journal Socket.
[    1.431315] systemd[1]: Listening on systemd-udevd-control.socket - udev Control Socket.
[  OK  ] Listening on systemd-udevd-control.socket - udev Control Socket.
[    1.432901] systemd[1]: Listening on systemd-udevd-kernel.socket - udev Kernel Socket.
[  OK  ] Listening on systemd-udevd-kernel.socket - udev Kernel Socket.
[    1.434387] systemd[1]: Reached target sockets.target - Socket Units.
[  OK  ] Reached target sockets.target - Socket Units.
[    1.451277] systemd[1]: Starting kmod-static-nodes.service - Create List of Static Device Nodes...
         Starting kmod-static-nodes.service…eate List of Static Device Nodes...
[    1.453140] systemd[1]: memstrack.service - Memstrack Anylazing Service was skipped because no trigger condition checks were met.
[    1.455201] systemd[1]: Starting systemd-journald.service - Journal Service...
         Starting systemd-journald.service - Journal Service...
[    1.456512] systemd[1]: systemd-modules-load.service - Load Kernel Modules was skipped because no trigger condition checks were met.
[    1.458033] systemd[1]: Starting systemd-sysctl.service - Apply Kernel Variables...
         Starting systemd-sysctl.service - Apply Kernel Variables...
[    1.459881] systemd[1]: Starting systemd-tmpfiles-setup-dev.service - Create Static Device Nodes in /dev...
         Starting systemd-tmpfiles-setup-de…eate Static Device Nodes in /dev...
[    1.462422] systemd[1]: Starting systemd-vconsole-setup.service - Virtual Console Setup...
         Starting systemd-vconsole-setup.service - Virtual Console Setup...
[    1.464960] systemd-journald[275]: Collecting audit messages is disabled.
[    1.466980] systemd[1]: Finished kmod-static-nodes.service - Create List of Static Device Nodes.
[  OK  ] Finished kmod-static-nodes.service…Create List of Static Device Nodes.
[    1.468744] systemd[1]: Finished systemd-sysctl.service - Apply Kernel Variables.
[  OK  ] Finished systemd-sysctl.service - Apply Kernel Variables.
[    1.471650] systemd[1]: Finished systemd-tmpfiles-setup-dev.service - Create Static Device Nodes in /dev.
[  OK  ] Finished systemd-tmpfiles-setup-de…Create Static Device Nodes in /dev.
[    1.473354] systemd[1]: Reached target local-fs-pre.target - Preparation for Local File Systems.
[  OK  ] Reached target local-fs-pre.target…Preparation for Local File Systems.
[    1.475231] systemd[1]: Reached target local-fs.target - Local File Systems.
[  OK  ] Reached target local-fs.target - Local File Systems.
[    1.493884] systemd[1]: Started systemd-journald.service - Journal Service.
[  OK  ] Started systemd-journald.service - Journal Service.
[  OK  ] Finished systemd-vconsole-setup.service - Virtual Console Setup.
         Starting dracut-cmdline.service - dracut cmdline hook...
         Starting systemd-tmpfiles-setup.se…e Volatile Files and Directories...
[  OK  ] Finished systemd-tmpfiles-setup.se…ate Volatile Files and Directories.
[  OK  ] Finished dracut-cmdline.service - dracut cmdline hook.
         Starting systemd-udevd.service - R…ager for Device Events and Files...
[  OK  ] Started systemd-udevd.service - Ru…anager for Device Events and Files.
         Starting systemd-udev-trigger.service - Coldplug All udev Devices...
[  OK  ] Created slice system-modprobe.slice - Slice /system/modprobe.
         Starting modprobe@configfs.service - Load Kernel Module configfs...
[  OK  ] Finished systemd-udev-trigger.service - Coldplug All udev Devices.
[  OK  ] Finished modprobe@configfs.service - Load Kernel Module configfs.
         Mounting sys-kernel-config.mount - Kernel Configuration File System...
[  OK  ] Reached target remote-fs-pre.targe…reparation for Remote File Systems.
[  OK  ] Reached target remote-fs.target - Remote File Systems.
         Starting dracut-pre-mount.service - dracut pre-mount hook...
[  OK  ] Mounted sys-kernel-config.mount - Kernel Configuration File System.
[  OK  ] Reached target sysinit.target - System Initialization.
[  OK  ] Reached target basic.target - Basic System.
[  OK  ] Finished dracut-pre-mount.service - dracut pre-mount hook.
[    1.670273] virtio_scsi virtio6: 1/0/0 default/read/poll queues
[    1.678653] scsi host6: Virtio SCSI HBA
[    1.687164] scsi 6:0:0:1: Direct-Access     QEMU     QEMU HARDDISK    2.5+ PQ: 0 ANSI: 5
[  OK  ] Stopped systemd-vconsole-setup.service - Virtual Console Setup.
         Stopping systemd-vconsole-setup.service - Virtual Console Setup...
[    1.699612] sd 6:0:0:1: Attached scsi generic sg0 type 0
[    1.699709] sd 6:0:0:1: Power-on or device reset occurred
[    1.700832] sd 6:0:0:1: [sda] 268435456 512-byte logical blocks: (137 GB/128 GiB)
[    1.701699] sd 6:0:0:1: [sda] Write Protect is off
[    1.702396] sd 6:0:0:1: [sda] Write cache: enabled, read cache: enabled, doesn't support DPO or FUA
         Starting systemd-vconsole-setup.service - Virtual Console Setup...
[  OK  ] Stopped systemd-vconsole-setup.service - Virtual Console Setup.[    1.709975]  sda: sda1 sda2

[    1.710710] sd 6:0:0:1: [sda] Attached SCSI disk
         Starting systemd-vconsole-setup.service - Virtual Console Setup...
[  OK  ] Finished systemd-vconsole-setup.service - Virtual Console Setup.
[     *] Job dev-loop0p2.device/start running (4min 53s / no limit)
  • Container log
Name: <redacted>
Status: RUNNING
Type: virtual-machine
Architecture: x86_64
PID: 385003
Created: 2024/04/05 11:01 EDT
Last Used: 2024/04/06 10:00 EDT

Resources:
  Processes: -1
  Disk usage:
    root: 9.57GiB

Log:
  • Container configuration
architecture: x86_64
config:
  boot.autostart: "false"
  image.architecture: amd64
  image.description: Fedora 39 amd64 (20240405_20:33)
  image.os: Fedora
  image.release: "39"
  image.serial: "20240405_20:33"
  image.type: disk-kvm.img
  image.variant: default
  limits.cpu: "4"
  limits.memory: 8GiB
  volatile.base_image: <redacted>
  volatile.cloud-init.instance-id: <redacted>
  volatile.eth0.host_name: maca<redacted>
  volatile.eth0.hwaddr: <redacted>
  volatile.eth0.last_state.created: "false"
  volatile.last_state.power: RUNNING
  volatile.last_state.ready: "false"
  volatile.uuid: <redacted>
  volatile.uuid.generation: 06473eb7-97f4-451b-b969-fc0cac66c883
  volatile.vsock_id: "978000521"
devices:
  eth0:
    network: <redacted>
    type: nic
  root:
    path: /
    pool: ssd0
    size: 128GiB
    type: disk
ephemeral: false
profiles:
- <redacted>
- <redacted>
stateful: false
description: ""

Hmm, can you do grep -r loop0p2 /etc to see what’s referencing this?

Couldn’t get into the VM but was able to mount the VM LV externally to take a peek. Did a grep at the root level instead.

./boot/loader/entries/06473eb797f4451bb969fc0cac66c883-6.8.4-200.fc39.x86_64.conf:options root=/dev/loop0p2 ro console=tty1 console=ttyS0
./etc/kernel/cmdline:root=/dev/loop0p2 ro   console=tty1 console=ttyS0

That seems to be the root block device.

Okay, changing those two to /dev/sda2 should get things booting again but it shows that there’s an issue with the image build process…

1 Like

Thanks, that resolved the issue.

Correct me if I’m wrong but is the issue that the Fedora VM images’s /etc/kernel/cmdline file contains root=/dev/loop0p2 ro console=tty1 console=ttyS0 where it should be root=/dev/sda2 ro console=tty1 console=ttyS0 instead? This might be causing the incorrect grub entries whenever there is a kernel upgrade.

Another difference that I noticed is that the initial grub entry has options $kernelopts where as the later ones from kernel upgrades end up with options <contents of /etc/kernel/cmdline >. Do you know if that is something to do with the way images are being built?

It should actually use the UUID of the partition instead of any fixed name.
There’s a new pull request on distrobuilder which is meant to eventually fix that.

Thanks for the heads up on the upcoming fix.

PS: For anyone interested, here is the PR, Fixed hardcoded root partition device name sda2 by nanjj · Pull Request #830 · lxc/distrobuilder · GitHub .

What were the steps to fix this? I currently have a vm same exact issue but not sure how to change the setting inside the vm since I can’t boot it pas that dev-loop0p2.device line.

Thanks in advance

I was able to do the following as per another post

zfs set volmode=full MyPool/virtual-machines/Piolin.block

And then mount /dev/zvol/MyPool/vietual-machines/Piolin.block-part2

I changed the loader entries to /zd0 since ls on /dev/MyPool / showed a symbolic link but I am still not getting any luck. Right now when I try to start the vm I get Job dev-zd0.device and it’s stuck there.

I recreated the vm and redid the upgrade and now it’s booting normally. Not sure if the fix is in place already

I’m not sure if reporting this is helpful (or where the issue is/who is responsible), but I had the same issue this morning with rocky/9/cloud that I installed a few days ago. Wouldn’t boot after Kernel update, manually changing loop0p2 to sda2 in both /etc and /boot resolved the issue.