Qemu-system-aarch64: Failed to put registers after init: Invalid argument

cemzafer · August 4, 2025, 9:18pm

Hi,
I have recently upgrade my incus system to 6.15 and the problem of starting vm still persist.
Here are my settings:

armbian@turing-rk1:~$ incus start test
Error: Failed to run: forklimits limit=memlock:unlimited:unlimited fd=3 fd=4 -- /opt/incus/bin/qemu-system-aarch64 -S -name test -uuid 2d605ef1-c857-46f2-b5b4-84aa8ee2844a -daemonize -cpu host -nographic -serial chardev:console -nodefaults -no-user-config -sandbox on,obsolete=deny,elevateprivileges=allow,spawn=allow,resourcecontrol=deny -readconfig /run/incus/test/qemu.conf -spice unix=on,disable-ticketing=on,addr=/run/incus/test/qemu.spice -pidfile /run/incus/test/qemu.pid -D /var/log/incus/test/qemu.log -rtc base=2025-08-04T21:16:11 -smbios type=2,manufacturer=LinuxContainers,product=Incus -runas incus: : exit status 1
Try `incus info --show-log test` for more info

armbian@turing-rk1:~$ incus info --show-log test
Name: test
Description:
Status: STOPPED
Type: virtual-machine
Architecture: aarch64
Created: 2025/08/05 00:10 +03
Last Used: 2025/08/05 00:11 +03

Log:

qemu-system-aarch64: Failed to put registers after init: Invalid argument

armbian@turing-rk1:~$ incus config show test --expanded
architecture: aarch64
config:
  image.architecture: arm64
  image.description: Ubuntu noble arm64 (20250801_07:42)
  image.os: Ubuntu
  image.release: noble
  image.requirements.cgroup: v2
  image.serial: "20250801_07:42"
  image.type: disk-kvm.img
  image.variant: cloud
  volatile.base_image: 2962aad138e91f4c7b147937e90fd51fe8e27a7c5a4c5d9e4b5d6b42fc143396
  volatile.cloud-init.instance-id: deba9195-e461-4331-aded-5a8bfd3c0fdb
  volatile.eth0.hwaddr: 10:66:6a:5b:21:9a
  volatile.last_state.power: STOPPED
  volatile.last_state.ready: "false"
  volatile.uuid: 2d605ef1-c857-46f2-b5b4-84aa8ee2844a
  volatile.uuid.generation: 2d605ef1-c857-46f2-b5b4-84aa8ee2844a
  volatile.vm.definition: virt-9.0
  volatile.vm.rtc_adjustment: "0"
  volatile.vm.rtc_offset: "0"
  volatile.vsock_id: "3836583668"
devices:
  eth0:
    name: eth0
    network: incusbr0
    type: nic
  root:
    path: /
    pool: default
    type: disk
ephemeral: false
profiles:
- default
stateful: false
description: ""

candlerb · August 5, 2025, 2:24pm

What’s the hardware? What’s the OS on your host? Has this worked with a previous version of incus, if so which?

(Maybe workaround is to go to incus 6.0.4 LTS, but that would be a reinstall from scratch)

I found exactly the same error message here though, might be something useful to pick up from it: 24.04 beta: can't boot VMs on kvm, qemu works fine · Issue #731 · Joshua-Riek/ubuntu-rockchip · GitHub

cemzafer · August 5, 2025, 9:05pm

Hi Brian, thanks for the reply.
The hardware is Turing RK1 modules and the OS Ubuntu 22.04. But tested with 24.04 and it is same. I think that there is something wrong with the cpu pinning. I have encountered the URL you shared with us and you point the right direction when I upgrade the kernel to something bigger than 6.10, problem disappears. I have tested with the stable Incus release but same error.
Here is the error message.

ubuntu@tnode2:~$ incus info --show-log test
Name: test
Description:
Status: RUNNING
Type: virtual-machine
Architecture: aarch64
PID: 2188
Created: 2025/08/05 23:33 +03
Last Used: 2025/08/05 23:51 +03
Started: 2025/08/05 23:51 +03

Resources:
  Processes: -1
  Disk usage:
    root: 5.03MiB
  Network usage:
    eth0:
      Type: broadcast
      State: UP
      Host interface: tapc6f82ddb
      MAC address: 10:66:6a:3e:a8:8b
      MTU: 1500
      Bytes received: 602B
      Bytes sent: 0B
      Packets received: 3
      Packets sent: 0
      IP addresses:
        inet:  10.56.164.228/24 (global)
        inet6: fd42:7520:5ad9:f9ce:1266:6aff:fe3e:a88b/64 (global)

Log:

qemu-system-aarch64: Failed to put registers after reset: Invalid argument
 PC=0000000000000000 X00=0000000000000000 X01=0000000000000000
X02=0000000000000000 X03=0000000000000000 X04=0000000000000000
X05=0000000000000000 X06=0000000000000000 X07=0000000000000000
X08=0000000000000000 X09=0000000000000000 X10=0000000000000000
X11=0000000000000000 X12=0000000000000000 X13=0000000000000000
X14=0000000000000000 X15=0000000000000000 X16=0000000000000000
X17=0000000000000000 X18=0000000000000000 X19=0000000000000000
X20=0000000000000000 X21=0000000000000000 X22=0000000000000000
X23=0000000000000000 X24=0000000000000000 X25=0000000000000000
X26=0000000000000000 X27=0000000000000000 X28=0000000000000000
X29=0000000000000000 X30=0000000000000000  SP=0000000000000000
PSTATE=400003c5 -Z-- EL1h
qemu-system-aarch64: Failed to put registers after reset: Invalid argument
 PC=0000000000000000 X00=0000000000000000 X01=0000000000000000
X02=0000000000000000 X03=0000000000000000 X04=0000000000000000
X05=0000000000000000 X06=0000000000000000 X07=0000000000000000
X08=0000000000000000 X09=0000000000000000 X10=0000000000000000
X11=0000000000000000 X12=0000000000000000 X13=0000000000000000
X14=0000000000000000 X15=0000000000000000 X16=0000000000000000
X17=0000000000000000 X18=0000000000000000 X19=0000000000000000
X20=0000000000000000 X21=0000000000000000 X22=0000000000000000
X23=0000000000000000 X24=0000000000000000 X25=0000000000000000
X26=0000000000000000 X27=0000000000000000 X28=0000000000000000
X29=0000000000000000 X30=0000000000000000  SP=0000000000000000
PSTATE=400003c5 -Z-- EL1h
qemu-system-aarch64: Failed to put registers after reset: Invalid argument
 PC=0000000000000000 X00=0000000000000000 X01=0000000000000000
X02=0000000000000000 X03=0000000000000000 X04=0000000000000000
X05=0000000000000000 X06=0000000000000000 X07=0000000000000000
X08=0000000000000000 X09=0000000000000000 X10=0000000000000000
X11=0000000000000000 X12=0000000000000000 X13=0000000000000000
X14=0000000000000000 X15=0000000000000000 X16=0000000000000000
X17=0000000000000000 X18=0000000000000000 X19=0000000000000000
X20=0000000000000000 X21=0000000000000000 X22=0000000000000000
X23=0000000000000000 X24=0000000000000000 X25=0000000000000000
X26=0000000000000000 X27=0000000000000000 X28=0000000000000000
X29=0000000000000000 X30=0000000000000000  SP=0000000000000000
PSTATE=400003c5 -Z-- EL1h
qemu-system-aarch64: Failed to put registers after reset: Invalid argument
 PC=0000000000000000 X00=0000000000000000 X01=0000000000000000
X02=0000000000000000 X03=0000000000000000 X04=0000000000000000
X05=0000000000000000 X06=0000000000000000 X07=0000000000000000
X08=0000000000000000 X09=0000000000000000 X10=0000000000000000
X11=0000000000000000 X12=0000000000000000 X13=0000000000000000
X14=0000000000000000 X15=0000000000000000 X16=0000000000000000
X17=0000000000000000 X18=0000000000000000 X19=0000000000000000
X20=0000000000000000 X21=0000000000000000 X22=0000000000000000
X23=0000000000000000 X24=0000000000000000 X25=0000000000000000
X26=0000000000000000 X27=0000000000000000 X28=0000000000000000
X29=0000000000000000 X30=0000000000000000  SP=0000000000000000
PSTATE=400003c5 -Z-- EL1h
qemu-system-aarch64: Failed to put registers after reset: Invalid argument
 PC=0000000000000000 X00=0000000000000000 X01=0000000000000000
X02=0000000000000000 X03=0000000000000000 X04=0000000000000000
X05=0000000000000000 X06=0000000000000000 X07=0000000000000000
X08=0000000000000000 X09=0000000000000000 X10=0000000000000000
X11=0000000000000000 X12=0000000000000000 X13=0000000000000000
X14=0000000000000000 X15=0000000000000000 X16=0000000000000000
X17=0000000000000000 X18=0000000000000000 X19=0000000000000000
X20=0000000000000000 X21=0000000000000000 X22=0000000000000000
X23=0000000000000000 X24=0000000000000000 X25=0000000000000000
X26=0000000000000000 X27=0000000000000000 X28=0000000000000000
X29=0000000000000000 X30=0000000000000000  SP=0000000000000000
PSTATE=400003c5 -Z-- EL1h
qemu-system-aarch64: Failed to put registers after reset: Invalid argument
 PC=0000000000000000 X00=0000000000000000 X01=0000000000000000
X02=0000000000000000 X03=0000000000000000 X04=0000000000000000
X05=0000000000000000 X06=0000000000000000 X07=0000000000000000
X08=0000000000000000 X09=0000000000000000 X10=0000000000000000
X11=0000000000000000 X12=0000000000000000 X13=0000000000000000
X14=0000000000000000 X15=0000000000000000 X16=0000000000000000
X17=0000000000000000 X18=0000000000000000 X19=0000000000000000
X20=0000000000000000 X21=0000000000000000 X22=0000000000000000
X23=0000000000000000 X24=0000000000000000 X25=0000000000000000
X26=0000000000000000 X27=0000000000000000 X28=0000000000000000
X29=0000000000000000 X30=0000000000000000  SP=0000000000000000
PSTATE=400003c5 -Z-- EL1h

ubuntu@tnode2:~$ incus info --resources
System:
  Product: Turing Machines RK1
  Serial: 7d04ab8abd9337b0
  Type: physical
  Chassis:
  Motherboard:

Load:
  Processes: 347
  Average: 1.07 0.90 0.46
CPUs:
  Architecture: aarch64
  Socket 0:
    Caches:
      - Level 1 (type: Data): 32KiB
      - Level 1 (type: Instruction): 32KiB
      - Level 2 (type: Unified): 128KiB
      - Level 3 (type: Unified): 3MiB
    Cores:
      - Core 0
        Frequency: 1800Mhz
        Threads:
          - 0 (id: 0, online: true, NUMA node: 0)
      - Core 1
        Frequency: 1800Mhz
        Threads:
          - 0 (id: 1, online: true, NUMA node: 0)
      - Core 2
        Frequency: 1800Mhz
        Threads:
          - 0 (id: 2, online: true, NUMA node: 0)
      - Core 3
        Frequency: 1800Mhz
        Threads:
          - 0 (id: 3, online: true, NUMA node: 0)
    Frequency: 1800Mhz (min: 408Mhz, max: 1800Mhz)
  Socket 1:
    Caches:
      - Level 1 (type: Data): 64KiB
      - Level 1 (type: Instruction): 64KiB
      - Level 2 (type: Unified): 512KiB
      - Level 3 (type: Unified): 3MiB
    Cores:
      - Core 0
        Frequency: 2256Mhz
        Threads:
          - 0 (id: 4, online: true, NUMA node: 0)
      - Core 1
        Frequency: 2256Mhz
        Threads:
          - 0 (id: 5, online: true, NUMA node: 0)
    Frequency: 2256Mhz (min: 408Mhz, max: 2256Mhz)
  Socket 2:
    Caches:
      - Level 1 (type: Data): 64KiB
      - Level 1 (type: Instruction): 64KiB
      - Level 2 (type: Unified): 512KiB
      - Level 3 (type: Unified): 3MiB
    Cores:
      - Core 0
        Frequency: 2304Mhz
        Threads:
          - 0 (id: 6, online: true, NUMA node: 0)
      - Core 1
        Frequency: 2304Mhz
        Threads:
          - 0 (id: 7, online: true, NUMA node: 0)
    Frequency: 2304Mhz (min: 408Mhz, max: 2304Mhz)

Memory:
  Free: 30.47GiB
  Used: 576.55MiB
  Total: 31.03GiB

GPUs:
  Card 0:
    NUMA node: 0
    Driver: rockchip-drm (5.10.0-1012-rockchip)
    DRM:
      ID: 0
      Card: card0 (226:0)
      Control: controlD64 (226:0)
      Render: renderD128 (226:128)
  Card 1:
    NUMA node: 0
    Driver: RKNPU (5.10.0-1012-rockchip)
    DRM:
      ID: 1
      Card: card1 (226:1)
      Render: renderD129 (226:129)

NIC:
  NUMA node: 0
  Driver: rk_gmac-dwmac (5.10.0-1012-rockchip)
  Ports:
    - Port 0 (ethernet)
      ID: eth0
      Address: 5e:34:15:cf:db:74
      Supported modes: 10baseT/Half, 10baseT/Full, 100baseT/Half, 100baseT/Full, 1000baseT/Full
      Supported ports: twisted pair, media-independent
      Port type: twisted pair
      Transceiver type: external
      Auto negotiation: true
      Link detected: true
      Link speed: 1000Mbit/s (full duplex)

Disks:
  Disk 0:
    NUMA node: 0
    ID: mmcblk0
    Device: 179:0
    Type: mmc
    Size: 29.12GiB
    Read-Only: false
    Removable: false
    Partitions:
      - Partition 1
        ID: mmcblk0p1
        Device: 179:1
        Read-Only: false
        Size: 4.00MiB
      - Partition 2
        ID: mmcblk0p2
        Device: 179:2
        Read-Only: false
        Size: 29.10GiB
  Disk 1:
    NUMA node: 0
    ID: mmcblk0boot0
    Device: 179:32
    Type: block
    Size: 4.00MiB
    Read-Only: true
    Removable: false
  Disk 2:
    NUMA node: 0
    ID: mmcblk0boot1
    Device: 179:64
    Type: block
    Size: 4.00MiB
    Read-Only: true
    Removable: false
  Disk 3:
    NUMA node: 0
    ID: nvme0n1
    Device: 259:0
    Model: Longline SSD
    Type: nvme
    Size: 238.47GiB
    WWN: eui.00000000000000000000010000000000
    Read-Only: false
    Removable: false
    Partitions:
      - Partition 1
        ID: nvme0n1p1
        Device: 259:1
        Read-Only: false
        Size: 238.47GiB
      - Partition 9
        ID: nvme0n1p9
        Device: 259:2
        Read-Only: false
        Size: 8.00MiB
  Disk 4:
    NUMA node: 0
    ID: sda
    Device: 8:0
    Model: WDC WD20EARX-00P
    Type: scsi
    Size: 1.82TiB
    Read-Only: false
    Removable: false
  Disk 5:
    NUMA node: 0
    ID: sdb
    Device: 8:16
    Model: WDC WD20EARX-00P
    Type: scsi
    Size: 1.82TiB
    Read-Only: false
    Removable: false
  Disk 6:
    NUMA node: 0
    ID: sdc
    Device: 8:32
    Model: CT500BX500SSD1
    Type: scsi
    Size: 465.76GiB
    Read-Only: false
    Removable: false

PCI devices:
  Device 0:
    Address: 0000:00:00.0
    Vendor: Rockchip Electronics Co., Ltd
    Vendor ID: 1d87
    Product:
    Product ID: 3588
    NUMA node: 0
    IOMMU group: 0
    Driver: pcieport
  Device 1:
    Address: 0000:01:00.0
    Vendor: Silicon Motion, Inc.
    Vendor ID: 126f
    Product: SM2263EN/SM2263XT SSD Controller
    Product ID: 2263
    NUMA node: 0
    IOMMU group: 0
    Driver: nvme
  Device 2:
    Address: 0001:30:00.0
    Vendor: Rockchip Electronics Co., Ltd
    Vendor ID: 1d87
    Product:
    Product ID: 3588
    NUMA node: 0
    IOMMU group: 0
    Driver: pcieport
  Device 3:
    Address: 0001:31:00.0
    Vendor: ASMedia Technology Inc.
    Vendor ID: 1b21
    Product:
    Product ID: 1064
    NUMA node: 0
    IOMMU group: 0
    Driver: ahci

candlerb · August 6, 2025, 9:27am

Maybe that’s the answer then: install a newer kernel. e.g. linux-image-generic-hwe-24.04 (which for Ubuntu 24.04 on x86_64 is 6.14.0), or linux-image-generic-6.11, linux-image-generic-6.14

cemzafer · August 6, 2025, 10:31am

You are absolutely right, but there is a handicap here when I install a newer kernel version the NPU driver are gone. In this platform I have little experience so I’m stuck.
Regards.

candlerb · August 6, 2025, 1:14pm

One to take up with the board vendor then?