Creating instance on CEPH RBD stuck unpacking

Incus
, ,
1

Hello.

I have a 3-OSD CEPH cluster set up, and I’ve been able to create containers on it just fine for the past few days. I tried creating my first virtual machine on it today, but whenever I do, the instance creation process hangs. Upon inspecting the operation, the create operation is stuck unpacking the image after download.

metadata:
  create_instance_from_image_unpack_progress: 'Unpacking image: 100%'
  progress:
    percent: "100"
    speed: "0"
    stage: create_instance_from_image_unpack

I’m not quite sure what is going on here!

2

What’s your ceph status output?

3 
  cluster:
    id:     a9b38e06-69a3-11f0-8762-52bc43003e89
    health: HEALTH_WARN
            Reduced data availability: 1 pg inactive
            Degraded data redundancy: 1 pg undersized

  services:
    mon: 1 daemons, quorum 26-18-ck-1-dal (age 43h)
    mgr: 26-18-ck-1-dal.aldtur(active, since 43h)
    osd: 3 osds: 3 up (since 43h), 3 in (since 4d)

  data:
    pools:   2 pools, 33 pgs
    objects: 2.92k objects, 6.5 GiB
    usage:   19 GiB used, 5.4 TiB / 5.4 TiB avail
    pgs:     3.030% pgs not active
             32 active+clean
             1  undersized+peered
4

You have one placement group that’s not functional and a cluster with exactly 3 OSDs, so that will cause I/Os going towards that PG to hang as there’s nowhere for Ceph to redirect them to.