I did try that, however, what happens then is either:
-
The request is sent to the API, judging by “lxd monitor --debug” but no response is sent from the daemon, so the command itself just hangs without any feedback, as a side I am unsure how long the timeout would be in such a case, but I usually give up after 10 minutes. There is no storage created. Restarting the snap.lxd.daemon.service fixes this.
-
If 1) isn’t the case and there is no existing storage you would run the configure on the targets, then the storage create, which hangs, though this time there is a storage created with a status of “ERRORED” with the “OSD pool missing” message I provided previously. Again, the pool does indeed exist in Ceph. I did notice in the driver that it runs a query to ceph to get this information, running it manually does indeed return results:
root@node02:~# ceph --name client.lxd --cluster ceph df -f json | jq .
{
“stats”: {
“total_bytes”: 6001218551808,
“total_avail_bytes”: 5995789131776,
“total_used_bytes”: 5429420032,
“total_used_raw_bytes”: 5429420032,
“total_used_raw_ratio”: 0.000904719578102231,
“num_osds”: 6,
“num_per_pool_osds”: 6,
“num_per_pool_omap_osds”: 6
},
“stats_by_class”: {
“ssd”: {
“total_bytes”: 6001218551808,
“total_avail_bytes”: 5995789131776,
“total_used_bytes”: 5429420032,
“total_used_raw_bytes”: 5429420032,
“total_used_raw_ratio”: 0.000904719578102231
}
},
“pools”: [
{
“name”: “device_health_metrics”,
“id”: 1,
“stats”: {
“stored”: 2726661,
“objects”: 6,
“kb_used”: 7989,
“bytes_used”: 8179983,
“percent_used”: 1.4365576816999237e-06,
“max_avail”: 1898049044480
}
},
{
“name”: “lxd-pool”,
“id”: 3,
“stats”: {
“stored”: 0,
“objects”: 0,
“kb_used”: 0,
“bytes_used”: 0,
“percent_used”: 0,
“max_avail”: 3796098088960
}
},
{
“name”: “lxd-pool2”,
“id”: 7,
“stats”: {
“stored”: 0,
“objects”: 0,
“kb_used”: 0,
“bytes_used”: 0,
“percent_used”: 0,
“max_avail”: 1898049044480
}
},
{
“name”: “lxdtest1”,
“id”: 8,
“stats”: {
“stored”: 36,
“objects”: 4,
“kb_used”: 24,
“bytes_used”: 24576,
“percent_used”: 4.31601065997711e-09,
“max_avail”: 1898049044480
}
},
{
“name”: “lxdalextest1”,
“id”: 9,
“stats”: {
“stored”: 0,
“objects”: 0,
“kb_used”: 0,
“bytes_used”: 0,
“percent_used”: 0,
“max_avail”: 1898049044480
}
}
]
}
Where the pool we want is lxd-pool.