Quick ceph question - unable to parse addrs in ceph.conf

1

Hi
I’m running Ceph as backend storage for my OpenStack cluster. I thought I’d try it out on LXD, so I create an RBD pool called lxd, ran RBD init on the pool then tried the command

lxc storage create ceph1 ceph source=lxd

but unfortunately get the following back:

image
image1685×78 2.52 KB

Now this ceph.conf works fine for OpenStack so not sure whats wrong with its format?

[client.rgw.p67.rgw0]
host = p67
keyring = /var/lib/ceph/radosgw/ceph-rgw.p67.rgw0/keyring
log file = /var/log/ceph/ceph-rgw-p67.rgw0.log
rgw frontends = beast endpoint=192.168.88.67:8080
rgw thread pool size = 512

[client.rgw.p70.rgw0]
host = p70
keyring = /var/lib/ceph/radosgw/ceph-rgw.p70.rgw0/keyring
log file = /var/log/ceph/ceph-rgw-p70.rgw0.log
rgw frontends = beast endpoint=192.168.88.70:8080
rgw thread pool size = 512

# Please do not change this file directly since it is managed by Ansible and will be overwritten
[global]
cluster network = 192.168.88.0/24
fsid = 9bd31b02-ee3c-4dc7-8334-c12bc9596ca0
mon host = [v2:192.168.88.67:3300,v1:192.168.88.67:6789],[v2:192.168.88.70:3300,v1:192.168.88.70:6789]
mon initial members = p67,p70
osd pool default crush rule = -1
public network = 192.168.88.0/24

[osd]
osd memory target = 23535812608
2

What version of the snap is that?

3

Hi
I thought for a second it may have been the old version and I hadn’t migrated!
But it looks like it is the latest snap v ersion 4.0.0

image
image1155×274 4.36 KB

4

Ok, what version of ceph do you normally run with this config?

5

It’s running Ceph Octopus which is I think the latest stable version of ceph.
This is the first time I’ve ever tested ceph with LXD

6

image
image1720×106 3.02 KB

7

The LXD snap ships its own version of the ceph client at version 12.2.13.
It’s usually not an issue talking to more recent servers but in this case there may be something that this version of ceph doesn’t like.

8

Note that you could feed it a much smaller ceph config just for LXD by doing:

  • snap set lxd ceph.builtin=true
  • mkdir /var/snap/lxd/common/ceph
  • systemctl reload snap.lxd.daemon

At which point /var/snap/lxd/common/ceph will be used rather than /etc/ceph

9

ok I’ll give that a try thanks!