Can't join existing LXD cluster because I can't make changes to default project

avml · September 8, 2022, 12:15am

Hello,

Having a little trouble rejoining a cluster with a node I. I create a token try to use that token to add the cluster member to an existing cluster after an lxd init…

boom I get this error

Error: Failed to join cluster: Failed to initialize member: Failed to initialize storage pools and networks: Failed to update local member project "default": You can't change the features of the default project

Here is the default project of the current cluster

config:
  features.images: "true"
  features.networks: "true"
  features.profiles: "true"
  features.storage.volumes: "true"
description: Default LXD project
name: default
used_by:
- /5.4/instances/nds
- /5.4/instances/pi-hole
- /5.4/instances/pi-hole2
- /1.0/profiles/bridge_network
- /1.0/profiles/default
- /1.0/profiles/demo
- /1.0/profiles/uptime-kuma
- /1.0/images/269b7a98b03082e01f71b72770b9c80fdfd3934864ebdf1eab89a486fc9c9b4b
- /1.0/images/37642262b80ba8ad4880a6fecb86df5ed9e46760680865e82c241f3edd68b09c
- /1.0/images/3cb11244746ec75aa427c73a7a885ab6e62dbbef1640812ecad499a02b7037a7
- /1.0/images/8b3cae2e46f37fa14a92a5963b0a330bf122aace7881c0edc07570aee1f47238
- /1.0/images/8fe1c8f9f5b534b2f68e3b9b13b22e70c88a43146969bfb8c5df991dc2e408dc
- /1.0/images/95f82d22bea6a0d20dc3c06a59929b768abd0c7243d5298c3973f1808688d117
- /1.0/images/a24f4fb7242288650d9940d24905f5c1e7862589ba6975a07cca040cb4496d4d
- /1.0/images/ee1c79c7b3dc0c2af2a1083c8fdf8c133da13a5bcc755eb89976320a7cc0244e
- /1.0/networks/UPLINK
- /1.0/networks/my-ovn

here is the project on the new machine

config:
  features.images: "true"
  features.profiles: "true"
  features.storage.volumes: "true"
description: Default LXD project
name: default
used_by:
- /1.0/profiles/default
- /1.0/networks/UPLINK
- /1.0/networks/lxdbr0

I can only assume lxd is trying to add features.networks: "true" to the new machine and in the default project and it throws an error.

Is there a way around this?

Thank you

tomp · September 8, 2022, 7:55am

OK so you’re missing this line in your config.

What verion of LXD is the cluster and the joining member?

tomp · September 8, 2022, 7:57am

Its most likely caused by this

And this work around should allow you to fix the joining member:

github.com/lxc/lxd

adding new members to cluster fails

opened 09:04AM - 12 Aug 22 UTC

closed 02:54AM - 13 Aug 22 UTC

phiser678

# Required information * Distribution: ubuntu * Distribution version: 22.04 * The output of "lxc info" or if that fails: See the debug output # Issue description I have an existing cluster, want to add more members but this fails. Removing existing members passes correctly, but can also not be re-added. There is this error at the end: Error: Failed to join cluster: Failed to initialize member: Failed to initialize storage pools and networks: Failed to update local member project "default": You can't change the features of the default project # Steps to reproduce 1. lxc cluster remove b104 2. on machine b104: 3. snap remove lxd;snap install lxd;zfs destroy -r tank/lxd;zfs create tank/lxd 4. on a machine of the cluster, get the token: lxc cluster add b104 5. on b104 with lxd init --debug: yes yes yes token yes tank/lxd tank/lxd yes yes I tried to check this issue on a second cluster which has the same versions of OS, kernel and lxd, but above setup steps works then. I suspect something in the lxd database. Also, I compared the debug outputs of the 2 clusters, but nothing really gives some add debug output, except the error. Here is the output of lxd init --debug: Again, thanks in advance for any help and the amazing work! ``` DEBUG [2022-08-12T09:51:35+02:00] Sending request to LXD etag= method=GET url="http://unix.socket/1.0" DEBUG [2022-08-12T09:51:37+02:00] Got response struct from LXD DEBUG [2022-08-12T09:51:37+02:00] { "config": {}, "api_extensions": [ "storage_zfs_remove_snapshots", "container_host_shutdown_timeout", "container_stop_priority", "container_syscall_filtering", "auth_pki", "container_last_used_at", "etag", "patch", "usb_devices", "https_allowed_credentials", "image_compression_algorithm", "directory_manipulation", "container_cpu_time", "storage_zfs_use_refquota", "storage_lvm_mount_options", "network", "profile_usedby", "container_push", "container_exec_recording", "certificate_update", "container_exec_signal_handling", "gpu_devices", "container_image_properties", "migration_progress", "id_map", "network_firewall_filtering", "network_routes", "storage", "file_delete", "file_append", "network_dhcp_expiry", "storage_lvm_vg_rename", "storage_lvm_thinpool_rename", "network_vlan", "image_create_aliases", "container_stateless_copy", "container_only_migration", "storage_zfs_clone_copy", "unix_device_rename", "storage_lvm_use_thinpool", "storage_rsync_bwlimit", "network_vxlan_interface", "storage_btrfs_mount_options", "entity_description", "image_force_refresh", "storage_lvm_lv_resizing", "id_map_base", "file_symlinks", "container_push_target", "network_vlan_physical", "storage_images_delete", "container_edit_metadata", "container_snapshot_stateful_migration", "storage_driver_ceph", "storage_ceph_user_name", "resource_limits", "storage_volatile_initial_source", "storage_ceph_force_osd_reuse", "storage_block_filesystem_btrfs", "resources", "kernel_limits", "storage_api_volume_rename", "macaroon_authentication", "network_sriov", "console", "restrict_devlxd", "migration_pre_copy", "infiniband", "maas_network", "devlxd_events", "proxy", "network_dhcp_gateway", "file_get_symlink", "network_leases", "unix_device_hotplug", "storage_api_local_volume_handling", "operation_description", "clustering", "event_lifecycle", "storage_api_remote_volume_handling", "nvidia_runtime", "container_mount_propagation", "container_backup", "devlxd_images", "container_local_cross_pool_handling", "proxy_unix", "proxy_udp", "clustering_join", "proxy_tcp_udp_multi_port_handling", "network_state", "proxy_unix_dac_properties", "container_protection_delete", "unix_priv_drop", "pprof_http", "proxy_haproxy_protocol", "network_hwaddr", "proxy_nat", "network_nat_order", "container_full", "candid_authentication", "backup_compression", "candid_config", "nvidia_runtime_config", "storage_api_volume_snapshots", "storage_unmapped", "projects", "candid_config_key", "network_vxlan_ttl", "container_incremental_copy", "usb_optional_vendorid", "snapshot_scheduling", "snapshot_schedule_aliases", "container_copy_project", "clustering_server_address", "clustering_image_replication", "container_protection_shift", "snapshot_expiry", "container_backup_override_pool", "snapshot_expiry_creation", "network_leases_location", "resources_cpu_socket", "resources_gpu", "resources_numa", "kernel_features", "id_map_current", "event_location", "storage_api_remote_volume_snapshots", "network_nat_address", "container_nic_routes", "rbac", "cluster_internal_copy", "seccomp_notify", "lxc_features", "container_nic_ipvlan", "network_vlan_sriov", "storage_cephfs", "container_nic_ipfilter", "resources_v2", "container_exec_user_group_cwd", "container_syscall_intercept", "container_disk_shift", "storage_shifted", "resources_infiniband", "daemon_storage", "instances", "image_types", "resources_disk_sata", "clustering_roles", "images_expiry", "resources_network_firmware", "backup_compression_algorithm", "ceph_data_pool_name", "container_syscall_intercept_mount", "compression_squashfs", "container_raw_mount", "container_nic_routed", "container_syscall_intercept_mount_fuse", "container_disk_ceph", "virtual-machines", "image_profiles", "clustering_architecture", "resources_disk_id", "storage_lvm_stripes", "vm_boot_priority", "unix_hotplug_devices", "api_filtering", "instance_nic_network", "clustering_sizing", "firewall_driver", "projects_limits", "container_syscall_intercept_hugetlbfs", "limits_hugepages", "container_nic_routed_gateway", "projects_restrictions", "custom_volume_snapshot_expiry", "volume_snapshot_scheduling", "trust_ca_certificates", "snapshot_disk_usage", "clustering_edit_roles", "container_nic_routed_host_address", "container_nic_ipvlan_gateway", "resources_usb_pci", "resources_cpu_threads_numa", "resources_cpu_core_die", "api_os", "container_nic_routed_host_table", "container_nic_ipvlan_host_table", "container_nic_ipvlan_mode", "resources_system", "images_push_relay", "network_dns_search", "container_nic_routed_limits", "instance_nic_bridged_vlan", "network_state_bond_bridge", "usedby_consistency", "custom_block_volumes", "clustering_failure_domains", "resources_gpu_mdev", "console_vga_type", "projects_limits_disk", "network_type_macvlan", "network_type_sriov", "container_syscall_intercept_bpf_devices", "network_type_ovn", "projects_networks", "projects_networks_restricted_uplinks", "custom_volume_backup", "backup_override_name", "storage_rsync_compression", "network_type_physical", "network_ovn_external_subnets", "network_ovn_nat", "network_ovn_external_routes_remove", "tpm_device_type", "storage_zfs_clone_copy_rebase", "gpu_mdev", "resources_pci_iommu", "resources_network_usb", "resources_disk_address", "network_physical_ovn_ingress_mode", "network_ovn_dhcp", "network_physical_routes_anycast", "projects_limits_instances", "network_state_vlan", "instance_nic_bridged_port_isolation", "instance_bulk_state_change", "network_gvrp", "instance_pool_move", "gpu_sriov", "pci_device_type", "storage_volume_state", "network_acl", "migration_stateful", "disk_state_quota", "storage_ceph_features", "projects_compression", "projects_images_remote_cache_expiry", "certificate_project", "network_ovn_acl", "projects_images_auto_update", "projects_restricted_cluster_target", "images_default_architecture", "network_ovn_acl_defaults", "gpu_mig", "project_usage", "network_bridge_acl", "warnings", "projects_restricted_backups_and_snapshots", "clustering_join_token", "clustering_description", "server_trusted_proxy", "clustering_update_cert", "storage_api_project", "server_instance_driver_operational", "server_supported_storage_drivers", "event_lifecycle_requestor_address", "resources_gpu_usb", "clustering_evacuation", "network_ovn_nat_address", "network_bgp", "network_forward", "custom_volume_refresh", "network_counters_errors_dropped", "metrics", "image_source_project", "clustering_config", "network_peer", "linux_sysctl", "network_dns", "ovn_nic_acceleration", "certificate_self_renewal", "instance_project_move", "storage_volume_project_move", "cloud_init", "network_dns_nat", "database_leader", "instance_all_projects", "clustering_groups", "ceph_rbd_du", "instance_get_full", "qemu_metrics", "gpu_mig_uuid", "event_project", "clustering_evacuation_live", "instance_allow_inconsistent_copy", "network_state_ovn", "storage_volume_api_filtering", "image_restrictions", "storage_zfs_export", "network_dns_records", "storage_zfs_reserve_space", "network_acl_log", "storage_zfs_blocksize", "metrics_cpu_seconds", "instance_snapshot_never", "certificate_token", "instance_nic_routed_neighbor_probe", "event_hub", "agent_nic_config", "projects_restricted_intercept", "metrics_authentication", "images_target_project", "cluster_migration_inconsistent_copy", "cluster_ovn_chassis", "container_syscall_intercept_sched_setscheduler", "storage_lvm_thinpool_metadata_size", "storage_volume_state_total", "instance_file_head", "instances_nic_host_name", "image_copy_profile", "container_syscall_intercept_sysinfo", "clustering_evacuation_mode", "resources_pci_vpd", "qemu_raw_conf", "storage_cephfs_fscache", "network_load_balancer", "vsock_api" ], "api_status": "stable", "api_version": "1.0", "auth": "trusted", "public": false, "auth_methods": [ "tls" ], "environment": { "addresses": [], "architectures": [ "x86_64", "i686" ], "certificate": "-----BEGIN CERTIFICATE-----\nMIIB/TCCAYSgAwIBAgIRAJtrjMnJyd4CO0Bm3+joKu8wCgYIKoZIzj0EAwMwMjEc\nMBoGA1UEChMTbGludXhjb250YWluZXJzLm9yZzESMBAGA1UEAwwJcm9vdEBiMTA0\nMB4XDTIyMDgxMjA3NTEzN1oXDTMyMDgwOTA3NTEzN1owMjEcMBoGA1UEChMTbGlu\ndXhjb250YWluZXJzLm9yZzESMBAGA1UEAwwJcm9vdEBiMTA0MHYwEAYHKoZIzj0C\nAQYFK4EEACIDYgAEvfjY2N3gCfa3KqdOVftyzDtn/Vly9vuAG+7acesJ+KDuGJkT\nfrv+Rt59gb7E5r0Tlp/O9QF4x4anRApEGUx0WfqABReIU52LMOy8u93HGYo9NyoA\nF5mjm1wWiLEQe9Rzo14wXDAOBgNVHQ8BAf8EBAMCBaAwEwYDVR0lBAwwCgYIKwYB\nBQUHAwEwDAYDVR0TAQH/BAIwADAnBgNVHREEIDAeggRiMTA0hwR/AAABhxAAAAAA\nAAAAAAAAAAAAAAABMAoGCCqGSM49BAMDA2cAMGQCMD3tK/TAf9UuAFhYZ4mgMyUk\n6EX7SylzjM2Rur+Jy3ONJr6sBMkwIST8g8HpA8V9QgIwX/fUy0R2BN0ODTzIwev3\n2NRDRhQwcwlCPmaQS8ffspqF963h1lVugDeqGPSmagkC\n-----END CERTIFICATE-----\n", "certificate_fingerprint": "79718261467bd8358cc6efa171696c3e5ede5bf0872383d48bf1e169dbee2a03", "driver": "lxc | qemu", "driver_version": "5.0.1 | 7.0.0", "firewall": "nftables", "kernel": "Linux", "kernel_architecture": "x86_64", "kernel_features": { "idmapped_mounts": "true", "netnsid_getifaddrs": "true", "seccomp_listener": "true", "seccomp_listener_continue": "true", "shiftfs": "false", "uevent_injection": "true", "unpriv_fscaps": "true" }, "kernel_version": "5.15.0-46-generic", "lxc_features": { "cgroup2": "true", "core_scheduling": "true", "devpts_fd": "true", "idmapped_mounts_v2": "true", "mount_injection_file": "true", "network_gateway_device_route": "true", "network_ipvlan": "true", "network_l2proxy": "true", "network_phys_macvlan_mtu": "true", "network_veth_router": "true", "pidfd": "true", "seccomp_allow_deny_syntax": "true", "seccomp_notify": "true", "seccomp_proxy_send_notify_fd": "true" }, "os_name": "Ubuntu", "os_version": "22.04", "project": "default", "server": "lxd", "server_clustered": false, "server_event_mode": "full-mesh", "server_name": "b104", "server_pid": 12977, "server_version": "5.4", "storage": "", "storage_version": "", "storage_supported_drivers": [ { "Name": "btrfs", "Version": "5.4.1", "Remote": false }, { "Name": "cephfs", "Version": "15.2.16", "Remote": true }, { "Name": "dir", "Version": "1", "Remote": false }, { "Name": "lvm", "Version": "2.03.07(2) (2019-11-30) / 1.02.167 (2019-11-30) / 4.45.0", "Remote": false }, { "Name": "zfs", "Version": "2.1.4-0ubuntu0.1", "Remote": false }, { "Name": "ceph", "Version": "15.2.16", "Remote": true } ] } } DEBUG [2022-08-12T09:51:37+02:00] Sending request to LXD etag= method=GET url="http://unix.socket/1.0" DEBUG [2022-08-12T09:51:37+02:00] Got response struct from LXD DEBUG [2022-08-12T09:51:37+02:00] { "config": {}, "api_extensions": [ "storage_zfs_remove_snapshots", "container_host_shutdown_timeout", "container_stop_priority", "container_syscall_filtering", "auth_pki", "container_last_used_at", "etag", "patch", "usb_devices", "https_allowed_credentials", "image_compression_algorithm", "directory_manipulation", "container_cpu_time", "storage_zfs_use_refquota", "storage_lvm_mount_options", "network", "profile_usedby", "container_push", "container_exec_recording", "certificate_update", "container_exec_signal_handling", "gpu_devices", "container_image_properties", "migration_progress", "id_map", "network_firewall_filtering", "network_routes", "storage", "file_delete", "file_append", "network_dhcp_expiry", "storage_lvm_vg_rename", "storage_lvm_thinpool_rename", "network_vlan", "image_create_aliases", "container_stateless_copy", "container_only_migration", "storage_zfs_clone_copy", "unix_device_rename", "storage_lvm_use_thinpool", "storage_rsync_bwlimit", "network_vxlan_interface", "storage_btrfs_mount_options", "entity_description", "image_force_refresh", "storage_lvm_lv_resizing", "id_map_base", "file_symlinks", "container_push_target", "network_vlan_physical", "storage_images_delete", "container_edit_metadata", "container_snapshot_stateful_migration", "storage_driver_ceph", "storage_ceph_user_name", "resource_limits", "storage_volatile_initial_source", "storage_ceph_force_osd_reuse", "storage_block_filesystem_btrfs", "resources", "kernel_limits", "storage_api_volume_rename", "macaroon_authentication", "network_sriov", "console", "restrict_devlxd", "migration_pre_copy", "infiniband", "maas_network", "devlxd_events", "proxy", "network_dhcp_gateway", "file_get_symlink", "network_leases", "unix_device_hotplug", "storage_api_local_volume_handling", "operation_description", "clustering", "event_lifecycle", "storage_api_remote_volume_handling", "nvidia_runtime", "container_mount_propagation", "container_backup", "devlxd_images", "container_local_cross_pool_handling", "proxy_unix", "proxy_udp", "clustering_join", "proxy_tcp_udp_multi_port_handling", "network_state", "proxy_unix_dac_properties", "container_protection_delete", "unix_priv_drop", "pprof_http", "proxy_haproxy_protocol", "network_hwaddr", "proxy_nat", "network_nat_order", "container_full", "candid_authentication", "backup_compression", "candid_config", "nvidia_runtime_config", "storage_api_volume_snapshots", "storage_unmapped", "projects", "candid_config_key", "network_vxlan_ttl", "container_incremental_copy", "usb_optional_vendorid", "snapshot_scheduling", "snapshot_schedule_aliases", "container_copy_project", "clustering_server_address", "clustering_image_replication", "container_protection_shift", "snapshot_expiry", "container_backup_override_pool", "snapshot_expiry_creation", "network_leases_location", "resources_cpu_socket", "resources_gpu", "resources_numa", "kernel_features", "id_map_current", "event_location", "storage_api_remote_volume_snapshots", "network_nat_address", "container_nic_routes", "rbac", "cluster_internal_copy", "seccomp_notify", "lxc_features", "container_nic_ipvlan", "network_vlan_sriov", "storage_cephfs", "container_nic_ipfilter", "resources_v2", "container_exec_user_group_cwd", "container_syscall_intercept", "container_disk_shift", "storage_shifted", "resources_infiniband", "daemon_storage", "instances", "image_types", "resources_disk_sata", "clustering_roles", "images_expiry", "resources_network_firmware", "backup_compression_algorithm", "ceph_data_pool_name", "container_syscall_intercept_mount", "compression_squashfs", "container_raw_mount", "container_nic_routed", "container_syscall_intercept_mount_fuse", "container_disk_ceph", "virtual-machines", "image_profiles", "clustering_architecture", "resources_disk_id", "storage_lvm_stripes", "vm_boot_priority", "unix_hotplug_devices", "api_filtering", "instance_nic_network", "clustering_sizing", "firewall_driver", "projects_limits", "container_syscall_intercept_hugetlbfs", "limits_hugepages", "container_nic_routed_gateway", "projects_restrictions", "custom_volume_snapshot_expiry", "volume_snapshot_scheduling", "trust_ca_certificates", "snapshot_disk_usage", "clustering_edit_roles", "container_nic_routed_host_address", "container_nic_ipvlan_gateway", "resources_usb_pci", "resources_cpu_threads_numa", "resources_cpu_core_die", "api_os", "container_nic_routed_host_table", "container_nic_ipvlan_host_table", "container_nic_ipvlan_mode", "resources_system", "images_push_relay", "network_dns_search", "container_nic_routed_limits", "instance_nic_bridged_vlan", "network_state_bond_bridge", "usedby_consistency", "custom_block_volumes", "clustering_failure_domains", "resources_gpu_mdev", "console_vga_type", "projects_limits_disk", "network_type_macvlan", "network_type_sriov", "container_syscall_intercept_bpf_devices", "network_type_ovn", "projects_networks", "projects_networks_restricted_uplinks", "custom_volume_backup", "backup_override_name", "storage_rsync_compression", "network_type_physical", "network_ovn_external_subnets", "network_ovn_nat", "network_ovn_external_routes_remove", "tpm_device_type", "storage_zfs_clone_copy_rebase", "gpu_mdev", "resources_pci_iommu", "resources_network_usb", "resources_disk_address", "network_physical_ovn_ingress_mode", "network_ovn_dhcp", "network_physical_routes_anycast", "projects_limits_instances", "network_state_vlan", "instance_nic_bridged_port_isolation", "instance_bulk_state_change", "network_gvrp", "instance_pool_move", "gpu_sriov", "pci_device_type", "storage_volume_state", "network_acl", "migration_stateful", "disk_state_quota", "storage_ceph_features", "projects_compression", "projects_images_remote_cache_expiry", "certificate_project", "network_ovn_acl", "projects_images_auto_update", "projects_restricted_cluster_target", "images_default_architecture", "network_ovn_acl_defaults", "gpu_mig", "project_usage", "network_bridge_acl", "warnings", "projects_restricted_backups_and_snapshots", "clustering_join_token", "clustering_description", "server_trusted_proxy", "clustering_update_cert", "storage_api_project", "server_instance_driver_operational", "server_supported_storage_drivers", "event_lifecycle_requestor_address", "resources_gpu_usb", "clustering_evacuation", "network_ovn_nat_address", "network_bgp", "network_forward", "custom_volume_refresh", "network_counters_errors_dropped", "metrics", "image_source_project", "clustering_config", "network_peer", "linux_sysctl", "network_dns", "ovn_nic_acceleration", "certificate_self_renewal", "instance_project_move", "storage_volume_project_move", "cloud_init", "network_dns_nat", "database_leader", "instance_all_projects", "clustering_groups", "ceph_rbd_du", "instance_get_full", "qemu_metrics", "gpu_mig_uuid", "event_project", "clustering_evacuation_live", "instance_allow_inconsistent_copy", "network_state_ovn", "storage_volume_api_filtering", "image_restrictions", "storage_zfs_export", "network_dns_records", "storage_zfs_reserve_space", "network_acl_log", "storage_zfs_blocksize", "metrics_cpu_seconds", "instance_snapshot_never", "certificate_token", "instance_nic_routed_neighbor_probe", "event_hub", "agent_nic_config", "projects_restricted_intercept", "metrics_authentication", "images_target_project", "cluster_migration_inconsistent_copy", "cluster_ovn_chassis", "container_syscall_intercept_sched_setscheduler", "storage_lvm_thinpool_metadata_size", "storage_volume_state_total", "instance_file_head", "instances_nic_host_name", "image_copy_profile", "container_syscall_intercept_sysinfo", "clustering_evacuation_mode", "resources_pci_vpd", "qemu_raw_conf", "storage_cephfs_fscache", "network_load_balancer", "vsock_api" ], "api_status": "stable", "api_version": "1.0", "auth": "trusted", "public": false, "auth_methods": [ "tls" ], "environment": { "addresses": [], "architectures": [ "x86_64", "i686" ], "certificate": "-----BEGIN CERTIFICATE-----\nMIIB/TCCAYSgAwIBAgIRAJtrjMnJyd4CO0Bm3+joKu8wCgYIKoZIzj0EAwMwMjEc\nMBoGA1UEChMTbGludXhjb250YWluZXJzLm9yZzESMBAGA1UEAwwJcm9vdEBiMTA0\nMB4XDTIyMDgxMjA3NTEzN1oXDTMyMDgwOTA3NTEzN1owMjEcMBoGA1UEChMTbGlu\ndXhjb250YWluZXJzLm9yZzESMBAGA1UEAwwJcm9vdEBiMTA0MHYwEAYHKoZIzj0C\nAQYFK4EEACIDYgAEvfjY2N3gCfa3KqdOVftyzDtn/Vly9vuAG+7acesJ+KDuGJkT\nfrv+Rt59gb7E5r0Tlp/O9QF4x4anRApEGUx0WfqABReIU52LMOy8u93HGYo9NyoA\nF5mjm1wWiLEQe9Rzo14wXDAOBgNVHQ8BAf8EBAMCBaAwEwYDVR0lBAwwCgYIKwYB\nBQUHAwEwDAYDVR0TAQH/BAIwADAnBgNVHREEIDAeggRiMTA0hwR/AAABhxAAAAAA\nAAAAAAAAAAAAAAABMAoGCCqGSM49BAMDA2cAMGQCMD3tK/TAf9UuAFhYZ4mgMyUk\n6EX7SylzjM2Rur+Jy3ONJr6sBMkwIST8g8HpA8V9QgIwX/fUy0R2BN0ODTzIwev3\n2NRDRhQwcwlCPmaQS8ffspqF963h1lVugDeqGPSmagkC\n-----END CERTIFICATE-----\n", "certificate_fingerprint": "79718261467bd8358cc6efa171696c3e5ede5bf0872383d48bf1e169dbee2a03", "driver": "lxc | qemu", "driver_version": "5.0.1 | 7.0.0", "firewall": "nftables", "kernel": "Linux", "kernel_architecture": "x86_64", "kernel_features": { "idmapped_mounts": "true", "netnsid_getifaddrs": "true", "seccomp_listener": "true", "seccomp_listener_continue": "true", "shiftfs": "false", "uevent_injection": "true", "unpriv_fscaps": "true" }, "kernel_version": "5.15.0-46-generic", "lxc_features": { "cgroup2": "true", "core_scheduling": "true", "devpts_fd": "true", "idmapped_mounts_v2": "true", "mount_injection_file": "true", "network_gateway_device_route": "true", "network_ipvlan": "true", "network_l2proxy": "true", "network_phys_macvlan_mtu": "true", "network_veth_router": "true", "pidfd": "true", "seccomp_allow_deny_syntax": "true", "seccomp_notify": "true", "seccomp_proxy_send_notify_fd": "true" }, "os_name": "Ubuntu", "os_version": "22.04", "project": "default", "server": "lxd", "server_clustered": false, "server_event_mode": "full-mesh", "server_name": "b104", "server_pid": 12977, "server_version": "5.4", "storage": "", "storage_version": "", "storage_supported_drivers": [ { "Name": "btrfs", "Version": "5.4.1", "Remote": false }, { "Name": "cephfs", "Version": "15.2.16", "Remote": true }, { "Name": "dir", "Version": "1", "Remote": false }, { "Name": "lvm", "Version": "2.03.07(2) (2019-11-30) / 1.02.167 (2019-11-30) / 4.45.0", "Remote": false }, { "Name": "zfs", "Version": "2.1.4-0ubuntu0.1", "Remote": false }, { "Name": "ceph", "Version": "15.2.16", "Remote": true } ] } } Would you like to use LXD clustering? (yes/no) [default=no]: What IP address or DNS name should be used to reach this node? [default=10.0.127.63]: Are you joining an existing cluster? (yes/no) [default=no]: Do you have a join token? (yes/no/[token]) [default=no]: Please provide join token: All existing data is lost when joining a cluster, continue? (yes/no) [default=no] DEBUG [2022-08-12T09:51:37+02:00] Connecting to a remote LXD over HTTPS DEBUG [2022-08-12T09:51:37+02:00] Sending request to LXD etag= method=GET url="https://10.0.127.243:8443/1.0" DEBUG [2022-08-12T09:51:37+02:00] Got response struct from LXD DEBUG [2022-08-12T09:51:37+02:00] { "config": null, "api_extensions": [ "storage_zfs_remove_snapshots", "container_host_shutdown_timeout", "container_stop_priority", "container_syscall_filtering", "auth_pki", "container_last_used_at", "etag", "patch", "usb_devices", "https_allowed_credentials", "image_compression_algorithm", "directory_manipulation", "container_cpu_time", "storage_zfs_use_refquota", "storage_lvm_mount_options", "network", "profile_usedby", "container_push", "container_exec_recording", "certificate_update", "container_exec_signal_handling", "gpu_devices", "container_image_properties", "migration_progress", "id_map", "network_firewall_filtering", "network_routes", "storage", "file_delete", "file_append", "network_dhcp_expiry", "storage_lvm_vg_rename", "storage_lvm_thinpool_rename", "network_vlan", "image_create_aliases", "container_stateless_copy", "container_only_migration", "storage_zfs_clone_copy", "unix_device_rename", "storage_lvm_use_thinpool", "storage_rsync_bwlimit", "network_vxlan_interface", "storage_btrfs_mount_options", "entity_description", "image_force_refresh", "storage_lvm_lv_resizing", "id_map_base", "file_symlinks", "container_push_target", "network_vlan_physical", "storage_images_delete", "container_edit_metadata", "container_snapshot_stateful_migration", "storage_driver_ceph", "storage_ceph_user_name", "resource_limits", "storage_volatile_initial_source", "storage_ceph_force_osd_reuse", "storage_block_filesystem_btrfs", "resources", "kernel_limits", "storage_api_volume_rename", "macaroon_authentication", "network_sriov", "console", "restrict_devlxd", "migration_pre_copy", "infiniband", "maas_network", "devlxd_events", "proxy", "network_dhcp_gateway", "file_get_symlink", "network_leases", "unix_device_hotplug", "storage_api_local_volume_handling", "operation_description", "clustering", "event_lifecycle", "storage_api_remote_volume_handling", "nvidia_runtime", "container_mount_propagation", "container_backup", "devlxd_images", "container_local_cross_pool_handling", "proxy_unix", "proxy_udp", "clustering_join", "proxy_tcp_udp_multi_port_handling", "network_state", "proxy_unix_dac_properties", "container_protection_delete", "unix_priv_drop", "pprof_http", "proxy_haproxy_protocol", "network_hwaddr", "proxy_nat", "network_nat_order", "container_full", "candid_authentication", "backup_compression", "candid_config", "nvidia_runtime_config", "storage_api_volume_snapshots", "storage_unmapped", "projects", "candid_config_key", "network_vxlan_ttl", "container_incremental_copy", "usb_optional_vendorid", "snapshot_scheduling", "snapshot_schedule_aliases", "container_copy_project", "clustering_server_address", "clustering_image_replication", "container_protection_shift", "snapshot_expiry", "container_backup_override_pool", "snapshot_expiry_creation", "network_leases_location", "resources_cpu_socket", "resources_gpu", "resources_numa", "kernel_features", "id_map_current", "event_location", "storage_api_remote_volume_snapshots", "network_nat_address", "container_nic_routes", "rbac", "cluster_internal_copy", "seccomp_notify", "lxc_features", "container_nic_ipvlan", "network_vlan_sriov", "storage_cephfs", "container_nic_ipfilter", "resources_v2", "container_exec_user_group_cwd", "container_syscall_intercept", "container_disk_shift", "storage_shifted", "resources_infiniband", "daemon_storage", "instances", "image_types", "resources_disk_sata", "clustering_roles", "images_expiry", "resources_network_firmware", "backup_compression_algorithm", "ceph_data_pool_name", "container_syscall_intercept_mount", "compression_squashfs", "container_raw_mount", "container_nic_routed", "container_syscall_intercept_mount_fuse", "container_disk_ceph", "virtual-machines", "image_profiles", "clustering_architecture", "resources_disk_id", "storage_lvm_stripes", "vm_boot_priority", "unix_hotplug_devices", "api_filtering", "instance_nic_network", "clustering_sizing", "firewall_driver", "projects_limits", "container_syscall_intercept_hugetlbfs", "limits_hugepages", "container_nic_routed_gateway", "projects_restrictions", "custom_volume_snapshot_expiry", "volume_snapshot_scheduling", "trust_ca_certificates", "snapshot_disk_usage", "clustering_edit_roles", "container_nic_routed_host_address", "container_nic_ipvlan_gateway", "resources_usb_pci", "resources_cpu_threads_numa", "resources_cpu_core_die", "api_os", "container_nic_routed_host_table", "container_nic_ipvlan_host_table", "container_nic_ipvlan_mode", "resources_system", "images_push_relay", "network_dns_search", "container_nic_routed_limits", "instance_nic_bridged_vlan", "network_state_bond_bridge", "usedby_consistency", "custom_block_volumes", "clustering_failure_domains", "resources_gpu_mdev", "console_vga_type", "projects_limits_disk", "network_type_macvlan", "network_type_sriov", "container_syscall_intercept_bpf_devices", "network_type_ovn", "projects_networks", "projects_networks_restricted_uplinks", "custom_volume_backup", "backup_override_name", "storage_rsync_compression", "network_type_physical", "network_ovn_external_subnets", "network_ovn_nat", "network_ovn_external_routes_remove", "tpm_device_type", "storage_zfs_clone_copy_rebase", "gpu_mdev", "resources_pci_iommu", "resources_network_usb", "resources_disk_address", "network_physical_ovn_ingress_mode", "network_ovn_dhcp", "network_physical_routes_anycast", "projects_limits_instances", "network_state_vlan", "instance_nic_bridged_port_isolation", "instance_bulk_state_change", "network_gvrp", "instance_pool_move", "gpu_sriov", "pci_device_type", "storage_volume_state", "network_acl", "migration_stateful", "disk_state_quota", "storage_ceph_features", "projects_compression", "projects_images_remote_cache_expiry", "certificate_project", "network_ovn_acl", "projects_images_auto_update", "projects_restricted_cluster_target", "images_default_architecture", "network_ovn_acl_defaults", "gpu_mig", "project_usage", "network_bridge_acl", "warnings", "projects_restricted_backups_and_snapshots", "clustering_join_token", "clustering_description", "server_trusted_proxy", "clustering_update_cert", "storage_api_project", "server_instance_driver_operational", "server_supported_storage_drivers", "event_lifecycle_requestor_address", "resources_gpu_usb", "clustering_evacuation", "network_ovn_nat_address", "network_bgp", "network_forward", "custom_volume_refresh", "network_counters_errors_dropped", "metrics", "image_source_project", "clustering_config", "network_peer", "linux_sysctl", "network_dns", "ovn_nic_acceleration", "certificate_self_renewal", "instance_project_move", "storage_volume_project_move", "cloud_init", "network_dns_nat", "database_leader", "instance_all_projects", "clustering_groups", "ceph_rbd_du", "instance_get_full", "qemu_metrics", "gpu_mig_uuid", "event_project", "clustering_evacuation_live", "instance_allow_inconsistent_copy", "network_state_ovn", "storage_volume_api_filtering", "image_restrictions", "storage_zfs_export", "network_dns_records", "storage_zfs_reserve_space", "network_acl_log", "storage_zfs_blocksize", "metrics_cpu_seconds", "instance_snapshot_never", "certificate_token", "instance_nic_routed_neighbor_probe", "event_hub", "agent_nic_config", "projects_restricted_intercept", "metrics_authentication", "images_target_project", "cluster_migration_inconsistent_copy", "cluster_ovn_chassis", "container_syscall_intercept_sched_setscheduler", "storage_lvm_thinpool_metadata_size", "storage_volume_state_total", "instance_file_head", "instances_nic_host_name", "image_copy_profile", "container_syscall_intercept_sysinfo", "clustering_evacuation_mode", "resources_pci_vpd", "qemu_raw_conf", "storage_cephfs_fscache", "network_load_balancer", "vsock_api" ], "api_status": "stable", "api_version": "1.0", "auth": "untrusted", "public": false, "auth_methods": [ "tls" ], "environment": { "addresses": null, "architectures": null, "certificate": "", "certificate_fingerprint": "", "driver": "", "driver_version": "", "firewall": "", "kernel": "", "kernel_architecture": "", "kernel_features": null, "kernel_version": "", "lxc_features": null, "os_name": "", "os_version": "", "project": "", "server": "", "server_clustered": false, "server_event_mode": "", "server_name": "", "server_pid": 0, "server_version": "", "storage": "", "storage_version": "", "storage_supported_drivers": null } } DEBUG [2022-08-12T09:51:37+02:00] Sending request to LXD etag= method=POST url="https://10.0.127.243:8443/1.0/certificates" DEBUG [2022-08-12T09:51:37+02:00] { "name": "b104", "type": "server", "restricted": false, "projects": null, "certificate": "MIIB/TCCAYSgAwIBAgIRAJtrjMnJyd4CO0Bm3+joKu8wCgYIKoZIzj0EAwMwMjEcMBoGA1UEChMTbGludXhjb250YWluZXJzLm9yZzESMBAGA1UEAwwJcm9vdEBiMTA0MB4XDTIyMDgxMjA3NTEzN1oXDTMyMDgwOTA3NTEzN1owMjEcMBoGA1UEChMTbGludXhjb250YWluZXJzLm9yZzESMBAGA1UEAwwJcm9vdEBiMTA0MHYwEAYHKoZIzj0CAQYFK4EEACIDYgAEvfjY2N3gCfa3KqdOVftyzDtn/Vly9vuAG+7acesJ+KDuGJkTfrv+Rt59gb7E5r0Tlp/O9QF4x4anRApEGUx0WfqABReIU52LMOy8u93HGYo9NyoAF5mjm1wWiLEQe9Rzo14wXDAOBgNVHQ8BAf8EBAMCBaAwEwYDVR0lBAwwCgYIKwYBBQUHAwEwDAYDVR0TAQH/BAIwADAnBgNVHREEIDAeggRiMTA0hwR/AAABhxAAAAAAAAAAAAAAAAAAAAABMAoGCCqGSM49BAMDA2cAMGQCMD3tK/TAf9UuAFhYZ4mgMyUk6EX7SylzjM2Rur+Jy3ONJr6sBMkwIST8g8HpA8V9QgIwX/fUy0R2BN0ODTzIwev32NRDRhQwcwlCPmaQS8ffspqF963h1lVugDeqGPSmagkC", "password": "eyJzZXJ2ZXJfbmFtZSI6ImIxMDQiLCJmaW5nZXJwcmludCI6IjM2NTU2ZjY1NzdkMDgzNDU3NDM5ZTg2ZjliYjRkMzQ3OTczYzQwMjJiY2I0ZDBkNGI4YjEyYjcxYzcxMjA3MjIiLCJhZGRyZXNzZXMiOlsiMTAuMC4xMjcuMjQzOjg0NDMiLCIxMC4wLjEyNy4xNTk6ODQ0MyIsIjEwLjAuMTI3LjEyMTo4NDQzIiwiMTAuMC4xMjcuMTM1Ojg0NDMiLCIxMC4wLjEyNy4yMzg6ODQ0MyIsIjEwLjAuMTI3LjE0ODo4NDQzIiwiMTAuMC4xMjcuMjY6ODQ0MyIsIjEwLjAuMTI3LjE1NTo4NDQzIiwiMTAuMC4xMjcuMTEzOjg0NDMiLCIxMC4wLjEyNy4zNzo4NDQzIiwiMTAuMC4xMjcuMjE5Ojg0NDMiLCIxMC4wLjEyNy4zMTo4NDQzIiwiMTAuMC4xMjcuMTAxOjg0NDMiLCIxMC4wLjEyNy4xMDY6ODQ0MyJdLCJzZWNyZXQiOiI5OGMyMGNmYzA1ZWNlNmRmZThjMzE1N2IyOWFhY2IwOGYxNmJlOTNkY2U3NjBmNWQ5MzRhZGY1MTYyOGMxZjAxIn0=", "token": false } DEBUG [2022-08-12T09:51:37+02:00] Connecting to a remote LXD over HTTPS DEBUG [2022-08-12T09:51:37+02:00] Sending request to LXD etag= method=GET url="https://10.0.127.243:8443/1.0" DEBUG [2022-08-12T09:51:37+02:00] Got response struct from LXD DEBUG [2022-08-12T09:51:37+02:00] { "config": { "cluster.https_address": "10.0.127.243:8443", "core.https_address": "10.0.127.243:8443", "core.trust_password": true, "images.auto_update_interval": "0" }, "api_extensions": [ "storage_zfs_remove_snapshots", "container_host_shutdown_timeout", "container_stop_priority", "container_syscall_filtering", "auth_pki", "container_last_used_at", "etag", "patch", "usb_devices", "https_allowed_credentials", "image_compression_algorithm", "directory_manipulation", "container_cpu_time", "storage_zfs_use_refquota", "storage_lvm_mount_options", "network", "profile_usedby", "container_push", "container_exec_recording", "certificate_update", "container_exec_signal_handling", "gpu_devices", "container_image_properties", "migration_progress", "id_map", "network_firewall_filtering", "network_routes", "storage", "file_delete", "file_append", "network_dhcp_expiry", "storage_lvm_vg_rename", "storage_lvm_thinpool_rename", "network_vlan", "image_create_aliases", "container_stateless_copy", "container_only_migration", "storage_zfs_clone_copy", "unix_device_rename", "storage_lvm_use_thinpool", "storage_rsync_bwlimit", "network_vxlan_interface", "storage_btrfs_mount_options", "entity_description", "image_force_refresh", "storage_lvm_lv_resizing", "id_map_base", "file_symlinks", "container_push_target", "network_vlan_physical", "storage_images_delete", "container_edit_metadata", "container_snapshot_stateful_migration", "storage_driver_ceph", "storage_ceph_user_name", "resource_limits", "storage_volatile_initial_source", "storage_ceph_force_osd_reuse", "storage_block_filesystem_btrfs", "resources", "kernel_limits", "storage_api_volume_rename", "macaroon_authentication", "network_sriov", "console", "restrict_devlxd", "migration_pre_copy", "infiniband", "maas_network", "devlxd_events", "proxy", "network_dhcp_gateway", "file_get_symlink", "network_leases", "unix_device_hotplug", "storage_api_local_volume_handling", "operation_description", "clustering", "event_lifecycle", "storage_api_remote_volume_handling", "nvidia_runtime", "container_mount_propagation", "container_backup", "devlxd_images", "container_local_cross_pool_handling", "proxy_unix", "proxy_udp", "clustering_join", "proxy_tcp_udp_multi_port_handling", "network_state", "proxy_unix_dac_properties", "container_protection_delete", "unix_priv_drop", "pprof_http", "proxy_haproxy_protocol", "network_hwaddr", "proxy_nat", "network_nat_order", "container_full", "candid_authentication", "backup_compression", "candid_config", "nvidia_runtime_config", "storage_api_volume_snapshots", "storage_unmapped", "projects", "candid_config_key", "network_vxlan_ttl", "container_incremental_copy", "usb_optional_vendorid", "snapshot_scheduling", "snapshot_schedule_aliases", "container_copy_project", "clustering_server_address", "clustering_image_replication", "container_protection_shift", "snapshot_expiry", "container_backup_override_pool", "snapshot_expiry_creation", "network_leases_location", "resources_cpu_socket", "resources_gpu", "resources_numa", "kernel_features", "id_map_current", "event_location", "storage_api_remote_volume_snapshots", "network_nat_address", "container_nic_routes", "rbac", "cluster_internal_copy", "seccomp_notify", "lxc_features", "container_nic_ipvlan", "network_vlan_sriov", "storage_cephfs", "container_nic_ipfilter", "resources_v2", "container_exec_user_group_cwd", "container_syscall_intercept", "container_disk_shift", "storage_shifted", "resources_infiniband", "daemon_storage", "instances", "image_types", "resources_disk_sata", "clustering_roles", "images_expiry", "resources_network_firmware", "backup_compression_algorithm", "ceph_data_pool_name", "container_syscall_intercept_mount", "compression_squashfs", "container_raw_mount", "container_nic_routed", "container_syscall_intercept_mount_fuse", "container_disk_ceph", "virtual-machines", "image_profiles", "clustering_architecture", "resources_disk_id", "storage_lvm_stripes", "vm_boot_priority", "unix_hotplug_devices", "api_filtering", "instance_nic_network", "clustering_sizing", "firewall_driver", "projects_limits", "container_syscall_intercept_hugetlbfs", "limits_hugepages", "container_nic_routed_gateway", "projects_restrictions", "custom_volume_snapshot_expiry", "volume_snapshot_scheduling", "trust_ca_certificates", "snapshot_disk_usage", "clustering_edit_roles", "container_nic_routed_host_address", "container_nic_ipvlan_gateway", "resources_usb_pci", "resources_cpu_threads_numa", "resources_cpu_core_die", "api_os", "container_nic_routed_host_table", "container_nic_ipvlan_host_table", "container_nic_ipvlan_mode", "resources_system", "images_push_relay", "network_dns_search", "container_nic_routed_limits", "instance_nic_bridged_vlan", "network_state_bond_bridge", "usedby_consistency", "custom_block_volumes", "clustering_failure_domains", "resources_gpu_mdev", "console_vga_type", "projects_limits_disk", "network_type_macvlan", "network_type_sriov", "container_syscall_intercept_bpf_devices", "network_type_ovn", "projects_networks", "projects_networks_restricted_uplinks", "custom_volume_backup", "backup_override_name", "storage_rsync_compression", "network_type_physical", "network_ovn_external_subnets", "network_ovn_nat", "network_ovn_external_routes_remove", "tpm_device_type", "storage_zfs_clone_copy_rebase", "gpu_mdev", "resources_pci_iommu", "resources_network_usb", "resources_disk_address", "network_physical_ovn_ingress_mode", "network_ovn_dhcp", "network_physical_routes_anycast", "projects_limits_instances", "network_state_vlan", "instance_nic_bridged_port_isolation", "instance_bulk_state_change", "network_gvrp", "instance_pool_move", "gpu_sriov", "pci_device_type", "storage_volume_state", "network_acl", "migration_stateful", "disk_state_quota", "storage_ceph_features", "projects_compression", "projects_images_remote_cache_expiry", "certificate_project", "network_ovn_acl", "projects_images_auto_update", "projects_restricted_cluster_target", "images_default_architecture", "network_ovn_acl_defaults", "gpu_mig", "project_usage", "network_bridge_acl", "warnings", "projects_restricted_backups_and_snapshots", "clustering_join_token", "clustering_description", "server_trusted_proxy", "clustering_update_cert", "storage_api_project", "server_instance_driver_operational", "server_supported_storage_drivers", "event_lifecycle_requestor_address", "resources_gpu_usb", "clustering_evacuation", "network_ovn_nat_address", "network_bgp", "network_forward", "custom_volume_refresh", "network_counters_errors_dropped", "metrics", "image_source_project", "clustering_config", "network_peer", "linux_sysctl", "network_dns", "ovn_nic_acceleration", "certificate_self_renewal", "instance_project_move", "storage_volume_project_move", "cloud_init", "network_dns_nat", "database_leader", "instance_all_projects", "clustering_groups", "ceph_rbd_du", "instance_get_full", "qemu_metrics", "gpu_mig_uuid", "event_project", "clustering_evacuation_live", "instance_allow_inconsistent_copy", "network_state_ovn", "storage_volume_api_filtering", "image_restrictions", "storage_zfs_export", "network_dns_records", "storage_zfs_reserve_space", "network_acl_log", "storage_zfs_blocksize", "metrics_cpu_seconds", "instance_snapshot_never", "certificate_token", "instance_nic_routed_neighbor_probe", "event_hub", "agent_nic_config", "projects_restricted_intercept", "metrics_authentication", "images_target_project", "cluster_migration_inconsistent_copy", "cluster_ovn_chassis", "container_syscall_intercept_sched_setscheduler", "storage_lvm_thinpool_metadata_size", "storage_volume_state_total", "instance_file_head", "instances_nic_host_name", "image_copy_profile", "container_syscall_intercept_sysinfo", "clustering_evacuation_mode", "resources_pci_vpd", "qemu_raw_conf", "storage_cephfs_fscache", "network_load_balancer", "vsock_api" ], "api_status": "stable", "api_version": "1.0", "auth": "trusted", "public": false, "auth_methods": [ "tls" ], "environment": { "addresses": [ "10.0.127.243:8443" ], "architectures": [ "x86_64", "i686" ], "certificate": "-----BEGIN CERTIFICATE-----\nMIIB/jCCAYOgAwIBAgIQRctJ7PxoyIYA04H5yRLwrjAKBggqhkjOPQQDAzAyMRww\nGgYDVQQKExNsaW51eGNvbnRhaW5lcnMub3JnMRIwEAYDVQQDDAlyb290QGI0MDMw\nHhcNMjIwNjA5MTIwNTA5WhcNMzIwNjA2MTIwNTA5WjAyMRwwGgYDVQQKExNsaW51\neGNvbnRhaW5lcnMub3JnMRIwEAYDVQQDDAlyb290QGI0MDMwdjAQBgcqhkjOPQIB\nBgUrgQQAIgNiAATLZCyhDT88Hb/fWtzYXhnrtkv6zJFYEqyMgynqhowrmjafIPz/\nQ0vNTH9n4O0SOUZnEsxAMMw7A1Q+Y1/yO5VUxjQl6MGbhiUjbq9Vy0SxkGBTufVu\nV22xw3algY/H7+ujXjBcMA4GA1UdDwEB/wQEAwIFoDATBgNVHSUEDDAKBggrBgEF\nBQcDATAMBgNVHRMBAf8EAjAAMCcGA1UdEQQgMB6CBGI0MDOHBH8AAAGHEAAAAAAA\nAAAAAAAAAAAAAAEwCgYIKoZIzj0EAwMDaQAwZgIxAOpoxU/9BcClgScGkNV+VV8a\nSyDs5Br1U/6kSq7KHs/+wdd8soUzySIvLXlqs3bm/QIxAKO9q3xmewS5JjgTQGL/\nRGLxv2CfyOmWDN1j05Ss1Zv+k5HWXFTe57ZJk9VetgjG2A==\n-----END CERTIFICATE-----\n", "certificate_fingerprint": "36556f6577d083457439e86f9bb4d347973c4022bcb4d0d4b8b12b71c7120722", "driver": "qemu | lxc", "driver_version": "7.0.0 | 5.0.1", "firewall": "nftables", "kernel": "Linux", "kernel_architecture": "x86_64", "kernel_features": { "idmapped_mounts": "true", "netnsid_getifaddrs": "true", "seccomp_listener": "true", "seccomp_listener_continue": "true", "shiftfs": "false", "uevent_injection": "true", "unpriv_fscaps": "true" }, "kernel_version": "5.15.0-46-generic", "lxc_features": { "cgroup2": "true", "core_scheduling": "true", "devpts_fd": "true", "idmapped_mounts_v2": "true", "mount_injection_file": "true", "network_gateway_device_route": "true", "network_ipvlan": "true", "network_l2proxy": "true", "network_phys_macvlan_mtu": "true", "network_veth_router": "true", "pidfd": "true", "seccomp_allow_deny_syntax": "true", "seccomp_notify": "true", "seccomp_proxy_send_notify_fd": "true" }, "os_name": "Ubuntu", "os_version": "22.04", "project": "default", "server": "lxd", "server_clustered": true, "server_event_mode": "full-mesh", "server_name": "b403", "server_pid": 3799, "server_version": "5.4", "storage": "zfs", "storage_version": "2.1.4-0ubuntu0.1", "storage_supported_drivers": [ { "Name": "zfs", "Version": "2.1.4-0ubuntu0.1", "Remote": false }, { "Name": "ceph", "Version": "15.2.16", "Remote": true }, { "Name": "btrfs", "Version": "5.4.1", "Remote": false }, { "Name": "cephfs", "Version": "15.2.16", "Remote": true }, { "Name": "dir", "Version": "1", "Remote": false }, { "Name": "lvm", "Version": "2.03.07(2) (2019-11-30) / 1.02.167 (2019-11-30) / 4.45.0", "Remote": false } ] } } DEBUG [2022-08-12T09:51:37+02:00] Sending request to LXD etag= method=GET url="https://10.0.127.243:8443/1.0/cluster" DEBUG [2022-08-12T09:51:37+02:00] Got response struct from LXD DEBUG [2022-08-12T09:51:37+02:00] { "server_name": "b403", "enabled": true, "member_config": [ { "entity": "storage-pool", "name": "local", "key": "source", "value": "", "description": "\"source\" property for storage pool \"local\"" }, { "entity": "storage-pool", "name": "local", "key": "zfs.pool_name", "value": "", "description": "\"zfs.pool_name\" property for storage pool \"local\"" } ] } Choose "source" property for storage pool "local": Choose "zfs.pool_name" property for storage pool "local": Would you like a YAML "lxd init" preseed to be printed? (yes/no) [default=no]: config: {} networks: [] storage_pools: [] profiles: [] projects: [] cluster: server_name: b104 enabled: true member_config: - entity: storage-pool name: local key: source value: tank/lxd description: '"source" property for storage pool "local"' - entity: storage-pool name: local key: zfs.pool_name value: tank/lxd description: '"zfs.pool_name" property for storage pool "local"' cluster_address: 10.0.127.243:8443 cluster_certificate: | -----BEGIN CERTIFICATE----- MIIB/jCCAYOgAwIBAgIQRctJ7PxoyIYA04H5yRLwrjAKBggqhkjOPQQDAzAyMRww GgYDVQQKExNsaW51eGNvbnRhaW5lcnMub3JnMRIwEAYDVQQDDAlyb290QGI0MDMw HhcNMjIwNjA5MTIwNTA5WhcNMzIwNjA2MTIwNTA5WjAyMRwwGgYDVQQKExNsaW51 eGNvbnRhaW5lcnMub3JnMRIwEAYDVQQDDAlyb290QGI0MDMwdjAQBgcqhkjOPQIB BgUrgQQAIgNiAATLZCyhDT88Hb/fWtzYXhnrtkv6zJFYEqyMgynqhowrmjafIPz/ Q0vNTH9n4O0SOUZnEsxAMMw7A1Q+Y1/yO5VUxjQl6MGbhiUjbq9Vy0SxkGBTufVu V22xw3algY/H7+ujXjBcMA4GA1UdDwEB/wQEAwIFoDATBgNVHSUEDDAKBggrBgEF BQcDATAMBgNVHRMBAf8EAjAAMCcGA1UdEQQgMB6CBGI0MDOHBH8AAAGHEAAAAAAA AAAAAAAAAAAAAAEwCgYIKoZIzj0EAwMDaQAwZgIxAOpoxU/9BcClgScGkNV+VV8a SyDs5Br1U/6kSq7KHs/+wdd8soUzySIvLXlqs3bm/QIxAKO9q3xmewS5JjgTQGL/ RGLxv2CfyOmWDN1j05Ss1Zv+k5HWXFTe57ZJk9VetgjG2A== -----END CERTIFICATE----- server_address: 10.0.127.63:8443 cluster_password: "" cluster_certificate_path: "" cluster_token: "" DEBUG [2022-08-12T09:51:37+02:00] Connected to the websocket: ws://unix.socket/1.0/events DEBUG [2022-08-12T09:51:37+02:00] Sending request to LXD etag= method=PUT url="http://unix.socket/1.0/cluster" DEBUG [2022-08-12T09:51:37+02:00] { "server_name": "b104", "enabled": true, "member_config": [ { "entity": "storage-pool", "name": "local", "key": "source", "value": "tank/lxd", "description": "\"source\" property for storage pool \"local\"" }, { "entity": "storage-pool", "name": "local", "key": "zfs.pool_name", "value": "tank/lxd", "description": "\"zfs.pool_name\" property for storage pool \"local\"" } ], "cluster_address": "10.0.127.243:8443", "cluster_certificate": "-----BEGIN CERTIFICATE-----\nMIIB/jCCAYOgAwIBAgIQRctJ7PxoyIYA04H5yRLwrjAKBggqhkjOPQQDAzAyMRww\nGgYDVQQKExNsaW51eGNvbnRhaW5lcnMub3JnMRIwEAYDVQQDDAlyb290QGI0MDMw\nHhcNMjIwNjA5MTIwNTA5WhcNMzIwNjA2MTIwNTA5WjAyMRwwGgYDVQQKExNsaW51\neGNvbnRhaW5lcnMub3JnMRIwEAYDVQQDDAlyb290QGI0MDMwdjAQBgcqhkjOPQIB\nBgUrgQQAIgNiAATLZCyhDT88Hb/fWtzYXhnrtkv6zJFYEqyMgynqhowrmjafIPz/\nQ0vNTH9n4O0SOUZnEsxAMMw7A1Q+Y1/yO5VUxjQl6MGbhiUjbq9Vy0SxkGBTufVu\nV22xw3algY/H7+ujXjBcMA4GA1UdDwEB/wQEAwIFoDATBgNVHSUEDDAKBggrBgEF\nBQcDATAMBgNVHRMBAf8EAjAAMCcGA1UdEQQgMB6CBGI0MDOHBH8AAAGHEAAAAAAA\nAAAAAAAAAAAAAAEwCgYIKoZIzj0EAwMDaQAwZgIxAOpoxU/9BcClgScGkNV+VV8a\nSyDs5Br1U/6kSq7KHs/+wdd8soUzySIvLXlqs3bm/QIxAKO9q3xmewS5JjgTQGL/\nRGLxv2CfyOmWDN1j05Ss1Zv+k5HWXFTe57ZJk9VetgjG2A==\n-----END CERTIFICATE-----\n", "server_address": "10.0.127.63:8443", "cluster_password": "" } DEBUG [2022-08-12T09:51:37+02:00] Got operation from LXD DEBUG [2022-08-12T09:51:37+02:00] { "id": "27694780-78cc-4ca6-8b99-9d12bcbe71e0", "class": "task", "description": "Joining cluster", "created_at": "2022-08-12T09:51:37.860941757+02:00", "updated_at": "2022-08-12T09:51:37.860941757+02:00", "status": "Running", "status_code": 103, "resources": { "cluster": null }, "metadata": null, "may_cancel": false, "err": "", "location": "none" } DEBUG [2022-08-12T09:51:37+02:00] Sending request to LXD etag= method=GET url="http://unix.socket/1.0/operations/27694780-78cc-4ca6-8b99-9d12bcbe71e0" DEBUG [2022-08-12T09:51:37+02:00] Got response struct from LXD DEBUG [2022-08-12T09:51:37+02:00] { "id": "27694780-78cc-4ca6-8b99-9d12bcbe71e0", "class": "task", "description": "Joining cluster", "created_at": "2022-08-12T09:51:37.860941757+02:00", "updated_at": "2022-08-12T09:51:37.860941757+02:00", "status": "Running", "status_code": 103, "resources": { "cluster": null }, "metadata": null, "may_cancel": false, "err": "", "location": "none" } Error: Failed to join cluster: Failed to initialize member: Failed to initialize storage pools and networks: Failed to update local member project "default": You can't change the features of the default project ```

avml · September 8, 2022, 3:36pm

Thank you very much!!! That was it… I was able to join the cluster with no problems.

Thank you,
Adrean