This error is similar to the one here:
But I don’t seem to have the connection problem reported.
Distribution: Ubuntu
Distribution version: 16.04 LTS
LXC Info:
driver: lxc
driver_version: 2.0.7
kernel: Linux
kernel_architecture: x86_64
kernel_version: 4.4.0-101-generic
server: lxd
server_pid: 10077
server_version: 2.0.11
storage: dir
storage_version: “”
Storage backend in use: ssd
I am trying to move an LXC container to another server, doing a live migration. I found some information here about how to do this:
From what I understand, I can just use this command:
lxc move container1 server2:
So I created some test containers, and these moved over fine (I already enabled the API on both servers). So now I want to move the actual container in question, with about 140gb of data on it. When I run the command, I get this error:
error: Failed container creation:
- https://X.X.X.X:8443: exit status 23
(where X.X.X.X is the IP of the server I am trying to move the container to).
We figured that this issue may be because we’re running out of RAM, so we added an 8gb swap file, and enabled it, but that doesn’t seem to make a difference.
Here are the logs from /var/log/lxd/lxd.log on the server we’re trying to send the container to:
ephemeral=false lvl=info msg=“Creating container” name=container1 t=2018-03-28T11:57:07-0400
ephemeral=false lvl=info msg=“Created container” name=container1 t=2018-03-28T11:57:07-0400
ephemeral=false lvl=info msg=“Creating container” name=container1/clean t=2018-03-28T11:57:08-0400
ephemeral=false lvl=info msg=“Created container” name=container1/clean t=2018-03-28T11:57:08-0400
lvl=eror msg="Rsync receive failed: /var/lib/lxd/snapshots/container1/clean/: exit status 23: " t=2018-03-28T11:57:08-0400
creation date=2018-03-28T11:57:07-0400 ephemeral=false lvl=info msg=“Deleting container” name=container1 t=2018-03-28T11:57:08-0400
creation date=2018-03-28T11:57:08-0400 ephemeral=false lvl=info msg=“Deleting container” name=container1/clean t=2018-03-28T11:57:08-0400
creation date=2018-03-28T11:57:08-0400 ephemeral=false lvl=info msg=“Deleted container” name=container1/clean t=2018-03-28T11:57:08-0400
creation date=2018-03-28T11:57:07-0400 ephemeral=false lvl=info msg=“Deleted container” name=container1 t=2018-03-28T11:57:08-0400
lvl=eror msg=“Rsync receive failed: /tmp/lxd_restore_968838929/: exit status 12: rsync: connection unexpectedly closed (0 bytes received so far) [Receiver]\nrsync error: error in rsync protocol data stream (code 12) at io.c(226) [Receiver=3.1.1]\n” t=2018-03-28T11:57:08-0400
I haven’t taken a snapshot, because we just wanted to do a live migration. So maybe that is why the snapshot for container1/clean isn’t there? With small test containers, this migration worked fine.
Does the live migration still create somewhat of a snapshot? If so, maybe there isn’t enough disk space left on the source server to create one?
We have a 200gb disk mounted to /var/lib/lxd/containers, and the container is using about 140gb of that. The root filesystem has about 5.5gb left. Since snapshots are stored in /var/lib/lxd/snapshots, I wonder if the live migration snapshot (if that is what is happening) determines that there isn’t enough space on the disk, and exits?