I’m copying between two servers both zfs backed and I’m strugging to get above 20-21MByte/second which is ~160MBit/S
The servers are remote to each other on the internet, Hetzner and OVH datacenters. Iperf3 between the two over zerotier is running around 350MBit and wireguard around 500Mbit.
I’ve tested lxc copy over both VPN’s and with both get the same 160Mbit cap on copy speed.
I then decided to rule out the overhead of any VPN by running over 8443 directly and not in the tunnel. The performance was exactly the same, which seems to suggest something else is slowing down the copy.
Is there any way of changing the encryption cipher of whatever LXD is using by default for comms over 8443, possibly to something more performant, or even switch it off for running through a VPN. I’m wondering if this is becoming the bottleneck, I would expect I should be able to send between servers of 400 to 500mbits through wireguard, or if there are any other parameters that can be tuned.
Both of these servers are bare metal Xeon’s of reasonable performance, 64GB ram each.