I apologise for necroposting, but maybe it may be helpful for someone in future.
The advice is simple: make sure both nodes can connect to each other, not just the one you’re transferring the container from to a new one. Once I enabled a reverse connection in the source machine’s firewall and added the source machine as a remote for the destination one, the transfer speed skyrocketed for some reason.