For anyone following this, the issue above is that lxd-agent is dynamically linked.
This should never be done as otherwise it would only work on VMs that use the same C library as the host system.
Instead lxd-agent should always be built statically so it can work in any VM.