Installing and using an X server inside of an LXD container, not on the host

Is this what you are after? running desktops in lxd containers and using guacamole to balance your connections like a terminal server.

I tested that and it worked well!

Cheers,
Jon.