Not sure if this helps but I got stuck forever trying to get Nvidia docker to run inside a non-privileged lxc, the fix for me was to change set “no-cgroups = true” in the Nvidia docker config file. /etc/nvidia-container-runtime/config.toml
I’m not sure why this information is so hard to find online but hope it helps.