Using GUI containers with no window manager on the host - problem with `nvidia.runtime=true`

Strange, according to that the driver still is not loaded

$ sudo nsenter --mount=/run/snapd/ns/lxd.mnt env PATH=/snap/lxd/current/bin:${PATH} LD_LIBRARY_PATH=/snap/lxd/current/lib nvidia-container-cli info
nvidia-container-cli.real: initialization error: nvml error: driver not loaded

According to lspci -knn the driver is loaded:

44:00.0 VGA compatible controller [0300]: NVIDIA Corporation GK208B [GeForce GT 710] [10de:128b] (rev a1)
        Subsystem: ZOTAC International (MCO) Ltd. GK208B [GeForce GT 710] [19da:5360]
        Kernel driver in use: nvidia
        Kernel modules: nvidiafb, nouveau, nvidia_drm, nvidia

Edit: Also the output of nvidia-smi is different now as I configured a different GPU for passthrough:

s$ nvidia-smi
Tue Nov 16 05:27:06 2021       
+-----------------------------------------------------------------------------+
| NVIDIA-SMI 470.86       Driver Version: 470.86       CUDA Version: 11.4     |
|-------------------------------+----------------------+----------------------+
| GPU  Name        Persistence-M| Bus-Id        Disp.A | Volatile Uncorr. ECC |
| Fan  Temp  Perf  Pwr:Usage/Cap|         Memory-Usage | GPU-Util  Compute M. |
|                               |                      |               MIG M. |
|===============================+======================+======================|
|   0  NVIDIA GeForce ...  Off  | 00000000:44:00.0 N/A |                  N/A |
| 40%   38C    P0    N/A /  N/A |      0MiB /   973MiB |     N/A      Default |
|                               |                      |                  N/A |
+-------------------------------+----------------------+----------------------+
                                                                               
+-----------------------------------------------------------------------------+
| Processes:                                                                  |
|  GPU   GI   CI        PID   Type   Process name                  GPU Memory |
|        ID   ID                                                   Usage      |
|=============================================================================|
|  No running processes found                                                 |
+-----------------------------------------------------------------------------+