On a multi-GPU node I am trying to add 2 GPUs in my lxd container using the PCI ID of each GPU instead of the base GPU ID.
I got the PCI IDs of my GPUs as follows:
GPU 0: 0000:67:00.0
GPU 1: 0000:1A:00.0
When I try to add GPU 0 with the following command:
lxc config device add test gpu0 gpu pci=0000:67:00.0
It gets added successfully with the following output:
Device gpu0 added to test
But when I try adding GPU 1 with its PCI ID with the following command:
lxc config device add test gpu1 gpu pci=0000:1A:00.0
It displays the following error:
Error: Invalid devices: Device validation failed for “gpu1”: Invalid value for device option “pci”: Invalid PCI address
The strange part is that both these PCI IDs were returned using the nvidia-smi query on the system and while first one works smoothly the second fails. Is there any reason for why this might be happening?