Gpu -> type physical and boot.autostart

If you ever play around with these two together and you loose your gfx append

module_blacklist=vfio_pci

To your modline at boot to get rid of the vm beeing loaded, afterwards you can remove the gpu from the vm.