#Isolate a PCIe device from an IOMMU group

82 messages · Page 1 of 1 (latest)

short hemlock
#

When I try to start my VM with GPU passthrough I get this error:

Error starting domain: internal error: QEMU unexpectedly closed the monitor (vm='win10'): 2023-11-20T19:16:30.412532Z qemu-system-x86_64: -device {"driver":"vfio-pci","host":"0000:04:00.0","id":"hostdev0","bus":"pci.5","addr":"0x0"}: vfio 0000:04:00.0: group 15 is not viable
Please ensure all devices within the iommu_group are bound to their vfio bus driver.

This indicates that the device is not running the proper driver, however lspci suggests everything is fine.

04:00.0 VGA compatible controller [0300]: NVIDIA Corporation GM107 [GeForce GTX 745] [10de:1382] (rev a2)
        Subsystem: ASUSTeK Computer Inc. GM107 [GeForce GTX 745] [1043:862c]
        Kernel driver in use: vfio-pci
        Kernel modules: nouveau

Any idea? Google didn't seem to help.

regal berry
#

Not what it indicates at all. The error is asking you to pass all the pci devices in the group to the vm.

manic bronze
#

@short hemlock

short hemlock
#

if I understand this correctly, I will also have to pass my network, sata and usb controller?

regal berry
#

Yeah

#

Just don't pass the bridges

short hemlock
#

Well that sucks

regal berry
#

If you pass one thing in the group the rest also has to go

short hemlock
regal berry
#

Good question. I think you might still be able to but not 100%

short hemlock
#

NotLikeThis why is the group layout so bad

#

like literally it can't be worse

regal berry
#

Because i ised to ssh to my host in order to debug while vm was running

short hemlock
#

I suppose there's no way I can manipulate with the groups?

regal berry
#

That was before the network card was connected in windows though, aka during boot.

regal berry
#

Why would you need stuff running on host though?

short hemlock
#

it's a VM I use for CAD software I cannot run on Linux

regal berry
#

Yeah, so?

short hemlock
regal berry
#

When you passthrough a gpu the gpu gets detached from linux and attached to vm

short hemlock
#

ik

regal berry
#

Xorg/wayland stops running

short hemlock
#

that's why I have two

regal berry
#

Oh i see

short hemlock
#

my main one (rx 7900XTX) and the secondary one (gtx 745)

#

These answers seem to offer solutions, but they really seem cursed

regal berry
#

It's weird that your gpu is on the same group as the network card though

short hemlock
#

it's really weird

#

I have 2 pcie x16 slots on my mobo

#

I guess that's what I get for buying a business MB

regal berry
#

If the other gpu is in its own group i think you could swap the gpus, like hardware-wise

manic bronze
#

@short hemlock install neofetch then paste the output here please

short hemlock
short hemlock
#

Can paste it as text if you want

regal berry
manic bronze
regal berry
#

Let me have a look at the link you sent earlier 1sec

manic bronze
short hemlock
#

I have no idea why the groups were assigned like that

regal berry
#

I'm terrible on phone kb

regal berry
short hemlock
#

Isolate a PCIe device from an IOMMU group

short hemlock
#

smh why did I get a b550 board

#

like I saved not even 100$ bucks

manic bronze
#

@short hemlock Shruge

image.png
short hemlock
#

I don't get your point?

manic bronze
#

we have almost the same specs, but it works for me

short hemlock
#

:/

#

I mean

#

your GPU is plugged in the main slot

#

my main GPU in the main slot is also in a separate group

#

only the second one is fucked

regal berry
#

you can fix it with a custom kernel or one that has a acs patch apparently

#

maybe not actually

manic bronze
#

Using custom kernels may cause all kinds of stability and reliability issues, including data loss. Having backups is strongly advised.

regal berry
#

we know killertofu thanks

manic bronze
#

"we" atpCap

short hemlock
#

a 5month outdated kernel

regal berry
#

i thought it was just a patch. skim read it sorry

manic bronze
#

The Linux kernel and a few patches

short hemlock
#

I do have the zen kernel

regal berry
short hemlock
#

No need to

#

apparently the zen kernel already does that

#

luckily

regal berry
#

nice JOIA

short hemlock
#

So now I should only need to figure out the rest pepePains

regal berry
#

yeah, it doesn't sound like a "just works" situation at all

short hemlock
#

well at least I don't have to use some hacky kernel

#

tbh I trust the zen kernel more than some random linux-vfio one

regal berry
#

fair