PCIe Bandwidth needs for GPU compute

[dry grove]

I'm trying to help my GF choose a motherboard, how many lanes does a 9070 XT need in order to not be losing significant performance doing AI, diffusion image generation, and some Vulkan stuff? The x16 lane on the motherboard would need to go to a NIC. I know for pure gaming it doesn't matter too much, but I'm not so sure how these compute tasks would differ in bandwidth requirements

[lavish needle]

With ai nvidia is kinda the only real way as it stands, yah amd has finally added some new hood stuff but they do not have enough support

Also why can't the NIC just go in a lower slot

[plush quartz]

Yeah. Amd is not really worth considering.

[heady idol]

Well bandwidth matters depending on task but as said above, stretch to Nvidia for AI

[dry grove]

She wants at some point to go up to 100Gb ethernet with a Melanox Connectx-5, and I think her current SFP+ NIC is already using 8 lanes

[lavish needle]

wat da

[plush quartz]

100gb Ethernet?

[lavish needle]

a nvidia software developer is in this server and doubts that gpu can even get close to utilizing even a 10gig link

[plush quartz]

I mean…

I don’t think you can get 100gb Ethernet residentially.

[lavish needle]

qsfp28?

i think you can do it for like 5k

[plush quartz]

I mean

Sure but that isn’t practical

[plush quartz]

Who’s isp has 100gb lines run?

[lavish needle]

ETHERNET

not internet

[plush quartz]

Mhm , he mentioned ai workload not sure if he’s trying to do server work as well.
Ethernet at 100gb is still around 5 grand