#Distributed Neuro(l) Net
1 messages · Page 1 of 1 (latest)
I think it would require far too much data transfer between devices
I dont think its the data transfer, but the latency. the RAM and vram access is measured in nanoseconds, whereas network latency is measured in milliseconds - literally millions of times slower. AI datacenters need optical connections to transfer huge amounts of data just a couple inches or feet. Folding @ Home is a distributed network thats very very powerful, but doesnt require data to be sent and recieved with the responsiveness of system RAM (which is considered stupid slow compared to vRAM).
Vedal would be best off with something like a GB100, if a PCIe version ever becomes available. I doubt he'd be able to afford to purchase an NVL72 (its a whole server rack of AI specific Blackwell [RTX 5000] GPUs). While Blackwell is... abysmal for gaming, its apparently quite the uplift for AI.
That’s what I meant
Neuro and evil but it's a virus