#Multi-GPU help

16 messages · Page 1 of 1 (latest)

daring orchid
#

I am using SwarmUI and want to use both my GPU's simultaneously to generate an image or video. Is this possible? if so, how? I have done some research but it confused me. any help would be much appreciated.

#

Sorry I may not have been clear, I mean a single image, rather than distributing a workload over a batch

soft pasture
#

you can't use multiple GPUs to speed up a single gen, Swarm doesn't support it and even Comfy / other frameworks support for it is very experimental as far as i know

daring orchid
soft pasture
#

outch, anything pre RTX is like pre-historic for AI related tasks :x
the 1070 has 8GB memory right? your best shot might be low steps distilled sdxl finetunes, but i'm no expert in these

#

*if you want decent speed

daring orchid
#

yes, 8GB and 6GB on the 1060.
The model im currently using works with 30 steps and my last image took just under 2 mins to generate (Euler K)

soft pasture
#

otherwise if you're willing to wait longer, Flux at Q4 quant might run in minutes

daring orchid
#

does SDXL have a similar amount of realism to FLUX or is it incomparable

soft pasture
#

Flux is better out of the box in a lot of aspects, but recent sdxl finetunes are still relevant

daring orchid
#

ahh I see

soft pasture
#

or the trillion illustrious/noobai finetunes, can't help much on these tho

daring orchid
daring orchid
slim depot
#

honestly your best course of action is to try to get a good deal selling the two of them and then an even better deal buying a used rtx 3060