#How to select the weight_dtype in Swarm UI?

8 messages · Page 1 of 1 (latest)

barren stone
#

If I go to the "ComfyUI Workflow" tab and click "Import from Generate Tab", I see that the SwarmUI workflow starts with this node:

In that node, it selected the weights of the model as fp8. But the weights are fp16 and I want to run them as fp16, so I want to change the setting to "Default". In the ComfyUI Workflow tab I can do that, but I want to do it in the default SwarmUI workflow, without having to do edit any ComfyUI workflows, since that's why I use SwarmUI. How can I change that setting in SwarmUI?

#

I was told in the Chroma Discord that this issue makes Chroma look worse by default in SwarmUI. It should not use that fp8_e4m3dn_fast setting, the recommended Chroma workflow is to use default. I also don't notice a speed difference between selecting fp8_e4m3dn_fast and default in the node, so using default does not seem to have any downsides, except for more VRAM usage.

barren stone
#

ah, its this?

loud sable
#

also if you have a non-fp8-format model, and you use Default, instead of fp8, it will be much slower

#

if you have an fp8-format model, there's no change you can do that affects anything, it's already at fp8 and stays that way

#

how much the 16bit vs fp8 speed difference is depends on what GPU you have

#

i think maybe a 3090 in particular? will have very small difference (no native fp8, but more than enough vram) and basically anything else will have a noticeable difference