GGUF models for Flux is not being detected by SwarmUI | SwarmUI | Page 1

gloomy kernel Aug 17, 2024, 7:40 AM

#

https://civitai.com/models/647237?modelVersionId=724099

Flux.1-Dev GGUF [Q4/Q4.1] [Q5/Q5.1] Q8 - Q4.0 | Stable Diffusion Ch...

Source https://huggingface.co/city96/FLUX.1-dev-gguf/tree/main by city96 This is a direct GGUF conversion of Flux.1-dev. As this is a quantized mod...

#

How do I make SwarmUI detect it, or does it not support GGUF models?

lethal karma Aug 17, 2024, 8:46 AM

#

ComfyUI doesn't support it, so therefor SwarmUI doesn't.

You could install a custom comfy-node to add support there (see https://github.com/city96/ComfyUI-GGUF, still WIP though), and then create an extention to have that node supported by SwarmUI.

gloomy kernel Aug 17, 2024, 6:39 PM

#

lethal karma ComfyUI doesn't support it, so therefor SwarmUI doesn't. You could install a cu...

create an extention
how do I do this part?

keen pike Aug 18, 2024, 9:54 AM

#

there's a feature request for this tracked https://github.com/mcmonkeyprojects/SwarmUI/issues/165

GitHub

Please consider adding support for GGUF Flux.dev · Issue #165 · mcm...

Feature Idea Basically, this: https://civitai.com/models/647237/flux1-dev-gguf-q4-q5-q8 Q8 seems to be superior in quality to fp8 while having a similar resource usage, which would be great for us ...

tough jay Aug 18, 2024, 3:11 PM

#

gloomy kernel > create an extention how do I do this part?

Learn how to prgram in the language SwarmUI extensions are written in and then write one.

#GGUF models for Flux is not being detected by SwarmUI