Help with GGUF support | SwarmUI | Page 1

long flume Nov 5, 2024, 2:31 PM

#

I'm currently experiencing problems setting up GGUF on a kaggle notebook using SwarmUi , the backends fail to load the model for some reason. I've tried everything from changing folder paths to restarting etc.

severe marten Nov 5, 2024, 2:32 PM

#

Help with GGUF support

severe marten Nov 5, 2024, 2:32 PM

#

long flume I'm currently experiencing problems setting up GGUF on a kaggle notebook using S...

see relevant docs @ https://github.com/mcmonkeyprojects/SwarmUI/blob/master/docs/Model Support.md#gguf-quantized-models

long flume Nov 5, 2024, 2:32 PM

#

severe marten see relevant docs @ <https://github.com/mcmonkeyprojects/SwarmUI/blob/master/doc...

I did doesn't help

#

I've already installed the files even manually

#

your doc mentions at the end "and it will just work" not identifying further any issues that might occur

#

"You will have to click the ☰ hamburger menu on a model, then Edit Metadata, and set the Architecture: field to the relevant correct one (it cannot be autodetected currently). " Maybe it's this ?

severe marten Nov 5, 2024, 2:35 PM

#

well yes if you haven't done that yet, that'd be the thing you have to do yes

#Help with GGUF support