#NotImplementedError: Cannot copy out of meta tensor; no data!

1 messages · Page 1 of 1 (latest)

clear moon
#

It's been asked before but I don't see an answer for it anywhere that fixes it so Imma ask myself, what does this bug even mean? I'm new to this (HEAVILY new) so I have no idea where to even start fixing this bug... Happens when I try using any model recently.

image.png
clear moon
#

AWQ seems to be the issue so far, I'll probably see if GPTQ doesn't have this issue