#First time trying to run.

4 messages · Page 1 of 1 (latest)

tame umbra
#

AutoGPTQ:

image.png
#

ExLlama:

image.png
#

Transformers:

image.png
#

For the final one, I'd like to clarify, I do have a GPU. It may not be the best, but I have an RTX 3060 Ti 8gb.