drowsy mist
Hello !
I encountered this glitch with gryphe/mythomax-l2-13b and pygmalionai/mythalion-13b (maybe more I didn't try all of them) Basically the responses sometimes ends with a \n\n###. It looks like a delimiter string. Should I remove it with a regex of did I miss something?
Thank you!
white marlin
Just another user here. I also expirienced that and by my observation most likely it depends on top_p. I made a simplest dirty hack in my app: input.replace("###", "").trim()
drowsy mist
I did exactly the same trick, but thanks for your reply !!