#What do I decrease?
1 messages ยท Page 1 of 1 (latest)
I was using 20k+ on the context might be the problem
But back then I was using 32k tokens but it works fine
Soo, context size.
Cosmos max is around 16k, but for janitor its around 150000
And why did it work for you when 32k?
Because the context didint fill up yet
I don't know
I was using the fast-forward looking buttn that extends the bot reply
But it says that
Just decrease the context size to 15000, if the chat hasent gone for long it should be fine.
Sometimes, you may need to make a new chat as ya know, context filled up