#What do I decrease?

1 messages ยท Page 1 of 1 (latest)

tender shuttle
#

I was using 20k+ on the context might be the problem

#

But back then I was using 32k tokens but it works fine

silk nacelle
#

Soo, context size.
Cosmos max is around 16k, but for janitor its around 150000

#

And why did it work for you when 32k?
Because the context didint fill up yet

tender shuttle
#

I don't know

#

I was using the fast-forward looking buttn that extends the bot reply

#

But it says that

silk nacelle
#

Just decrease the context size to 15000, if the chat hasent gone for long it should be fine.
Sometimes, you may need to make a new chat as ya know, context filled up