#How to fixed the error while using CosmosRP

1 messages ยท Page 1 of 1 (latest)

tacit bobcat
#

What error, you gotta be more specific

vestal elk
#

it's not the max new token, it is the 50432 context size โ˜ ๏ธ

tacit bobcat
#

Also, yes

winter owl
#

100% context size, you're using an 8k context model but setting it at 50k context. You are gonna run into the context issue again as soon as your chat maxes out the 8k context in 50 - 100 or so messages (dpending on how long replies are)