I'm using Janitor and have the 'max tokens' setting set to zero (aka unlimited), but Cosmos almost always cuts off mid-sentence at around 500 tokens. I've tried setting the max tokens to 1k, clearing the custom prompt, and editing rerolled messages to not have any cut off, but none of those seem to work. This issue has spanned multiple bots by the way, so it's not a matter of a particular bot's scenario or character description being wonky either.
#Messages keep getting cut off
lunar thistle
charred raft
I'm using Janitor and have the 'max tokens' setting set to zero (aka unlimited),...
Setting it to 0 automatically sets cosmos to around 500, you'll need to set the tokens manually. I would recommend starting a new chat instead of continuing ones that have been cut off as Cosmos (as much as it is prone to learning) can be quite stubborn with it.
Sometimes, if your responses are decently short, the responses you'll get from the bot, in turn, will match.
Make sure that the bots you are using don't have any Jailbreaks within their definitions as well. I've used one and it seemed to constantly cut off the responses, giving 1 or 2 longer responses every 10 rerolls
lunar thistle
I have rather long responses (usually 500-1k tokens) and it often gets cut off even when using the 1k setting and replying to some of my longer responses. The bots I use also don't have any jailbreaks baked into them.
Does it get caught on cutting off messages even when none of the chat's messages are left cut off? One of the chats is basically brand new (7 messages from the bot including the initial message and excluding rerolls) and it's still been doing it when I've tried changing it to 1k. I also turned off proxy for some of the responses partially because of the cut off; I think only one or two of the bot's responses that I continued from were sent with Cosmos, so does it somehow learn from the deleted messages or something?
charred raft
I'm not necessarily sure it would learn from it even after the message being edited to get rid of the cut off bit. When people have an error like "Bot talking for user", we recommend that they edit the message so it doesn't continue happening, so presumably, it takes in the edited message than the original
It could be how Janitor sends and processes the requests being sent to Cosmos. As far as what I've seen with people talking about cut-off messages, generally, they are using Janitor as the website (as do i when the same thing happens to me as well)