[✅ Solved] Problem with bot responses

[fickle pasture]

So l've noticed that me and others have
problem with the same/very similar
responses from bots. Anyone know why
that's happening & how to fix it? l'm using
Chub

[haughty bramble]

It sounds like you're experiencing issues with repeated or similar bot responses on ChubAI. This could be due to a few reasons:

1. Jailbreaks or Custom Prompts: If you're using any jailbreaks, instructions, or custom prompts, they can affect the quality of the responses. Ensure these are removed, and start a new chat to reset the chat history.

2. Website Issues: Sometimes, the issue might originate from the website itself. If ChubAI has trouble handling slower responses, it might cause similar bot outputs.

3. Recommended Settings: Make sure you're using OpenAI Default generation settings and check the Models Channel for the recommended temperature for each model.

4. Model or Endpoint Usage: Ensure you're using the correct base URL for the model within ChubAI. Refer to our configuration guide if needed.

If the issue persists, try testing the model on another website to see if the problem resides with the website or the model itself. If the problem continues, you may need to create a support ticket for further assistance.

Please note: This is an automated response from @haughty bramble. While it strive to provide accurate assistance, It may occasionally make mistakes. If you find any inaccuracies or need further clarification, feel free to wait for our community helpers to give you further guidance. Thank you.

[charred flax]

Try to change the temperature and max new token

[fickle pasture]

Any recommendations on how much I should set them on?

[charred flax]

Temperature 1 and max new token to the highest it can be

[fickle pasture]

Just did that and I'm still getting similar responses

The first part is the same and second one is different this time

[faint arch]

Worked for me actually. Changed Janitor temp to 1.0 from 1.3 and max tokens from 0 (unlimited) to 1000 (max), I'm getting different responses after rolling the same one over and over word-for-word. I also lowered conext size to 8000 from 12k.

[charred flax]

Did you try changing the settings back to what you had them after?

[faint arch]

Not yet, I'll try later. Gonna update in 30m.

[fickle pasture]

Do context size matter? If so, what's the best size?

[charred flax]

Context size does matter a lot, cosmo goes up to a bit more than 16k

I supose for the moment going for less can work, then see if its still having the problem after changing

[fickle pasture]

So if I have set up 15900 now, on how much should I lower it?

[charred flax]

Try 8k, aparently it worked for somone else

[fickle pasture]

I think it's working, but it just dosn't want to change the first part of the message at all for some reason

I can live with that tho

Thank you

[charred flax]

Did you try it on other bots

[fickle pasture]

No, just this one I'm using rn. I'll do it now tho

[fickle pasture]

I just try it on the bot on which I had issues with the same responses over and over again & it's the same thing, the first part of the message says the same but the second part of it is changing

But only 3 times, the 4th one was the same message from before

Is there anything else I can do to fix it?

[charred flax]

I supose maybe try to turn the temperature all the way up

[fickle pasture]

Okay, it's working now, tried with both bots 2 times and all 4 responses were different

Thank you for your help

[charred flax]

Try to change the settings back to what you had them

[fickle pasture]

Did that and still all works well it seems, all new responses were different

[charred flax]

Very well, go have fun

[faint arch]

@charred flax same, on new settings and old alike. Maybe it just need a little jostling after the downtime, I usually only change my settings in terms of temperature from like 1.1 to 1.3 and leave everything as is

[fickle pasture]

Thanks for help again

[charred flax]

It is strange, first time I see something like it but yea you are probably right that it just needs to be changed a bit

[faint arch]

It's notable that I've only had this issue on this very long chat which I started before the maintenance. My responses on new chats were fine last night. I'm already like 60 (real) messages into this one - not counting rerolls. I usually make a new chat ~20-30 messages in after I change bot definitions to update the story.

[charred flax]

Huh, I do have some old long cosmo chats, I will probably play around with them and try to see what exactly helps, thank you for the information

[haughty bramble]

[✅ Solved] Problem with bot responses