[✅ Solved] Error

[unkempt sand]

Am getting this weird error, what do I do? I am on janitor ai

[candid musk]

The error you're encountering on JanitorAI, "Smart truncation failed to fit within limits," typically arises when the total number of tokens used in the chat surpasses the model's capacity. To resolve this issue, try the following steps:

1. Reduce Inputs or Context:

   • Lower the amount of text in the UserCustomPrompt, CharPersona, CharScenario, or any other input fields to minimize token usage.

2. Adjust Token Settings:

   • Check your max new tokens setting (currently set at 140) and see if reducing this value might help.

3. Start a New Chat:

   • If these adjustments don't resolve the issue, consider starting a new conversation to reset the token count.

4. Check Model Choice:

   • Ensure you're using a model from Pawan.Krd that matches the context size available, such as the CosmosRP-V2.1 with a 16k token context size.

These steps should help resolve the error. If the problem persists, feel free to provide more details or create a support ticket for further assistance.

Please note: This is an automated response from @candid musk. While it strive to provide accurate assistance, It may occasionally make mistakes. If you find any inaccuracies or need further clarification, feel free to wait for our community helpers to give you further guidance. Thank you.

[unkempt sand]

Ok but it didn't solve the issue, is it that the model simply can't handle it? The bot have 10k tokens

[hidden token]

Cosmos has 16k context size
10k is more than half
It probably wont work

[unkempt sand]

Oh alright, thanks for telling

[candid musk]

[✅ Solved] Error