[✅ Solved] Why does the response keep getting cut off.

[median fjord]

Thanks for providing the details and screenshot!
If you're setting max_tokens to 150-200 in JanitorAI, the model will try to generate responses up to that limit, but sometimes it might stop mid-sentence due to token limits, prompt length, or how JanitorAI handles the output. Here are some suggestions to reduce cut-off responses:

1. Lower the input prompt length:
   If your messages and chat history are long, they take up tokens and leave less room for output. Try deleting or shortening the previous chat history if possible.

2. Increase max_tokens if possible:
   Even if you prefer shorter replies, a setting of 200 tokens occasionally isn't enough for the model to finish its thought. Try increasing to 250–300 just to test if it helps; you can always trim the reply yourself.

3. Try OpenAI Default settings:
   Avoid strict limits or jailbreaking; use "OpenAI Default" generation settings as recommended for best results.

4. Check for accidental prompt content:
   Don't add custom instructions/jailbreaks—leave the extra prompt fields as a single space.

5. JanitorAI limitation:
   Sometimes responses get cut off from JanitorAI's side (site timeout, UI limit, etc.), not our API. If it happens even after adjusting token limits, consider trying a different website like VenusChat.AI, ChubAI, or SillyTavern to compare.

6. Model/website may truncate:

Some websites add their own restrictions or have bugs that prematurely cut responses. This is out of our control.

Summary:

• Increase max_tokens slightly for testing.
• Keep chat history short.
• Avoid extra prompts/jailbreaks.
• Try on a different website if issue persists.

If you still face issues after these changes, it may be a limitation of JanitorAI itself. Please also check their support or try other frontends for best experience.

Please note: This is an automated response from @median fjord. While it strive to provide accurate assistance, It may occasionally make mistakes. If you find any inaccuracies or need further clarification, feel free to wait for our community helpers to give you further guidance. Thank you.

[median fjord]

[✅ Solved] Why does the response keep getting cut off.