#[π Closed] Bot stopped generating randomly
1 messages Β· Page 1 of 1 (latest)
For Step 3.5 Flash, max tokens is capped at 1024. Setting 5000 wonβt work.
Try this:
- Set Max Tokens to something valid, like
256or512 - Keep Temperature around
0.7β0.9 - Make sure you are using the correct model ID:
stepfun-ai/Step-3.5-Flash - Use the API base URL for that model:
https://api.pawan.krd/stepfun-ai/Step-3.5-Flash/v1
If it still stops early, the issue is usually your client/app stopping generation, not the model. Also remember: every request needs a valid API key.
-# This is an automated response from @dusky shoal. While I strive to provide accurate assistance, I may occasionally make mistakes. If you find any inaccuracies or need further clarification, feel free to wait for our community helpers to give you further guidance.
It didn't work, neither 256 or 512. The model is correct, temperature is 0.8, but it still cut mid conversation
[π Closed] Bot stopped generating randomly