sonic jewel
I'm having an issue with SillyTavern + Deepseek where it stops responding when the context length gets to around 10k tokens. I never get anything returned or any error codes, just endless waiting for response.
It's a little intermittent too. Seems to respond immediately at 9k tokens, sometimes it may start taking 30+ seconds to start a response at 10k tokens, other times it stops working suddenly, and other times it seems to work fine up to around 12k before stopping at 13k.
Then it works right away when you reduce the context back down below 10k.
This only happens when restricting the provider to the official deepseek. Likely unrelated, but the other providers quickly devolve into nonsense for me, even after lowering the temp.
This happens on two separate sillytavern installs, using both chat completion and text completion API. It's been happening for about a week.
polar fable
gusty pond