#Improve bot behavior
39 messages · Page 1 of 1 (latest)
you can try adding temperature, frequency/presence penalty and reduce top_p
just try little by little
usually temperature 0.9 is enough for a daily chat bot
for top_p you can set it to about 0.7 for unexpected answers
I found the other two do not have major influence, but you can try adding them to the max
Well what about translator?
In translator, I suggest that you set temperature to 0~0.1
IUf temperature is much too high, the bot might give nonsense translations
But it usually depends on what kind of language you are translating into
Any language to anyother language
👀
User enter the language and I put that language in my prompt
When I try to translate English into Chinese, the translation will be non sense when temperature is higher than 0.4
I suggest temperature = 0 for the most stable output
top_p = 1
fre and pre penalty don't affect this much
So what's your prompt of the translation
Wait
ah I think your prompt is quite good
So did you meet some problems of the output of the translation?
Sometimes wrong and random sentences
But I dont want to translate like google translate (I mean word by word) I want to AI understand the text and give them best possible translation
So have you try my suggestion before?
To solve this. I think some examples are necessary
Just like this:
The following are some examples
Input: xxxxxxxxxxxxx
Output: xxxxxxxxxxxx
Input:xxxxx
Output:
That might be a problem