#Tokens in non-English languages

3 messages · Page 1 of 1 (latest)

scenic sable
#

Hey folks,

Is there a work-around for the extreme "token cost" of languages that aren't English? e.g. Ukrainian, Russian, etc. It looks quite daunting to pay 7x-10x in tokens for the same prompt length in a language that's not English.

stone cloak
#

I don't think so, but depending on the model you are using (e.g. gpt4), you could translate it into English with a cheaper model (e.g. gpt3.5), and then append something like: "\n-----\nRespond in {language}".