Hello guys. Im trying to rewrite an existing text. I tried a few models but I can't get consistent responses in length. I tried a lot of prompts to tell that I want almost the same length. I wasnt very lucky. Anyone tried similar things ?
#Getting consistent results in response length. Rewriting text.
signal gale
torpid acorn
what are you using?
signal gale
Tried llama3 and mistral
torpid acorn
how many tokens?
signal gale
Do you mean the prompt with the text?
torpid acorn
and after that it start allucinating?
signal gale
I tried a lot of prompts and it always gives me like 400-600 words back. If you chat with it and ask it to extend the text its almost does it. But the main problem that I want consintent outpust cause I want to automate it with python. So I want to get the results in one prompt.
torpid acorn
lets wait for nick he might know better
slow cipher
Hello guys. Im trying to rewrite an existing text. I tried a few models but I ca...
Well LLMs see tokens not words
I guess you could only try with a better prompt or use another model
signal gale
Can I set an expedted token count in the response ?
I tried 2 different models with like 10-15 different prompts. No consistency unfortunatelly.
slow cipher
Can I set an expedted token count in the response ?
You can set a max output tokens but not minimum output tokens