#super slow query because of the spaces in the prompt

3 messages · Page 1 of 1 (latest)

tall cloak
#

This prompt is super slow (minutes, and it sometimes fails after ten minutes). By adding spaces to the prompt, it's super fast (ten seconds). I've tried this ten times, in two different computers and internet networks, with the same results.

# slow, minutes, and it sometimes fails after ten minutes
messages=[{'role': 'system', 'content': 'You are a book reviewer.'}, {'role': 'user', 'content': 'Write a list of diverse funny passages of the book "1984" by George Orwell.\nThe response must be a python array of strings, with each string representing a funny passage of the book.\nDo not write a variable name, only the array. Do not write anything else.'}]


# fast, 10 seconds
messages=[{'role': 'system', 'content': 'You are a book reviewer.'}, {'role': 'user', 'content': 'Write a list of diverse funny passages of the book "1984" by George Orwell.\n  The response must be a python array of strings, with each string representing a funny passage of the book.\n  Do not write a variable name, only the array. Do not write anything else.'}]

r = openai.ChatCompletion.create(model="gpt-3.5-turbo-16k", messages=messages, temperature=0, max_tokens=15000)
print(r)

any idea?

sweet skiff
#

That being said, I really don't know how the model handles new line characters