#[API] GPT4 8k generate shorts answers

1 messages · Page 1 of 1 (latest)

lunar pewter
#

Hello everyone,

I am testing GPT4 through the API. I send a prompt of 3K tokens and ask the model for a long answer but it always return a short answer with missing parts.
Apparently it's a recurring problem. https://community.openai.com/t/gpt4-incomplete-and-partial-responses/122816/28
Do you have any idea of how to solve this problem (it works great with GPT-3.5-Turbo-16k).

Thanks and have a nice day 🙂

OpenAI Developer Forum

I have the same issue. I have used chatgpt, then subscribed asAp, and was great. Now responses are always small and I hit the max 25 faster, because I have to write”continue”. I would prefer 6 messages every 3 hours if they were complete. Typically I use it to summarize and organize notes.

#

[API] GPT4 8k generate shorts answers

fickle wadi
#

Can you share code / prompts / example output?