#Anyone experiencing this? Missing First Token in Stream Response from /v1/chat/completions Endpoint

1 messages · Page 1 of 1 (latest)

burnt sentinel
#

Hey Team. We're really struggling with this random issue and can't unearth why. We seem to randomly be getting "null" back for the response for the 1st chunk on some occasions. It's pretty random.

I've seen this thread but it didn't solve it for us: https://community.openai.com/t/stream-response-from-v1-chat-completions-endpoint-is-missing-the-first-token/187835

We have submitted a new thread here for our issue: https://community.openai.com/t/missing-first-token-in-stream-response-from-v1-chat-completions-endpoint/261047/1

Anyone else experiencing this?

OpenAI Developer Forum
Stream response from `/v1/chat/completions` endpoint is missing the...

I am successfully streaming a response from this endpoint using the 'gpt-3.5-turbo' model, so I feel the implementation is right, but I am consistently missing the very first token. Is anybody else seeing this? Here is my stream reader implementation (JavaScript): const reader = response.body.getReader() reader.read().then(function proces...

OpenAI Developer Forum
Missing First Token in Stream Response from /v1/chat/completions En...

While streaming a response from the specified endpoint using the ‘gpt-4’ model, it has been observed that the very first token is consistently missing from the received data. This issue is impacting the completeness and accuracy of the streamed response. It is essential to investigate and address this problem to ensure the correct functioning of...