#Real Time Generation

2 messages · Page 1 of 1 (latest)

graceful lark Jul 6, 2023, 9:04 AM

Is there an option to generate the Chat-GPT-3.5-turbo response in the API in real time character by character like on the website?

mossy dove Jul 6, 2023, 11:24 AM

Not by character, but by token yes. It's called streaming mode. Look it up.