I want to stream responses back to users using Web Streams API in a worker. I'm on a free plan at present which doesn't allow workers running for long in any way. Do you think workers are better suited for immediate responses instead of text streaming cases like mine?
#Is a worker well suited for streaming chatGPT responses?
viral galleon
bleak zodiac
I want to stream responses back to users using Web Streams API in a worker. I'm ...
If you are just directly streaming a Response, then it shouldn't be an issue. It only becomes more difficult if you need to modify the stream while it is running?
viral galleon
do you mean that time limitations do not apply when you're passing a stream from an external source? Is there a price burden though?