ionic pelican
Hi everyone,
I'm using the http endpoints to access the API from a C++ app (specifically I'm using https://api.openai.com/v1/chat/completions) . It's all working great when I wait for the messages to be complete. But the messages take a long time to complete. So I'd like to add streaming to my app, but it seems, this is currently not possible, if not using one of the API solutions like JS, because there doesn't seem to be any WebSocket or similar support. Is there currently any way to use streaming in an environment like C++? And if not, does anyone know if there are any plans?
Inb4, I need to stay in C++ with this, because the software I'm working on demands it for various reasons. ChatGPT recommends I run a Proxy server that uses JS, so I can connect to that from my C++ app via Websocket and it handles the streaming, but that seems like an awfully complex solution...