#I was hoping for faster models. Thats my

1 messages · Page 1 of 1 (latest)

spark cove
#

I'm in Poland - doesn't have any problem with latency. However it is a matter of a couple things. Especially if you set up an outbound agent on your custom server.

crimson sparrow
#

So you don‘t have the problem, that the user has to wait sometime up to 3-4 sec before he get an answer?

spark cove
#

Not at all, usually you have instantly / fluent response in most cases. The latency is not a problem for me. Where are you located? Is it an inbound or an outbound agent?

crimson sparrow
#

Inbound, Liechtenstein/ Switzerland

#

I mean it also depends on the context size/ RAG settings. But latency is indeed a challenge