#Hi I'm working on integrating the swift

1 messages · Page 1 of 1 (latest)

ornate raptor
#

hey so you want the sdk to show the user the data that was returned from the server tool?

#

this kind of flow?

  1. user on client connects to convai via sdk
  2. user says something that triggers system tool
  3. system tool is successful
  4. system tool is used to continue the conversation + result is shown to user?
#

i think this is already possible currently by creating a client tool that shows responses to the user and prompting the agent which tool responses should be shown to the user and prompting the LLM which data to pass over (ie drop some fields maybe)

little spruce
#

yea i realized that and used client tool

#

thanks for the detailed reply and support!!!

#

I thought it could be more straightforward by just return the json response right? I implemented the client tool exactly as you described. But then I wonder- if LLM would hallucinate? Wouldn't that increase the inference cost? (although now covered by you guys)

#

I kinda realized mid-way that this is prob some design choice from your end so I wonder if there is any reason behind it

ornate raptor
#

yeah i mean the idea of a system tool call is that it gets fed into the LLM to collect data but isnt necessarily shown to the user

#

would you want to be able to define which system tools send the response to client also or just set it to all?

little spruce
#

I was thinking about cuz I thought json responses could be sent back when I designed the cloud functions. So now I am using a logmessage client tool to send back all data.

little spruce
#

Hey Angelo! Another question I got implementing the swift sdk is that the agent voice always go through the earpiece (the stereo speaker that people use when making phone calls i guess) but not through the speaker. Therefore the sound is always so small. I tried all kinds of ways to modify the audio setting to play through speaker but couldn't seem to have it work. Would appreciate some help🙏

ornate raptor
#

hey, honestly swift isnt my best area of expertise but i will try to take a look

#

let me know if you find a solution too so i can update the SDK!

little spruce
#

Hi Angelo! I am still looking into this problem, are you the only dev working on sdk? Not sure if talking with the person who developed the swift sdk would reveal the root cause faster. Thanks!