@wompfox any reason not to set up | Dagger | Page 1

dull dove Mar 6, 2025, 10:10 PM

#

I punted on adding the telemetry bit but it does need to get added. For streaming, from what I could gather from the google genai client, the startChat interface doesn't support it. There is a generative streaming function but I don't think it's compatible with how we're doing things

manic fractal Mar 6, 2025, 10:10 PM

#

I see a SendMessageStream which seems like what I want

dull dove Mar 6, 2025, 10:11 PM

#

oh yep sorry, that's exactly what you want. So SendMessage can be swapped for that

#

I was thinking of this one which wouldn't work https://pkg.go.dev/github.com/google/generative-ai-go@v0.19.0/genai#GenerativeModel.GenerateContentStream

manic fractal Mar 6, 2025, 10:12 PM

#

sweeeet, will pick it up, hopefully doesnt take long

manic fractal Mar 6, 2025, 11:26 PM

#

@dull dove pushed if you wanna try, added token metrics too

#

i switched back after it refused to do things i wanted it to 😛 https://v3.dagger.cloud/dagger/traces/b6761c6bf64b267543920532d5689223

dull dove Mar 6, 2025, 11:27 PM

#

LOL nice I will pull. Is this with gemini-2.0-flash?

manic fractal Mar 6, 2025, 11:36 PM

#

no idea - might not be, I just accepted all the defaults in the AI studio and didn't specify on the CLI. I just set a token

dull dove Mar 6, 2025, 11:37 PM

#

cool I think that's default in our client at least if you didn't specify a model. I've found it's pretty dumb when we just give it a container or directory and ask it to use it, but really really smart with actual prompting and large contexts. Not sure why

manic fractal Mar 6, 2025, 11:37 PM

#

ah yeah interesting

#

maybe it's related to how Claude is so eager to jump into action without reading the manual 😛

#@wompfox any reason not to set up