getting a surprising result from | Dagger | Page 1

arctic lance Mar 13, 2025, 3:37 AM

#

Here's the code:

title, err := dag.Llm(dagger.LlmOpts{Model: model}).
        WithPrompt("Write an appropriate pull request title for the following assignment. It should be under 150 characters. Just tell me the title and nothing else.\nAssignment:\n" + assignment).
        LastReply(ctx)

#

Screenshot_2025-03-12_at_11.38.13_PM.png

#

Screenshot_2025-03-12_at_11.38.27_PM.png

#

value of title is "(no reply)"

#

Same prompt in a shell returns the expected value. But I've hit this consistently with that code

#

ok not every time apparently 🤔 super weird

arctic lance Mar 13, 2025, 6:44 PM

#

@main pendant @sonic spoke any guesses on this one? It looks like (no reply) is returned by LastReply if no non-zero assistant response is in history, but it sometimes returns the correct value and in the above trace we can see there was a reply. Race condition?

arctic lance Mar 13, 2025, 7:14 PM

#

oh I just realized locally where it was working as expected I'm on llm.6 and it's not working in llm.8. I think I see the bug in the gemini client

#

one of these days we'll add tests for SendQuery 😅

arctic lance Mar 13, 2025, 7:50 PM

#

confirmed the fix @sonic spoke https://github.com/dagger/dagger/pull/9862

GitHub

llm: fix gemini text response by kpenfound · Pull Request #9862 · d...

looks like with the streaming change the text content got dropped from being appended to the content string

sonic spoke Mar 13, 2025, 7:51 PM

#

facepalm thanks!

#getting a surprising result from