#Does anyone have a pattern for

1 messages · Page 1 of 1 (latest)

violet cypress
fiery mural
#

It sounds like ideally you could put the assessor in the orchestrator's environment and let it manage calling the assessor tasks.
So one way to do that would be to have a function of the assessor that can accept multiple tasks and then split out using Golang concurrency like Jeremy said and collate the responses in your function.
Another way would be to let the model ask for multiple tool calls since some models are capable of requesting multiple tool calls at a time. So in that case the orchestrator would say call assessor(x), asssessor(y), and assessor(z). Unfortunately I think right now on the Dagger side that would still happen serially. @glass sentinel do you know if there's a reason we're doing this serially instead of using concurrency? https://github.com/dagger/dagger/blob/main/core/llm.go#L847

glass sentinel
#

like for a.b.c.d it would instead run a > [b, c, d] in parallel which is totally bogus