custom params | Dagger | Page 1

mystic fossil Mar 27, 2025, 4:38 PM

#

Hi 👋 , this should be possible to add for sure -- i guess the easier is to make a dev version ; But, we could make that configurable, I guess the first easiest play would be to introduce an env variable, would that work for you ?

idle linden Mar 27, 2025, 5:05 PM

#

Thanks for the response @mystic fossil! Yes, I think env var would work just fine. I was actually trying to find if openai supports env var to overwrite params for their chat api but with no luck 😅

frozen field Mar 27, 2025, 5:06 PM

#

This is probably related, I think the issue could be exanded for more provider-specific options https://github.com/dagger/dagger/issues/9969

GitHub

✨ LLM: configurable streaming · Issue #9969 · dagger/dagger

What are you trying to do? Some LLM servers that serve OpenAI endpoints do not behave the same as OpenAI when it comes to streaming, such as llama.cpp or certain Azure setups. We should have a conf...

#custom params