how to change max_tokens to tokens reserved for completion | AG2 (formerly AutoGen) | Page 1

torpid cobalt Dec 3, 2023, 7:26 PM

#

for some agents how can we change tokens reserved for completion. right now it says 4k tokens reserved for completion

steady pulsar Dec 4, 2023, 9:28 AM

#

directly in the call ?

torpid cobalt Dec 4, 2023, 4:41 PM

#

nvm i used max_tokens inside llm_config to fix this

#how to change max_tokens to tokens reserved for completion