#stop token when max_tokens=None

1 messages · Page 1 of 1 (latest)

wintry pelican
#

If i set max_tokens to None, how does the model decide when to stop the output? Is there a default end token internally?

coral etherBOT
#

Hi @wintry pelican. I'm kapa.ai, your friendly support bot. I will try to answer your question by searching through the knowledge base. :wave: