#What's the order of 'top_p' and 'temperature'?

1 messages · Page 1 of 1 (latest)

cunning sphinx
#

In what order are top_p and temperature applied if both are specified?

Is the distribution of output tokens first squished (temperature) and then truncated and renormalized (top_p), or is it first truncated and renormalized and then squished?