I've integrated ChatGPT 4o mini into a data processing workflow using the API and Python, but I'd like to switch to Mistral Small. Everything is set up, the only thing stopping me is I need the probability values of the answers provided. This is possible through the ChatGPT API, but not through the Mistral API (for as far as I know). Adding this functionality would be a great help.
#Getting answer probability values through API
urban fjord
broken patrol
I am not an API user, but I second this. You are referring to this? I did not know that ChatGPT had probability of tokens displayed, but that is pretty. Found this image on the web.
urban fjord
Yeah that's basically what I'm looking for, I'm solliciting single token answers and I need to know how probable the answer given was. It's a way of assessing how confident the model was in it's judgement. The feature is described here in the OpenAI API reference in the chat completion section https://platform.openai.com/docs/api-reference/chat/create