Applied AI·The API layer
you ask for the probabilities back and use them as a rough confidence signal, or to spot where the model was torn between two answers.
Logprobs
Draft summary, pending review
An option to return the log probabilities of generated tokens. Useful as a rough confidence signal, for building classifiers, and for detecting when the model was 'unsure' between alternatives.