Applied AI·The API layer
you cut off the improbable tail instead of reshaping the whole distribution, and you move this or temperature, not both.
Top_p (nucleus sampling)
Also callednucleus sampling
Draft summary, pending review
Restricts sampling to the smallest set of tokens whose probabilities sum to p, cutting off the improbable tail. An alternative lever to temperature; adjust one, not both, unless you know why.