Applied AI·Evaluation and reliability

you report that eighty-two percent of cases passed and someone asks whether that was one attempt each or the best of five.

Pass rate / pass@k

Also calledpass@k

Draft summary, pending review

Pass rate is the fraction of cases scored correct. Pass@k asks whether any of k sampled attempts passes, standard in code generation where you can test candidates automatically. Report which one you measured; they differ a lot.