you sample the answer five times and take the majority, paying five times the cost to get the hard cases right.

Self-consistency / majority voting

Also calledmajority voting

Draft summary, pending review

Sampling several answers and taking the majority or best, trading cost for accuracy on hard problems. A test-time compute technique worth knowing both as a quality lever and as a reason benchmark numbers need footnotes.