jargon

Applied AI·Production patterns and cost

you run the candidate on live traffic without showing anyone its answers, and compare the logs afterwards.

Shadow deployment

Draft summary, pending review

Running a candidate (new model, new prompt) on live traffic without serving its output, logging results for offline comparison against the incumbent. The lowest-risk way to test a change against reality before it faces a user.

Commonly confused with