Applied AI·Evaluation and reliability
your golden set stayed green and real users still hit a case nobody had imagined, so you started sampling live traffic too.
Offline vs online evaluation
Draft summary, pending review
Offline: scoring against the golden set before shipping. Online: measuring live behaviour through user feedback, task completion and sampled review. You need both; offline catches regressions, online catches the cases your golden set never imagined.