Comparison
OfflinevsOnline evaluation
Offline
Offline: scoring against the golden set before shipping.
Online evaluation
Online: measuring live behaviour through user feedback, task completion and sampled review.
The difference
Offline: scoring against the golden set before shipping. Online: measuring live behaviour through user feedback, task completion and sampled review. You need both; offline catches regressions, online catches the cases your golden set never imagined.
Entry: Offline vs online evaluation →