Comparison
Alert fatiguevsRunbook
Alert fatigue
the channel has forty alerts a day, everyone has muted it, and the real one goes unnoticed for two hours.
The desensitisation caused by frequent, low-value or non-actionable alerts. It is a reliability failure in itself: the detection system exists and no longer works. The cure is deleting alerts, not adding severity levels — if an alert does not need a human to do something now, it is a dashboard.
Full entry →Runbook
the alert links to a page that tells the person on call what to check and what to do, at four in the morning.
Written procedure for diagnosing and mitigating a specific alert. It converts institutional knowledge into something a tired non-expert can execute. Runbooks rot faster than code because nothing fails when they go stale, so linking them from the alert is what keeps them honest.
Full entry →