Backend & systems·Scaling and load management
you push utilisation past eighty percent and latency stops rising gently and starts going vertical.
Saturation
Also calledutilisation, queueing delay
How close a resource is to its limit. The relationship with latency is non-linear: queueing delay climbs steeply as utilisation approaches one, so a system at 90 percent is not slightly worse than one at 70, it is on a cliff. This is why capacity plans target utilisation well below full.