Comparison
Dead letter queuevsQuarantine table
Dead letter queue
the message failed five times so it gets moved somewhere else, instead of blocking the queue forever by being retried in a loop.
A separate destination for messages that exceeded their retry limit. It keeps one bad message from consuming the consumer's entire capacity and preserves the payload for inspection. A DLQ nobody alerts on or drains is just a slower way to lose the message.
Full entry →Quarantine table
rows that fail validation go to a side table with the reason attached instead of failing the load or being silently dropped.
A destination for records that could not be processed, retained with enough context to diagnose them. It is the third option between stopping the pipeline and losing data quietly, and it is what makes 'we processed 99.4 percent of rows' a statement someone can act on. It only works if something watches its row count, otherwise it is a place data goes to be forgotten with extra steps.
Full entry →