Data engineering·Moving data out of the source
the vendor posts to your endpoint whenever something changes, and when your endpoint was down for an hour those changes are simply gone.
Push-based ingestion
Also calledwebhook ingestion, producer push
The source sends data to you as it happens, over a webhook or a stream write. It is the low-latency option and it moves the cost of delivery onto the sender, but it makes you responsible for being available: what the sender does when you are not — retry, drop, or nothing at all — is a property of their system, not yours. Read their retry policy before you rely on it, because most webhook providers give up quietly.