Data engineering·Moving data out of the source
you ask the source for new rows on a schedule, so an outage on your side just means the next run reads more.
Pull-based ingestion
Also calledpolling ingestion, consumer pull
You fetch from the source on your own schedule, tracking your own position. It is the resilient default — being down costs latency rather than data, and you control the rate — at the price of load on the source and latency equal to the poll interval. The choice between pushing and pulling is mostly a choice about who owns the failure, which is why it survives as an argument long after the latency numbers are agreed.