Data engineering·Orchestration and running it in anger
two pipelines have no declared relationship and one of them only works because the other happens to run first.
Pipeline dependency inversion
Also calledimplicit dependency, hidden dependency
A real data dependency that exists in the SQL but not in the orchestrator's graph, so ordering is a coincidence of scheduling. It survives for months because the timing usually holds, and it breaks the day one job gets slower. Deriving the graph from the code rather than maintaining it by hand is the structural fix, which is most of the argument for data-aware scheduling.