Data engineering·Moving data out of the source
you stopped inserting a row at a time and pointed the warehouse at a folder of files, and the load went from hours to a minute.
Bulk load
Also calledcopy command, bulk insert
Loading data through a warehouse's file-oriented path rather than as individual statements. Analytical stores are built to ingest large sorted chunks and are catastrophically slow at single-row writes, so this is less an optimisation than the intended door. It is the first thing to check when someone reports that the warehouse 'cannot keep up with writes' — usually it is being used as if it were a transactional database.