Data engineering·Files, formats and table layers
the whole record is written together, so appending one event is cheap and reading one field of a billion records is not.
Row-oriented format
Also calledrecord-oriented format, row store file
A file layout keeping all of a record's fields adjacent. It is the right shape when records arrive one at a time and are consumed whole — message payloads, change events, ingestion buffers — because a write is an append rather than a rewrite of every column region. Pipelines commonly use a row format at the edge and convert to columnar once data is at rest, and that conversion is often the single largest job in the pipeline.