jargon

Data engineering·Files, formats and table layers

the files are columnar with statistics in the footer, so the engine can skip whole chunks without reading them.

Parquet

Also calledApache Parquet

The de facto columnar file format for analytics: typed columns, per-chunk statistics, dictionary and run-length encoding, and a footer describing the layout. Its statistics are what make predicate pushdown work, which is why the same query can be fast or slow on identical data depending on how the files were written and sorted. It is a vendor-neutral name people say as a noun, which is why it is here and a console feature is not.

Commonly confused with