jargon

Data engineering·Files, formats and table layers

the table's partitioning was changed without rewriting any of the existing files, and old queries kept working.

Iceberg

Also calledApache Iceberg

An open table format built around explicit manifests and hidden partitioning, where the partition transform is stored in metadata rather than in the file path. That indirection is its distinguishing feature: a query filtering on a timestamp gets pruning without knowing the layout, and the layout can be changed later. It is a name said as a noun in architecture conversations, which is why it appears here rather than as a vendor footnote.

Commonly confused with