It Depends #64: Iceberg, Delta, Hudi, Polaris, Unity & Lakehouse - Vinoth Chandar Onehouse - Jun ’24

[@alexischicoine2072]

Amazing video. I was always curious to learn more about the differences between the table formats and this covered it well.

[@humaidkidwai]

Sanjeev, thank you for these podcasts. It is tremendously helpful!

[@SanjeevMohan]

Thank you very much for taking the time to comment.

[@nandakishore5198]

transactional layer
iceberg - update is delete +insert
iceberg - mark the del records , create file of new inserts
hudi - mor
hudi - streaming workloads
liquid clustering
table metadata formats
hudi, delta - more writes
iceberg - more read - warehouse
read, write, table management
read optimised
write optimised
hudi
lakehouse
data rewriting
3 tables formats
table metadata formats
iceberg - snapshot
delta, hudi - log bassd
write, read, table management
hudi - built in table mgmt
metadata
cor ; mow
cow; mor
interoperability
uniform
read compatibility
write compatibility
manifest file
delta log
xtable and uniform
foundational db in sf
access control + technical metadata
polaris - sf
unity catalog - open source
iceberg rest api catalog
metastore - read and write plans
data not tied to one engine
data catalog being interoperable bw engines
lake view - ingestion, transformation, orchestration- observability