Understanding Apache Iceberg architecture | Starburst Academy

preview_player
Показать описание
Apache Iceberg is an open table format that is especially useful for huge analytic data sets. It enables data warehouse functionality in the data lake. The secret to how it does this lies in its architecture and how it handles metadata.

In this video, you'll learn about Apache Iceberg architecture and how Iceberg stores metadata. Concrete examples are provided to further enhance the learning. You'll even get to see an example of the data and metadata being stored in an Amazon S3 bucket.

#ApacheIceberg #DataLakehouse #BigData #DataAnalytics #MetadataManagement #CloudDataWarehouse #DataLakes #SQL #DataEngineering #ACIDTransactions #DataFiles #ManifestFiles #Parquet #Avro #DataArchitecture
Рекомендации по теме
Комментарии
Автор

It seems like it will be a future mess

Tom.malucao