Delta Lake: Reliability and Data Quality for Data Lakes and Apache Spark by Michael Armbrust

preview_player
Показать описание
Delta Lake is an open source storage layer that brings reliability to data lakes. Delta Lake offers ACID transactions, scalable metadata handling, and unifies streaming and batch data processing. It runs on top of your existing data lake and is fully compatible with Apache Spark APIs.

#BIGTH19 #BigData #MachineLearning

Session presented at Big Things Conference 2019 by Michael Armbrust, Principal Engineer at Databricks

20th November 2019
Kinépolis, Madrid

  1. Big Things Conference
  2. conference
  3. databricks
  4. Delta Lake
  5. Data Lakes
  6. Apache Spark
Рекомендации по теме
Delta Lake: Reliability 0:31:30

Delta Lake: Reliability and Data Quality for Data Lakes and Apache Spark by Michael Armbrust

What is Delta 0:02:31

What is Delta Lake?

Delta Lake Reliability 0:31:30

Delta Lake Reliability and Data Quality for Data Lakes and Apache Spark by Michael Armbrust

Data Reliability for 0:24:49

Data Reliability for Data Lakes | Databricks

How Apache Spark 0:58:21

How Apache Spark 3 0 and Delta Lake Enhances Data Lake Reliability

What is this 0:06:58

What is this delta lake thing?

Building Reliable Data 0:37:51

Building Reliable Data Lakes at Scale with Delta LakeBurak Yavuz Databricks - Tathagata Das

Make Reliable ETL 0:45:01

Make Reliable ETL Easy on Delta Lake

Databricks Mastery Hands 0:44:22

Databricks Mastery Hands On Big Data, ETL, and Lakehouse Transformation - Part 2

AWS re:Invent 2019: 0:58:21

AWS re:Invent 2019: Build reliable data lakes with Delta Lake & Databricks (ANT347-S)

Boston Spark Meetup 0:41:01

Boston Spark Meetup @ Wayfair / Delta Lake: Open Source Reliability and Quality for Data Lakes

Demystifying Delta Lake. 0:25:52

Demystifying Delta Lake. Data Brew | Season 1 Episode 3

Tech Talk | 0:53:30

Tech Talk | Diving into Delta Lake Part 1: Unpacking the Transaction Log

Building Reliable Lakehouses 0:25:56

Building Reliable Lakehouses with Delta Lake

Open Source Reliability 0:24:40

Open Source Reliability for Data Lake with Apache Spark

How Delta Lake 0:31:11

How Delta Lake Address Data Lake Challenges

SBTB 2019: Michael 0:30:34

SBTB 2019: Michael Paul Armbrust, Delta Lake: Open Source Reliability and Quality for Data Lakes

Getting Data Ready 0:58:45

Getting Data Ready for Data Science with Delta Lake and MLflow

Cloud-Native Data Ingestion 1:01:45

Cloud-Native Data Ingestion with AWS Aurora and Delta Lake

Building Robust Production 0:52:01

Building Robust Production Data Pipelines with Databricks Delta

Delta Lake - 0:00:47

Delta Lake - Things you need to know - 1. What is it?

Data Warehouse Vs 0:03:24

Data Warehouse Vs Data Lake Vs Delta Lake Vs Lakehouse in simple terms

Seattle Spark + 0:56:43

Seattle Spark + AI Meetup: How Apache Spark™ 3.0 and Delta Lake Enhance Data Lake Reliability

Implementing a Reliable 0:48:11

Implementing a Reliable Data Lake with Databricks Delta and the AWS Ecosystem - Denis Dubeau