Delta Lake 0.7.0 + Spark 3.0 AMA

preview_player
Показать описание
On August 18th, 2020, join Apache Spark and Delta Lake committers Burak Yavuz, Tathagata Das, and Denny Lee for an illuminating “Ask Me Anything” session. Whether you would like to know more about the history of Apache Spark to the current bleeding edge use cases of Spark 3.0 and Delta Lake, this is the session to ask your questions!

---
Speakers:

Burak Yavuz is a Software Engineer and Apache Spark committer at Databricks. He has been developing Structured Streaming and Delta Lake to simplify the lives of Data Engineers. Burak received his BS in Mechanical Engineering at Bogazici University, Istanbul, and his MS in Management Science & Engineering at Stanford.

Tathagata Das is a Staff Software Engineer at Databricks, an Apache Spark committer and a member of the Apache Spark Project Management Committee (PMC). He is one of the original developers of Apache Spark, the lead developer of Spark Streaming (DStreams) and is currently one of the core developers of Structured Streaming and Delta Lake. Previously, he was a grad student in UC Berkeley at AMPLab, where he conducted research about data-center frameworks and networks with Scott Shenker and Ion Stoica.

Рекомендации по теме
Комментарии
Автор

Does This delta metastore support external hive meta store in Databricks?

MukunthanGJ
Автор

In merge statement, how can I exclude specific columns when insert operation is triggered into delta table.

NameEncrypted
Автор

How could we know which version of Delta Lake is running? Could we specify somewhere with session config? I appreciate for your advice.

atsushiomodaka