Change Data Feed in Delta

Change Data Feed is a new feature of Delta Lake on Databricks that is available as a public preview since DBR 8.2. This feature enables a new class of ETL workloads such as incremental table/view maintenance and change auditing that were not possible before. In short, users will now be able to query row level changes across different versions of a Delta table.

In this talk we will dive into how Change Data Feed works under the hood and how to use it with existing ETL jobs to make them more efficient and also go over some new workloads it can enable.

Connect with us:

[vinayemmadi]

Thanks for the great video! Can you post the link to the notebook?

[dineshreddy]

How does CDF figure out the primary key

[hungphan]

Is Change Data Feed going to open source in the near future?

[amitjangra]

How to query the streaming data? Can we use SQL for reading the CDF?