CDC with Azure Data Factory - Change Data Capture on Azure - Basic Examples using DataFlows

preview_player
Показать описание
In this video, we see how CDC works in Azure Data Factory and Azure SQL Database. By enabling CDC on the database and utilizing Azure Data Factory Data flows we perform an initial load from source to target, plus all the subsequent incremental changes.
A very common scenario is to load the data into Delta format creating a Data Lake. CDC takes care of this scenario as it has option to store the data into Delta format.

Follow me on social media:

00:00 - Intro
01:38 - CDC behind the scenes
03:08 - Enabling CDC on Azure SQL Database
05:12 - From source table to target table
11:50 - Multiple Source and Multiple Destinations
19:56 - Change Data Capture Preview
Рекомендации по теме
Комментарии
Автор

Does CDC support, using a Query, which joins multiple tables in the DataFlow activity? I tried setting the input query instead of Table and it removes the option for CDC. Is there any other way, it can be achieved?

ankitkhirwadkar
Автор

Hii great video on cdc. I want to achieve in delta file as a source which keeps on changing and want to take only those change or incremented data from delta file .Can you please tell me how to achieve this.

nimeshdichwalkar
Автор

I understand how it's pretty easy to work with CDC & ADF for one table, but I don't understand how I would manage my pipeline easily if I have let's say 100 tables with CDC...What's the best practice in this case ?

sbkc-hannibal
Автор

Hi my DB tire in S0 so i couldn't implement CDC using data flows but i can achieve it using CDC ( preview ) there i could achieve update and insert functionalities but i couldn't achieve delete functionality. Could you help me on this

balajidevaraj
Автор

It works with SQL Server on prem as well ?

samukapsilvas
welcome to shbcf.ru