How to copy data using Azure Data Factory tumbling trigger

preview_player
Показать описание
Today's video explains how to use Azure Data Factory to copy a table incrementally into a data lake, using tumbling window trigger.

Agenda:
0:00 Introduction
1:15 Dummy table in Azure Data Studio
2:46 Data factory demo

Further reading:

Let's connect on:
Рекомендации по теме
Комментарии
Автор

Hi Riz, so what should I do when I don't want it to create new csv files all the time?
I would like to use this so that it just updates my target (sink) database every time there was a update in the source.

Thanks

yanni
Автор

Rig Ang, we can also incrementally load data using alter-row (insert operation) in data flow activity right?

pawanreddie
Автор

Thanks Riz,
your video is pretty useful for incremental load scenarios. I have a question:
Do you think it is possible to implement incremental load:
- if source data does not have any date/timestamp columns
- if you are not allowed to enable change data capture (CDC) in the source system
?

jb-ehfp
Автор

This is awesome and neatly done, Rizal. Very useful in delta scenarios.

girishsuch