filmov
tv
5 How to copy multiple tables in Azure Data Factory using a single pipeline, control table, MetaData
Показать описание
ADF has a template which can create a metadata driven copy pipeline. As part of this pipeline we can copy multiple sources in one pipeline run only. The list of tables to be copied is controlled by a "Control Table".
The source & destinations can be API, or any tables in SQL server, Oracle, MySQL, Postgres etc. But the control table can be created only in SQL Server or some other supported DBs. This is better than creating individual copy steps if you have 20 or more tables to be copied. We can add triggers which will trigger the pipeline at different scheduled intervals for different tables. We can also add alerts for any failures.
Happy Learning.
The source & destinations can be API, or any tables in SQL server, Oracle, MySQL, Postgres etc. But the control table can be created only in SQL Server or some other supported DBs. This is better than creating individual copy steps if you have 20 or more tables to be copied. We can add triggers which will trigger the pipeline at different scheduled intervals for different tables. We can also add alerts for any failures.
Happy Learning.
0:00:23
0:00:16
0:00:27
0:01:51
0:00:25
0:00:18
0:01:10
1:35:50
0:01:33
0:00:29
0:00:36
0:58:01
0:00:37
0:18:53
0:01:07
0:00:21
0:00:18
0:00:58
0:02:02
0:00:15
0:00:19
0:00:19
0:10:01