#106. Dynamic Column Mapping in Copy Activity

This video takes you through the steps required to do the column mapping between source and sink dynamically. We make use of a look up table to get the mapping of source to sink column names. We use a lookup activity to get the mapping and then we use it in the copy activity.

[bandariramprasad]

You are the best in azure training!! Please make the videos on azure darabricks and azure data warehouse.

[roshankumargupta]

Thanks for the video mam.. very helpful!

Can you also help like how do we do unit test on table rows and columns like to check whether copied table contents are correct or not? Thanks

[naveenvaddi-uldf]

I have a scenario as same but small difference, my requirement is I have hundreds of tables in HANA as source with different schemas in each table, while migrating data to azure ADLS using ADF it is converting decimal data type to decimal(38, 18) by default . how can I migrate all the tables dynamically with their original datatypes as source using ADF? can you do a demo on this please?

[sujitunim]

Hi I have one use case in which I am getting data from the rest API but the order of the column is not the same every time. And I need to write a response in the CSV file. But the column should be a specific order. Is there any way to handle this in ADF copy activity.

[harishkonakandla]

do we have another option for this? every time we can't see tables columns are present in this column mapping table right?

[ArindamSinha-vb]

Mam I want to get all the column names and fetch those column values from an API, how can I do it?

[hanvikapolu]

Most of the scenarios explained in Pipeline, can you please make a video with Data flow for this.

[yogeshnikam]

I have scenario, whenever new table create in Synapse then load data abd second scenario add column

[vipuljain-okqy]

Have you done anything on mapping side on copy activity?