Azure Data Factory - Copy and Delete Activities (Part 5)

In this video we look at using the copy and delete activities to archive files dynamically in Azure Data Factory!

[rohitshukla]

Nice stuff Mitchell, Very informative. Thanks for taking time and making it wonderful video. I wish if you could add some videos for Azure DataBricks as well 🙂

[dadosporai]

Loved it. With Microsoft official tutorial I could not accomplish this, but wit your video I could. Thanks!

[naraparsrini]

its great explanation and provide more real time scenario and issues for ADF.

[syedislam]

Great tutorials. Hope to see more videos from you soon!

[MitchellPearson]

Sorry for the hand movement picking up on the Mic, I will definitely fix the setup going forward!

[JeffAffeld]

Great You are very easy to follow and understand. I've gotten a lot of great value out of your videos so far. Do you have a video, where you would use the copy activity to a database table where you would choose which table to load based on the dynamic file name you are pulling from the source dataset? I wanted to load to a sql table, but based on the file name choose what table to load to.

[gautamtrivedi]

Hey, that was a clear & great explanation. just wanted to know can we use a feature of PolyBase load or CP command load, when our source is DataBase because when I am using this feature and when I am validating my pipeline integration service say that your source is not blog storage or DataLake Gen2.

Thanks in advance.

[masoudghodrati]

Thanks Mitchell! The best vid I've ever seen on this topic!

Question, copy-delete using foreach works well for hundreds of files but when we have thousands of file this approach had extremely poor performance. If there any way to copy and then delete without foreach?

Thanks

[Sarabjitsethi]

Thankyou Sir, you are my life saver...

[snehadominic]

A doubt, if the filtered output will always be one file, we could've avoided the use of forEach right? Then how can we access the filename in the source dataset of Copy activity. Can anyone please help.

[Sarabjitsethi]

can you show how to use lastmodify date to dataflow task, like if i am having 3 files in folder of each month and i want to get only latest one to my datalake.. Can you make one video? please

[dineshwadhwa]

Hi, Can you help me in copy activity, i am stuck with HTTP/Rest Connector

[MikeBaron]

repeat that tutorial 3 times and every time dynamic copy failed, error in information is not informative at all. How can I see what is the value of @{item(0).name}?