13. How to copy last modified files from multiple folders into another folder using ADF pipeline

In this video, we learnt how to get the last modified filenames from multiple ADLS folders and copy those files to another ADLS location using ADF pipeline
#adf
#azuredatafactory

[luvvkatara]

Thank you Annu for this awesome content and Explanation

[KaraokeVN]

I have this use case : Customers requires me to import files from Blob Container and Just load the newest record into SQL Table, how can i do that.
Thank for your help !!!!
💓💓💓💓

[akeemadedigba]

Nice video. But what if destination is multiple folders and not dumping to one folder., what do you need to add or change?

[Tillutelugu]

Do scenarios as early as possible 😊...

[KaraokeVN]

I have question: Can we use incremental Load from Blob to Azure SQL Server with this pipeline or we have to make a store proc to get the lastest record/file.

[sravankumar]

If we don't know which folder has latest modified files how can we write expression for this scenario

[repalasanthosh]

thank you so much. Is there a video on how to load /copy a specific file from specific folder to a specific table using parameterization?

[userazure-thbs]

If i do have hundreds of files in the folder and also every day a file gets placed under that folder then won't it be an ideal way right? How can we do that then?

[hritiksharma]

Suppose I have written some code in databricks and it is throwing some error . Can we retrieve this error message from databricks notebook and send it on a mail which contains pipeline name and error message both.

[akeemadedigba]

Can you this exact video in opposite direction ?

[JesusSevillanoZamarreno]

i have folders for different entities that have underscore like 'ENT_B2KBA'. Im getting error in the child get metadata activity saying that ' the specified resource has invalid characters' What can i do???

[purvajpradhan]

How do we do it for Sub Folders in the same container?

[OnlineForward]

I appreciate all your videos. Honestly speaking, in most of your examples you refer to "CONTAINERS" as "Folders". I hope this is not offensive.

[krishnachaitanyareddy]

Hi can you do video on how to transfer files from Adls gen 2 to sftp server. Thanks

[jramachandram]

Hi, one doubt if we don't know specific folder like demo, each folder has different latest modified files how can we write the logic

[akeemadedigba]

How to copy last modified different files from one folder to each respective folders using adf?