How to Fetch Latest File or Last Modified File from ADLS | Use of GetMeta, IF, Set Variable, ForEach

How to Fetch Latest File or Last Modified File from ADLS | Use of GetMeta, IF, Set Variable, ForEach.

How to find latest file from storage account folder,
how to find last modified file in adf,
how to copy latest file from adls,
use of get meta data activity, if condition, set variable, For each and Copy activity

[karthik]

lastmodifiedref data has which value inside it? how will lastmodified date of file have value greaten than or equal to tis lastmodifiedref? can you please let me knw

[sacshriv]

Great share and great content with detailed steps on how to achieve the desired results from scratch.
I like your videos where you share the knowledge by executing each and every steps involved. Although it is perfect video but there is room for the improvements. What I felt is missing in the explanation is a one pager diagram or the solution design. at one point viewer may loose the context at which stage what is happening. Great if you can corelate the steps you are performing with one pager slide in between so that ppl can sense at what stage what is happening and why is it important to perform certain steps.

[rajudasari]

if we re-run the pipeline for modified data will be duplicated?

[indranilmondal]

very complex should have easier option for such activity.. its very common requirement to have incremental load.. should be more easier to implement...

[gurshlail]

Great video, thank you. Do you have a video to connect the latest modified file to Azure SQL from the output folder

[yash-rilg]

is it so complicated to pick the last modified file in the folder?