5. How to load all the foldernames and count of files inside each folder into SQL table using ADF

In this video we learnt how to get all the foldernames and count of files inside each of the folders and load it into SQL table using ADF pipeline
#adf
#azuredatafactory
#datafactory

[avinashthakur]

Nice nice
Explanation is very good Annu
Keep up the good work ✌️😊

[mybinotes]

.. I learned ADF watching your videos .. thank you so much

[azurelearner]

hello
after 15 min this video is getting stuck and not able to follow afterwards
please check

[HugoAraujo]

Great! This was what I was looking for.

[rajnishrajput]

Thanks Annu, very nicely explained
I wanted to loop through 5 layers of subfolders and copy the jason to azure sql db, this example was useful

[emmanuelokwoli]

Great video! Can you please show how you can copy this multiple files into a database? not just the number of files but the con
tent of the files

[cpxmmwc]

Hi Annu, thanks for your videos and sharing knowledge, could you please make videos on incremental load, scd1, scd2

[kishorkumar]

Thxs for the video this has made my job simple. i am really thankful mam..

[OnlineForward]

This is impressive use case, but now consider everything until FILTER then copy to a blob storage all the files you get from filter.

[nagababukamatam]

if i hava a empty folder before deploy, it is showing folder 1 -count 8, folder 2 - count 5, folder 3 - count 0 after that if i copy a file in folder 3 the it is again show double time show's folder 3 - count 0 & folder 3 - count 1..please help me.

[SantoshKumar-yrmd]

This is good but if we need to copy Folders with file inside folders, how to do that please suggest

[ashokreddykunduru]

can you please explain when we use Get Metadata activity and Lookup activity &
deference between the Get Metadata activity and Lookup activity

[DR-gouy]

Hi, thank you for your video, could you tell instead of count how do i get actual folder path (example: 2023/11/23....n subfolder and actual file name) how to output the actual folder path instead of count of files.

[somily]

Hello, I have one similar case but I need to iterate each container and each subfolder something like recursively, so I need to identify all the subfolder nested

[harshbrahmbhatt]

Can we load the data of files in different folder into the azure sql table?

[SaurabhMenon]

Hello, as an alternative to the filter activity, could we instead use the length function over the childItems array of the second get metadata to get the number of files inside the folder?

[stangoodvibes]

Ok ive found several examples of this, NONE of which show a kind of recursion that then goes back into the level 2 folders to get or count the files in the subfolders.
The use case in have is to start at a parent folder and extract the path and name of every file in all the subfolders. The folder structure is such that there may be any number of subfolders with files in the last child folder. The subfolders may be 6 or 7 levels deep 😑

[chittaranjanpradhan]

HI any, first of all good job on making such videos. One thing I didn't get it in the lookup activity you have used for folder name as '@{item().name}.But how the pipeline will come to know that is from GEtMetadata1 because we have one more fetMetadat2 also present where @{item().name} also present. Please explain

[talamanchisudheernadh]

Hi Maam i have 10 files like file1, file2, .... i want to load first 5 files to sql can you do one video on this scenario

[nagababukamatam]

gopi
0
krish
2
nag
8
gopi
1
krish
2
nag
8