34. Get Metadata Activity in Azure Data Factory

In this video, I discussed about Get Metadata Activity in Azure Data Factory

Link for Azure Functions Play list:

Link for Azure Basics Play list:

Link for Azure Data factory Play list:

#Azure #ADF #AzureDataFactory

[theratipallyphanikumar]

Hi Maheer, I like your Explanation But instead of Explaining can you Please Execute The pipelines so it could be a better understanding. In Many Videos, You are Explaining How to Do it but you are not Executing the Pipeline. So We can get easily how it is impacting

[kuladeepk]

Hi Maheer,

Can you explain how to develop a pipeline/logic to recursively search for files in a directory regardless of any number of sub folders. It has to get  details of all the files in the directory.

[khana]

what if I have multiple files under the folder and I want alter or derived a column in all those, can you do those using Get Meta data activity

[cristianbautistamartinez]

The most conplete ADF course I've seen until now!!
Thanks a lot!!

[absspaceinformation]

@Maheer - I like the way you explain all the basic ADF concepts to real life scenarios. I have one query if its possible . Kindly help me with it.
Is there any way we can know in ADF, who has uploaded file at datalake container.
I have real time scenario where, In case of failure of pipeline, I need to notify respective person who has uploaded the file. ?

[narenn]

I have a scenario where I am reading a set of same structured files from a folder (each file is a sales data from different stores across country). my pipeline is failing every now and then due to the structure of files from some store are changing, so the mapping is failing. after watching this video I am thinking of applying this Metadata combined with if condition. for each loop to iterate on each file, read the COLUMNCOUNT metadata of current item using @item(), if columncount = Xvalue then Run the ExecutePipeline that actually copies the data, ELSE log the wrong file details into a file for after execution investigation. Will that work ? Thanks

[debasissarangi]

don't understand how you use @equals in activity, when I put it it shows me wrong

[archanametkari]

@Maheer - I like the way you explain all the basic ADF concepts to real life scenarios. I have one query if its possible . Kindly help me with it.
Is there any way we can know in ADF, who has uploaded file at datalake container.
I have real time scenario where, In case of failure of pipeline, I need to notify respective person who has uploaded the file. ?

[ukumar]

Could please explain metadata attributes as well please

[viveknimmagadda]

Is there a way to recursively go inside the subfolders and extract the files from those subfolders? Or is there any other activity with which this can be achieved?

[sabithaa]

hey, could you please help me to get the data count from mongodb collection. how can we get that

[UmerPKgrw]

is there a way to store the contents of a file into variables? For Example, read a value from a file and store this value in the variable/parameter.

[venkateshedunuri]

hello brother in adf where we use powerbi plz make one video on that one

[sgnaneswari]

8:24 i guess it is not MDS, it is MD5 Message digestive file

[balamanikanta]

Hi Maheer, your series is really hepful.
Can We pass the Activity Name to subsequent Activity ? If we can do so, What are the main Activities we can use ? Just please give me a hint ...
Thanks in advance. :)