Azure Data Factory - Dynamic File Names with expressions

In this video we take a look at how to leverage Azure Data Factory expressions to dynamically name the files created. This of course makes it easier to also make pipelines and datasets reusable.

#MitchellPearson #MitchellSQL

[mendalin]

This is a very underrated channel!! Super helpful! 🙏🏽

[dwaynecarroll]

Thank you for this excellent example in beautiful, clear English!

[jaredaugust]

Thanks for making this -- it was super easy to follow and helpful!

[gautamtrivedi]

Hey Man, You rocked, Awesome.
Your Explanation was so clear & step by step that I understood the dynamic concat concept.
Hoping more videos on Function parameters

[fudhater]

7:06 Can't you use formatDateTime?

[louisar]

I’m really trying to learn this with using an Excel Source and an SQL table as my sink destination. I need that SQL table to use that excel file name. Do you have a video for that???

[AbgarMusayelyan]

How do you set the value of FileName from the copy activity?

[mkiserbb]

Very helpful !! Thanks for demo’ing this, Mitchell!!

[Rodri-xfit]

Hi, thanks for this video. It has helped me a lot. However, I still have a problem with the source SQL table and the JSON sink. I want one JSON file per record, but I can only generate one JSON file for the entire table. Any hints on how to reference the ID of each record in the file name?

[kannibala]

Hi
How to use multiple wildcards to filter a files from a share path?
For example, I have the files like .json, .csv, .txt, .xml, .xls
I could like to copy only .json and .xml.. How to do it? Thanks in Advance

[ssbeats]

What if we have multiple formate files in our folder eg. Few are .csv and few are .txt file ?

[dayasandhu]

What do you write in the sink and source for the copy activity?

[luisafernandarodriguez]

Thanks for your video, good explanation!

[ijeomaossai]

Hi Mitchell, your videos always rock. Thanks. I was able to load files to blob storage but when I attempted to load the same file into SFTP, I keep getting an error that the file path does not exit. Apparently, it believes the expression together with the root directory is the file path. When I put an empty text file and remove the expression I was able to load it. Do you please have any tip that would be helpful to load data to SFTP?

[harishkonakandla]

can you please make a video on SCD in ADF

[penchalaiahnarakatla]

Hi Michael, how rename file name. In blob. I verified so many you tube channels. But I didn't got. It useful if you make this video please.