45. Iterate over excel file sheets dynamically and copy them as a CSV file using Azure Data Factory

In this video, I discussed about Iterating over excel file sheets dynamically using sheet index and copying them as separate CSV files using Azure Data Factory.

Link for PySpark Playlist:

Link for PySpark Real Time Scenarios Playlist:

Link for Azure Synapse Analytics Playlist:

Link to Azure Synapse Real Time scenarios Playlist:

Link for Azure Data bricks Play list:

Link for Azure Functions Play list:

Link for Azure Basics Play list:

Link for Azure Data factory Play list:

Link for Azure Data Factory Real time Scenarios

Link for Azure Logic Apps playlist

#adf #datafactory #azure #azuredatafactory #etl #WafaStudies #maheer

[kitykaklyne]

Excellent explication, Very good job . Thank's so much

[rk-ejep]

Awesome explanation..great efforts..👏👏

[RAAMASHAAMYC]

Awesome bro - I got the exact question from one interview where I mentioned the same case with azure functions + fpreach copy but this is more informative but for failed activity part.

[purvajpradhan]

Hello @WafaStudies: I do have scenario, in which I need to work with Excel of 250MB of size( multiple Sheets in it)
Currently, the copy activity takes a lot of time, can you suggest in this case?

[chinmaykshah]

Hello do we have anyway to create json files for all documents available in cosmos mongo db api? I need to migrate data from cosmos mongo to google postgres any good way to achieve this?

[SantoshKumar-yrmd]

great, I also encountered exact question

[saikrishnabudharapu]

I need all the output CSV files in single sheet one row below other, here the column header is same. could you please give me the solution for this

[sudarshanthota]

Hi Anna from Kadapa. Your Videos awesome. How to copy each sheet at scheduled time. Example: I want to copy sheet 2 after 1 hour. Pls let me know if you have answer

[alaknandanadi-ykpd]

Hi..if I want the name of the sheet in the filename.csv then what should I do

[Sayon____bhattacharjee]

Sir my humble request please make video on microsoft interview process for azure data engineer role

[krishnachaitanyareddy]

I want sink as azure sql then in table name how we populate sheet names

[sanatkumar]

Is any direct way to convert from azure SQL tablets into Excel sheet.

[sravankumar]

Hi bro, I have one doubt is this logic applicable to multiple excel files with multiple sheets to generate a csv file, could u please clarify my doubts

[anthony]

Wafa, how can do That with data flow and apply a transformation to any sheet?

[PraveenkumarVinukonda]

What if there is any other error in copy activity

[const]

what if you want your pipeline to fail when legitimate errors occur?? this is such bad code

[jamshedsalik]

Hi sir,
I hope you're having a wonderful day.
I have csv file with 3 columns

ID Name Gender
1 Raja Male
2 Sara Female
3 Aksha Male
4 Ritu Female

But i just want to read Female gender record and send to sink location
Output:
ID Name Gender
2 Sara Female
4 Ritu Female
Can we achieve this in using Azure data factory?