11. Slowly Changing Dimension(SCD) Type 1 Using Mapping Data Flow in Azure Data Factory

In this video, I discussed about Slowly changing Dimension Type1 using mapping data flows in azure data factory

Link for Azure Databricks Play list:

Link for Azure Functions Play list:

Link for Azure Basics Play list:

Link for Azure Data factory Play list:

Link for Azure Data Factory Real time Scenarios

Link for Azure LogicApps playlist

#Azure #ADF #AzureDataFactory

[sagar_patro]

Thanks a lot WafaStudies, really this is a great explanation for type-1 and eagerly we are waiting for SCD-2 part. Please post soon :) !!!!

[azhi]

This is good, no too many columns used in the jobs.

[tech_studies]

Very clearly explained, ..loved your videos always, thank you Wafastudies 😊

[Extream]

Good use case with detailed explanation

[vssrikanthgarnepudi]

Really cool stuff and it’s very use full.
Can you make tutorial on Azure service bus & datagrid.

[sirojiddinsobirov]

Hi Wafa, thanks for great videos, I have a question: what if you have 1 million rows in source and let's say 20000 rows in sink which has same value as source. In this scenario, will it update these 20000 rows again as well ( even if, it matches)?

[satyareddy]

Hi wafa!!
Can I use upsert option available under copy activity for the same purpose

[shivanidubey]

Sir pls share video related to Azure data warehouse and external tables

[srujankumar]

Hi, this is good. I followed these steps and did this using delta files in Data lake, it’s doing inserts & updates as expected. But, one thing we are missing is RecordCreatedDate & ModifiedDate columns. If weadd a created date as getdate, it’s updating each and every row since the time is changed now in that column.

Can you please suggest how to capture the updated time in this scenario?

[jagrutipatra]

Thank you for this video. In the scd2 could you please try to explain the scd2 data flow template already present in Microsoft .

[himanshutrivedi]

Hi Can you please put SCD type 2 video..it really helpful..and appreciate in advanced...

[mahammadshoyab]

Good video wafa, the only point i absorb here is you are hard coding filename and table name, if you make parameterization, that willbe most real time scenario.

[himanshutrivedi]

Hi Wafa Studies please show incremental loading video as well.

[kalananr]

I have problem where are checking if sink has those data

[insane]

In SCD type 1 : if i want to update 2 column rest of 4column .is it possible?

[saikumar-itgl]

Hai bro i have one scenario that i have to copy files from blob to sqldb where file size is greater than 20 mb how can i achieve that

[gowthamg]

Hi, is there any other way to get in touch with you regarding doubts?