Dataflows end-to-end project (Microsoft Fabric) + Lakehouse + Power BI

In part 2 of the dataflow extravaganza, I present an end-to-end Fabric project using dataflows to read data in from Azure, transform it, load it into a Lakehouse (Bronze), view it Power BI, transform it again, load it into a Lakehouse (Silver), then do some final Power BI visualisation of the data!

0:00 Intro
0:55 Goals for the project
1:41 Get data from Azure
2:57 Initial transformations
4:37 Initial load to Lakehouse
6:39 Exploring the data in Power BI
9:27 Dataflow 2 (Bronze to Silver)
13:26 Final viz in Power BI
15:56 Summary

#microsoftfabric #dataflow #powerbi #lakehouse

[LearnMicrosoftFabric]

Hey all! How's it going with Dataflows and Fabric? Have you started using either yet?! Share you experiences below 👇😃

[AmritaOSullivan]

Thanks for this fab video. It is so so easy to understand and so useful to actually go through use cases end to end!

[rizvinazish]

very nice easy way you explained it, very helpful!!

[LaZyBuM]

Thanks for the wonderful videos on Microsoft Fabric.
I see that all the data imports are "one time activities" from a source.

How can we get the delta data (eg. new records, deleted records) in the source syncd with the lakehouse periodically?
i.e., What about the continuous CRUD operations being done on the source (eg. Sql DB) ? How can that be synced with the data in the lakehouse?

[arnabgupta]

Thanks for the awesome video. How do you add the folder names like BronzeLayer/SilverLayer? It all got created into the same workspace for me.

[sanishthomas]

nice.. Quick question why we are not having dataflow UI that we had in adf and synapse

[jevonzhu]

dataflow2 cannot be deployed in Fabric pipeline by my side, why is that?

[pphong]

Thank you for sharing! I didnt load my data into the azure storage account - i used DFg2 to read/upload the CSV file.

Do you guys experience slow delta writing to the lakehouse? [Can I do something to speed it up]?