Getting Started with Dataflow in Microsoft Fabric Data Factory

The Dataflow in Microsoft Fabric is an element for getting the data from the source, transforming it, and loading it into a destination. In this article and video, we will go through what Dataflow is and how it works with a simple example of it.
Learn more from my article here:

[shafa]

I wanted to get started with Fabic from day one of announcement literally. So thank you for starting this series. You have given us an ahead start!! Cheers

[xxgfmij]

Very Good Video and easy to understand to explore futher for beginners...

[raviv]

Good Video, Thanks for creating and sharing. It would be interesting to know how it performs on real world large datasets.

[JorgeSantos-zxgg]

First of all thanks for the video. Suggestion : It would be great to have the links for your other videos appearing as you speak or in the description below.

[kapiljadaun]

Hi
Your way of explaining is great.
I would request you to make a video from starting to making reports in Power BI with demo. It will be very helpfull.
Thank you

[mounikajuttiga]

Can we refresh the dataset for every 15mins in fabric(schedule refresh)?

[ruru]

Thanks Reza great video as usual!
We're trying some PoC with Fabric Warehouse (not Lakehouse) for our SQL user community. Although I have no issues loading small files with Dataflow Gen2, when trying to load On-Premis data through our Gateway (which works fine to refresh PowerBI Datasets) i always get this error:
"An exception occurred: Microsoft SQL: This function doesn't support the query option 'EnableCrossDatabaseFolding' with value 'true'."
I cannot find anything related to this...any clue? I wonder if many have tried to implement a "true" business scenario and not just some Exel samples...for this we need to pull data from the Gateway. Thanks!

[barttrudeau]

Reza, Your videos are amazing. You stay razor focused and on subject. I'm really enthused about Fabric but concerned about licensing. I don't want to try a bunch of new things for a month only to find out I can't afford them once the trial period is over. We have E5 licensing and I'm not sure what that's going to cover when the trial period is over. Any chance you could update the licensing video you did a while back to help us understand the cost implications of using Fabric?

[tea]

Excellent video. Thank you for sharing. I am new to your channel but enjoying all of the content. I recently started a YT channel as well focused on Azure Data and I was just curious what software are you using for drawing red boxes around items and zooming in on your video?

[yoismelperez]

Thanks for sharing Reza. I like how you are taking the lead to go over Microsoft Fabric products. One question, I may have missed, will replace do update on existing records and inserts for new, or just replace on the entire dataset. Being familiar with PBI Dataflows, I think the answer is it will replace all but just want to confirm.

[MilhouseBS]

Thanks. Seems like there should be a "Publish & Refresh" option?

[adamsabourin]

Reza if we choose append instead of replace is it going to keep duplicates? If so how can we save as “append and remove duplicates”?

[antonyliokaizer]

I'm wondering why public preview don't have the button "Add data destination" in 10:16 after I upload a csv file as a table? Thank you.

[mjbah]

Hi Reza.

May thanks for the video. As always, your videos are helping a lot.

I got a question around 'adding data to destination'. I was just wondering if you must add each table separately. I am just thinking that if you got so many tables and you want to add all the tables to the same destination whether you can't do it all at once?

[decentmendreams]

Hi Reza, these are all good but what has downed on me is that if you are with a Premium Per user licensing Fabric means squat . If feels like a rich man has moved in to your neighborhood and you are watching all his fancy toys as the movers unload . I actually went ahead and turned off the trial version as it seems to overcrowd my Service page .Am I far off here ?