Dataflow Gen2 in Microsoft Fabric - ULTIMATE GUIDE (Part 1 of 2)

Dataflows are a key part of the Data Factory experience in Microsoft Fabric. With dataflows we can bring data into Fabric, transform it and load it into our OneLake.

This is part 1 of a 2-part guide to dataflows in Microsoft Fabric.
The 2nd video about dataflows features a real-life project using Dataflows - make sure you're subscribed for that one coming very soon!

0:00 Intro
0:39 Key Concepts
3:21 Get Data into Dataflow
5:55 Transforming Data
7:25 Outputting data to destination
8:00 Who is it for?
09:34 Comparison with other tools
12:32 Limitations
14:11 Wrapup

[yanfeili]

it's really clear and useful! Thank you so much for sharing your knowledge!!

[pphong]

Thank you for the detailed presentation on Data Factory, especially the comparison between DFg2 and Data Pipeline.

[RaviPatel-bmrf]

Hi Will,
First of all, you are awesome.
I am working on project where I am using Copy Data activity in Data pipeline but that is Buggy when it comes to Datetime column. So need to find alternatives and Then I tried Dataflow Gen 2 and found it cannot be parameterized or meta driven. Do you think there is possibility to do that using Dataflow Gen 2?
Any insight would be much appreciated.

[AmritaOSullivan]

What is the compute for DF gen 2? As I. Why is it slower than let’s say a fabric pipeline? Don’t they both use the MPP architecture? Thanks

[karybuilds]

Hey, loving this channel! where is the data set so i could follow along?

[voenzhi]

In terms of comparison to other tools, what about Azure Data Factory, particularly Mapping Data Flows? Mapping Data Flows seem to be missing from Fabric

[nishantkumar]

Which one would faster and better in term of compute cost as time saving, dataflow gen2 or running notebook?

[cargouvu]

How did you get to the PowerQuery interface? It's sort of understood but I'm having trouble getting to it.

[EduInquisitive]

Is it possible to get data into fabric from multiple sources? if yes how can we do that?

[nies_diy]

Great tutorial , how we can transform multiple csv in a dataflow and then sink them in a lakehouse or warehouse using the same dataflow is it even possible i tried it but when i select the destination it is only taking one CSV to sink at destination i am stuck here

[AndyKabeer]

Hi, great video, how do we load data from REST API using Dataflow Gen2 ?