Learn Together: Ingest Data with Dataflows Gen2 in Microsoft Fabric

Follow on Microsoft Learn:


Data ingestion is crucial in analytics. Microsoft Fabric's Data Factory offers Dataflows (Gen2) for visually creating multi-step data ingestion and transformation using Power Query Online.

---------------------

Learning objectives

- Describe Dataflow (Gen2) capabilities in Microsoft Fabric
- Create Dataflow (Gen2) solutions to ingest and transform data
- Include a Dataflow (Gen2) in a pipeline

---------------------

Chapters
--------
00:00 - Introduction
07:08 - Learning objectives
12:18 - Understand Dataflows (Gen2) in Microsoft Fabric
13:54 - What is a Dataflow?
15:26 - Integrated Dataflows (Gen2) and Pipelines in Microsoft Fabric
1:06:57 - Recap
1:10:23 - Knowledge check
1:15:02 - Summary

---------------------

Presenters

Gilbert Quevauvilliers
Data Consultant, Microsoft MVP, Microsoft Super User
FourMoo

Matthias Falland
Cto, Microsoft MVP
Corporate Software

Moderators

Reid Havens
Founder And Bi Evangelist, Microsoft MVP, Microsoft Super User
Havens Consulting Inc

[kebincui]

Brilliant session 👍. Thank you Gilbert and Matthias.

[quiosaevaristo]

Thks for the beautiful live.
How can we implement incremental loading

[ainaajidian]

Can i use dynamic path from Lakehouse folder for Dataflow Gen 2 insert into one table with append from multiple file and remove duplicate row(s)? So if new file uploaded to folder i choose, then the Dataflow Gen 2 use the newer file(s), if you know the way please enlighten me.

[ljfkdgh]

Hello sir,
Thank you so much providing these productive videos.

Today, I faced a challenge, and the solution I couldn't find elsewhere.
That is

How to Extract data from SAP Hana Cloud to Microsoft Fabric (cloud to cloud connectivity). Could you please help me here?

[fiqtikf]

How to trigger the pipeline using API?