Microsoft Fabric - Incremental ETL

Welcome to today's episode of the Microsoft Fabric MVP video series!

Amit Chandak joins Ryan to talk about incremental ETL in Fabric.

Meet Amit:
YouTube: @AmitChandak

[ndAirborneTrooper]

FABRIC...utterly awesome - unbelievable ecosystem integrations with on the fly build-in/code-in logic functionality. Thank you, Microsoft Team.

[MilhouseBS]

Maybe add the "incremental ETL" subject to the video title?

[marimuthukalyanasundram]

Kudos Amit, Its excellent explanation about Incremental load in Fabric how data engineers can use in real time project. More exciting to know about SCD Type-2 implementation in Fabric without using the store procedure, needs to be handle in Dataflow activities. I Compared with Synapse Data flow activities but SCD Type-2 options are not available.

[thepakcolapcar]

hello @amit
When I follow the steps, in power BI I see the "Trial" option as disabled adn by default it has selected my "Pro" licence.
However on top it shows me "PPU trial: 59 days left". Is that how it is uspposed to be?
Further as I proceed, and try to create Lakehouse, it gives me a message asking to upgrade to free Fabric tiral capacity.

[Babayagaom]

can anyone tell me in this case what is Medallion Architecture DW will be gold layer, lake will be bronze and which one will be silver layer? also is it necessary to create medallion arch everytime ?

[demon-hp]

u did not tell from where did you get server name for postgre sql in fabric

[VivekDevalkar]

How do you do incremental ETL based on modified date i.e. I want updated source records to be updated in the destination and new records to be inserted. Would that basically need to be handled at a stored procedure level using perhaps a merge statement or is there is better/different way to do that within Fabric?