DP-600: Monitor and Optimize Performance in Fabric (Video 6 of 10)

In this video, we dive deep into key techniques to enhance performance within Microsoft Fabric.

Google classroom community:

Covering Dataflows Gen2, Notebooks, and SQL queries, you'll learn how to identify and resolve bottlenecks in data loading and query processing.

We’ll explore real-world performance improvement strategies, including staging and partitioning, along with Delta Lake optimizations like V-Order and optimized writes to tackle file structure issues. Perfect for analysts and developers, this session equips you with actionable methods to streamline workflows in Microsoft Fabric.

00:00 Module 2 - Prepare and Serve Data - Monitoring and performance optimization - Overview and Course Roadmap
02:03 Google classroom community overview
03:11 Performance Optimization Matrix overview
09:58 Monitor tool DEMO in Fabric
13:32 Dataflow Gen2 Refresh History
15:25 Fabric capacity metrics APP Walkthrough
18:56 SQL Queries: DMV’s and Query Insights
26:46 Incremental Refresh capability in Dataflow Gen2
28:37 FAST COPY in Dataflow Gen2
31:13 Staging in Dataflow Gen2
35:40 Data partitioning of Delta table files
39:06 VORDER and OPTIMIZED WRITES in Delta table Optimization
45:43 Optimizing SQL queries: Optimize joins with required Indexes
47:42 Summary

Dataflow Gen2 Optimization techniques blog links:

Notebooks Optimization techniques links:

SQL Queries tools links:

#DP600 #microsoftfabric