Microsoft Fabric End to End Data Project for Data Analysts and BI Engineers

Welcome to this comprehensive Microsoft Fabric data project using New York City taxi data. This video will guide you through an end-to-end data project, focusing on Data Warehousing, Data Factory, and Power BI.

We'll use TLC Trip record data, stored in a Fabric Data Lakehouse, and transform it through staging and presentation layers using Data Factory activities, Dataflows, and Stored Procedures.

Pre-requisites ✅
- Microsoft Fabric environment,
- Basic SQL, and data warehousing knowledge

Timestamps⌚
00:00:00 Introduction
00:04:32 Downloading the NYC Taxi Data Files
00:06:39 Data Lakehouse Files for Landing Data
00:12:19 Pipeline from Landing to Staging
00:42:16 Dataflow from Staging to Presentation
00:59:18 End to End Data Processing
01:03:33 Semantic Modelling and Power BI
01:07:44 Replacing the Dataflow with a Stored Procedure

Links and Resources 🔗

Check out my Udemy Course 📚

[insghtsandmore]

Just starting looking into Fabric, this tutorial gave me a clear overview what Fabric can do. Thanks alot!!

[sharunkumar]

Thanks a lot Malvik, you are amazing!

[Robertlavigne]

Love these end to end tutorials! Excellent examples of what can be accomplished. Thanks for making these!!! For anyone attempting a similar workflow in production it’s likely a good idea to have the staging load dates be dependent on the most resent presentation load logging dates rather than the staging ones. With the setup shown in this video a failure between the staging and presentation loads will cause a month to be missing in the presentation layer that will require manual cleanup of the logging table to correct.

[aminemohamadou]

@Pathfinder Thanks for the great video cristal clear explanation. Is it possible make one more focus on how to create Power BI reports/ dashbord ?

[sreeramch]

Cant thank you enough...you explaination is crisp and clear. Thank you for providing free material which could hve cost few hundred dollars.

[nicemovies]

Thanks mate, can't wait to go through this project!

[hasanakhtar]

Please create a Udemy course on Microsoft Fabric?

[adegunloyerebecca]

@pathfinder-analytics

Hello, Coach

We are the YAGI Team and recently reviewed your Udemy course. Your content shows great potential for sales with the right strategies in place.

Given Udemy’s competitive nature, standing out often requires high enrollments and positive reviews. We’d love to discuss how we can help enhance your course's visibility and success.

Looking forward to your thoughts!

Best regards,
YAGI Team"