Microsoft Fabric: Load local SQL server data in Lakehouse using on-premise Gateway| Dataflow Gen2

In this video of Microsoft Fabric, I will show to load data from an on-Premise SQL server to Lakehouse using the on-premise gateway with help from Dataflow Gen 2

Microsoft has Microsoft Fabric, the next-generation Analytic Platform. Check out how to enable it on Power BI Service. How to start a Fabric (Preview) trial
The Microsoft Fabric Platform provides customers with a SaaS-ified, open, lake-centric(One Lake), full-featured data, analytics, and AI platform that meets all their data estate needs. Power BI, Synapse Data Warehouse, Data Factory, Spark, and Notebook all under one platform

00:00 Install On-Premise Gateway
03:00 Create Dataflow Gen 2 with Gateway
06:00 Map Destination to Lakehouse
09:00 Publish Dataflow Gen 2, and Load Challenges
12:30 Create Model and Analyze data in Power BI Service

🔵 What is Microsoft Fabric
Microsoft Fabric is an all-in-one analytics solution for enterprises that covers everything from data movement to data science, Real-Time Analytics, and business intelligence. It offers a comprehensive suite of services, including data lake, data engineering, and data integration, all in one place.

With Fabric, you don't need to piece together different services from multiple vendors. Instead, you can enjoy a highly integrated, end-to-end, and easy-to-use product that is designed to simplify your analytics needs.

Don't forget to like, comment, and subscribe for more great content!
▶️Data:

---------
▶️Follow me on:
---------
▶️My Other Videos:

-~-~~-~~~-~~-~-
Please watch: "Microsoft Power BI Tutorial For Beginners✨ | Power BI Full Course 2023 | Learn Power BI"
-~-~~-~~~-~~-~-

[azobensadio]

Thanks so much for this great presentation

[bulubrr]

Hi,
i installed the on premises data gate way and it shows the gateway is online ready to use while i'm connecting to the sqlserver in dataflow gen 2 it was not establishing the connection for my SqlServer i given all the credentials like ServerName and database name and username and password and it was showing the error and also it was not showing the datagateway in the connect data source...
Connection could not be created. This may mean it is not accessible from this network or at this URI, or that a gateway is required to access this data source. (Session ID: c0bbfcd3-7712-4c40-a022-b0f448c24f12, Region: us)
and
A network-related or instance-specific error occurred while establishing a connection to SQL Server. The server was not found or was not accessible. Verify that the instance name is correct and that SQL Server is configured to allow remote connections. (provider: Named Pipes Provider, error: 40 - Could not open a connection to SQL Server)

[majeedadil]

Thanks for sharing. How about loading SQL Server data residing in cloud as part of a VM from Data Factory to Fabric Warehouse instead of Data Flow G2?

[manishagujralkhanna]

Hi Amit does fabric store a copy of this data and where this data exactly stores in fabric

[vishwassee]

Hi Again Amit Thanks for your previous reply i was able to resolve the error. Is there a way i can connect to On-prem SQL server using Fabric Notebook?

[vishaljuneja]

Thank you Amit for great explaination, but I would like to know as I want to manage the direct connectivity of data from SQL on premise to lakehouse so how to do as so in process you showed we need to apply schedule refreshes which is again come with limit so I need direct connectivity so any changes made in data it should reflect in our lakehouse and then over power bi reports too. How this can be achived

[huongbui]

I followed your steps and got a problem that I couldn't choose Destination target. It rotated always when I wanted to open a warehouse (in my case, its name is WH004) to choose an existing table. This problem did't happen when I connected to Github or loaded a csv file.

[saumyakapoor]

great ! Looking forward to Purview hub integration with Fabric. When i try to launch it as an administrator, it just shows :

Loading Microsoft Purview hub (preview)...

[anmolmalviya]

Hello sir, can we set refresh for on premise data

[vishwassee]

i am getting this error after i publish error: GatewayCannotAccessSqlError Couldn't refresh the entity because of an internal error any idea how to fix it?

[yakkalaakhila]

Could you please tell which name have to give for the connection and database in connection settings.

[dbsql]

Disappointing that it only works with SQL server data sources.