Microsoft Fabric: Import On Premise SQL Server Data into Fabric SQL Database!

Azure SQL Database in Microsoft Fabric, aka Fabric SQL Database, aka #FabSQL is here! Now we need to get data into it! In this video Bradley Ball, aka @SQLBalls , guides you through installing an On Premise Data Gateway, connecting it to your #MicrosoftFabric Tenant, and then building a Dynamic Data Pipeline to import the data into Fabric SQL DB!

Chapters
00:00 Dynamic Import for Fabric SQL Database
00:58 Demo Enable Fabric SQL Database at the Tennant
01:36 Demo Create Fabric SQL Database
02:03 Demo Install On Premise Data Gateway
02:52 Demo Create Connection to On Premise SQL Server
03:38 Demo T-SQL Query to Dynamically Get Tables & Schemas
03:58 Demo Create Dynamic Data Pipeline to Import Data
07:18 Demo Validate Data Transfer
08:01 Demo Check the Mirror for Replication

SQL database in Microsoft Fabric (Preview)

Microsoft Fabric decision guide: choose a SQL database

Install an on-premises data gateway

Data Factory documentation in Microsoft Fabric

Ingest data into your Warehouse using data pipelines

/*******************
/CONNECT WITH US!!
/*******************

Tales from the Field

Bradley Ball

Daniel Taylor

Neeraj Jhaveri

Josh Luedeman

Andrés Padilla

[UsmanBinIhsan]

Thanks a lot for explaining. Great Video.

[robcarrol]

Great video, thank you. I deployed #FabSQL in a client environment yesterday. They were going to use a Warehouse originally but now they have the option of SQL DB inside fabric, they are going with that instead 😊

[Blackout-ungw]

Cool - but this is just a one time sync, right? You mentioned something about "mirroring" and "replication", but that usually refers to continous synchronization. Someone else mentioned CDC, which we've been trying to work with, but it seems like the only way is to implement a custom solution for it until SQL Server 2025 is released (with, allegedly, Fabric Mirroring integrated).

[MarkBrady]

Trying to pull data in from a 2019 On Prem...Anyhow, at the 6:20 mark in the video regarding the destination, I receive an error. Error code 2105 "The value in key 'AccessToken' is not found". Any thoughts off the top of your head? Thanks

[SANTHANAMLAKSHMANAN-dt]

This is awesome, thanks for the video.

also, I believe this is for the first time when a DB has to be moved to azure sql in fabric. but what about the everyday data being moved to new fabric sql db.

any info on that would be really helpful for next step in this solution

[timcrowther]

This is really really helpful! One question, you are mentioning that you have replication happening at the end there 🤯 is this automatically happening with the pipeline? What's the additional set up for this? please please help!

[ifeadeniyi]

Can we look at how to subset and anonymize/sanitize data during the import process from On-prem SQL Server to FabSQL. This helps in certain compliance cases when real PII needs to be protected (or not replicated as is).

[retrisagod]

Be nice if the fabric pipeline had CDC built into on prem sql -> "fabsql".. ADF does this (in preview?) but won't work with an IR. This would be very useful instead of having to roll your own CDC handling methodology across the gateway..

[mdhruv]

Would be real cool if you can show the steps to us a backpac backup file to restore in sqlserver . I think you have to use the az cli for that to work . Store the bac file in the lake house and show us how to retrieve it