Understanding OneLake within Microsoft Fabric

The key to Microsoft Fabric is definitely OneLake! OneLake enables the reuse of data within Fabric to help drive all of the engines. One copy of the data! Josh Caplan joins us to help get an understanding of the power of OneLake.

OneLake, the OneDrive for data

OneLake shortcuts

OneLake File Explorer

Josh Caplan:


*******************

Want to take your Power BI skills to the next level? We have training courses available to help you with your journey.


*******************
LET'S CONNECT!
*******************


***Gear***

#MicrosoftFabric #OneLake #GuyInACube

[lwhieldon]

This is so cool! I can see this being a quick but powerful win for small businesses that want to harness their data without having a ton of overhead in getting services up & running!

[wmcnabb]

Adam and Josh - thank you for the demo! As always...awesomeness has been extracted.

[lopypop]

Wow! This was the best explainer so far! I'm interested in tracking when other external sources will be available via shortcuts because my organization keeps data warehoused in other (non-Amazon) sources.

[Bharathrs]

What's the performance impact of having data as shortcut compared to having these in one lake when we use it in different engines especially direct query on power bi

[jason.campbell]

Can a shortcut be established to an on premise SQL server? Or, is it possible to sync OneLake with (on-prem) SQL server tables?

[kingnemmi]

Thank you so much for the demo!! I have a question regarding a potential use case for this. I have a client that has multiple data locations, they're still moving into the cloud scene however they currently utilise an Access Db for a particular set of data. If this db was hosted on a vm within azure, could OneLake potentially reference data from Access Db?

[vantuandang]

Does anyone know if DirectLake is as performant as the import mode?
As far as I know, each workspace is located in one region: do we pay cross regions transfer costs when using a shortcut between two workspaces located in 2 different regions?

[zubingidwani]

Do you see anything on the horizon to allow an ISV to provision a onelake, setup domains and grant external guest users (the ISV's customers) access to different paritioned datasets? In otherwords is there anyway for an ISV to grant lakehouse to their SaaS customers?

[jenlam]

Hi Adam, it would be great if you can do an end to end demo on how to use Fabric based on a company scenario. 😉

[sandeepbarge]

Is my understanding correct that structured data is stored in Onelake in .Parquet files? If so how efficient is it as compared to storing data in RDBMS like SQL server?

[inkuban]

If we use a different source other than S3 like ADLS for example can we still load the datasets directly from those external sources within our Power bI REPORT.

[bladerunnerisback]

Great stuff, thanks for sharing. Any chance to have a shortcut for Snowflake coming soon?

[phyberoptx]

Do we have an eta on the shortcuts for Dataverse? Will there be shortcuts for Business Central as well?

[mnhworkdev]

Can a on-prem SQL server be set up as a shortcut by using a remote gateway? This would ensure that our data at rest would still be on-prem.

[FredericLEGUEN-Excel]

It looks fantastic. I have a question. I use to store my data in Azure SQL. Is it better to migrate my data from Azure SQL to OneLake or it's better to stay like it is now.

[martinbubenheimer]

I like the shortcut table feature! Is there also a way to create shortcut tables to REST APIs or OData web APIs so that I can get the latest data from source systems like Sales Force or Business Central without copying the data on a schedule into OneLake where it will eventually get outdated or is missing columns I need at all?

[ncbshiva]

What is the difference between data in onelake and data in adls gen2 datalake ?

[adolfojsocorro]

Hi, I understand Premium gives you access to Fabric's features. But is OneLake priced separately?

[brenp]

Amazing vid. Very informative.

Question:

Is it possible to have a deeper dive into the inner workings? All the Marketing and Sales sessions/materials/etc. repeat the line (or something similar) that: "it's one OneLake and you can have one Fabric on top". Josh mentioned in this video that whoever owns (uploaded) the data, say to your store DB, continues to own it and the OneLake consumer gets a copy.

I'm curious on how this is actually working. The last thing I want is our data and analytics team "connecting" to our application data stores and running crazy queries on our operational data.

Given Josh said it's copied data, I'm curious to know more and what that means for debugging missing data, eventual consistency, atomicity, etc.

Thanks!

[joanguerette]

What if we have a DataHub, can we connect the MS Fabric One Lake to our DataHub ? Do we have to do data governance in 2 places ?