Microsoft Fabric: Creating a OneLake Shortcut to ADLS Gen2

Microsoft Fabric: Shortcut to Azure Data Lake Storage Gen2 - End To End Demo - Part 4

Shortcuts in Microsoft Fabric enable zero-copy referencing of data across OneLake and clouds. With Shortcuts, you can get rid of your pipelines that are used to copy data into your storage account - instead, the data that's required for your Fabric operations is just retrieved as and when needed.

In this video we use an Azure Data Lake Storage Gen2 (ADLS Gen2) account as the source, and configure a Shortcut in our Bronze Lakehouse so that the referenced data sits alongside our other raw data.

- 00:00 Intro
- 00:19 What are Shortcuts in Microsoft Fabric?
- 02:08 Demo - Browsing source data in ADLS Gen2
- 03:32 Where should I create my Shortcut?
- 04:46 Creating a Shortcut in Microsoft Fabric - Configuring connection
- 06:07 Configuring Shortcut settings
- 07:00 Browsing virtualized Shortcut data in Lakehouse View
- 08:04 Outro

Useful links:

Series contents:

If you want to learn more about Fabric, take a look at some of our other content:

#MicrosoftFabric #onelake #shortcuts #adls #datafactory #dataengineering #lakehouse #datalake #data #ai #analytics #medallion #bronze #silver #gold

[endjin]

Thank you for watching, if you enjoyed this episode, please hit like 👍subscribe, and turn notifications on 🔔it helps us more than you know. 🙏

[MatthewRoche]

Another great installment - thank you!

[levidevos]

Hi Ed, as a proposal for part 6, could you show us how you would go about copying files from bronze to silver and explain us the reasoning behind switching between files and (managed) tables?

[malleshmjolad]

Hi Ed,
We have loaded few tables using synapse link into adls gen2 and created shortcut to access the adlsgen2 files in fabric, but while loading the files into tables, we are not getting the column names for the tables and it is showing as c0, c1....etc which is causing an issue, can you please give some insights on how to overcome this and load the tables with metadata also

[moeeljawad]

Hello Nice video. could you please explain from where exactly did you get the dfs url that you had pasted in the ADLS shortcut connector? in my url i am having a blob part in it and that is preventing me from doing the connection. Thanks

[ChrisDowns]

Once you have the shortcut connected, would you be converting it into a table format? I've seen that you can do this by right clicking and selecting 'Load to Tables'. However, how does this work when the .csv you're referencing has new potential columns/rows added to it? Would it pick this up on your lakehouse table? Thanks :)

[johnsonbolaji]

Hi Ed, how did you ingest the ONS postcode directory data into the ADLS in the first place. Did you upload it?

[ullajutila]

The video was ok, but it did not explain how the ADLS storage account networking needs to be configured. More specifically, how to configure it in a secure manner, without allowing access from all networks.