Microsoft Fabric Spark integration and VS Code

Welcome back to another episode of Fabric Espresso DE&DS series. In this episode, Qixiao and Estera will discuss VS Code, The Synapse VS Code extension and Microsoft Fabric Notebooks.

The Synapse VS Code extension supports a pro-developer experience for exploring Microsoft Fabric lakehouses, and authoring Fabric notebooks and Spark job definitions. Learn more about the extension, including how to get started with the necessary prerequisites. Visual Studio Code is one of the most popular lightweight source code editors; it runs on your desktop and is available for Windows, macOS, and Linux. By installing the Synapse VS Code extension, you can author, run, and debug your notebook and Spark job definition locally in VS Code. You can also post the code to the remote Spark compute in your Fabric workspace to run or debug. The extension also allows you to browse your lakehouse data, including tables and raw files, in VS Code.

🎙 Meet the Speakers:

👤 Guest from Microsoft Fabric Product Group: Qixiao Wang, Principal Program Manager in Microsoft | Fabric Spark



👤 Host: Estera Kot, Senior Product Manager at Microsoft.



👍 Like this video? Don't forget to hit the 'Like' button and share it with your network!

🔔 Stay Updated: For more insights into Microsoft Fabric Data Engineering and Data Science, and all things tech, make sure to subscribe to our channel and hit the notification bell so you never miss an episode!

[GuillaumeBerthier]

Great Job @Qixiao & team ! Let’s hope that any future Fabric Copilot will be integrating this VS Code for Synapse notebooks experience

[mattstainsby]

I want this to work so badly but the config is turning out to be really difficult.
For my kernal I can see fabric-synapse-runtime, however, when I'm running, spark is not being recognised

[saravananbc]

Hi ESPRESSO team, the Demo video very small size not able to see in the laptop, please zoom out while walthrough the demo

[flavioleccese]

please add support to sparkR... this extension is the only thing allowing to actually use fabric notebooks (how would you expect to write code without an autocompleter on the platform?) and R is an important piece for many

[Patches]

Is it possible to use mssparkutils or another module to interact with the lakehouse (e.g. modify directories)? I ran into issues when I tried; not sure if that is user error or a lack of functionality.

[dionisiysuvuy]

I hope save of notebooks works better then now in fabric UI

[ferraresso]

obg pelo vídeo!
thx for the video, bro!
Arigatou Gonsaimasu!
Muchas gracias!
Danke!
Yo soy grato!
Viva la vida é uma festa!

[emersonafonsopaludeti]

Não dá para ver nada, pois o vídeo é muito pequeno