SageMaker + VS Code + Github Copilot : the dream IDE for ML?

We have all our definition of the perfect development environment for ML. For me, it's the combination of cloud-based managed infrastructure (all the way up to large multi-GPU instances), a great software IDE (not Jupyter!), and amazing productivity tools.

In this video, I show you how to make it happen by installing VS Code and Github Copilot on Amazon SageMaker. Yes, it's possible :) Enjoy!

⭐️⭐️⭐️ Don't forget to subscribe to be notified of future videos ⭐️⭐️⭐️

[wryltxw]

i don't know why YouTube didn't recommend this channel long before. youtube needs to recommend based on quality rather than merely popularity.

[roadnohand]

For the ones who struggle to install with timeouts, this lifecycle script will only work if it doesnt take longer than 5min.

Julien used a quiet heavy instance type, this lifecycle script wont work on smaller instances, and gets an timeout after 5min.
But you can install it manualy to fix this issue

[tipdub]

Thanks for sharing, Julien. I'm getting up to speed on using SageMaker Studio, and it's an adjustment being used to just using VSCode locally for software or data engineering and then deploying code to the cloud through its console. It seems to me that some people use notebooks in SageMaker almost as a CLI to not only experiment and explore the data, but to also output the scripts for executing in production. What are some alternate workflows or best practices for ML engineering that you have seen in your experience or amongst your colleagues at Huggingface? By the way, I am very inclined to try out this approach. Notebooks as an IDE in SageMaker just doesn't feel right to me.

[woshiwopa]

This is awesome! I wonder if it's possible to use local vscode and its ssh remote host function to connect to the sagemaker notebook so that I can keep all the settings and extensions on my vscode.

[matthewchung]

this is awesome but the copilot extension no longer works. if you are still using this workflow, do you have a workaround?

[dparkmit]

Thanks for the instructions. I followed them successfully, but the CoPilot plugin doesn't work with Code Server. Is there some kind of workaround to get it to work?

[_aarishalam]

Terminal commands that does training (like RASA train) are killed automatically in sagemaker code server

[Kanata]

Login with SageMaker Studio, installed the extension ok and login as well ok. But then.
[INFO] [auth] [2023-02-15T22:14:49.339Z] Invalid copilot token: missing token: 403
[ERROR] [default] [2023-02-15T22:14:49.342Z] GitHub Copilot could not connect to server. Extension activation failed: "No access to GitHub Copilot found."

Any tip?

[rubenbullones]

Thanks a lot for the video, but i have a question, is there any way to only authenticate one time for copilot? Because each time a restart instance, i have to authenticate again.

[andrijanabrkic]

Thanks for this video! I managed to reproduce to steps, but for some reason I can not edit anything inside the launched VScode, I get the error: NoPermissions (FileSystemError): Error: EACCES: permission denied.. Any ideas why this might be happening?

[kyutmeg]

Can we use this without enabling internet access to Sagemaker Instance ?

[hussainshaik]

this is awesome. just wondering can we also run code-server on google colab environtment?