AWS Crash Course for Python Data Science with NVIDIA GPUs: EC2, IAM, SPOT, Tunneling

In this video I provide a tutorial for launching EC2 instances for use with data science from Windows 10. I show how to launch a spot instance to save money, preparing a Putty PPK, and using a Putty tunnel to access JupyterLab.

Putty

WinSCP

Commands from Video

nvidia-smi
top
docker run -it --rm --gpus all -p 8888:8888 tensorflow/tensorflow:latest-gpu-py3-jupyter

0:55 AIM
3:10 Launch EC2 and Key Pairs
4:49 Instance Details and Spot Instances
6:51 Login Key Pair
8:32 Login to EC2 Instance with Putty
9:03 Generate a Putty PPK File
10:21 SSH Tunnels and Putty
16:42 Jupyter

Follow Me/Subscribe:

[KeyserTheRedBeard]

magnificent video Jeff Heaton. I smashed the thumbs up on your video. Always keep up the superb work.

[xlxlxl]

Jeff, thank you for the intro, would love to hear more about using S3 and more advanced docker usage.

[alex-gqm]

The tunneling trick is a very cool! I like the approach that you are using for running the training in way that is really cloud agnostic, as opposed to using their Sagemaker framework that would automatically spin up separate instances when you train your models and your data must also reside in S3 so that these instances can access it. Now, that might scale a little better for larger training jobs and they handle everything for you behind the scenes...however, I still like your approach better as you are much more in control and you could even fine tune the process locally before you run the actual training in the cloud.

[BasilioMoreno]

Thank you! Extremely useful video. Iwould love to see more on AWS for data science.

[caligo]

Great help thanks Jeff I am looking forward to video about managing everything with python and mounting local volume.

[johanhagner]

This was really great. These are the sorts of things I can spend a weekend on and just ragequit.

[RobertJohnson-xgkh]

Thanks Jeff! Would love to see more videos like this.

[joliver]

This was definitely helpful. Pem and ppk files have always confused me.

[muralimayhem]

Hi Jeff, Love your videos.
Why did the video pan away from the cursor from 12:08? It would have been good to see the commands that you type. I was only able to spot nvidia -smi

[mitchellthompson]

More AWS and MLOps. Do you have a tutorial series on Docker as well?

[manuelillanes]

Hi Jeff, is AWS better than Colab? How much money you spend on AWS for a project?

[orjihvy]

Why not Google Cloud? Just that AWS doesn’t have free trial.