How to Schedule & Automatically Run Python Code!

In this video we learn various methods for how we can schedule and automatically run python code. We'll start by looking at cronjobs & windows task scheduler and then we will walk through running tasks in the cloud using AWS Lambda & Cloudwatch. The ultimate goal of this video is to learn how we can automatically generate & send an email with an analytics report every day.

There are methods highlighted in this video that will work on Mac, Linux, & Windows.

~ GitHub resources ~

~ Relevant videos ~

~ Articles mentioned ~

~ Other resources ~

Thank you to Skillshare for sponsoring this video!

-------------------------
Video timeline!
0:00 - What we’ll be doing in this video
0:56 - Check out Skillshare! (sponsored)
1:56 - How can we automate scripts? Overview of local, cloud, and serverless methods
5:18 - Simple example of local script automation w/ cronjobs & windows task scheduler
18:32 - How to schedule code on a cloud machine (use cronjobs)
18:51 - Simple example of cloud script automation w/ AWS Lambda & Cloudwatch
27:09 - Schedule & automate sending an email locally
45:12 - Schedule & automate sending an email on the cloud w/ Lambda & Cloudwatch
50:18 - Installing python packages in a serverless environment (zip uploads)
55:50 - Generate & schedule sending analytics reports (locally)
1:02:45 - Generate & schedule sending analytics reports in AWS Lambda
1:07:03 - Limitations of lambda (max file upload size)
1:09:00 - Generate & schedule sending analytics reports in AWS Lambda
1:18:32 - Final thoughts & video recap!

-------------------------
Follow me on social media!

-------------------------

Practice your Python Pandas data science skills with problems on StrataScratch!

Join the Python Army to get access to perks!

*I use affiliate links on the products that I recommend. I may earn a purchase commission or a referral bonus from the usage of these links.

[KeithGalli]

Hope everyone is doing well! If you have any questions about the material covered, let me know in the comments :)

[tyswenson]

Keith continues to read my mind with video ideas..

[krystianmasiak]

Man, I just want to say thank you. You showed me python, now i'm looking for job in Data Science and i'm much above my friends from studys on that specialization, so...

THANK YOU! <3

[justin]

I just found your channel a few days ago and it’s already become my favorite python channel. I really love the real world examples. Fantastic content. Please keep it up.

[RougeSam]

I LITERALLY just needed this solution. Let’s go Keith

[cambridgebreaths]

Keith, how to motivate an absolute beginner to start delving into this giant ocean of programming, honestly feel overwhelmed just opening a book or watching a video, even your amazing videos. THANKS

[xxpwnrlifxx]

I'm new into web-scraping. For school, I'm trying to create a project comparing food prices in in different settings like Chick-Fil-A in stores vs Chick-Fil-A in airports/malls. I watched your other web-scraping videos but I think a video about scraping then converting it over to an excel/csv file would be very nice! Thank you for all the content you do post!!!

[sarathk]

You are so committed in what you do in all your videos. Thank you so much since I wanted a script I wrote that taps into SQL server -> dB -> Tables -> data frames and dashboard output to run automated....great timing and awesome video

[itsmesanto]

This is great. Better than paid tutorials out there. Thanks for providing it for free.

[ed-salinas-]

This video showed up on my recommendations at the right time. YouTube reading my mind. I've been trying to wrap my head around Cloud Functions for a while but had not seen any suitable examples until now. Only problem for me, though, is that I want to be able to use Google Cloud Functions, and it's not really clicking for me to translate what you show with AWS Lambda to GCP Cloud Functions. I'm hoping it'll "click" at some point since I'd rather use the GCP Ecosystem. If it doesn't, I'll switch over to AWS Lambda since what you show in this video does seem to make good sense and will make for a good template for my particular projects. Thanks!

[saulflores]

This is an amazing resource. I'm using what I am learning from these videos for projects in my internship. Thank you!!!

[tellulois]

Well done! Bro, Keep making such beautiful Videos

[theholybananaaaandthemiley]

Amazing Content. I appreciate the effort!!

[NoahElRhandour]

i really appreciate the creative and useful tutorial topics

[legacies]

I hope some day you will do a video on custom models in Keras and other advanced stuff

[immanuelsuleiman]

This is incredibly useful
great job as always
thank you

[EUU]

Thank you for your clear delivery and explanations, loved it. Gave me what i was looking for plus also taught me about other methods and just more general knowledge about python windows and linux. I wish you all the success and happiness you desire

[radabbadaa]

Awesome vids from this channel. Keep it up!

[Qibbles]

I use a raspberry PI zero to run my scripts and cronjob. Hardly any overhead and I can leave it 24/7!

[venn]

Man I love your vids you are the best! Its hard to get a nice answer because everyone calls themselves professionals these days but you are the gold. So here goes my question: Is there any real great book/books or courses you can suggest for python oop + algorithms in general? Also a personal question >> which programming languages you think I should crash? In school we started with python but I find c++ so fun as well.. or what other languages I should master for getting a good job and being well skilled? Really hoping you answer me.Thank you 😭🥺