How to load data into PostgreSQL using Python | Your first ETL pipeline | Data Engineering Tutorial

What are the basics you should cover when you build an ETL pipeline?

🎬In this episode I am showing you how an ETL process would look like. We are going to load the data from Task 8 and load it into our local PostgreSQL database.

✨If you are new here:
This is a public and weekly online Python Class which you can attend as well. All you have to do is to join our Discord server if you are interested! Links down below :)

==== CLASS STARTS AT 4:30 ====

⏱ Timestamps
0:00 Intro & Agenda
1:00 Recap - How to start web scraping using DEV TOOLS
4:30 Example how my ETL pipeline would look like
9:30 What is a logger?
17:00 Test the database connection
27:25 How to create a database table based on your data
42:00 How to extract the .json data and load into PostgreSQL

========================

If you want to learn how to become a programmer and build automated software, this video is for you. Feel free to drop them in the comments or join our socials!

========================
🙋‍♂️Community Discord:

📲 Instagram:

📩 Connect with me:

Subscriber: 1174
#dataengineering #pythontutorial #dataanalysis

📚The FASTEST way to become a Data Engineer:

📚Knowing this about DATA will shock you:

📚FREE Python Programming Class:

[dogedingo]

Also very interesting how powerful try and exception blocks are! Definitely going to implement them more into my code.

[evaristusokey]

Good one sir, however, I didn't get to understand how am supposed to download data straight from a website into the postgres using python

[sarahcross]

this was super helpful, thank you. do you have a tutorial that explains how to load the data to PostgreSQL when the json data is nested?