Let's Build a Python Web Scraping Project from Scratch | Hands-On Tutorial

💻 Web scraping is the process of extracting and parsing data from websites in an automated fashion using a computer program. It’s a useful technique for creating datasets for research and learning.

🔗 Resources used in the workshop:

In this workshop, we’ll use Python and its ecosystem of libraries to scrape information from a website and create a dataset of CSV file(s).

Here are the steps we’ll follow to build a web scraping project from scratch:
✅ Pick a website and identify the information to be scraped into a CSV file
💾 Use the requests library to download web pages from the site programmatically
💬 Use Beautiful Soup to parse and extract information from web pages
📝 Create well-formatted CSV file(s) with the extracted information
✍ Document and share your work online in the form of a Jupyter notebook or blog post

⌚ Time Breaks:
Introduction 00:00
Problem Statement 7:03
Setting up Jupyter 15:09
Fetching pages with requests 25:26
Parsing pages with beautifulsoup 33:27
Saving data to CSV files 1:01:41
Scraping another page 1:03:10
Defining functions 1:11:28
Putting it together 1:30:35
Documentation 1:56:04
Publishing your notebook 2:26:13
Q&A 2:28:22

🎤 About the speaker
Aakash N S is the co-founder and CEO of Jovian - a community learning platform for data science & ML. Previously, Aakash has worked as a software engineer (APIs & Data Platforms) at Twitter in Ireland & San Francisco and graduated from the Indian Institute of Technology, Bombay. He’s also an avid blogger, open-source contributor, and online educator.

-

[sakata_gintoki]

Honestly this is one of the best Youtube Programming tutorial. You make it from scratch and discuss it elaborately. Hope you can make more awesome teaching videos in future.

[JosepOriol]

That was an excellent tutorial, as always! In Jovian we trust!

[Afri_Data]

As a beginner struggling with web scraping for over a week. after watching the video, i've been very confident with beautiful soup and also been recommending it to my college on our Data Science community forum. Thank you

[hemantvardani]

After watching this video, I became fan of your teaching . Thank you Aakash and Jovian
Thanks for this beautifully curated video.

[myelifek]

Thank you Aakash and Jovian team for the webminar. You guys rock!

[datamanku]

What a BEAUTY, what a beauty, the best web scraping video on whole youtube

[Lotaristo]

I really like this guy. Although I'm sure that he's experienced one, he's doing work from the perspective of a total beginner - and that's very good option. Although the are many tutorials where people could make similar stuff in much less time, they mostly have a lot of details which hard to remember, and more appropriate for more experienced users, which could do at least basic or intermediate stuff without any problems and which just need to learn some new syntaxes and use it - but for beginners there are a lot hard-to-understand things, and I'm sure that to show them as many details as possible, simplify things and repeat even most basic things time after time (even if it takes more time) is the most appropriate way to learn something new.
Also this recommendation not only to write code, but also to create a plan and move according to it - I'm totally agree with it - if you are new with any tool and don't know what and how you should work, planning will really help you to move forward much more smoothly (alas, almost noone makes such good plans - if there are comments in a code it's already nice thing to have).

[happyjohn]

I just can't trust a man who doesn't use a dark theme when there is one available

[chetanvgoudar]

I saw many vid on youtube about scraping but this one is a lit.. thanks jovian for this awesome content and crisp explanation..
Waiting for more videos on data science ❤️❤️

[PriyankaDebnath-gi]

Thank you so much. Your code helps me so much that I can't even explain how much it helps me.

[sonukumarjagylan]

superb...it was very confusing for me earlier but after watching your video regarding scraping i have completed this project in one go...carry on plz upload more videos

[devendrakhanolkar]

You are Absolutely methodical and good that you have revised and summarise the topic. Your voice and ability to teach is impressive:-)

[janicejose]

Such a precise explanation, amazing content, really impressed!!

[nehagarg]

Thank you for this project and explaining it line by line. It really helped me a lot to do web scrapping project.

[MohammedAli-kldw]

Thank you. This project was very detailed and so very usefulful for beginners like me. You put in a lot of efforts for this. Thank you once again for your genuine efforts sir. I wish by the grace of God you grow by leaps and bounds and along with you we also catch up.

[muhammadusman-jerl]

this is vedio is one of the best vedio after learning basics of scraping. infact i have taken a course from coursera but this vedio is best as compared to that course...

[athanikarammy]

Great tutorial Aakash sir....please do more ...your way of methodologically describing the things and explaining them are great.

[sachinsoni]

One of the best tutorial ever followed🙂. Great work Aakash sir🎉

[sahuanvesh]

best video on web scrapping till date brother..

[nathanalabi]

I must say this is Top notch!
Thank you for this sir!