A Better Web Scraper - 3 Steps Demo Python Web Scraping

In this video we run thorugh a demo of the 3 steps to scraping sucess from my previous video. I break down each part and show you how to use functions to build a better web scraper with Python. We scrape products from a woocommerce site and work through some pagination to get all the products and prices.
-------------------------------------
-------------------------------------
Disclaimer: These are affiliate links and as an Amazon Associate I earn from qualifying purchases

[NeilSpeed]

Hey John, thank you for sharing - your skills are really appreciated and has given some inspiration to me.. I have never coded in my life and I have been able to follow along your scripts and instructions! Can't wait for more videos!!

[engineerbaaniya]

Awesome work best YouTube channel for understanding scraping

[shacharbard]

Kudos mate, you're awesome. i'm learning from each one of your videos. you definitely should create a Udemy course or something. would also be great if you could do live sessions with Q&A

[victormaia]

Thanks for the methods! I usually fell satisfied when I run the codes once, but when I have to revisit it sometimes I get lost reading the codes, will try to put it in action.

[nurlansalkinbayev]

Hello John. Nice to meet you. Very informativ AND helpfull video. Thanks for your code.

[Kumar-lbzg]

thanks for the info and well explained you gained a new sub

[fbzz]

Very useful video, ty 4 sharing.. new sub.

[antonioja]

Thanks for the videos. You're the Best teaching about scraping in YT...
Would u make a vídeo about export all the data to API or something?
Thnx
I really think that you love alcohol xD..

[celerystalk]

Yes to functions. DRY: don't repeat yourself.

[daddy_eddy]

Thanks a lot!
This is website is dinamic. How to make a scroll befor end page. Because we do not know what need range()

[NeilSpeed]

Hey John, Quick one for you... do you think you could do a tutorial which shows the error handling for non-existant pages?

[phantomsixtrading]

Could you use something like this as the foundation for setting up an email alert when a sold-out item comes back in stock?

[madhuj]

Thank you.

How to work with aspx sites n dropdown pagination

[phantomsixtrading]

The website has changed the structure to 'li' class now and I cannot get your program to work the same with 'li' vs 'div' - please help

[harshgupta-dscw]

Can you build a web scraper to scrape ott platforms? Please

[David-mjst]

Hi John, I decide to learn all you tutorial on this channel.Nearly 2 years have past, there are some changes in this web.I use get name, because \n apearing at both head and tail.Use {item.find('span', class_='price').text} to get the price.Before these, I use {soup.find_all('li', class_='product')} to get the block of each product, I was a bit worried about geting unnecessary infomation for 'product' is so common, fortunatly it work well.
I also got problem when run 3step.py(it's my file's name) in terminal, and changed name to step.py.I use pycharm in windows10, i guess int couldn't be put at the begining of a .py file in windows10.
I also need to improve my English😂.I am in lockdown in china for covid, at least 10days can't get out the comunity.
Maybe its a chance to learn more.
Best wishes for you!

[niteshkanojia]

how to scraoe woocommmerce websites with one script