How I Scrape 7k Products with Python (code along)

A short but complete project of scraping 7k+ products with Python.

➡ COMMUNITY

➡ PROXIES

➡ HOSTING

If you are new, welcome. I'm John, a self taught Python developer working in the web and data space. I specialize in data extraction and automation. If you like programming and web content as much as I do, you can subscribe for weekly content.

⚠ DISCLAIMER
Some/all of the links above are affiliate links. By clicking on these links I receive a small commission should you chose to purchase any services or items.

[treed]

Fantastic video, I've always appreciated your expert approach and brief but clear explanations.

[andi.herlan]

Hi John, thank you for your outstanding videos especially in web scraping topic. I still cannot support you as that much, but I always recommend your channel when someone ask me where to learn scraping in Python.

[abdulrafay]

Please do share how to speed it up and other whatever stuff you do in real life. Thanks for sharing :D

[runnrnr]

NIce video! Added it to the selectolax repo as another example.

[Aaron-isee]

Wouldn’t you want to change the headers too?

[cokemaya]

Great video as usual! what would be the best approach to filter down these urls if they already exist in our database?

[RicmodUttara]

Next video is showing how easy this is to do in scrapy?

[deepbrar]

Hey john, I created a bot using selenium but i wanted to deploy it somewhere. I tried to deploy it on pythonanywhere but wasn't able to do that because for installing chrome for selenium i required root access.

I also tried with Playwright but pythonanywhere have a firewall so they blocked the ip when i ran the command "playwright install chromium"

So the question is where am i supposed to deploy them for free ??
I really want to make my project go live....

[aijokker]

Why people scrape products from some websites?