Python | No Selenium | advertools tutorial

Note: Use requests to get each of the resultant/reconstructed URLs produced by the Pandas code. Remember to pass the headers with the url.
I didn't show the downloading of the pdf files as that is trivial once you are able to form the url, and the target site was just an example.

I saw this post on Stackoverflow and wanted to help. By using advertools and Pandas the code was very short and there was no need for Selenium or bs4 or Scrapy.

Visit redandgreen blog for more Tutorials
=========================================

Subscribe to the YouTube Channel
=================================

Follow on Twitter - to get notified of new videos
=================================================

Buy Dr Pi a coffee (or Tea)

Proxies
=================================================
If you need a good, easy to use proxy, I was recommended this one, and having used ScraperAPI for a while I can vouch for them. If you were going to sign up anyway, then maybe you would be kind enough to use the link and the coupon code below?

You can also do a full working trial first as well, (unlike some other companies). The trial doesn't ask for any payment details either so all good! 👍

◼️ Coupon Code: DRPI10
(You can also get started with 1000 free API calls. No credit card required.)

Thumbs up yeah? (cos Algos..)

#webscraping #tutorials #python

[EliasDabbas]

Thanks a lot for the demo and the review! I see you do a lot of scraping, would love your feedback on the advertools crawl function (crawler/scraper built with scrapy).

[networkautomation]

Didn't know of 'advertools' - looks very useful - I need to check it out!
Thank you for making this video. Keep them coming!

[monkey_see_monkey_do]

Man, you've managed to explain it without swearing)
On my side I just can't avoid expressing explicitly when trying to explain why I never use (used to be exact) Selenium.
Just to give you an idea of how much I liked this video - it makes you desiring to scrape something even if you don't need it)
I'm truly amazed by the raised level of your content in general and calm technical explanations like "it's not a tool for this job" in particular.

I want finally start seeing Ads on your videos to make sure you're getting paid for your work.
P.S. Number of subscribers of your channel has disappeared recently. Is that intentional?
Did you already get your 1000 subs?

[icematrix]

Well, i loved your approach, I'm trying to figure out how to scrape UPCs for all the products in my ecommerce shop, what was the best approach, I tried with Bs4 on Amazon, and immediately got kicked out, never used selenium nor scrapy, but I noticed most of the sites right now uses some kind of robot protection, so making them harder to scrape.