Web Scraping With Selenium And A Raspberry Pi - All You Need To Know

The web and it's websites are complicated. So basic web scraping just won't cut it when it comes to things like logins, forms, and pagination. Well, let's learn how to get what we want using Python, Selenium and a Raspberry Pi.
_____________________________

📲🔗🔗📲 IMPORTANT LINKS 📲🔗🔗📲
_____________________________

• PREVIOUS VIDEO - Beginners Guide To Web Scraping with Python - All You Need To Know

_____________________________

💰💰💰💰 SUPPORT THE SHOW 💰💰💰💰
_____________________________

_____________________________

📢📢📢📢 Follow 📢📢📢📢
____________________________

[SimSimsTECHcrunch]

The YouTube legend has returned again!!!!

[UserUnknown]

Can't imagine the amount of editing this video must have took, woah! Great explanation. Thank you.

[lachlanmoore]

Use Explicit Waits when you can instead of the time module, Expected Conditions are great for this.

[cyrustakem]

I miss your videos, i don't know why youtube stopped recommending them, they are highly educative

[timothycain]

love this project. you made many aspects of programming with python INFINITELY MORE CLEAR TO ME.

[johnbushur]

Very useful. I came across selenium a while ago but wound up using excel tools instead. I’ll have to give this a try for my next project.

[jasonbailey]

We had a Perl script that we used to scrap data off of a website. They changed the way the login worked and Perl didn't support the new method (OK, it probably does, but I hate working with Perl scripts, so I I didn't bother researching after our consultant said it didn't), so I just made the users start doing the scraping manually. Now I'm tempted to give this a try to start scaping that data again.

[NitishKumarIndia]

This guys belongs to the golden age of YouTube when the things were simple.

[twys]

Great explanation and great video. I just learned about web scraping w BS4 and selenium.

[thehoneyseals]

This made me so happy thank you so much . you have no idea

[abrandnewcompany]

Beautiful soup combined with request can do everything what you want, even more than selenium. But I didn't know the NoSuchElementExist Try and catch which is really handy indeed I always use to program it myself a function like that. Thanks!

[mejia]

Gracias desde Colombia me ayudo mucho tu video

[lukasdegle]

Like it a lot!

But why don't you use a context handler while writing to files? :)

[d-rey]

where in the video did you mention running this on a raspberry pi?

[webslinger]

For hiding username and passwords I use config parser to grab from a separate file. What I haven’t figured out is how to use proxies to avoid bot detection. Sorry for the hijack but I need to ask. Anyone with a good tutorial? Thanks!

[mmuneebahmed]

Awesome, thanks! Will this selenium library also work with any social media websites or do we have to use other libraries in conjunction to selenium?

[OnixEdge]

@Tinkernut Do you have any tips on how to keep the webdriver updated if you are using the pc and chrome?

[paulmagu]

Selenium is very useful.
Any ideas of running web-scraping on the server side with selenium preferably? (Other libraries in python or Node are welcomed suggestions!)
thx.

[AliAli-rjqb]

sorry i was missing an s in find_elements so now it is working

[domasberulis]

what are your rpi specs? Mine 1gb ram RPI 3B takes 3 minutes to launch the browser