Python Selenium for Beginners — A Complete Web Scraping Project (Scraping Dynamic Websites)

In this tutorial, we're going to learn web scraping with Python using Selenium. We'll learn Selenium by solving a complete project from scratch. We'll see how to install Selenium, learn how to find elements, click on a button, select elements from a dropdown, extract data from tables and export it into a CSV file. If you liked this introduction course to Selenium, you're gonna love my web scraping course in Python.

--------------------
Content:
0:00 Intro
0:30 Installing Selenium and Chromedriver
2:50 Importing Libraries and Creating The Driver
6:45 Clicking on a button with Selenium
13:24 Extracting data from a table
25:52 Exporting data to CSV file with Pandas
31:29 Selecting elements within a dropdown

[yunusemresurmeli]

This is the best Selenium tutorial on youtube. Thank you for the tutorials.

[emammadov]

This is the best selenium tutorial video I've come across so far. Kudos to you, mate!

[mauriciovalercampos]

Now I understand how to make loops and export everytNice tutorialng really god bless you.. your way of explaining simply aweso I loved it

[zdpompc]

I've just watched this video. Morever, it's really powerful that helping me understand it. Thanks a bunch

[afiraaslam]

this made web scrapping with selenium so easy for me Thank you

[suna]

Don't give up mate, that was my first day to use soft soft and i will work on it for a long ti!

[profeme]

Very nice video and a great introduction to Selenium and web scraping with python in general 🙂

[FarizAbdan]

Thanks!!! Great tutorial!
With some code modification I can completely scrape dynamic website.

[harshinibhat]

Thanks a lot Frank . This video helped lots

[MrWoodstock]

Great beginner video man. Appreciate it!

[MukeshYadav-wbuo]

your lecture is so very helpful. It is awesome love you from India.

[ckksnyoutube]

Thanks for this, helped me understand why .ui and select

Need to understand .common, and .exceptions

[shazz]

One of the best videos with amazing teaching quality bro you are far better than many of the professors out there.
In this video instead of Spain if i want to select and scrape informations about all the nations and their leagues is there any simple way?

[nadineuwurukundo]

Thank you PyCoach. This video is very helpful. Can you please do us a video on how to scrape reviews from trip websites that are embedded in multiple pages?

[sumpeter]

Hi Frank, I have a quick question. Is it possible to write a complicated python script that can interact with different kinds of websites for automation, or do we have to write script for every website different and script must be customized? thanks

[sumudukanchana]

Great video. very very valuable video.

[buraks.]

This is cool. I've just read your medium article. Keep up the good work

[benloder]

Hi Frank - great video for me as a newbie.
I managed to get the csv file to create and save to my projects folder but some of the scores are represented as dates in the file, e.g. 02-Mar, 02-Jan. The data in the text editor is fine though.
Is this just an issue with Excel saving the score column export as a mixture of 'General' & 'Custom'?
Is there any solution to this?
Thanks. [I'm using python 3.10 and Atom editor on Windows].

[hipockt]

Frank, the website you are using now has season 22/23 that is blank. You are showing 2021 season that is populated. I am assuming that is why your code works and mine does not. Is there a work-around for this?

[aniruddhasreenath]

If you are using webdriver manager along with selenium then how would you append data?