use selenium chromedriver to extract information from a website in Python

preview_player
Показать описание
Take a seat and enjoy some serious python selenium programming done by the one and only American Developer!

If anyone had difficulty with how to use google developer console here is a link that can explains how to use it:

Or... if you would like me to create a video about how to use the google chrome developer console, I would be more than happy to make one!

This video covers simple selenium code that will allow you to extract all ticket price information from a website.

As you may have noticed, I did use the xpath call "//*" which simply means everything within a given part of the DOM.

This is how I have been able to use selenium on dynamically based webpages like gmail. This is just a sample of it from the video:

The following concepts are being used in this python tutorial:
for loops
class
object usage
functions
variable declarations
selenium function and class calls
chromedriver

selenium selenium selenium selenium
selenium
selenium
selenium
selenium
selenium
python
python
python
python
python
python
Рекомендации по теме
Комментарии
Автор

You are awesome my friend... I appreciate you taking the time to share some knowledge. :)

alexcano
Автор

I am planning to add a video to this series tonight. The video will be about to how properly install and configure your vagrant environment to run these web scraping automated scripts!!

TheAmericanDeveloper
Автор

Everything was going well until I tried the expediaUnitTest(). It's throwing the following error: AttributeError: 'expediaUnitTest' object has no attribute 'driver'. Any suggestions?

vinven
Автор

6:01 "You thought I was going to say it again" I died laughing for 5 minutes

alexcordero
Автор

Hi I would like to learn on what the purpose of that classes.I don't have any idea about python. Thank you. :)

automationra
Автор

did you have the source code in github?

amaalasaad
Автор

how can i use it to extract data from multiple pages.. i am trying to extract reviews from ecommerce website but unable to do it for multiple pages.. It would be great if u can help on this!!

shubhamgurav
Автор

Thank you for your excellent video - unfortunately Expedia changed the web page as far as I can figure - now when trying to enter a return date it gets overwritten by the departure date

gestionsservicecm
Автор

Your presentation is spot on. Could you please make a video on how Selenium addresses random pop ups and modals? Many thanks....

fasertaser
Автор

Why not use the XML it makes picking what you are looking for quicker. 11:50

andrer.
Автор

what about infinite scroll ? can u make the tutorial :))

irfancandra
visit shbcf.ru