Scrap Data from JavaScript based Website [Python Selenium]

Using BeautifulSoup or Scrapy Framework we can easily scrap a normal website where the HTML files are generated from Server. But if a website uses any JavaScript libraries like JQuery or ReactJs or Angular to dynamically create the HTML data, then we can not simply use the BeautifulSoup library or scrapy framework to scrap the data. To solve the problem, we can use the Selenium web scraping tool which has Python support. So in this episode, we will learn what is Selenium and how we can use it to scrape data from the JavaScript-based website.

#selenium #python #javascript

[MrToweleySlowMo]

Really helpful, thank you from Ireland!

[Hydra-BR]

Thanks a lot, i'm starting at Selenium and that video was very helpful :)

[amirahmed]

very much helpful to start selenium with python,
Thanks a lot

[mousbouchamekh]

Thank you Mahmud, that was helpful to get my hands dirty with Selenium...Gratitude

[asifabdullah]

how can we collect data for example i need name email and website

[salimhossain]

just amazing dude.... great great great thanks...

[ldphuoc]

really helpful, thank you so much!!!!

[ivanspiderman]

I have no trouble pulling the data, however my cmd with the data closes automatically

[adityapandit]

Is data mining or web scraping good career.?

[vinaysingh]

Hi Sir, I like your articel, can we o this with .net and javascript? if it is pls share the code if you have and suggest me

[__-detu]

Hope series tutorial brother on selenium

[sharaths]

How to change Grofers location using python selenium in automated way

[PawanKumar-kljs]

New package available that automatically checks and downloads chromedriver: