How to Web Scrape Data from Multiple URLs | Scrape Data From a List of URLs

Web Scraping projects can get quite complex.

For example, you might be trying to extract data from multiple different URLs from the same website.

We are ParseHub and today, we will go over how to set up a web scraper to extract data from multiple different URLs.

0:00 Intro
0:24 Downloading ParseHub
0:32 Setting up your web scraping project
0:55 Importing list of URLs
1:44 Using the loop command
1:56 Begin new entry command
2:16 extract command
2:33 Go to template command
3:17 adding another select command
3:48 Running your web scraping project

---
Follow Us

#webscraping #scrapemultipleurls #dataextraction

[cafecomconteudo]

I had to re-run this video tens of times because it goes kinda fast when trying to do it at the same time. no music is necessary either. buuuut it worked smoothly broo!!!

[armaannaqash]

You scrap from the same domain!! Wnat if i need to scrap from 100 websites each having different domain! Is it possible.?? If yes.... how?

[farazjaved]

I have downloaded your software and used 1 to 2 time. When i select all data and it also shown in review column it looks like ok. But when i try to download it shows that file is empty.
Kindly solve this issue...
Thank You :)

[mykesmyth]

yeah, when I use this software and follow the steps, and hit Test, the fields do not populate. It's like the additional tab gets renamed to some random number and then when the original tab gets called, it has the wrong tab name.

[stromaeg]

A very confusing video Why you put this stupid music in the background? Are you a singer? You sell music?