UiPath - How to Data Scrape from a web page and save to Excel - Full Tutorial

This video shows, how to extract data from the Amazon web page and save the result to Excel in UiPath. The data scraping is spanning multiple pages.

You could also watch:

0:05 Present the scraping use case
We want to data scrape in a browser from Amazon and save to Excel. The data we need is title, url and price. If the data spans multiple pages, we also want to scrape those.

1:22 Data Scraping wizard
The built-in wizard for data scraping is used to easily scrape our information of Amazon. To store our data a Data Table is defined in the outout. You can see a Data Table as an Excel sheet, but only existing while the workflow runs. Therefore we need to write out the Data Table to an Excel sheet to save the data.

2:33 Data spanning multiple pages
UiPath prompts us automatically to indicate if our data is spanning multiple pages. If yes, we simply just indicate the 'Next page' icon.

3:15 Open Browser
Automatically open the browser to automate in.

3:58 Write the extracted data to Excel
Using an Excel Application Scope and a Write Range we can write our Data Table to an Excel sheet.

Connect with me:

#uipath #rpa #automation

[gavp]

The best RPA channel on YouTube. I actually was wanting to learn but gave up a while back after going through so many long and unclear videos. I had a task to extract many lines of data from a website and stumbled upon your channel. Thanks so much!

[kaiwei]

Hello im from singapore, can u teach me how to do multiple scrapping and append the data

[simenandreasknudsen]

Thanks Anders! Just a question, what if I want to go into each item to scrape additional info that I can't just by looking at the overview page. What would be the best way to do that? Thank you!

[laurasarriafrancodesarabia]

Hi Anders! Thanks for your video! It was very helpful!
Nevertheless I'm facing a little trouble. My code only extracts the data from the first page. It goes through all the pages correctly but it does not extract the data.
Do you have any idea about how to solve that?
Thanks again!

[vishnupradhaban]

Uipath keeps on updating its feature. The present Uipath community Edition has a modification in Data Scraping.

[Suraj_Khote]

Question: if we are scraping large data and if bot fails in middle how can we save the data which is scraped till then..?

[mariamahmed]

thank you so much that was very helpful

[aksh]

Hi Anders,
I have a table of nearly 79000 rows in a websites. But i am not able to scrap the whole table. When i open the page and scrape after like 5 minutes, i can scrape 10, 000 rows. Similarly if open the website and scrape after an hour then i can scrape the whole 79000 rows. Can you please help me to find a solution?

[sunnynagar]

When I am scraping data through data scraping, then what should I do if my robot is stopping again and again? And the data has 1000 pages.

[shithijkumar]

hi mine only moves to 2nd page and stops there it does not continue to go to page 3 4 5 how do i fix this

[mrmavit]

Hi Anders, thanks again for the wonderfull tuturials,

I have expanded this tutorial you did here, so i have made a way of reading the document saved above and extracting the urls and automatically saving the documents in the URL using the downloadFIleActivity, however the download file activity alows for saving for a specific format, do you know a way for making it dynamic?

[automationbachir]

Hi
Thanks for the this tutorial.
I tried to reproduce the same sequence as you, I get I get the following error : “Excel Application Scope_1: Error opening workbook. Make sure Excel is installed.”

This message is incomprehensible because Excel is installed and work perfectly, I use it daily.

So please what is the problem?
I use Uipath Studio Pro 2020.10.0-beta-149

[BrindhaBerry]

Hi Jensen, wish you a happy new year .your videos are helpful. During data scraping to move to the next page we are clicking on next button. Eg.i want to extract all the google contact but only few names are coming how to extract the data without having next button, i want to extract all the names from a to z

[uipathbachir]

Hi Anders,
I have uipath v0.10 and there are no more "datas scraping" or "screen scraping". where are they with this new version?

[roipatrickflorentino]

I tried extracting multiple pages but upon inserting it to excel it only writes up first page result of scrapping. HELP.

[butcherbaby]

Hi Anders, I'm facing an issue with scraping, uipath is only scraping the first row of data not all rows (search items are 7 spanning in 3 rows and 3 columns ) do u know why it's I'm doing exactly the way you're doing except I'm opening in incognito

[jameun]

Hi Anders, I have a list of 6500 names listed alphabetically on 33 pages, is there a way for the bot to easily find particular name on those pages? My list has no search function. Do I have to go through each pages everytime I need to look for a name?

[katarzynaszyja]

260 / 5000
Wyniki tłumaczenia
Hi Anders :) I like your movies very much, but I have one problem here. How can I get results for all prices. I have to do this example on eBuy and just like you I don't get all the prices. I only need to save 30 examples in Excel. Regards Kate

[tobiewaldeck]

Hi Anders. You have done a video where the next button doesn't work for data scraping. I'm dealing with a website checkatrade.com where the last next button is gray and uipath keeps clicking it because the 'element exists' is always true. What do I do in that case to get out of that infinite while loop.

[uipathbachir]

Hi Anders,
I found, now its’ called “Table Extraction”.