Web Scraping in Power Automate Desktop | Multiple Pages | Tutorial

Do you want to scrape structured data from the internet with Power Automate Desktop (PAD)? In this tutorial you learn how to scrape data from multiple pages.

⭐️ The website to scrape from ⭐

⭐️ Skip through the video ⭐
00:00 - Intro
00:15 - The website to scrape from
00:49 - Creation of an Excel file to keep track of all categories
02:45 - Loop through the Excel file
05:46 - How to scrape structured data with Power Automate Desktop?
13:28 - How to scrape data from multiple pages with Power Automate Desktop?
15:08 - How to change a selector in Power Automate Desktop?
18:23 - How to change where Power Automate Desktop saves files?
18:50 - Running the bot
19:02 - Outro

⭐️ Follow me ⭐
🧡 Instagram: TomsTechAcademy

#powerautomate #powerautomatedesktop #roboticprocessautomation #webscraping

[matthewsheehan]

Seen many videos on Web Scraping in Power Automate and yours is the best by far! Thank you this helped me tremendously! I look forward to watching more of your tutorials.

[muhammadbariakhdan]

Thank you very much sir. This video gives me an idea how to scrape website with click links. Appriciated it man :)

[ykbdtzx]

OMG, I don't know how to thank you Sir!

You just helped me solve the first step for my final year project.... Thanks alot.... keep making helpful videos. Thanks so much

[mariavlogs]

Thank you for your tutorial, it works on paginated websites. Is there a workaround for "Load More" buttons?

[asom]

Thank you so much for your video! I tried the same technique but the extractions stops and goes to Website privacy page. Not sure if this is caused by the web scraper or the code. could you please help me with this matter?

[rahatrahman]

Hey please make video to download files from web table hyper link where you have multiple pages.

[rockero]

Hi! Great vid! What would you recommend for a web with multiples pages. The web automatically refreshes every 5 or 6 minutes. How do I continue from the last one?

[vigneshvangala]

Do a video on selecting multiple check boxes in web page using power automate desktop

[damla]

Thank you for this great video. Can I extract information from different websites for the same task and collect it in a single excel. Thank you so much

[ReetardM]

great example, thank u! what is the solution for infinite scrolling rather then clicking on the web page numbers?

[JamesOrtega-vrzn]

I am trying to scrape my corporate site to excel my issue is after the loop ends at page 279 it keeps copying the last page with an error. Can you help.

[tempzu]

it was a good video but could you make in detail with a flow....it was like haphazardly done so thought bit confusing for noob.

[christiannebloem]

Ha Thomas, super bedankt voor de goede video! Ik ben eigenlijk nog net een stap verder aan het denken. Is het ook mogelijk om het veld 'categorie' telkens terug te laten komen? Zodat je in je kolommen krijgt: Categorie = laptop, Productnaam = A, Categorie = laptop, Productnaam = B, etc.? Hoe kan ik aangeven dat datzelfde element dan ook bij elke selectie wordt weergegeven? Lijkt me makkelijker als je meerdere categorieën hebt die over tijd kunnen veranderen, nieuwe worden toegevoegd of namen wijzigen. Groetjes, en ga zo door!

[stricklerville]

Fantastic video. I do have a question, what would be the best way in Power Automate to pull data from the individual pages. Like say in your example you have the Laptop Packard 255 G2, when you click on it, it has more details. How can I automate scraping those details from the individual pages and put it into one row in the excel spreadsheet?

[virtumind]

Great tutorial but I see in extract data from web page then advanced there is an option for select paging element, can we use that ? How ?

[praveenasrinivas]

Hi I am trying to extract html table from the links. extract data throws an error failed to extract data. can you pls help me how to resolve this?

[Ramkrishna]

I have a problem in extracting from the web. The data i want doesn’t gets copied in right format in excel.

[sayeu]

It's so slow, took 30+ minutes to scrape 500 pages

[trisha]

Thanks for this. Not winning with next page as it has anchor 2 as ordinal not text 16:22 @matthewsheehan??