Extract Multiple Web Pages with Power Automate Desktop - Full Tutorial

This video tutorial shows how to extract multiple web pages with Microsoft Power Automate Desktop. You'll learn how to create a loop with a dynamic selector and ensure you don't overwrite Excel data.

VIDEOS FOR YOU:

POWER AUTOMATE DESKTOP GROUPS:
- Join my network with 4200+ Automation/RPA developers, where we solve Automation/RPA problems, network and help each other upgrade our careers. It's free!

FOLLOW ME:

0:00 Web Scrape a Single Page
Power Automate Desktop is next to none regarding data extraction of web pages with no code. Directly apply Regular Expressions to the results if you want to filter them further.

3:13 Multi-page Web Scraping
We have search results on multiple pages. In addition, there is no next button, only page numbers. So the solution is to create a loop with a dynamic selector - both dependent on the current and the total page number.

6:37 Creating a Dynamic Selector
We create a dynamic selector in Power Automate Desktop so that we can click all the next page buttons.

12:48 Write to Excel (multiple pages)
We'll ensure we don't overwrite Excel data when continuously writing newly extracted data to Excel.

#powerautomate #powerplatform #office365

[andersjensenorg]

Thanks for all your questions and comments 🥰

[kaushikgohil]

I learned something new, was able implement in actual real life requirement. Thank you very much for making it so easy and simple.

[VitorReis-rnho]

I have struggled a lot, but, thanks to your instructions, I managed to adapt small parts of the script to my needs.
I already knew your work teaching autohotkey. Your teaching is fantastic!!! Thank you very much!

[sergiobarros]

Mr. Jensen, you rock! Thank you for this wonderful tutorial. Greetings from Brazil!

[glennganey]

Thanks for another great tutorial. The dynamic selector was elegant.
I am still scratching my head over doing a google search for a refrigerator part (DA47-00322B). I go through the standard selector UI assignments for the results title and for the body of text, sometimes the part number will not appear in the title but does appear in the body of text. When I run PAD it picks up only nine of the thirteen results. Using your tip (F-12) I look at the code, but I am no web programmer, and do see a significant number of differences between some of the results.
The object of the exercise is to write a URL & part number if the part number is explicitly found in either the title of body of text and of course save the results in excel. I do believe this would make for a good tutorial since so many people use google searches. Thanks for any incite you can shed.

[adenilsonx.franco]

Thank you very much for the tutorial that prepared Mr. Anders Jensen, it will help me a lot, I will use it in other researches, because I can use your techniques.

[agamenon]

Thank you for such a great video Anders. I wonder if you can post a video explaining how to scrape web pages with infinite scroll.

[missnlahi]

Thanks I'll try it. I think this addresses why my script was only working for the 1st page of data

[Taxita]

Thanks for doing this. I was wondering how to do that.

[dDseen]

thank you very much for this video, but i have a question, why is your data in excel is separate nicely from value scrap from web into each individual cell, meanwhile mine is all the data scrap from the web is lump into a single cell

[Chime-In-CelebQuotes]

Thank you Anders !! this is very helpful :)

[manjunathreddy]

Thanks for awsome content!
Could not see advanced settings option in add ui element in the Power automate desktop, and I am using latest vestion.

[suraj_singh]

Kudos Anders Sir Make a video on Working with CMD Sessions operations from basic to advance in Power Automate Desktop

[fanisz]

Mr Jensen thank you very much for you valuable support.
I have a quick question about regex. If got the return value is lets say 1000, 00 € and I want to retrieve only "1000", what regex should I type ?

[Hungry_kitchen]

Hi Anders thanks for the great video, may I know how to scroll down and extract the entire table from web page in PAD, Iam trying but able to get only the one's displayed on the screen, hope to see the repl soon😊

[TTtipsforlife]

hi there, is there a way i can download multiple PDF from a webpage? The challenge is that the PDF changes regularly but luckily on the same web page. I need the automation to be able to dynamically select the new PDF and download. Tried a number of searches but no success. Any support will be much appreciated

[Palmakify]

Thank you for the video, always helpful.
I have a question: When I try to extract the list of HRef from a website, I only get 2 results written into my excel, but on the preview extraction, it shows me more than 2 results. It's a bit strange that the preview results and the actual extracted results are different.

[BrainUpp]

Also scrape data from inside from every link multiple data upto multiple pages

[matusklubica]

Hello im struggling with the third part of your video, i cant make it work, my source code looks different and I cant deal with it, i would really like to master it, thank you for your help, love your videos :)

[stanTrX]

Thanks. There is also set pager property for the next pages, does that work as well?