How to scrape website links with Power Query

In this video I am going to show you how to scrape links from websites with a simple line of code. #curbal #powerquery #powerbi

SUBSCRIBE to learn more about Power and Excel BI!

Our PLAYLISTS:

☼☼☼☼☼☼☼☼☼☼

POWER BI COURSES:

Want to learn Power BI? How about you take one of our courses? Here you can find the available courses:

☼☼☼☼☼☼☼☼☼☼

ABOUT CURBAL:

************

************

QUESTIONS? COMMENTS? SUGGESTIONS? You’ll find me here:
Twitter ► @curbalen, @ruthpozuelo

#SUBSCRIBE #CURBAL #MVP

[richweinberg]

This worked great. Thanks.
At first this didn't work for me, but it was because the links I wanted were only relative links, meaning they didn't contain the website address or http://. I modified the text from:
{"Link", "a[href^=""http""]", each [Attributes][href]}
to
{"Link", "a[href]", each [Attributes][href]}

[GabeTek]

I saw the post from Chris Webb but I didn't get it right away.
You just made it so clear!
Thank you!

[EricaDyson]

Well a big thank you to both of you! Never would have discovered this without you!

[paspuggie]

I'm sure I commented but I can't see it. Anyway this is brilliant Ruth and had read Chris Webbs post before but your videos makes it easier. I managed to extract 140 URLs from one webpage...Cool!

[oshiowueme]

hi, if the column1 could not extract the exact text, how could I do, if I split the column1 after fisrt step?

[ezequielellena]

Hello, what KPI or analysis could be done with that table. I have the same case and I don't know what to analyze.

[usmanmirza]

I am trying to do the same but the navigator doesn't load the entire page as there is a script arrow at the bottom of the page hence showing only first 40 rows. Please advise.

[miguelcalejo]

I'm trying to scrape data from a web page which displays the 10 top items and there's a button "View more" to see more items (till 100) which I open, but powerquery only scrap the top 10 and displays "View More" as a line. Is there a solution for this? Thanks

[MoviFrenzy]

Hi Ya plz help me the web page scraping which has credential page

[neerajahirwar]

Can i get the link of all PDF using same steps

[bpdeepakbp]

Thank you for this video. this is really good one

[wimvanderlinden]

Where can i load these pbix files? Very nice film!!

[cokemaya]

Awesome tips as usual! I was thinking about going a level deeper in the hierarchy and scrapping those URL's, for instance, creating a table from a webside and then create a function that calls the column from the previous table which contains the hyperlinks with different "Addresses" & "numbers". Obviously they have to share the same structure to allow me to put out the same data. " Well I do not known if that make sense, but it would be great to learn that. Congrats for you channel!

[CPatwal]

Thanks Ruth, will the website owner know that his/her/their website was scraped ?
I mean I would want to just avoid getting into trouble :-)

[alreadydeadfunk]

When I saw the title of the video (before watching it), I thought about Chris' blog, too.

[elchin]

Nothing special. The most important is how to get data from each scraped link (and you can do it with custom function)