Web Scrape Nested Links/Multiple Pages - Web Scraping in R (Part 2)

Web Scraping in R: Visiting Nested Links using RVest Part 2 -- After scraping movies from IMDb (in the last video), I also want to extract the main cast members from each movie -- which requires me to go into each movie's link. In this video, I show you how to scrape and navigate into links to potentially scrape even more

Music by: Prod. Riddiman

[Nafke]

I love how much knowledge you can pack in such a short vid. I love the editing, the tone, the pace… your tutorials are def among the best on YouTube for any field!

[prasenjeetrathore]

man you should post more, love your videos, very easy to follow tutorials 🧡

[CE]

Your videos are really great man, keep going!

[willykitheka]

Sorry I didn't realize you created a series so am going through all of them! Once again thanks for sharing...this is super useful!

[postercam]

You juste helped get my researches to an unexpected level of data-collection. Thanks so much for this, your videos were an incredible support.

[vicentefontecilla]

A big thanks for you. ive been looking this on the internet for hours adn you just explained it in 9 min. Thank you so much! Keep doing videos!

[grainofsalt]

Thanks so much for this. Your videos have been SO helpful for my analytics class....you have no idea. I don't know if you get any financial benefit from these videos at all, but I wanted to express my appreciation

[vedantamohapatra]

Hey, great vid. However, after two years the iMDB website has made some changes and when you click the movie link it redirects you to a page which has all details about the movie but you can't the cast by using the selector gadget as the cast are in div elements. We have to click another link on this page "All cast and crew" and then on that page we can select the cast. So how do we it as we cant use the movie_links in sapply function as it returns nothing.

[suganyavidyadharan]

Great tutorial.... I loved all the four parts... You are awesome... Thank you so much for this... I have been looking videos for web scraping and this is the best.... Thank you once again... God bless you...

[OldNorse]

Excellent video. Perfect example from which I could follow and apply to my own project. Great.

[atilga.n]

thank you thank you thank you! amazing explanations and demonstration, really clear, thanks again!

[JapjeetS]

How are you getting the table output in a different tab, and the format looks so clean?

[ss_]

Thank you very very very much 👏👏👏👏👏👏👏👏👏👏👏👏👏👏👏

[nancyachiengodhiambo]

Nice presentation, waiting for web scrapping of multiple pages

[KianaAshoftehfard]

thanks for this tutorials.I tried the codes and the variables remain empty. Could this problem be due to the new site restriction? Because selectorgaget is not working like your video now.

[jannonflores]

Thanks for this bro! I was able to scrape propertyfinder because of this. One problem thou, how can we make the program faster? It seems that whenever it scrapes across multiple pages, it always takes time rather than just scrape from outside details.

[radhikaiyer]

hi.. this is very informative.. unfotunately when i try to do wikipedia scraping i get the following error "Error in open.connection(x, "rb") : HTTP error 404" what am i doing wrong ?

[paulfong]

thank you so so much for your great tutorial!! And I have a question: what should I do when the error "Error in data.frame(name, year, rating, sys, cast, stringsAsFactors = FALSE) :
arguments imply differing number of rows: 50, 45" appears for that on imdb there're 5 movies without rating?

[bonumsanguis]

I tried doing this in Google news to extract the articles from each of the urls/headlines. It only work for a single sample url and not for all. Please help. 🙏🙏🙏

[jesusrafaelyanvalenzuela]

Nice Videos! Thanks a lot.
The sapply function is relatively slow (1 seg per Link). What is the reason why sapply takes so long? Is there a way to make it faster?