Web Scraping with Node.js

---

[nurnaim.sourav]

YouTube: I'll recommend this cool stuff after 3 years

[Metruzanca]

It's broken now(they changed the user profiles) but this is a great intro to web scraping, thanks.

[simplyfabian]

It's a very good basic tutorial to start off, the only thing that could be improved is the use of async await which I am also doing on my videos on NodeJs Scraping

[antoinelb]

Good tutorial, but I like more when everything is being tested as it goes. For example do one request and console.log it before starting to add logic to it, and then after parsing, another console.log to see what comes out, and so on...

[MaxOnMaxxer]

If you use this in an app, you would get a CROSS-origin read blocking error. How can you resolve this error and use this nice tutorial in a real app? Thanks 👍

[MrPaladan]

Awesome video Beau! I followed along but was trying to get data from my profile...I managed to get the HTML from the page but couldn't make sense of it so I went ahead with the jQuery way in the article you show. Thanks for the great resource!

[AlexHaxxz]

wow this is so awsome. thank you for the tutorial. have you done one that shows you how request data from login sessions?

[PyMoondra]

Really nice job. I like your teaching style. Hope to see more videos from you.

[josebreijo]

Async generators will make the data consumption easier. Nice tutorial :D

[codingmorrison]

Great work man! I love these types of tutorials!

[jarg]

nice video brother, great to see some creative ways to use node

[daviddaskal]

Excellent tutorial thanks! Can you share a way we can use node JS to scrape live data from a website, for example live scores ? Thx

[FernandoPonteFilho]

Nice tutorial. I wish you could do with pages who needs login/password. And scrap tables. Sometimes I wish to organize my Medium favorites, it's a mess, and can't use their api for this (already requested on their github)

[DeepakSingh-ufvv]

How to do scraping where login/authentication is required.

[deathkillertech]

Good tutorial but keep running code after each function

[LesCarbonaro]

Thanks for the step-by-step walk-through, Beau. Was just wondering, would this scrape dynamically generated websites, for example sites written with React or Angular? Thanks again.

[sbastion]

Thanks a bunch for the tutorial! You explained it clearly & helped me in understanding this tutorial 👌

UPDATE:
When I tried to run this code, I got an error that says:
"TypeError: data.directory_items is not iterable"

How do I fix this?

[bluekaioken]

well explained, productive and with nice background sound effects lol

[xXAngelmlXx]

Hello. The video was pretty good and it thaught me a few things.

Would this work to scrape the Nike we site? I have code using puppeteer but it only kinda works sometimes because they try to block my bot, I have counter measures but even then.

[_TGrey_]

Nice video. Thanks!
If somebody wants to see alternative video on this topic, i have one. Unfortunatelly with eng subtitles for now.
Cheers