Introduction to Web Scraping with Node and X-Ray

Introduction to Web Scraping with Node and X-Ray

Web scraping is cool! In this video, we use both NodeJS and X-Ray to do this in JavaScript against a local Express application. It can be expanded to scrape data from other sites using the techniques shown in this video.

Ensure to comply with the TOS of any site you're scraping, and play fair!

You can also find me:

[uelude]

Thanks, calmly articulated yet not patronising whatsoever. Subscribed :)

[Mynameisweirdoss]

Mate this video is straight forward and easy to understand, earned yourself a sub, legend!

[RemeLeHane]

This looks soo much simpler than what I have already done with cheerio. Thanks, we do some testing and probably refactoring.

[GustafLindqvist]

Nice to see X-ray. Going to try it out!

[davidconnelly]

Very nicely done. Can I just ask, have you (or anybody else out there) had a chance to compare Xray to any of the other popular scraping scripts out there like Nightmare or Cheerio?

[vaviloffx]

Great video, and very nicely composed example page with "irregularities", as in real life!

[misak.]

Great video, great channel!
Just one question - can we use X-Ray with Ionic 3? And if so, could you do a tutorial on that? Thanks

[blueprint]

Can x-ray handle ajax loaded content ?

[EE-wpqr]

Is there any way to specify where to further search for elements after something like "div.className"??

[tobihikari]

Hey, thanks for the Tutorial. I used xray for a project a lot and then switched to osmosis...would be a nice Tutorial too. Also saving everything to a Mongo db

[rdharan]

shall we make this is as a chrome extension?
any possible ways?
kindly help me to sort it out!!

[shubhamwoodflake]

How get data from Inherited Class and Same Tag element Data with class?

[mohamedmoussa]

how can i use web scrapping with ionic ?? or is there any way to scrap with my ionic app ??

[deniszavadskiy]

Hi Paul. Are you familiar with CouchDB & PouchDB?