Python Scrapy Tutorial- 1 - Web Scraping, Spiders and Crawling

In this video we understand the terms python web scraping, spiders and web crawling. We also see an example of amazon being scraped using scrapy.

Next video - How does web scraping work?

#python

[MrReerka]

To anyone who is considering whether to follow this tutorial. This is the best Python web scraping tutorial out there. There are no gaps in his steps. Something as simple as a virtual environment is explained here which saves you a lot of time.

[seahad]

Hey many thanks. It's hard to find a person who is knowledgeable and a great instructor. Keep it up and your channel will prosper.

[MikeM-uyqp]

I'm about 2/3rds of the way through this channel's Scrapy playlist and just want to say thanks for one of the best python tutorials on YouTube.

[hoddiewarrior]

Best intro ever "Imagine This that you're currently on amazon " lol

[codewithpav]

Thank you for putting together this excellent tutorial on how to use Scrapy. It helped me a lot to learn scraping and Scrapy specifically. Thanks from England brother!

[maarte]

just finished the whole tut series one of the best for me. easy to understand for beginners. there's a lot of invaluable learnings here not just web scraping. thanks for sharing this content. keep it up!!!👏🏽👏🏽

[kapilanps]

Wow surprised by the quality of the content you provide us.
Great content. Well explained and beautifully presented.
U deserve more man...

[learneverything]

Wonderful content bro.... Through your channel I have learnt lot of keep making videos like this...

[sanjuyadav-cqke]

This was really a great tutorial series, learned a lot. Thanks for such a great content. 🙌

[marcoae]

I think your English is really improving 👍🏼 keep it up

[slavabugz]

Awesome tutorial, I'm going to use this in my job, hopefully :D

[ruanjiandiguo]

Thanks man, this is really useful. Cheers!

[saadksm]

Hello! I assume that scrapy can be used to create a News Aggregator with categories like News, Politics, Entertainment etc... I just found your tutorial and I'm really excited!!

[nicesoul]

minus O :) is the output argument. I think it's better to call that sign a hyphen or a hyphen-minus.

[sgerodes]

I really like the 'a' pronounciating in scrapy instead of 'ei'. :D

[sathassecurity]

Hi do you have any github account for this scrapy series?

[crackmensus]

Thanks for the video!
I have a question: at 2:25 you say that the program used to scrape the data is known as a spider, I think that the program is called crawler?, a spider is a program that browses the web automatically?. Corrrect me if I am wrong.

[sudharshanravi]

Hi, I am a beginner at web scraping. Is it possible to execute all these on jupyter notebook as I haven't used pycharm so far?

[mdzinnunuddin]

this course is appropriate for these days? I want to do a scrapping course, but don't know either this course is updated or not.

[MrAsiried]

I need some helpm here. for the below code I am getting only a square bracket.what is that I am doing wrong here. response.css('#tab__1--1 li::text').extract()