Web Scraping 1: Selectors & Shell in Scrapy & Python (Scrapy Series)

This is part of the Scrapy Crash Course. Take the full crash course for FREE:

Once you know the basics, learn how to Download all Files from any site with Scrapy.
Take the FREE course:

What is Web Scraping?
In a nutshell: Web Scraping = Getting Data from Websites with Code

What is Scrapy?
Scrapy is a Python library to make web scraping very powerful, fast and efficient.
There are other libraries too like BeautifulSoup, for web scraping. However, when it comes to true power and flexibility, Scrapy is the most powerful.
Why Learn Scrapy?
- Most powerful library for scraping
- Easy to master
- Cross-platform: doesn't matter which OS you are using
- Cloud-ready: Can be run on the cloud with a free account

Most Important: You would be able to earn by taking up some of web scraping as a freelancer

-~-~~-~~~-~~-~-
Please watch: "Making Scrapy Playwright fast and reliable"
-~-~~-~~~-~~-~-

[extraordinaryblues]

Sir it is better than all udemy and datacamp courses on web scraping please can u upload some timeseries videos as well and thank u very much sir

[arohamart]

i want to really thank you a lot !! i did not understand scrapy else from you !!!

[codeRECODE]

Hi everyone, I need your support to get this channel running. Please SUBSCRIBE and Like!

Leave a comment with your questions, suggestions, or a word of appreciation :-)
I would love your suggestions for new videos.

[abdullahhafez]

Bro i have some questions i need ur help in some things can i contact you

[pythusiast]

very much helpful... keep up the gud work man..

[Semihszy]

hi upendra it is a really nice tutorial but I still couldn't solve the problem that led me to this. i have been scraping some bet sites by selenium and other popular methods but after i encounter scrapy and playwright would be a better solution i tried to implement them but keep having the same error; first there is nothing scraped and there is always a 404 code on response. is there anyway i can find out what this is cause URLs work and i can see the json when i copy the request URLs to the browser

[pythonenthusiast]

please post more real life projects on scraping sir! thanks!

[iamsantanuroy]

Hello Upendra ji, I am from commerce background, and no idea about programing. But I am interested in learning scraping and python to get a edge in my present job. Please guide me..

[adityapandit]

Hii sir can we give this command in pycharm terminal. When I am trying these command in ubuntu terminal. It's not working. Please help