Web Scraping 4: Scraping Multiple Items from a List with Scrapy & Python (Scrapy Series)

In this video, we will learn how to get Multiple Items from a List on a page. You can apply this to amazon or any other site that displays listings.

This is part of the Scrapy Crash Course. Take the full crash course for FREE:

Once you know the basics, learn how to Download all Files from any site with Scrapy.
Take the FREE course:

What is Web Scraping?
In a nutshell: Web Scraping = Getting Data from Websites with Code

What is Scrapy?
Scrapy is a Python library to make web scraping very powerful, fast and efficient.
There are other libraries too like BeautifulSoup, for web scraping. However, when it comes to true power and flexibility, Scrapy is the most powerful.
Why Learn Scrapy?
- Most powerful library for scraping
- Easy to master
- Cross-platform: doesn't matter which OS you are using
- Cloud-ready: Can be run on the cloud with a free account

Most Important: You would be able to earn by taking up some of the web scraping gigs as a freelancer right away.

-~-~~-~~~-~~-~-
Please watch: "Making Scrapy Playwright fast and reliable"
-~-~~-~~~-~~-~-

[codeRECODE]

Hi everyone, I need your support to get this channel running. *Please SUBSCRIBE and Like!*
Leave a comment with your questions, suggestions, or a word of appreciation :-)
I would love your suggestions for new videos.

[bulmavegeta]

Me gustaria hablar en ingles para agradecerle por el aporte a la comunidad autodidacta, información muy valiosa que me ha ayudado mucho más que todo lo que he estudiado en estos dias sin poder entender hasta que vi sus videos.

[nadyamoscow]

Thanks a lot, that was a great lesson

[alisaeidalsheikh]

Sir there is a question I didn't find answer for
How to scrap data from multi pages into a single file
Say
page one have ItemName, itemNumber
Page two have price, description
How to extract them into one line In a files using scrapy

[adb]

Sir, what's the shortcut keys you use to format the json file

[usmantariq]

Hllooo Sir! I have a question that can we pass list to the pipeline to store in database and can we yield items by not giving or declaring its all values which we created in the items file with equal to this prgram=field()....?

[patriciacm]

Hi, after looking for several Scrapy tutorials this ones were my favorites. I have an issue in a personal project, the response is 200 but when a try to save the info into a csv this one is empty. I already printed the text response and its says that my browser does not have "javascript" but in fact it has. How can I fix this issue? Thank you and well done.

[udayposia]

****Question: Doing similarly what you did in this tutorial, How would I scrap the author's birth date along with the name in the same tutorial? If you click about beside author name it will pop up new page with all author date. So, How can I get any field which is in next but going through all the item in previous page. I hope you got my question. Please help me need help with this.