What I'd Add FIRST To a new Scrapy Project

-------------------------------------
Disclaimer: These are affiliate links and as an Amazon Associate I earn from qualifying purchases
-------------------------------------

Sound like me:

-------------------------------------

Video like me:
-------------------------------------

PC Stuff:

[janekstern]

You videos helped me understand scrapy more than any other resource, ty!

[linuxinstalled]

I wish this video had more exposure. I greatly appreciate that you took the time to put this series together. Being able to see these examples of the various mechanics behind scrapy has been hugely helpful. Thank you again.

[shihlun]

Thanks for the tutorial, after watching it, it gave me a better understanding of scrapy itemloader documents.

[davyroger]

Thanks! the documentation did not go into enough depth and im glad someone made a comprehensive video on it

[victormaia]

Great tutorial! very easy to follow, had no problems, about the typos, I'm the worst typer ever, but tabnine always saves my life.

[woldemarkiev]

Great tutorial!! It really helps to understand

[amineboutaghou]

Another great video ! Very well done John 👏🏼

[gwulfwud]

Thank you! I watched the previous video and then this, and it felt like I know so much about scrapy already. Really really good videos. Keep it up!

[milank]

Great explanation as always, really helpful tutorial

[codewithnacho]

Awesome vid! It answered my questions with Item Loaders. Docs were confusing me haha

[hendrikfeddersen]

Thanks a lot. The videos are very clear. Do you mind explaining please in one of your next videos the correct folder structure of a Scrapy project and what file goes where and why.

[nadyamoscow]

Thanks a lot, what you do is amazing.

[vidproli]

great tutorial, explain the exact thing I was looking for, thank you

[carinafelnecan]

Thank you, I learned a lot from this video:)

[justinames]

As the others have said, thanks for your time and effort, a great help. The links connecting to Amazon (e.g. the lighting link) are dead, and you might want to update them. On another front, have you added a video on caching? All in all, really well done, and, again, thanks.
jA

[byroncodes]

Hello John, could you do a video on how to host the scrapy scripts

[RahulYadav-wvl]

Amazing Tutorial 😍
I do have a question - I am trying to get basic information from a shoe website and the spider is only returning half the items on the website because of the DUPEFILTER setting. Maybe there are same links for same shoe and different color or multiple items with the same link but if I try to change the filter setting, it goes into infinite loop. Is there a way around that?

[Daviuliano]

Super nice, however I am struggling to understand how would that work with a dynamic website where I am following a GET method which returns a data in json format. I do a bit of working around and convert it to a dictionary - but can’t seem to get it to return an item… any ideas that can help me?

[Abdul_Rafay_Pal]

what would you recommend? splash or playwright?

[MohAmuza]

I scraped a product and some items don't have some data so the result is a nonetype which means None,
I created in the items.py a function to check if it is None print something:
def check_gift(value):
if value is None:
return "No gift"
else:
return value
but it don't work where is the problem?