Coding infinite scroll Reddit scraper for my subscriber | Python SCRAPY

Hey what's up guys, Code Monkey King's here. In this video we gonna create a reddit scraper that handles infinite scroll page within a given subreddit, extracts post URLs, crawls through them and scrapes title, description and comments from each post respectively.

Source code

[monkey_see_monkey_do]

I've just realized that data extraction logic is a bit wrong here, but again just for you to bear in mind guys - this tutorial covers reddit specific infinite scroll page handling rather then data extraction which is provided here just as a proof of concept, so feel free to adjust/rewrite data extraction logic on your own.

[FelipeJaburOficial]

you help a lot with your videos. thank you

[abdulganiybabatundeusman]

Is there a way to get the timestamp that shows when you hover on the time of post?

[kiransalve]

please make video on how to scrap data if search query parameter can't fetch json data, like trip.com

[muhammadhananasghar]

#Sir I Am your Student.I have learned scrapping from u.Sir Can u please teach how I can scrape emails from any site.