Scraping IMDB With Python 2024. without selenium!

In this video, we'll be diving into the world of web scraping by extracting IMDb data using Python Scrapy and uncovering hidden information on websites! 🚀 No need for Selenium, Playwright, or any automated web drivers – we'll be sending requests, cleaning the data, and converting it into JSON format. 🧹✨

I'll also show you how to bypass website restrictions using a fake user agent! 🕵️‍♂️🔍

🌟 Important: Always consider the ethical implications of web scraping. 🌟

💬 Feel free to contact me if you have any questions about web scraping! 💬

00:00 - Intro
01:53 - Our job and checking the final result
03:50 - Setting up a virtual environment and spider
09:23 - Checking how data is released in IMDB and what we need to scrape
16:20 - Working with Scrapy shell to find the required elements
27:00 - Cleaning data using json in Scrapy shell
31:10 - Implementing our spider
51:01 - Outro Chat (A Little Talk)

[JoaoSantos-jbul]

I'll watch it again later! Thank you!

[mahdishahbazi-fzuj]

OMG, u truly make magics with just coding, it's amazing👌

[JaHiDHoSsEn-czzs]

could you make a video for rendering heavy javascript websites with an in-depth solution
scraping video

[JaHiDHoSsEn-czzs]

could u make a video upon scrapy splash