How to Setup Selenium on Docker for Web Scraping: A Complete Guide

Are you tired of dealing with messy dependencies and version conflicts when running your Selenium web scraping code on different machines? Look no further than Docker! In this video, we'll show you how to set up Docker for Selenium web scraping and demonstrate the benefits of using Docker to create a self-contained environment for your code. We'll walk you through the process of writing a simple web scraping script using Selenium, creating a Dockerfile to package our code and dependencies inside a Docker container, and building and running the Docker image. By the end of this video, you'll have a solid understanding of how to use Docker to streamline your web scraping workflow and ensure consistency across different environments.

Commands from video:
check if docker installed - docker --version
command for update packages - apt update
check google chrome version - google-chrome --version && which google-chrome
move file to another directory - mv chromedriver /usr/bin/chromedriver
check chromedriver version - chromedriver --version

[shashiranjan]

I guess it will not work if we deploy this anywhere else because you didn't add the chrome and driver in the docker image.

[brandonvillanueva]

Is there a needed web driver that is needed to be installed into the docker container in the first place? Or is it running based on the driver that you have on your machine?

[alexdin]

thanks for this amazing video please can we use this docker as a flask api and connect to it from our host machine?

[kapilbadokar]

Will this configuration work if i want to deploy it to AWS Lambda?

[ilgizrakhimyanov]

Проделал все то же самое, однако получаю ошибки об отсутствующих зависимостей по типу fonts-liberation, libatk-bridge2.0-0 и т.д. Объясни плс как так, куда копать

[Guee]

Could you give the git repository please?

[KashishVarshney-criz]

this is not making any sense because you are manually fixing things for chrome driver.

[tntmgpw]

This shit will no where work, what people looking for is how to deploy it in AWS for example update ur video

Наш акцент трудно не узнать, но автор долго не выдавал себя, пока на Амазоне не появилась доставка в Российскую Федерацию 😂