Code a Python Bot (Part 4: Scraping data to a Pandas Data frame)

#python #pythonbot #webscraping #pandas #selenium

In this series, I will show you how to code a Python Bot by example. Follow me as I develop from scratch a Python bot that is able to find suitable clubs to play badminton in my local area of London.

⭐ DON'T KNOW PYTHON?

Note: I will get an affiliate commission if you sign up for the course. So that's one way for you to support the channel.

✅ Source Code and Article:

✅ CONTACT ME FOR CONSULTING AND ANY OTHER BUSINESS ENQUIRIES

✅ SUPPORT THE CHANNEL or get MENTORING

✅ FOLLOW ME

✅ My Equipment

If you are curious about what equipment I use and you want to support the channel, feel free to check my affiliate links. This means that, at zero cost to you, I will earn an affiliate commission if you click through the link and finalize a purchase.

Samsung 970 Evo Plus SSD 2TB - M.2

COMPONENTS FOR RTX 3090 DEEP LEARNING PC COMPONENTS(Affiliate Links)

AMD Ryzen 5900X CPU

ASUS TUF Gaming NVIDIA GeForce RTX 3060 OC Edition Graphics Card, 12GB GDDR6

EVGA GeForce RTX 3090 Ultra Gaming, 24GB GDDR6X, ARGB LED, Metal Backplate, 24G

ASUS ROG Strix X570-E Gaming ATX Motherboard, AMD Socket AM4

Corsair iCUE H150i PRO XT RGB Liquid CPU Cooler (360mm)

NZXT Kraken Z73 360mm AIO LIquid Cooler RGB CPU

Crucial Solid State Drive 1TB

Samsung 970 Evo Plus SSD 1TB - M.2

PC Case - Phanteks Eclipse P600S

Memory - Corsair Vengeance RGB Pro 32GB (2x16GB) DDR4 3600- Black

Corsair RM850, RM Series, 80 Plus Gold Certified, 850 W Fully-Modular ATX Power Supply

SAMSUNG 34-Inch CJ791 Ultrawide Curved Gaming Monitor, White

Logitech K780 Multi-Device Wireless Keyboard

Timestamps

0:00 Pandas Library
1:30 Understanding HTML Structure for Scraping
3:15 Importing BeautifulSoup library
3:45 Feeding HTML from selenium to BeautifulSoup
4:00 Finding div by css class with BeautifulSoup with findAll() method
5:45 Extracting text from HTML using BeautifulSoup
6:45 Finding div by css class with BeautifulSoup find() method
9:25 Retrieving date from date picker using xpath