How to scrape ANY website with Beautiful Soup, Selenium, and Python (part 2 of 2)

NOTE: GITCOIN, DEVPOST, AND MANY OTHER PLATFORMS TERMS OF USE BAN SCRAPING. Please do not repeat, use this as a learning resource only.

REALLY simple implementation of selenium web drivers.

NOTE!! At ~15 minutes I mess up by typing `src` instead of `hackathon_src` in my `BeautifulSoup` initiation. So when I run the code to show it doesn't work, it doesn't work for the wrong reason. This still isn't right because the beautifulsoup still won't pick up what can only run after the javascript completes.

Learn how to scrape ANY website, and how to update your #devrel OKRs too! Beautiful Soup is an amazing tool built into python.

Do you want to get stats on your football team so you can algorithmically manage your fantasy team? Boom make a web scraper that scrapes ESPN. Track your competitors activity on different social medias? Great, that's covered here too.

*** Code Reference ***

** Donate **
ETH Wallet address: 0x9680201d9c93d65a3603d2088d125e955c73BD65

*** Follow Me! ***

Feel free to ask any questions on coding, chainlink data, fintech data, software engineering, or anything else!

#python #devrel #beautifulsoup #hackathons #scrape #selenium