Python Tutorial: Web Scraping with Requests-HTML

In this Python Programming Tutorial, we will be learning how to scrape websites using the Requests-HTML library. Requests-HTML is an excellent tool for parsing HTML code and grabbing exactly the information you need. So whether you're pulling down headlines from news sites, scores from sports websites, or prices from an online store... Requests-HTML and Python will help you get this done quickly and easily. Let's get started...

The code from this video can be found at:

✅ Support My Channel Through Patreon:

✅ Become a Channel Member:

✅ One-Time Contribution Through PayPal:

✅ Cryptocurrency Donations:
Bitcoin Wallet - 3MPH8oY2EAgbLVy7RBMinwcBntggi7qeG3
Ethereum Wallet - 0x151649418616068fB46C3598083817101d3bCD33
Litecoin Wallet - MPvEBY5fxGkmPQgocfJbxP6EmTo5UUXMot

✅ Corey's Public Amazon Wishlist

✅ Equipment I Use and Books I Recommend:

▶️ You Can Find Me On:

#Python #Requests

[hell]

46:32 Javascript rendering
49:42 Asynchronous requests

[waichan]

I don't usually comment in fact never, but I just wanna say thanks! the content you produce is by far the best I have seen

[neoninsv]

I am a big fan of you showcasing what it looks like first, then breaking it down in detail.

[eeshsingh]

I see Corey's video. I hit like. 2am notification squad. 🤣 Hi from India!

[TedMaciag]

Hey Corey, BEST video for an older programmer to understand. Thanks very much!

[edemaehiz]

Menh. woke up this morning with a desire to reinforce my knowledge on Beautiful soup and APIs. Your videos did it for me.
In Bini, Nigeria we say "Uwese kakabor" meaning thank you so much

[kristianfjeldepedersen]

It is so satisfying how you always somehow cover the topics both me and the rest of the notification squad find most interesting. Keep up the excellent work, Corey.

[compinerd]

17:23 sugar right there, i saw so many people just saying okay now we copy this, and put a 2 behind everything.
oh my gawd. thank you - great tutorial so far

[andrewmendela]

Corey, you are a wizard!
I dont know how are you doing this, but by far your videos are the best educational programming material that i have ever seen, thank you! When i get my first job you will be the first person i pay

[archstampton]

Thanks Corey, I just finished the video. I appreciate the fact that took some time to go through some non-directly related topics (csv files, splitting links, etc ...) As soon as as I will be a bit more confortable on Python, I will read that American Doll Bed link of yours.

[ericli]

What a great tutorial! I bet this is the first long tutorial that I ever watched nonstop.

[coreycarter]

Hahaha! As soon as I see a notification that he has uploaded a video it’s like Christmas morning!

[justinpopa]

You could not have timed this more perfectly for me. I was planning on working on figuring out how to do exactly this while relaxing this evening. Thank you!

[ricksegalCanada]

12 minutes in, I can grab website information from this tutorial. Why is this a big deal? I know next to nothing about Python. Corey is high value in a very condensed time. Others would take hours to get to his 12-minute mark. Subscribed.

[benwalsh]

This is really top notch. Thanks so much for putting this together. Very well done!

[yubero]

Daaamn this is the greatest video I’ve ever seen about scrapping, nice I was looking for this kind of explanation for long time since I’m working on a project with python 3

[ahmed_ziada]

If I could give you a billion likes for this video I would. This is top quality content.

[maciejZar]

Hi Corey,

Great video! Thank you.
About your question concerning “beauty” of scraped webpage, I think that if you do
session = HTMLSession()
r = session.get(url)
print(r.text)
not r.html
you have in fact html but ordered somehow.
Best

[speaktothepoint]

That’s fantastic. Corey makes it very simple to understand the complex topics.

[debbygram]

real heroes don't wear capes they teach like Corey Schafer. You literarily make programming simpler than A, B, C.