Scrape HTML tables easily with Pandas and Python

In this video I will show you how you can scrape html tables direct from the web using pandas. this works surprisingly well! i'll show a few examples of where it could be useful for quick and simple scraping.
-------------------------------------
-------------------------------------
Disclaimer: These are affiliate links and as an Amazon Associate I earn from qualifying purchases

[CB_]

Excellent tutorial! I spent hours trying to figure out how to scrape an html table from an archive. Then I found your video and successfully did it in under ten minutes.

[shreesingh]

Just One Word: *Awesome* 🔥
You nailed it.

[rakshithrajesh]

best web scraping channel. Highly Recomend it

[dataisfun]

Awesome technique you a life saver. Tried it and it work with just 3 lines of code compared to what i did with BS that took 16 lines

[henrikthustrup]

Where have you been all my life?! Brilliant scraping examples on your chanel... Thx.

[teamgreentech]

I'm super excited to have found this!
Thank you so much.

This saved me extra days of trying to parse the html with beautiful soup. I guess this is more beautiful than beautiful soup 😅

[sayyadsalman]

Hi john. Thank you very much for this video. Really helpful.

[ByOakk]

This is awesome thanks gonna try this out !!

[busride]

it was very excellent content I've never found in youtube!!!

[dhy]

thank you! finally, i find the solution!

[martinkaspar]

Outstanding - - this ist just outstanding. Can you do more tutorials ! There are plenty Python - things that you can write about!

[marcobaquero]

Great tutorial. Tks...and only using pandas!!!...Awesome!!

[martin-xqte]

Brilliant tutorial. Just found you on the web

[sayyadsalman]

John, I am currently working on the project where I am using concurrent.future. I am passing 300 URLs and the output is fast but it's missing/skipping lot's of results in between. If there is a way to make threads wait until they get the data, please help me. I went through the documentation but not getting it. Thanks in advance.

[mehdidaryaee]

Great job man !!! but is there anyway to extract the links along side the table?

[gameplaysside]

thx man, but some website you can get just 10 Elements when scrape. and in browser when I look to source i just can see 10 elements but when I go down in page the other tables begins to appear how can i make request to get all tables (i dont wenna use api)

[Ghstwrter]

Hey john great content man, loving all the videos you've been making lately. Currently I am trying to scrape table data from a covid website and want to use pandas because I believe it to work the best with table data. I cant get pandas to run though. I've created a venv with pandas installed and lxml installed as well but there seems to be an issue when I try to parse the table data from the html. where there any other libraries or a certain version of pandas you were using for this video? I'm on Ubuntu20.04 and also using VScode like you here in this video

[aliakbarakbari]

Hi John,
I am using python 3.7 with pycharm and jupytor, when entered all the codes in pycharm, it is showing :
"Process finished with exit code 0 " checked the terminal, it is not showing the tables.
when using the same code in jupytor, it is saying "name df is not defined"
any idea?
regards

[CorporateMusician]

How to put the extracted table on a excel sheet?

[bishopsbeers]

Why tf aren't most tech videos like this