Introduction to Web Scraping (Python) - Lesson 01 (BeautifulSoup, Twitter)

In this video, I show how to use Beautiful Soup to scrape a twitter timeline for a particular account.

Kieng Iv/SAF Business Analytics

[ppluck]

Well done! I spent weeks on books and other videos and sites and what I needed to accomplish was done in this series by SAF in a few videos. Awesome job! Must watch

[bfofkdl]

I am freaking out. I copied ur code and see that error "AttributeError: 'NoneType' object has no attribute 'text'
"

[williamriopellemspt]

A lot has changed on Trump's Twitter account as I run the code. Very interesting data and helpful learning Python. Thank you much!

[RicardoMedley]

I keep getting No module named 'bs4' and this is although I have downloaded beautiful soup

[ashfaqtunio]

Wonderfully explained, simple, lucid and to the point. Kudos!

[ezrawilliam]

Thank you so much dude. This video really helps me understand how web scraping in Python especially in PyCharm really works!!

[joshuaclark]

Very good video! I really appreciate you taking the time to thoroughly explain the process in a simple easy to understand way.This was very helpful in allowing me to broaden the horizon in what I can do with this.

[FB-trkf]

Few questions:

1. Why are you only pulling out 20 of his tweets;
2. How would one pull out all of his tweets;
3. How can one sort his tweets in terms of - which one of his tweets as been 're-tweeted the most' or 'most liked'

Many thanks,

[jyo]

how do i iterate the page? this only show one page

[ayselabasova]

Can someone please explain why instead of class="ProfileHeaderCard" I see class="css-1dbjc4n r-1iusvr4 r-16y2uox r-5f2r5o r-m611by" and unless I write the first one it prints out none!

[cangri]

Please help at 11:58! I can't call the "find" methods multiple times. It says that:
AttributeError: 'ResultSet' object has no attribute 'find'

[MarkJay]

on the for loop, you can use enumerate and save yourself the dummy counter i

[youngoz]

Hey I was wondering would you need Twitter's API to scrap bookmarks of someone's Twitter or could you run the script and gather those pictures?

[ThatGuyDownInThe]

literally won't let me find classes at all, tried everything, can someone please tell me if they changed the way this works?

[Donutzsick]

AMAZING video!! Thank you so much! very helpful!

[anatoletsypin]

How do you know when to use a for loop and when to use just a single statement (like print) to get all the relevant information?

[joshuamills]

have twitter radically changed their html code?

[seanchen]

I keep getting ordinal not in range(128) error.
The Full line 'ascii' codec can't encode character '\u2019' in position 34: ordinal not in range(128)
How do i fix this ?

[niharikareddy]

I'm using python 3.5.2. while executing the command "from bs4 import BeautifulSoup" it giving an error that bs4 is not found. Do I need to install anything else separately.

[savannshop]

Thank you for the video. Excellent presentation....