Web Scrape Google News with Python Requests and Beautiful Soup | Part 3 #webscraping #python

Thank you for watching this quick video on how to web scrape data from Google News with python, beautiful soup, requests, and urllib3. Any questions, comments, suggestions? Leave them down below!

Google News Series:

-----------------------------------------------------------------------------------------
Socials:

-----------------------------------------------------------------------------------------

Tutorial Tuesdays:

-----------------------------------------------------------------------------------------

Tags: beautiful soup, bs4, web scrap, web scraping, python tutorial, urllib3, requests tutorial, Web Scraping Google News with Python Tutorial, Web Scraping Google News with Python, Google News Bot, pip install requests, web scrapping
#python #webscraping

[foodfinance]

Thank you so much for this video series - been searching for weeks on a video like this that doesn't involve a bunch of different libraries. Onto my personal challenge of iterating this process for 39 different searches!

[amel]

thank you so much, you're a life saver!!

[guardianguardian]

i have a question, i cant find 'next' in my print(soup) result, and i cant find a tag class when i inspect the web page. so i just ran first page only and cant scrape another pages. any solution?

[alrz]

Hi there. Thank you for this beautiful video. As in your video, I also encountered Subscription error during collecting data from Next pages. I used this line and it handled.
next = soup.find('a', attrs={'class':'nBDE1b G5eFlf'})

[chaibmustapha]

really, thank you very much for these efforts, you saved me.

[sahilgupta]

Hey, I just want to ask you that when is your next video going to come for doing sentiment analysis?

[chandrimad]

Thanks a ton. I am getting the results. But I am also getting an error "TypeError: 'NoneType' object is not subscriptable". Anyone is there to help me resolve this?

[JaveGeddes]

I'm trying to scrape articles (paragraphs) from multiple joined urls, (they were relative) but once I get them joined I can't seem to get any thing from the results. the joinurl prints out, but I don't know how to then open those links, & further scrape each. I've also used + to join them, and manually inserted the tags print('"<a href="' + base + url.get('href')+ '">Link</a>"') still can't scrape what comes out of it.. I don't use jupiter, I'm viewing via chrome, using sublime... can you help?

[unaprofequis]

Thank you! The tutorial was great. If I'm scraping data in Spanish, how can I recover the accents?

[delladiniyati]

hello RAM Rabbit channel, i have a problem "with requests.Session() as c:"
error message :
with requests.Session() as c:
^
IndentationError: unexpected indent
I'm using google collab. should I do?

[casseypaputungan]

Hi, do you know how to specified the languange or location of the news? Thank you

[intrusivevoices]

Hey again its me from your headless selenium video, I just wanted to ask do you know how to edit an existing cookie with selenium webdriver?

[catherinexuan]

How can I fix TypeError: 'NoneType' object is not subscriptable?

[sahilgupta]

Hey, can you please provide us with a command to scrape both the images? I have tried a lot but unable to do it. Thanks. Also, when can we expect a Sentiment Analysis video?

[auliar]

How about scrape google maps review sir?

[arpitsh]

Can you give the source code of google news scraping