Web Scraping with Python on the cloud

In this tutorial, we use BeautifulSoup and Requests in Python to pull the market cap of a stock (AAPL) from Yahoo Finance. Next, we set our program to run everyday and to send us an sms text message with the results.

#Wayscript #Python #Scrape

Want to clone this script to your own account?

Follow WayScript on Social Media:

Code from the Tutorial (Updated 4/6/2020)
''''''''
import requests
from bs4 import BeautifulSoup

ticker = 'AAPL'

print( ticker, 'Market Cap', market_cap )

variables[ 'MarketCap' ] = market_cap
''''''

[patdevine]

I love how easy this makes putting different working parts of a project together and work seamlessly. Can't express how cool I think wayscript is. Solves many practical daily issues in a very quick and very user friendly way.

[fraabru]

i have watched like 10+hours of beautiful soup videos and this is the best one i have found so far... i just wish it was more complex and used pandas and csv files to scrape multiple things off multiple pages... you explain why you are doing things in an utterly ground zero type of way... its just great for someone who doesnt know how to program... thank you bromigo...

[jamilacruz]

I would like to decompile a source code from an exe file for python. It's possible?

[tapashbaishnab]

How to save the csv file or save it to my dropbox directly after web scraping?

[charisthawhite]

Hi, nice video but how to make it conditional? let say if only when the price > 500 then it'll send me an email.
thanks for advance

[tomh]

Great Video! Having an issue with this line: html_element = soup.find('td', {'class' : "QXiyfd")
where "QXiyfd" is the class of the td tag I want to grab. when I print this html_element variable, I am getting returned to me None and when I call html_element.text I get an error that Nonetype object has no attribute 'text'


Please help

[axvex]

Do I have to keep the site open for the script to run?or do I have to have my pc on?

[piptopia]

Hey Jesse can I pay you to have you set up a dashboard for me I been trying to learn how to code but my work schedule preventsme for days at a time but seeing that wayscript is so functional to use and you already know the ins and outs I would prefer just to pay you to help me set this dashboard Ive been trying to build for a year now.

[OzgurUrhan]

Talib library does not work in python on your site