[Python Project] Sentiment Analysis and Visualization of Stock News

This project is a beginner-friendly Python and Data Science scraper focused on building a script that analyzes the sentiment of news articles of stocks on FinViz. We'll learn how to use the Requests module in Python, get the HTML returned in BeautifulSoup and parse the Article Data, apply Sentiment Analysis on the data with NLTK, and finally visualize the results of our data frame in Pandas with MatPlotLib.

00:00 - Part 0: Welcome to the Project
01:25 - Part 1: Getting Finviz Article Data
11:05 - Part 2: Parsing and Manipulating Finviz Data
21:47 - Part 3: Applying Sentiment Analysis
33:27 - Part 4: Visualization of Sentiment Analysis

♦♦♦♦♦♦♦♦♦♦

THECODEX is a company focused on empowering and enabling anyone to learn how to code. Established in 2015 by Avinash Jain, THECODEX has taught over 600,000 students around the world how to code. With over 16 programming courses on a wide variety of topics, and more than 20,000 5-Star reviews, THECODEX is the right choice for you.

We provide engaging and comprehensive videos that break down complex information and cover everything you need to know about the subject. All students get access to our Q/A forums where you can get your doubts and problems cleared up. At the end of every course, you will receive a certificate of completion.

Jumpstart your Coding Journey with THECODEX today!

♦♦♦♦♦♦♦♦♦♦

Music: Flash Funk (Marshmello)

♦♦♦♦♦♦♦♦♦♦

[TheCodex]

Trying something new with this Project - all the videos in the series are in one complete video! Let me know what you think of this format :)

00:00 - Part 0: Welcome to the Project
01:25 - Part 1: Getting Finviz Article Data
11:05 - Part 2: Parsing and Manipulating Finviz Data
21:47 - Part 3: Applying Sentiment Analysis
33:27 - Part 4: Visualization of Sentiment Analysis

[seizuresaladventures]

You have covered so many concepts we’re covering in a data science boot camp.

Much props and kudos to you. I value your knowledge sharing - bless

[prathameshmohite]

Thanks for this amazing project. I guess we can get much accurate sentiments if we consider extracting the entire news article instead of just the headlines?

[definitelynatty]

For error 403 use:


hdr = {'User-Agent': 'Mozilla/5.0 (X11; Linux x86_64) AppleWebKit/537.11 (KHTML, like Gecko) Chrome/23.0.1271.64 Safari/537.11',
'Accept': 'text/html, application/xhtml+xml, application/xml;q=0.9, */*;q=0.8',
'Accept-Charset': 'ISO-8859-1, utf-8;q=0.7, *;q=0.3',
'Accept-Encoding': 'none',
'Accept-Language': 'en-US, en;q=0.8',
'Connection': 'keep-alive'}

req = Request(url=url, headers=hdr)

[jibrilrichter]

Dude, you are amazing! I just like the way you explained the entire process. You got yourself a new subscriber!

[cavingada]

What are your thoughts on us building our own model for determining polarity scores? Perhaps feeding a train dataset with article headers, time and stock movement at that time to help predict the score? Do you believe the results would be more accurate (proportionally?)

[Maximus.]

Mate, this video is exceptional, . congratulations and thank you so much for sharing.

[skybeat]

You have a passion for teaching. Great work mate.

[Jam_]

Thank you so much for this amazing project bro!

[philrenda]

This is fantastic; thank you for sharing. It took a little work to get the modules installed correctly. Pillow had prerequisite libraries that were missing. I would be very interested in learning how to modify the code to layer closing stock price onto the graph....

[kathiravanmm]

Awesome Project yet Explained simply and earned yourself a SUBSCRIBER 😎😎😎

[tvsk]

Great Work Bro!! Very Well Explained . I followed along and built this program on my laptop.

[rabeyaakter]

It was really good. Loved your energy!

[nukeee]

Very well done, great job! Thanks for sharing!

[jameszhou]

Hi Avi, great video on introducing NLTK score on text! everything going great except i can extract timestamp from finviz site. instead of simple space split, there are \r\n etc. what would be a quick way to get rid of them. thanks a lot.

[LeeAnalysis]

I keep getting an error when I try to run this code df['date'] = This is the error I keep getting 'DateParseError: Unable to parse datetime string:
, at position 0'
Anyone know how to fix this?

[LAME_MMA]

This is an excellent resource, thank you for sharing. And you have earned a subscriber \m/

[lorenzobarzaghi]

but using beautiful soup on Finviz Is it legal?

[fatimabaig]

File "/Users/letsbegin/PycharmProjects/pythonProject/main.py", line 23, in <module>
for ticker1, news_tables1 in news_tables.items():
TypeError: 'NoneType' object is not callable

[gerardpuche]

I did, and it works fine, but it gets just a few headlines, how do I fix it? There's no error showing up, but it only gets a few??