Coding Challenge #48: White House Social Media Data Visualization

References:

Videos:

Related Coding Challenges:

Timestamps:
0:00 Introduce the coding challenge
1:38 Describe the format of the data
2:05 Illustrate the JSON data
2:51 Let's code
3:28 Load the JSON data
5:05 Iterate through the tweets
6:20 Count tweets by month
7:01 Create a date object
8:03 Describe date properties
9:12 Create a key based on the year and month
9:28 Explain how to count instances with an identifier
9:54 Create an object to count tweets
11:14 Visualize data
11:50 Consider data chronologically
12:40 Draw a bar for each month
14:39 Use the count for the height of the bars
15:22 Consider the minimum and maximum values to normalize the data
16:40 Resize the height of the bars
18:05 Count words in each month
18:44 Create an object to count words
20:00 Consider the text of all tweet
20:21 Break the text into words
22:32 Iterate through the words
22:53 Count the frequency of the words
23:56 Explain the existing code
24:30 Examine object and word count
25:32 Filter words
26:37 Find the most frequent word in each month
26:47 Mention video 'Term Frequency - Inverse Document Frequency' for an alternative analysis.
27:14 Extract the words for each month.
28:04 Iterate through the words to consider the most frequent value
29:39 Clean up data to ignore a set of words
31:45 Draw data to the canvas
32:45 Summarize the coding challenge
32:55 Test with a different dataset
33:53 Conclude the coding challenge

Editing by Mathieu Blanchette
Animations by Jason Heglund
Music from Epidemic Sound

#datavisualization #wordcount #javascript #p5js

So I started watching your videos at a half speed and to by honest, I can't remember when I laughed more!

[morphman]

Hearing JSON being said so many times in a row takes me back to my school days. I did a course on web development, and being a group of 20-30-year-old beer-loving boys living at the height of social media, we did what anyone in that situation would do: We humanized JSON.

We convinced the entire school that we had a 24th class member named Json Query. He had a Facebook account, was let into the Facebook group for the school and the class and he even turned in some class work. At the peak of the joke, he was even assigned by one of the newer lecturers to a group work assignment.

Let me remind you, his name was Json Query and the course was for Web Development in a school specializing in coding.

Despite Facebook's insistence on proving you're a "real boy", the account is still there today.

[osenseijedi]

I just noticed, in the end credit, your socks match with your tie.
I'm not disappointed.

[RicohetX]

This channel is awesome! I enjoying watching your vids and really learn a lot out of them! Keep up the amazing work Dan!

[MrCrosby]

Cant wait to one day being as good as you! I have a huge passion for computer science AND programming :))

[Dochollidayc]

Funny you're worried that slow mo will make you look drunk? Haha Mr. Shiffman...I work in law enforcement and have no idea what you are talking about but I can't stop watching because you are a pretty cool guy!! And I am hooked on coding because of you! Great job!

[nishkaarora]

YAYAYAYYAYAYAY YOU DID A DATA VISUALIZATION VIDEO OMG

[loreleimcveen]

Your right you do sound drunk at half speed! Thanks for this vid, watched during the livestream and I'm watching it again now. This is helping me to understand JSON data so much better (y)

[Twitchi]

21:50 correction: a drunk person in a super echoy room

[iminni]

*Coding challenge:* replicate the mobile game *Stack*.

[jiteshbohra]

please use machine learning with such data sets in the future, amazing work!

[livingstonekaramage]

Hi Daniel, Thanks a lot for the good job! Please prepare a coding challenge on sentiment analysis using Twitter APIs

[Algebrodadio]

This would have been an ideal video to use RiTa.js.

[dfhfdgfgdfshdfhe]

It looks like d3.js has some features for data visualisation that are missing in p5.js. Will we be having those features in p5.js also in the future? If you plan to include those features in p5.js, I would also like to contribute to the source code. I am very much interested in contributing to the core codebase.

[MrMixlat]

dear Daniel, can you make a organization tree ???

[maxer]

Daniel thanks for this video. Even though I am not going to make this example, i can use the things that u explained and put it in my space invaders code

[parkouratheight]

at 17:31 you said May to November.The array goes from 4/2015 to 10/2016, does the data extend past the beginning and end of those months?

[RitobanRoyChowdhury]

Do you participate in the ludum dare game dev competition? If not, I would love to see you participate in the next one in April! ldjam.com - new site, ludumdare.com - old site

[jihosong]

but how can i extract json file out of facebook or tweeter?

[petros_adamopoulos]

27:50 : Object.Kenyans, most definitely...