Graph Neural Networks - a perspective from the ground up

preview_player
Показать описание
What is a graph, why Graph Neural Networks (GNNs), and what is the underlying math?

Highly recommended videos that I watched many times while making this:

Reference blog posts about GNNs:

Special thanks to:
Seb, Rish and Jet for reading drafts of this and giving such amazing feedback.
Serene for helping enhance production decisions like design, color, animation flow, time-management for my editing and recording (hahaha), and others.
Jay and Malcolm for being there and encouraging the decision to do this video.

Literature References:
Recommended survey → Wu et al. 2020
Convolutional GNN layers → Defferard et al. 2016; Kipf & Welling 2016
Attentional GNN layers → Monti et B 2017; Veličković et al. 2018
General Message Passing GNN layers → Gilmer et al.2017; Battaglia et al 2018; Wang et B 2018
Halicin → Stokes et al., Cell 2020

-----------------
Timeline:
0:00 - Graph Neural Networks and Halicin - graphs are everywhere
0:53 - Introduction example
1:43 - What is a graph?
2:34 - Why Graph Neural Networks?
3:44 - Convolutional Neural Network example
4:33 - Message passing
6:17 - Introducing node embeddings
7:20 - Learning and loss functions
8:04 - Link prediction example
9:08 - Other graph learning tasks
9:49 - Message passing details
12:10 - 3 'flavors' of GNN layers
12:57 - Notation and linear algebra
14:05 - Final words

------------------
Music by Vincent Rubinetti
Download the music on Bandcamp:
Stream the music on Spotify:

------------------
Thanks for watching this, and I really hope it was helpful!
A quick introduction - I'm Alex from Singapore, a PhD student at NUS working on machine learning, computer vision and (I guess of course) GNNs for medical imaging and healthcare applications.
I've recently been thinking about doing explainer videos about machine learning or tech, and have always found great value in visual animations of math concepts.
So, thanks Grant Sanderson, James Schloss and the 3b1b team for organizing SoME1 which pushed me to pick up After Effects, research, script and put this together over the past month.

If you have questions or want to connect (please do!), you can:
Рекомендации по теме
Комментарии
Автор

OUTLINE:
0:00 - Graph Neural Networks and Halicin - graphs are everywhere
0:53 - Introduction example
1:43 - What is a graph?
2:34 - Why Graph Neural Networks?
3:44 - Convolutional Neural Network example
4:33 - Message passing
6:17 - Introducing node embeddings
7:20 - Learning and loss functions
8:04 - Link prediction example
9:08 - Other graph learning tasks
9:49 - Message passing details
12:10 - 3 'flavors' of GNN layers
12:57 - Notation and linear algebra
14:05 - Final words

alexfoo_dw
Автор

Only one video on this chanel? Come on. This is top quality content. I would definitely watch anything that gets published there.

al-.W
Автор

This is by far the best introduction to GNNs in YouTube today. I habe seen many of them. Congratulations and thank you!

psic-protosysintegratedcyb
Автор

Today, I understood Message Passing very well. Amazing interactive explanation. People like you make life easier. Thank you, Alex.

mirjunaid
Автор

Amazing introduction to GNN's, summarizing all the important basics in a beginner-friendly fashion while providing very helpful visuals

tillfricke
Автор

I'm writing a master thesis where I'm going to use graph neural networks to calculate traffic flow, so grateful for this thanks Alex!!

WolfAtlas
Автор

Best introduction tutorial on GNNs. Many tutorials throw statistics around as an explanation but very few provide the intuition behind it. Well done.

Commonsenseisrare
Автор

What an amazing explanation, wondering if you are going to add further on this line .if so, looking forward for this moment.big thanks

البداية-ذذ
Автор

Amazing how you managed to include so much information in a relatively short video without compromising the depth of explanation. Subscribed and hoping for more content in future.

nazmultakbir
Автор

Crazy amounts of work has been put into this video. The simplicity was the cherry on the top. Thanks a ton. Gained a new sub.

adityasankhla
Автор

I spent like a week reading all the papers and now I stumble upon this video. God I wish I watched this before

nikolaychechulin
Автор

Such a lovely content man! I was having trouble understanding GNNs from other sources, but only your animation made it crystal clear in one go. Cant be thankful enough. Hope you keep making such wonderful explanatory videos on other topics in ML.

shazajmal
Автор

Your video deserves millions of views. SEO your video properly and you will get that. best of luck.

IndoPakComparison
Автор

Bro, you nailed it! This type of explanation is what we need. You are a legend

thepresistence
Автор

The best introduction to GNN i have seen so far. Please upload more videos on GNN

chiragshetty
Автор

Wow, this is an amazing explanation of GNNs, hats off! Thank you so much!

SerranoAcademy
Автор

This is fabulously done; the low-level explanation of the CNN analogy and layer's function expression and then abstracting that to a generalised function expression as seen in research papers. Thank you so much!

techlover
Автор

bro this is the best introduction of gnn I have ever watch.

vishwajeetvishwakarma
Автор

Cleverly explained, beautifully animated! Great job!

saleemun
Автор

Such a great explanation for GNN. The examples are easier to understand so that I could clearly get the concept right!! Thanks for the wonderful video!!

sruthisrinivasan