Graph Neural Networks - a perspective from the ground up
ฝัง
- เผยแพร่เมื่อ 7 มิ.ย. 2024
- What is a graph, why Graph Neural Networks (GNNs), and what is the underlying math?
Highly recommended videos that I watched many times while making this:
Petar Veličković's GNN video → • Intro to graph neural ...
Michael Bronstein's Geometric Deep Learning keynote speech (beautiful!) → • ICLR 2021 Keynote - "G...
Xavier Bresson's Graph Convolutional Networks lecture → / iiv9r6bjxh
3Blue1Brown’s series on Neural Networks → • But what is a neural n...
If you'd like to go further with GNNs, do get started with Petar's wonderfully compiled list of resources to continue → goo.gle/3cO7gvb
Here's also another awesome compilation, to go further with research → github.com/GRAND-Lab/Awesome-...
Also, the GNN literature is growing so quickly so subscribe to this Telegram channel by Sergey Ivanov to help you keep up → t.me/graphML
Reference blog posts about GNNs:
Michael Bronstein → towardsdatascience.com/geomet... (a must-read), towardsdatascience.com/do-we-...
Amal Menzli → neptune.ai/blog/graph-neural-...
Eric J. Ma → ericmjl.github.io/essays-on-d...
Rishabh Anand → / an-illustrated-guide-t...
(More recent) Distill → distill.pub/2021/gnn-intro/, distill.pub/2021/understandin...
Special thanks to:
Seb, Rish and Jet for reading drafts of this and giving such amazing feedback.
Serene for helping enhance production decisions like design, color, animation flow, time-management for my editing and recording (hahaha), and others.
Jay and Malcolm for being there and encouraging the decision to do this video.
Literature References:
Recommended survey → Wu et al. 2020
Convolutional GNN layers → Defferard et al. 2016; Kipf & Welling 2016
Attentional GNN layers → Monti et B 2017; Veličković et al. 2018
General Message Passing GNN layers → Gilmer et al.2017; Battaglia et al 2018; Wang et B 2018
Halicin → Stokes et al., Cell 2020
-----------------
Timeline:
0:00 - Graph Neural Networks and Halicin - graphs are everywhere
0:53 - Introduction example
1:43 - What is a graph?
2:34 - Why Graph Neural Networks?
3:44 - Convolutional Neural Network example
4:33 - Message passing
6:17 - Introducing node embeddings
7:20 - Learning and loss functions
8:04 - Link prediction example
9:08 - Other graph learning tasks
9:49 - Message passing details
12:10 - 3 'flavors' of GNN layers
12:57 - Notation and linear algebra
14:05 - Final words
------------------
Music by Vincent Rubinetti
Download the music on Bandcamp:
vincerubinetti.bandcamp.com/a...
Stream the music on Spotify:
open.spotify.com/album/1dVyjw...
------------------
Thanks for watching this, and I really hope it was helpful!
A quick introduction - I'm Alex from Singapore, a PhD student at NUS working on machine learning, computer vision and (I guess of course) GNNs for medical imaging and healthcare applications.
I've recently been thinking about doing explainer videos about machine learning or tech, and have always found great value in visual animations of math concepts.
So, thanks Grant Sanderson, James Schloss and the 3b1b team for organizing SoME1 which pushed me to pick up After Effects, research, script and put this together over the past month.
If you have questions or want to connect (please do!), you can:
Find me on Twitter → / alexfoo_dw
Find me on LinkedIn → / alex-foo - วิทยาศาสตร์และเทคโนโลยี
OUTLINE:
0:00 - Graph Neural Networks and Halicin - graphs are everywhere
0:53 - Introduction example
1:43 - What is a graph?
2:34 - Why Graph Neural Networks?
3:44 - Convolutional Neural Network example
4:33 - Message passing
6:17 - Introducing node embeddings
7:20 - Learning and loss functions
8:04 - Link prediction example
9:08 - Other graph learning tasks
9:49 - Message passing details
12:10 - 3 'flavors' of GNN layers
12:57 - Notation and linear algebra
14:05 - Final words
This is by far the best introduction to GNNs in TH-cam today. I habe seen many of them. Congratulations and thank you!
From the correct level of mathematical precision, to the pedagogy of the content and up to the voice of the speaker. It all fits like a charm. Chapeau!
Too kind! Thanks so much :)
7 Months later i can just agree to every point of that. Wonderful
Really great job and great animations. What tools do you use to make all these animations? Must be very time consuming
Yes this is the best video on graph neural network BY FAR!!
Only one video on this chanel? Come on. This is top quality content. I would definitely watch anything that gets published there.
Today, I understood Message Passing very well. Amazing interactive explanation. People like you make life easier. Thank you, Alex.
Thanks for the kind words! Glad this helped you :)
Amazing introduction to GNN's, summarizing all the important basics in a beginner-friendly fashion while providing very helpful visuals
Thanks for the kind review! Glad you found this useful :)
Best introduction tutorial on GNNs. Many tutorials throw statistics around as an explanation but very few provide the intuition behind it. Well done.
Amazing how you managed to include so much information in a relatively short video without compromising the depth of explanation. Subscribed and hoping for more content in future.
Such a lovely content man! I was having trouble understanding GNNs from other sources, but only your animation made it crystal clear in one go. Cant be thankful enough. Hope you keep making such wonderful explanatory videos on other topics in ML.
Crazy amounts of work has been put into this video. The simplicity was the cherry on the top. Thanks a ton. Gained a new sub.
I'm writing a master thesis where I'm going to use graph neural networks to calculate traffic flow, so grateful for this thanks Alex!!
Sound awesome! Glad this was helpful, Richard!
Your video deserves millions of views. SEO your video properly and you will get that. best of luck.
indeed
Thanks for your kind words! Happy this was helpful :) any tips for SEO would be appreciated!
Such a great explanation for GNN. The examples are easier to understand so that I could clearly get the concept right!! Thanks for the wonderful video!!
What an amazing explanation, wondering if you are going to add further on this line .if so ,looking forward for this moment.big thanks
Thanks so much! Glad you found it helpful :) yes I intend to try different topics and different video lengths soon!
Bro, you nailed it! This type of explanation is what we need. You are a legend
Cleverly explained, beautifully animated! Great job!
I spent like a week reading all the papers and now I stumble upon this video. God I wish I watched this before
Glad this was helpful! The paper reading will definitely pay off haha
The best high level explanation I've found, thanks!
Your video is amazing. Well explained with beautiful visualizations. Thanks a lot.
dude, the effort you put into this is amazing! Thank you
Appreciable introduction to make concept totally clear. Keep up the good work !!
Very clear explanation of the high level concepts with a remarkably understandable example!
very good explanations. cleared all the doubts, thanks
You have a gift Alex. Thanks for this beautiful explanation. I hope you continue your amazing work.
Beautifully made and explained, MORE!!
amazing explanation, we would love a series on graph neural networks from you.
It's a shame you didn't make more videos, this is like the 3Blue1Brown of NN. Best video on GNN i have ever seen.
Amazing content...probably the best one which I have watched till now for GNN
This is fabulously done; the low-level explanation of the CNN analogy and layer's function expression and then abstracting that to a generalised function expression as seen in research papers. Thank you so much!
great introduction & the animation helps a lot! thanks Alex!
Alex! Until I watched this video I felt like I was scrambling my brain trying to understand GNNs. Thank you for the gorgeous and clear explanation.
Amazing way of explaining it, the animations helped a lot, GREAT JOB! Thanks a loooooooooot.
Great explanation and illustration.
This is amazing, I can't tell you how much I needed this to see exactly where my models are messing up. Thank you😭!
Thank you for the great explanation, Alex. I’ve only just heard of GNNs in recent days and you have clarified things for me. They appear to be very efficient. 👍🙏
That is the best video explain the GNN and the more intuitive i have seen, thank you a lot.
Magnificent, spectacular presentation, helped a lot in all aspects of my studies.
Very clear explanation. Perfect work!
Absolutely amazing video! Subscribed.
Thank you ,sir. This has been the most helpful GNN video for me.
Great video! You saved my life, thousands tons of love from Vietnam
Lovee your pho
Spectacular work!
really great and detailed explanation. Amazing graphics and text. Please do more !
That's a very impressive way to explain graph nn ... Well done!
bro this is the best introduction of gnn I have ever watch.
Nicely done! Well illustrated that keeps the learning interesting 👍
Thanks Jia Hao!!
Man where are you.... we need videos from you
Great Video, Simple and easy to understand! appreciate the efforts taken!
Amazing and well done video! Thank you for sharing!
Thanks for the simple explaination of GNN
We need more videos like this!
Wow, very good explanation. Thank you!
best video so far on the topic of graph neural networks.
this is the most fun and informative video about GNN
Best explanation I've found sofar on this topic. We need more videos from you!
Thanks for the kind words!
one of the best intros to GNN i found on youtube 👍👍
Wow. This is one of the best videos I've seen. Thank you for putting the effort into the helpful animations too.
Just noticed that this is your first video. you have a gift! please keep making more
Thanks Alex. I'm not a Maths person, yet I enjoyed your video. Looking forward to learn from basics from you 🙏
Keep them coming Alex. An amazing explainer. Hats off.
Thank you for your kind words!
Really helpful visual stimulations! ✨
Thanks Serene!!!
So good! so well done, and clearly explained!
This is amazing!! I sincerely hope you make more!
Thank you! Glad you found this helpful :)
That was my best presentation video that ı've ever watched. Thanks for everything.
Wow what a nice work! Must have put much effort in this! Thanks for sharing
I still struggle a bit to understand, but I will rewatch it
This is the best GNN explainer I've seen. Thank you so much for this! Just one question: What did you use for the animations?
thank you so much for this video! helped me a lot to understand GNNs for my report
This video is very well done thank you!
Alex! Thank you for this video!!!
That is a perfect introduction. And what a fascinating topic. Thanks :)
Easy explained but still has good depth. Pinnacle of good edu videos.
Great job w the animation! It makes the topic easier to understand 💯
Thanks filmmaker Elton!!
This is the best gnn video i've seen
What a lucid explanation to a complex topic. Take a bow..
This video was incredibly helpful. Thank you.
Glad you found this helpful! Thanks for the positive feedback :)
Yeah, this is the 3Blue1Brown equivalent of Graph networks. Nothing else comes close. This is spectacular :)
This is best video on GNN for beginners
very good video. please do more on GNNs. thank you!
Great video! I hope to see more :)
best expaination for GNN, Thanks for the video 👌
You did an amazing job. I was wondering why did you stop making such videos . If possible please continue doing so
Best GNN video out there!
This an extremely nice video. Thanks you
Best introduction to GNN
Really helpful, Good clean explanation👌. Thanks
Thank you! So glad you found this helpful :)
The best explanation on TH-cam!!!
Thank you! Glad you found it useful :)
This was a terrific video, thanks. I hope it gets more views.
Wonderful! I use perceptrons / multipreceptrons and finally getting into GNN. You have a wonderful explanation! Thank you so much. I am very interested in GNN classification and anomaly detection
Thank you! Glad you found this helpful :) ah yes anomaly detection is very appropriate for GNNs, do pursue it further!
Hey your way of explaining it is very simple and beautiful 🤩.. Please make more videos like this 🙏🏻 you are too good 🔥
You’re too kind, glad you enjoyed it!
Hey, this video is amazing! I hope to see more videos from you :)
Really great explanation. GNNs seemed hard 15 min back...Thanks a lot!
Cool infographics man!! And nice explanation.
What do you use to create such animations
Thank you!! Glad you enjoyed this. I used After Effects for all the animations :)
Amazing, simply...
Great analysis
Please continue. Don't let us hang dry after this addictive introduction.
Great video!!!!! I could even understand it
A new star is born 🌟 good job Alex, with thanks.
Hahaha too kind, thank you! Glad this was helpful to you :)
Great video!
Really great video and very clear explanation! If you don't mind me asking, may I know what software do you use to create the animation? Thanks!
Thank you! Glad you found it clear :) I used After Effects for all the animations, and Illustrator for the objects
It's amazing explanation with visualization, really worth like share and subscribe, thanks for sharing such explanation and appreciated your efforts
Amazing explanation. We have lots of hope from Alex. All the best.
Thanks so much for the kind words! :) Glad you found this helpful
Wow!! Keep this great work going!! ❤🚀
Thank you! Glad you found this helpful