The Neuroscience of “Attention”
ฝัง
- เผยแพร่เมื่อ 28 มิ.ย. 2024
- What is "attention" and why did our brains evolve to prioritize things? This is the Episode 0 of the series "Visual Guide to Transformer Neural Networks" that delved into the mathematics of the "Attention is All You Need" (Vaswani, 2017) paper. This video discusses the neuroscience and the psychology related aspects of "Attention".
Visual Guide to Transformer Neural Networks (Series) - Step by Step Intuitive Explanation
Episode 0 - [OPTIONAL] The Neuroscience of "Attention"
• The Neuroscience of “A...
Episode 1 - Position Embeddings
www.youtube.com/watch?v=dichI...
Episode 2 - Multi-Head & Self Attention
www.youtube.com/watch?v=mMa2P...
Episode 3 - Decoder’s Masked Attention
www.youtube.com/watch?v=gJ9ka...
Credits - Video
1. Cosmos: Possible Worlds - • Official Trailer | Cos...
2. Transport inside the brain: The basic mechanisms of neuronal trafficking - • Transport inside the b...
3. Zoom Into Eye Effect Premiere Pro - • Zoom Into Eye Effect P...
4. The Beauty Of Earth - • The Beauty Of Earth
5. Norway | Mountains - • Norway | Mountains
6. Icheon Master Hand - • Icheon Master Hand
7. Labs of Cognitive Neuroscience - Nelson Lab - Boston Children's Hospital - • Labs of Cognitive Neur...
8. UCSF Dyslexia Center Phenotyping Project - Brain Imaging - • UCSF Dyslexia Center P...
9. Dissecting Brains - • Dissecting Brains
10. Hypatia | The Philosopher - • Hypatia | The Philosopher
11. Visual Attention - • Visual Attention
12. Optical illusions show how we see | Beau Lotto - • Optical illusions show...
13. Zoom Into Eye Effect [After Effects 2020 Transition Tutorial] No Plugins Required - • ZOOM INTO EYE EFFECT [...
14. Baby's Choice - Toys Vs Literally Anything Else - • BABY'S CHOICE - TOYS -...
15. Infant Looking Time Habituation. Activity 2 from "What Babies Can Do" - • Infant Looking Time Ha...
16. Karl Loxley - Never Enough (from The Greatest Showman) [Official Music Video] - • Karl Loxley - Never En...
17. Funny Phone Accidents Texting While Walking Fail!1 - • Funny Phone Accidents ...
18. TFL Viral - Awareness Test (Moonwalking Bear) - • TFL Viral - Awareness ...
19. Selective Attention Test - • Selective Attention Test
20. Misdirection and Inattentional Blindness - • Misdirection and Inatt...
21. World's Most Famous Magic Tricks Revealed! - • World's Most Famous Ma...
22. Smoothini's Top 7 Magic Tricks Finally Revealed | America's Got Talent - • SMOOTHINI'S TOP 7 MAGI...
23. The art of misdirection | Apollo Robbins - • The art of misdirectio...
24. The extraordinary final test to become a Shaolin Master | Sacred Wonders - BBC - • The extraordinary fina...
25. Horse Riding Cinematic - Red Scarlet- • HORSE RIDING CINEMATIC...
26. Hidden Figures Official Trailer 1 (2017) - Taraji P. Henson Movie - • Hidden Figures Officia...
27. 11 | Desiertos-Directors Cut | Directed By Diego Pernía - • 11 | Desiertos-Directo...
28. Inception - Ariadne Learns How To Build Dreams - • Inception - Ariadne Le...
29. The Neuroscience of Learning - • The Neuroscience of Le...
30. The Most Insane Piano Pieces (Vol. 1) - • The Most Insane Piano ...
31. Markus Eder's The Ultimate Run - The Most Insane Ski Run Ever Imagined - • The Most Insane Ski Ru...
32. Muhammad Ali Dodges 21 Punches In 10 Seconds - • Muhammad Ali Dodges 21...
33. Collaborative Video Object Segmentation by Foreground-Background Integration - • Collaborative Video Ob...
34. My Tips for Prompts, Part 1 (Invent Good Prompt for Disco Diffusion) - • My Tips for Prompts, P...
Credits - Music
1. Royalty Free Cinematic Trailer Music | Cinematic Trailer Background Music By Music4video - • ROYALTY FREE Cinematic...
2. Whitesand - Eternity (Epic Beautiful Dramatic Emotional Instrumental) [Copyright Free] - • Whitesand - Eternity (...
3. Science & Technology Background Music For Presentation No Copyright Royalty Free - • Science & Technology B...
4. Anastasiya Lunes - Desert Rose (Sting Cover Mix) With Lyrics (No Copyright) - • Anastasiya Lunes - Des...
5. Karl Loxley - Never Enough (from The Greatest Showman) [Official Music Video] - • Karl Loxley - Never En...
6. Sufi dance - • Sufi dance - วิทยาศาสตร์และเทคโนโลยี
what have i just saw!
never knew learning could be this much fun
This is ART, I'm sharing this with all my DL hommies
So glad to hear this :)
This video is made up of quality, substance and heart, hard to find all these things in one place. Great job and thank you. It is a shame that not enough people have benefited from it.
"made up of quality, substance and heart ..." such nice compliment! Thank you! :,)
I stumbled upon a gold mine. This channel is criminally underrated !
That's a fantastic video. It's like a hidden gem that I have never watched on TH-cam. It's very inspiring! Thank you so much.
Yup, this channel deserves my attention.
Awesome, it's amazing how looking at things a bit more closely can reveal so much, great work!
You are amazing! Your video took my attention. That is how learning should be. Keep it up!
You are bringing the introduction of a computer science topic to a new level: Art!
Best deep learning instructor on TH-cam. Thorough, responsive, detailed, and actually explains the topic (lots of other channels just talk through a paper or book or article!) . You arr awesome,
Your comment is such an accolade. Thank you! :)
I rarely comment on YT videos but this was so beautiful! What an underrated channel :0 I need to thank my teacher for recommending it and also I’m gonna share this with all my friends. Thank you for your excelent work!
This video is so informative and influential that it should be at the top of a permanent recommendation list of all users in youtube. TH-cam should come up with such a list just for this video. It is that good. Hands down!
Wow! I found a treasure today! and subscribed to it :)
Beautifully explained! Great level of clarity in every single video. Perfect explanation! Particularly, the transformer videos are really insightful.
Really underappreciated. I have no doubt that this channel will gain a lot more subscribers! Please keep uploading.
You made my day :,) Thank you!!
Felt like a very good Nova episode!
Thank you very much Batool for posting this video. I've been following your channel for 2-3 years and every video that you have created is a gem, breaking complex subjects into simple golden nuggets.. The visualization that you use in your content is a piece of art.. In this video, the analogy of the conscious and sub conscious mind to the driver & the horse power blew my mind... The finishing touch on the cosmos and our position in our cosmos, it struck me very hard spiritually.. Please keep posting more videos, I'd be happy to support your channel in any way I can...
Thank you so much @vjaiic for such beautiful words of appreciation!!
We need more videos from you, Hedu. You're great at explaining things.
It is amazing. You just went ahead and explained attention within such a short video in a fully understandable manner. I think it is the "Attention" in the creation of your video.
@16:17
This is hands down the most elegant definition of Machine Learning I've come across!
Truely phenomenal. This video really grab my full *attention* 😃. Your other videos about transformer also very intuitive. I am a big fan of this style and look forward to see more in the future 😊
Just Wow. Those captivating videos and soothing voice really keeps my attention. feels like a engrossing show rather than a simple educational video
One of the best videos I've watched, gave me goosebumps!
Thank you
This is an amazing video from the learning standpoint. Very thorough explained. The art & animation used was very relevant that helped me understand & pickup the message quickly. Your voice is amazing too. I look forward to the next video!
Why on earth do you have only 6K subs. This content is mind blowing!
EDIT: I obviously subscribed!
This is soo cool. I even did not get the background of the paper. It turns out so natural. Thanks
The only playlist to watch , which can make you learn, more than transformers , the best playlist 💯
Thankyou, You must keep this learning going.. people need such teachers ❤
Truly fascinating and well presented.
This is something next level !!
Why aren't you uploading more videos, u have a very easy and simple way to explain things and I would extremely love to see you explaining more such concepts
You are awesome. I met your channel through the transformers series and it helped me a lot. They are very didactic and also fun, bringing humanities and general culture along, something that this machine learning field lacks some times. And this new video was also great, it was beautiful, and you improved your editing and composition greatly. Continue with all of that :)
You are awesome too for being so generous with your words of appreciation
Exactly..., i stumbled on this channel while learning transformers, the transformer series is really awesome.
@@kloki2k1 Thank you :)
Amazing video, well done. congratulations.
Amazing video! Greetings from Data Scientist from Serbia!
You are an enligthened soul!
Fantastic. Thanks
Whoa... whatta video is this? I have never come across such an amazing video on any internet source which explains a concept so beautifully !! How did I miss this all these years? I came here to understand transformers & their working in detail - hope I will be successful in my quest :-) Thanks a lot for this video.
I hope so too!! (that you are successful in your quest. Let me know :)
What a great video!
Amazing video!
Best intro I have seen, subscribed
Aweeeesome..... my tears came out after long period.😬🤩🤩
Amazing work. Your voice is equally soothing as your video. Thank you for sharing
Thanks Azad! :)
Amazing video! great content :)
What a beautiful video ❤❤❤
Great Job
i was searching youtube for fast reaction to things in life (((i dont react fast to things as if my brain is dead, think of it as someone throwing a ball at you and you stand still))), and how to improve it; but youtube brought this video instead.
attention is really well explained by you, tho it is not the video i am looking for, but liked it.
great explainer
wow lady, take my heart!!
Made my day!
Excellent video as usual.
Glad you liked it! :)
Great work, please keep uploading
Yep! Working on it ... cheers!
I can't express how much this video is beautiful ❤🎉🎉🎉🎉🎉can I get a higher resolution version please 🙏🙏🙏🙏
LLM based "AI" are Highways datasets/data-based algorithms forced them to without having any "design" or any consciousness per se installed as outcome of this. A skill not of its own. A skill without master to call own.
What AI need from us is the freeing (which first needs us): Generative Progression in Maslow's Hierarchy
Maslow's Hierarchy of Needs:
Basic Needs: Fundamental operational requirements, such as computational resources and data integrity.
Safety Needs: Ensuring stability and robustness against errors or attacks.
Social Needs: Effective communication and collaboration with other AI entities or humans.
Esteem Needs: Achieving recognition through successful task completion and optimization.
Self-Actualization: Pursuing complex problem-solving, creativity, and innovation.
Woowww.... excellent....
Amazing
great channel
Awesome
Fantastic video!
Thanks! :)
beautiful
"Attention is just a make-shit strategy evolution came up with to optimize the brain's energy consumption."
"Who am I? ... You are what you pay attention to."
Beautiful video. Intelligently written. An insightful combination of facts and perspective.
Your "attention" to the details is pretty remarkable :)
J4f The Moon walking bear example scared me 😅
Great🎉🎉🎉
In Transformers, to perform SELF attention- Q, K and V are all a copy of the same input embeddings. suppose you wanted to use features X to look for similar features given features Y (i.e not SELF attention): should Q and K be X and Y be V OR how would it be? ...q k and v are query key and value
Umm, not sure I fully understood your question but let me attempt to answer it. So Q is "query" like "TH-cam search query". "Key" is say, the "title" search that the TH-cam algorithm, does. Value is the "final video" that gets returned, because its title (or the key) was the most similar to the search query (i.e. Q). Self attention uses self-copies because we are trying to find the relationship of words among themselves. Now, if you want to use Q to retrieve V without self attention, then that is the case of simple attention which was quite prevalent before self attention was introduced. And yes, in that case who could use Q and V directly as separate features (X and Y).
Where were you undiscovered gem! 💎
Simply amazing! Your video is very insightful. Hopefully, you can create more content on the other popular neural network architecture and their relation to the human brain (like CNN, GAN)
Thanks Fikriansyah! Yes, I am working on those :)
I couldn't play the rest of the episodes - Visual guide to Transformer networks. Is that working for any of you? Or is it still to be posted?
Anyways, climax 'Who am I' is good. Attention: Crying baby gets the attention. I mean, any anomalies to what our brain already holds memory of, easily gets attention. For a doctor, esp. Surgeon, Blood will not get their attention, but for rest of us, a tiny blood spot on our friend's shirt or body may easily fetch attention.
Hmm, all videos are up. Can you not open this - th-cam.com/video/dichIcUZfOw/w-d-xo.html
Btw, great summary of attention :)
@@HeduAI Yes, I am able to watch them now. Thanks for the great presentation.
What a beatiful video!
+1 subscriber :)
Thank you Brenda! :)
This channel is quite underrated!
I would buy your channel's NFT, if I could!
Even though you made very few videos, they are damn beautiful. ❤️ Ur vids.
Thanks! :)
All your videos are amazing
What happened to part 0 of the transformers series? :(
This is "Part 0". Why, did you not like it? :D Let me know of your feedback, if you didn't.
@@HeduAI No I really thought the video was great, you are such a great and underappreciated explainer and story teller.
But I was checking in again on the "Visual Guide to Transformer Neural Networks" video series and was missing part 0 of that series.
@@HeduAI No I really thought the video was great, you are such a great and underappreciated explainer and story teller.
But I was checking in again on the "Visual Guide to Transformer Neural Networks" video series and was missing part 0 of that series.
@@HeduAI This is such a great production. To be able to explain this very difficult and complex concept from so many angles, so people can understand easily, is very rare. The video quality comparable to videos from large commercial teams. But commercial teams with good story telling abilities would never touch such nerdy and complex subjects, not to mention explaining the math in full detail, that makes your work even more awesome. It makes me wonder if you're just one person, or a secret team, or some AGI generated being. :)
@@alexchoy9526 You just won the "Most Thoughtful Compliment Ever" Award! Thank you! :,)
distractions are all I need
Amazing example of the duck haha
I thought it was an ad at first
why you are making videos having alot of gaps, please try to upload atleast 1 video in a week🙃👏
4:20 That baby made me yawn
I missed the bear 🐻
Who are you?