Brain-Like (Neuromorphic) Computing - Computerphile
ฝัง
- เผยแพร่เมื่อ 9 ก.ย. 2020
- Memristors, Artificial Synapses & Neomorphic Computing. Dr Phil Moriarty on the limitations of the Von Neumann architecture and what could be next.
Phil's blog post: muircheartblog.wpcomstaging.c...
Von Neumann Architecture: • Von Neumann Architectu...
/ computerphile
/ computer_phile
This video was filmed and edited by Sean Riley.
Computer Science at the University of Nottingham: bit.ly/nottscomputer
Computerphile is a sister project to Brady Haran's Numberphile. More at www.bradyharan.com
I like how this field of research is a blend of chemistry, biology, electronic engineering and computer science
And later, when all this nonsense has stopped, perhaps we'll dig it up some day adding Archaeology to that list.
The future is more interdisciplinary and I like that =P
if you go down enough, biology becomes chemistry and if you go down even more, everything becomes physics.
@@Biped it's all applied math
@@rewrose2838 true. does that mean that being a mathematician qualifies you to be a doctor? :D
I'd love to hear more about this, on one condition: we get this man more coffee
And a helmet to protect his skull from the over-excited motor function. Although I guess he'll be first in line for a neuromorphic replacement.
I could listen to him talk all day.
It wasn´t coffee, It was Weed !!
yeah. couldn't find a course on TH-cam or anything
@@ivanguerra1260 When I drink coffee, people think I'm high on speed
This is an interesting research field I did not know the existence about up until now. I propose follow-up videos from Dr Phil Moriarty because this is too interesting!
Lex Fridman recently had a very interesting interview on this topic if you want something longer to listen to
Dr. Phil Moriarty sounds like a fictional character from a Japanese comic book in English...
@@phs125 He is a grand nephew of James Moriarty (if you know what I mean ;)
@@Matthew-kn7xi Thank you, I will definitely watch the video today!
I hope Dr. Phil Moriarty uses more Rush examples in the follow up videos
yes please go into more detail about neuromorphic computing
This is one of the most interesting, weird and cool areas of computer science in my opinion
It's so unconventional by current standards and yet when you think of first principles I think we see it's a welcome addition that should help cover a slew of problems that are ill-addressed by current systems.
This is legit the future!
Its really an area of computer engineering
@@paulleimer1218 Now that it's experimental, yes, although you can already find applicable problems in e.g. discrete maths. But if/when it becomes a real market, then re-thinking computation knowledge outside Von N. machines is likely to trigger whole new classes of common pipelines such as compilers or notions of Big-O complexity. It's bound to become a particular sub-domain within CS eventually if neuromorphic computing takes ahold. And I haven't even touched at the network science which is currently perhaps the poorest aspect in all of applied CS, being largely dealt with in stochastic rather than formally true paradigms (e.g. routing, still relying on tables at the end of the day, not pure logic).
This is physics, not CS
This is really fascinating, but the parallels to neural circuitry were extremely overstated here. In an actual biological synapse, there's a giant division of varied proteins at work that does much more than simply tune the 'strength' of a connection in a straightforward way. Also: Single synapses often employ multiple transmitters; receiving synapses have differing receptors that respond differently to the same transmitter; synapses give themselves feedback about their own activity; different types of neurons have different patterns of baseline-firings in addition to action potentials etc.
In more general terms: Nothing beyond the most primitive neural circuits is comprehensively and computationally 'understood'. Even though Prof. Moriarty talks about the lack of division between memory and 'processing' in humans, this is not exactly correct (there are dedicated 'memory areas' whose destruction or impairment has grave consequences for information storage and the capacity to learn, but they are not by themselves necessary or sufficient for the acquisition or recall of every type of memory). Nobody, in fact, can rigorously characterize where memory 'is' localized in the brain. But again, it is bound to be a combination of macroscopic regions, local synaptic information, temporal firing patterns etc.
An informative video still, and I of course understand why these details and others were glossed over. But taking the neural analogy too serious, is kind of a bad idea in my opinion (at the current level of knowledge).
I was cringing as he described short-term plasticity and long-term potentiation. His blog post is also full of strange statements like "neurons combine (co-locate) memory and processing". Which is not actually true. That sort of question goes back to MuCulloch and Pitts who showed you actually have structures of connected neurons which can do logical processing together, not individually. The synaptic weighting between these units serving as memory of the system (Freeman).
I think that the implication is not that these devices exactly mimic the behavior of the brain, but that they can be "trained" as typical neural networks can in order to more closely mimic that. I would imagine during the process of training that there would indeed be separation and grouping of these small neuron-alikes to form larger structures. I do however have some major issues with CMOS being called energy hungry. It's only energy hungry because it can be, not because it has to be. Right now computing is based on flat chips with a limited surface area and a fixed cost, and one thing you can do to increase the computing power is to drive the circuits faster. Frequency is a large part of power consumption of chips, and part of the reason that phones are so power efficient is that they have multiple cores which run at 1 Ghz or less. GPUs are actually fantastically power efficient for their raw amount of performance because they have huge numbers of cores working in parallel at lower frequencies. Now imagine if you could fabricate an entirely integrated CPU with modern transistor density, not only in 2D, but in the full 3D volume equivalent of a human brain, and then have the coding to utilize that many parallel processors. You could drive them at 1 Mhz or less and still crush most other devices in highly parallel tasks. However, right now, that technology would be horrendously expensive and maybe even impossible with our technological progression. It will probably require nanoscale 3D printing to achieve anything close to that, which is fairly similar how brains are formed (in a broad sense).
"Memory" can mean several things, for example the memory of a event in the brain, which could be something like "data memory".
Or it can mean: you remember how to drum, walk, talk, etc. This is more like "program memory".
I think that "neurons combine (co-locate) memory and processing" refers to this "program memory"... the algoritms used to process data.
Indeed is more like proccessing and memory are the same thing in neural nets.
On the other hand, neural nets also store "data memory" as they are pattern recognition devices.
It's all about Spheroidal Cows...
It’s almost as if he’s doing a 13 minute video and can’t completely explain a whole scientific field! What’s more he specifically says in the video that he will be leaving stuff out. Then absolute geniuses turn up in the chat to try to prove how smart they are by listing all the things he didn’t explain. Absolutely cringe.
If you have the opportunity, then it would be awesome with more videos on this topic in the future.
Yes! Please do more videos about it :)
Vote +1 very interested
A highly caffeinated Professor Moriarty is a joy to behold. He was going 100 miles a minute, stopped on a dime to answer you and then took off again without missing a beat.
Drumming might not have been the best analogy. Drummers are usually working with fewer synapses :)
Is this a good musical joke or is this a sick burn ?
Haake, T., Garstka, M. et al. would like a word with you
The drummer might have locked his keys in the car, but it's the bass player that's stuck inside. 🔥
I love this guy's energy and ability to explain such a vast and deep field to a common layman with no prior knowledge of these things, and without math at that. Amazing, please keep these videos going and give Phil more coffee 😂
Ray kurzweil predicted that we will achieve AGI by 2029, I think he is right
Dr Moriarty is usually pretty passionate and energetic, but he's totally wired in this one! Caffeine is a hellofa drug. Love his passion for the field and his eloquence in breaking down complex topics.
I always trust a man who's this excited and who likes John Bonham.
I had to watch the first two minutes twice, because I was geeking out on his shirt.
Memristors are useful for standard computing also so theres multiple funding reasons for their development
"You don't have a lot of liquid in a laptop"
Coffee has entered the chat.
Coffee is not exactly a liquid, but a mixture of various solutions and suspensions of solids.
I love listening to people talk about something they're passionate about... And I can see that he's passionate... I love this... I love learning from people like this...
GIVE US MORE OF THIS! Seriously this is a fascinating area of research. I'd love to see many more videos about this topic.
This man is so excited, it's like he's on the verge of a breakthrough. Love his enthusiasm!
I'd love more videos about this field! Super interesting and love the enthusiasm this guy has!
He is so enthusiastic about his research! I ❤️ his energy.
People like that, approach and hyper passion like that, is what gives me chills. This stuff is fascinating. Thank you so much.
Ok this was AMAZINGLY interesting and well explained. Please we need more on this field !
What about FPGAs?
I could listen to this guy all day has such enthusiasm
9:58 But this one goes to 11!
Neurons that fire together, wire together.
Dude, I have been waiting SOO long for someone to talk about neuromorphic computing on TH-cam.
I love the enthusiasm of Dr Phil Moriarty! Inspiring! Keep on producing such awesome work!
That Zeppelin shirt is fantastic! More videos with Phil!!! Also, nice to see info about the electrical hysteresis loop. Should make a computerphile vid on the history of the Law of Hysteresis discovered by Charles Proteus Steinmetz. It's EXTREMELY computing-relevant.
Wow! Never came across such a fascinating research field , my mind is totally blown away. The way Dr Phil Moriarty explaining shows his passion and enthusiasm towards this field, thank you Dr Phil. What I observed is generally academia doesn't support such a path-breaking research, we need more private industrial research so that at least we can try and experiment such unique ideas and they won't have to worry about lack of funds. If possible please make more videos on this topic, thanks again for making such an awesome informative video :)
Moriarty preaching about Neuromorphic computing gives me great hope, as I'm a physics student but I love concepts like these and am glad to know studying physics won't necessarily keep me away!
This sounds like one of the most important topics covered here, this is amazing! Would love to see more of this.
I would definitely watch a series on this topic
I can feel Dr's Phil energy. It's Amazing.
I'd love if this could be a series. Also the way he introduce papers that might be interesting to check out
please sequel! all those juicy materials too, Transition metal dichalcogenides (TMDC), OxRAM, CBRAM, Ferroelectric systems, floating gate transistors. then one more ep on short term plasticity, long term memory consolidation, Prof JJ Yang's short term plasticity temporal coding paper. mind blown.
This makes so much sense. Amazing. Please make more!!
Brady/Sean we need more videos on neuromorphic computing!!
This is the Dr. Phil I would rather watch.
Nice video as usual with all these nothingam's channels :) so YES PLEASE MOAR on this ! I'm in Switzerland next to EPFL and i've heard about the Blue Brain Project but i didn't think others were so close to developping a memoristor
Interesting field of research that I didn't even know existed. Would very much love to see more content on this!
Now that NPUs are becoming mainstream and available in laptops/smartphones/GPUs, this video deserves an update because there's like ZERO videos other than this that describe how NPUs actually work. Prior to this all I knew is that somehow they leveraged Kirchoff's law, but seeing that memristor diagram put it into perspective.
I absolutely want more of this
Wow! We need more of Dr. Moriarty!
Very well presented and, as always, Dr Moriarty's infectious enthusiasm made me want to buy one (and I don't even know what it is)
I love your enthusiasm. Thanks for making this so interesting.
Regular activation patterns lower the threshold, so your brain can compute after.
Constant firings slow down the neurons to avoid oversensation, like when staring at a bright light, it gets darker.
It's also down to chemical resources in the brain and that being "smart" is being energy(chemical) efficient.
one additional aspect of the memristors ability to remember its past states via the vacancies in the synapses of the board, is the toffoli gate itself.
Each input neuron and each output neuron on the board have their own ancilla bits inside their toffoli gate, which means its actual qubit that can help remember the last state of the synapse
This is fascinating, please more.
I've been working on simulating memristors as artificial synapses and I can really feel this man excitement
We definitely need more, this sounds very interesting!
Definitely want more clips on this field!
Please Computerphile, do more of these video, this is a very exciting topic :)
Hi guys definitely would like to hear more about this topic.
Thanks and keep up the excellent work
This is fascinating, I love this field!
Thanks for decomposing the memristor to its bare essence.
Ok so this is equally fascinating and terrifying. Please give us more.
Super interesting stuff; would definitely be interested in more of this field.
Yes.. Yes please do more of these
Please more of these it is fascinating
As a material science masters I’m writing my thesis on neuromorphic computing this year. I’m insanely excited to say the least.
The most valuable video i had watched in 2021, Really! i felt like i'm not wasting my time.
The day we fully understand our brain will be the day we'll have the biggest jump in how to correctly design better computational architecture
Please do more on this field. I would definitely watch that
Yes: please do more videos on this topic. Thank you.
Yes, more of these videos please.
Great work!! Please, keep uploading contents about this subject
That is absolutely fascinating. I really would like to know more about these neuromorphic architectures and how they work.
The Dr Phil actually worth watching.
Would love to see more of this!
More in this topic!! This video was so hype
Damn, he hits his head often :D
He's finding carriage returns without line feeds in his inner monologue and has to supply them from the outside.
Beautiful explanation. Imagine the fulfillment that engulfs researchers in this field; it must be intoxicating.😀
yikes, thank you so much for bringing this more into the spotlight! I did research on memristors during grad school, neuromorphic computing, the physical side of deep learning, really is the next big thing.
This will have a big impact on everything.
Isn't this what renowned computer scientist Miles Dyson was working on way back in the day?
Indeed, memristor technology is actually the product of a bootstrap paradox in which the technology was discovered from the remnants of a murderous robot from the future.
@@mushin111 Someone should make a movie about that!
Please, more content on this topic!
Loved it ! Continue this amazing stuff.
10:20 I'm sure it's unvoluntary but I love how the box has the "Intel Inside ™" logo on the size and it's mimicking a memoristor ahahah
Please please more of this stuff!!!!
I just started graduate studies in computational neuroscience/machine learning! This is super cool and I want more videos!
Would love to hear more about this subject...very interesting
I would love to hear more about this stuff.
I always love Dr. Moriarty's energy and delivery.
Yes. More please.
Please do more videos on this topic!!!
More videos on this topic, PLEASE!
Would love to see more (in depth) videos on this topic.
YES YES YES
PLEASE DO MORE VIDEOS !
I would love to see more videos on this.
I was absolutely engrossed in this video because of the content... I need more... PLEASE??
Yes! More videos on neuromorphic computing please!
I would definitely not mind more videos in this field!
Yes please more!
So our consciousness is computational? confirmed? Also yes more videos please. You're one of the best channels on youtube.
Its incredible this video OMG
Plus one for more videos on this topic
Def more videos please!
Phil reminds me so much of one of the monologues in the movie 'A Waking Life'
Incredible video! Thank you very much!
I was working in TiOx memristors at the University of Southampton and their potential is unbelievable!
Shame they need a massive investment in order for them to be fabricated!
Thank you guys! Brought me incredible memories!
Please more videos on this!