Thanks for Lex always for having those great conversations and great lectures. If u r too busy Imma recommend u to watch 40:00 for two mins at least to get insights of how deep learning will go.
Outline: 0:00 Introduction 3:42 Current state of deep learning 6:44 Architecture vs dataset 8:01 Learning through interaction 10:46 Our brain is big 12:40 Knowledge 24:01 Ex Machina 25:28 Bottle Ideas 27:54 Bias in Machine Learning 31:29 Teaching Machines 33:58 The Turing Test 37:48 Whats next 40:20 Gans
Great discussion, thank you Yoshua and Lex. A question about infants vs. machine learning: If we view the world as we see it, a continual, light-speed fast, changing pice of data, would it be safe to say that the infant uses huge datasets as well?
Thank you Lex and Mr. Bengio! So many exciting points in there. I enjoyed the critique of Ex Machina (really liked the movie, but had similar problems with it).
Yoshua is filtering the hype around AI & DL and speaking frankly. He has been a front-runner in DL for a long time and still is not carried away by it.
The youtube automatic caption is almost perfect,and that's super crazy.One or two years ago those captions were completely nonsense and now they were perfect
Every science progress is based on collective works of large group, beautifully said. Not only science, but almost everything, from poem, literature, even to every progress in our daily life. Individual who has name under each breakthrough is largely synthesizer of collective intelligence. ❤❤❤language, internet, and all technologies make it possible and easy.
I know this comment comes a bit late, as a dr I believe that what is missing is a language between components to be used in ai, so the differents components within a system can Interact, you can even take these examples in celular behavior. We shoulf observe the micro before we can apply rules to the macro.
Great talk! Some feedback on the format: An unedited version might be better, the topics can get quite theoretical at times and when they do, it can take some time for the points to really set in. So the pauses can help with that. But I also don't mind re-watching. 😁
Maybe it's on the original podcast, but it might have also been nice to have discussed ethics a bit. As in, how do we decide when/if there are ethical considerations. For example if we think there is a chance an AI has human level understanding of itself and the world, is it ok to be deleting, updating, modified ect (even if it doesn't have a specific value for it's own existence). Especially because it will be so hard to define whether an AI is self aware or simply mimicking. The general trend in the scientific community seems to be very post-fact, like we would need to define with certainty that it is self aware before we worry about ethics. But it's necessarily impossible to do that. Even if we can somehow make that definition (which we possibly can't with certainty), we would already be doing those things in order to create it. The criteria shouldn't be that we're sure it's self aware, but (as we would do for a potential person) be sure that it isn't. But that would also be self defeating, as it would mean we can't develop the AI to make the distinction in the first place. I'm not sure it will matter or be discussed seriously anyway as most people seem incapable of considering that any AI can be self aware, even if they consider their own brain and consciousness to be of physical origin. Which is self contradictory, but we're great at putting what we want before what we know!
Research - artificial neural networks are modelled on biological neural networks - the difference between biological neural networks and artificial neural networks - properties of BNNs and how they occur - mechanisms
We have our natural brains as a point of reference and we can model every atom and every interaction with current mathematics/physics. It's just complex in terms of computational requirements. Why would artificial brains require new mathematics?
6 ปีที่แล้ว +2
I thought that he might be meaning physical limitations. But mathematics has some limitations also. He will need to clarify.
Maybe you're right. I just read too many "the universe is mysterious" or "humans don't understand X, so how can we understand Y" comments that bring nothing to the discussion and this sounded like "there's this obscure part of mathematics that I personally believe is key to everything and all those researchers don't get it". If I misunderstood the comment and took it the wrong way, I'm sorry.
@@aigen-journey maybe he means we'll need entirely new maths to encode the human mind. Thats literally whats implied. Idk if thats true but its interesting. I wonder if anyone serious has hypothesized this
25:41 The concensus is that breakthroughs in AI by private companies will (most likely) never be "bottled" and go undiscovered by the general research community. However, isn't Boston Dynamics in robotics a perfect example of exactly this?
One key missing linkage in AI, the mysterious point, seems to be the biological consideration. If our brain is an organ added/expanded later to explore our live better, the objective function of AI should have such consideration to orchestrate the whole even though certain suboptimization may take place as we may move our attention from one to the next. Sleep/dream or meditative process may represent the way to seek for better optimization by coming up with deeper insight for each of us to live better. The interplay of conscious and unconscious (while we may seek balancing various sub-optimized objective functions) is a way for us to respond to various stimuli to find a way to be alive - and to live better. My sense is: given that we live in the world of impermanence, we are made (i.e., programmed) to feel happy when we are in line to accomplish such a task. -> If so, my question to AI scientist is: how do you bridge the gap?
From my exposure to Zen, meditation, etc., I see being aware of "conscious of unconscious" is the way to discover insight/wisdom. Here, commonly used expression, Sila (right conduct/habit/edge) -> samadhi (reach out to unconscious mind and body are one - deep learning) -> panna/prajna/WISDOM (insight - know what is going on and how to act) is how the process may work - following the principle of Law/ Nature's way. Or, Thy will be done. I am very much interested in witnessing how AI may merge with such an age-old practice.
@@TheHellogs4444 and parent is more likely to play a role as an external critic assignment that attempt to reduce the explorative probability and using their prior knowledge to just straightly label the unexplored policy
@@jacobadamczyk3353 YES! I loved entropy based models and maxEnt RL in particular is amazing. I think maxEnt RL with better models and dynamic updates will probably lead us close enough to AGI that there wont be any jobs any more.
Peculiarities and phenomena of human psychology == breadcrumbs to underlying structures We already have to much common knowledge - we just have to use it.
wow............totally agree with the points of those movies....that one individual creates........and invents all things......no it doesn't happen like that.........Leon Musk has teams, and engineers that solve, and build more prototypes......Man can't be compare and idolize as God to create things..............................Great interview Lex......Thanks.............:) ................bye
I hope that there will be intelligent beings from other planets who come to help us accelerate computer technology on earth, or humans who come from a future that brings technology from the future.
Lex, You will be remembered in the history books for bringing these visionaries to talk about their work that ordinary folks can understand.
Thanks for having him on Lex, love hearing from the guys on the cutting edge.
Please DO continue with these series! Thank you :)
It’s mad to see what’s he has done with the podcast. Shout out to lex
Love how you trimmed the video, not a second of wasted time! Thanks.
YES! Yoshua Bengio. Thank you for this continued AGI series Lex!
Thanks for Lex always for having those great conversations and great lectures.
If u r too busy Imma recommend u to watch 40:00 for two mins at least to get insights of how deep learning will go.
if you're too busy just watch it later
Wonderful talk. I do agree with Yoshua Bengio's critique of the 2014 film Ex Machina. Thank you for sharing this.
I would like to see you interview Yoshua for a second time.
There is certainly a priori that helps build complex systems. Thanks Yoshua for this.
This guy looks chill AF
Such a pleasure to watch those podcasts, Joshua Bengio just came after Francois Chollet. Keep going and Greets from Russia ;)
Amazing questions for an amazing speaker. Thank you Lex!
Outline:
0:00 Introduction
3:42 Current state of deep learning
6:44 Architecture vs dataset
8:01 Learning through interaction
10:46 Our brain is big
12:40 Knowledge
24:01 Ex Machina
25:28 Bottle Ideas
27:54 Bias in Machine Learning
31:29 Teaching Machines
33:58 The Turing Test
37:48 Whats next
40:20 Gans
I looked uo some things I didn't understand and they are all computing terms, so, not my area of work! Such a great chat!
Thank you so much Lex. Great content as always.
Great discussion, thank you Yoshua and Lex. A question about infants vs. machine learning:
If we view the world as we see it, a continual, light-speed fast, changing pice of data, would it be safe to say that the infant uses huge datasets as well?
Gem of an interview...just saw in bits and pieces
Amazing Interview! Thank you Lex and keep this great work!
Thank you Lex and Mr. Bengio! So many exciting points in there. I enjoyed the critique of Ex Machina (really liked the movie, but had similar problems with it).
I'll have to listen to this again and look some stuff up!
To my likes, Bengio is amongst the top 3 ML scientists in the world.
I like this series. Please continue your cool way.
Yoshua is filtering the hype around AI & DL and speaking frankly. He has been a front-runner in DL for a long time and still is not carried away by it.
The youtube automatic caption is almost perfect,and that's super crazy.One or two years ago those captions were completely nonsense and now they were perfect
💕36:54- 37:34 💎 Excellent last question Lex!
my favorite researcher
25:43 That moment was kind of ominous!.... ^_^
"You Shouldn't Trust Him" - Ava
Every science progress is based on collective works of large group, beautifully said. Not only science, but almost everything, from poem, literature, even to every progress in our daily life. Individual who has name under each breakthrough is largely synthesizer of collective intelligence. ❤❤❤language, internet, and all technologies make it possible and easy.
You really liked to use fixed camera only on first few podcasts
I know this comment comes a bit late, as a dr I believe that what is missing is a language between components to be used in ai, so the differents components within a system can Interact, you can even take these examples in celular behavior. We shoulf observe the micro before we can apply rules to the macro.
Your topics are pretty interesting!
Great talk! Some feedback on the format: An unedited version might be better, the topics can get quite theoretical at times and when they do, it can take some time for the points to really set in. So the pauses can help with that. But I also don't mind re-watching. 😁
Maybe it's on the original podcast, but it might have also been nice to have discussed ethics a bit. As in, how do we decide when/if there are ethical considerations. For example if we think there is a chance an AI has human level understanding of itself and the world, is it ok to be deleting, updating, modified ect (even if it doesn't have a specific value for it's own existence). Especially because it will be so hard to define whether an AI is self aware or simply mimicking. The general trend in the scientific community seems to be very post-fact, like we would need to define with certainty that it is self aware before we worry about ethics. But it's necessarily impossible to do that. Even if we can somehow make that definition (which we possibly can't with certainty), we would already be doing those things in order to create it.
The criteria shouldn't be that we're sure it's self aware, but (as we would do for a potential person) be sure that it isn't. But that would also be self defeating, as it would mean we can't develop the AI to make the distinction in the first place.
I'm not sure it will matter or be discussed seriously anyway as most people seem incapable of considering that any AI can be self aware, even if they consider their own brain and consciousness to be of physical origin. Which is self contradictory, but we're great at putting what we want before what we know!
What you people think of using AR for supervised/reinforcement learning? Will it be our next step for learning sophisticated tasks?
Research
- artificial neural networks are modelled on biological neural networks
- the difference between biological neural networks and artificial neural networks
- properties of BNNs and how they occur - mechanisms
cc.Lex Fridman:
cc.Yoshua Bengio:
A strong case can be made to support your theory on sematics.
Great.! Just when a transformation in currently adopted system is needed.
Where is the table of contents?
Premonition from Yoshua B.: need a system with human in the loop for training, this is exactly what was done for ChatGPT.
Why no one is discussing the limits of the applied mathematics we have in encoding higher cognitive learning?
Mathematics or physics?
We have our natural brains as a point of reference and we can model every atom and every interaction with current mathematics/physics. It's just complex in terms of computational requirements. Why would artificial brains require new mathematics?
I thought that he might be meaning physical limitations. But mathematics has some limitations also. He will need to clarify.
Maybe you're right. I just read too many "the universe is mysterious" or "humans don't understand X, so how can we understand Y" comments that bring nothing to the discussion and this sounded like "there's this obscure part of mathematics that I personally believe is key to everything and all those researchers don't get it". If I misunderstood the comment and took it the wrong way, I'm sorry.
@@aigen-journey maybe he means we'll need entirely new maths to encode the human mind. Thats literally whats implied. Idk if thats true but its interesting. I wonder if anyone serious has hypothesized this
What an amazing interview ! I need to Understand Gans
Joshua is very impressive talker, I can't understand him in 1.5x speed.
u missed the Y
25:41 The concensus is that breakthroughs in AI by private companies will (most likely) never be "bottled" and go undiscovered by the general research community. However, isn't Boston Dynamics in robotics a perfect example of exactly this?
Great interview! But I did not like all the thinking moments cut out. Makes it unnaturally fast, and takes away the time for me to think as well.
It feels like he was talking about Transformer's architecture 😉
One key missing linkage in AI, the mysterious point, seems to be the biological consideration. If our brain is an organ added/expanded later to explore our live better, the objective function of AI should have such consideration to orchestrate the whole even though certain suboptimization may take place as we may move our attention from one to the next. Sleep/dream or meditative process may represent the way to seek for better optimization by coming up with deeper insight for each of us to live better. The interplay of conscious and unconscious (while we may seek balancing various sub-optimized objective functions) is a way for us to respond to various stimuli to find a way to be alive - and to live better. My sense is: given that we live in the world of impermanence, we are made (i.e., programmed) to feel happy when we are in line to accomplish such a task. -> If so, my question to AI scientist is: how do you bridge the gap?
From my exposure to Zen, meditation, etc., I see being aware of "conscious of unconscious" is the way to discover insight/wisdom. Here, commonly used expression, Sila (right conduct/habit/edge) -> samadhi (reach out to unconscious mind and body are one - deep learning) -> panna/prajna/WISDOM (insight - know what is going on and how to act) is how the process may work - following the principle of Law/ Nature's way. Or, Thy will be done. I am very much interested in witnessing how AI may merge with such an age-old practice.
Lex, thank you for the chance to listen to Yoshua. But where's your impression? Where's excitement?
Our pleasure too.
Wow, not even 200,000 views in 5 years!
Human intelligence come from everyday natural learning.
Great interview, thanks Lex. Yoshua seemed a bit angry.
Deep Learning Partnership yep, not angry per se, more like grumpy. Maybe had an annoying day, lol.
this is the guy who starts Skynet
Or LEGION
Curiosity is a reward function (especially for newborns).
Less a reward function, more like that's the explorative policy that they use (and update to satisfy more curiousity)
@@TheHellogs4444 and parent is more likely to play a role as an external critic assignment that attempt to reduce the explorative probability and using their prior knowledge to just straightly label the unexplored policy
@@TheHellogs4444 MaxEnt RL is the popular way to formalize this idea 💡
@@jacobadamczyk3353 YES! I loved entropy based models and maxEnt RL in particular is amazing. I think maxEnt RL with better models and dynamic updates will probably lead us close enough to AGI that there wont be any jobs any more.
@@TheHellogs4444 Have any specific ideas on new approaches? Or do you see any interesting new areas?
24:30 and on how Hollywood pictures A.I. progress
🔥🔥
Peculiarities and phenomena of human psychology == breadcrumbs to underlying structures
We already have to much common knowledge - we just have to use it.
Follow your intuition and update if new evidence appears.
wow............totally agree with the points of those movies....that one individual creates........and invents all things......no it doesn't happen like that.........Leon Musk has teams, and engineers that solve, and build more prototypes......Man can't be compare and idolize as God to create things..............................Great interview Lex......Thanks.............:) ................bye
6:49 "Neither!" 😂
I hope that there will be intelligent beings from other planets who come to help us accelerate computer technology on earth, or humans who come from a future that brings technology from the future.
Pardohar Simanjuntak I hope we will soon assume responsibility and threat Earth better.
are you worthy to be saved.
Oh, when vulcanians try to emulate emotions... so cute
@24:40 Tesla: Hold my coil
25:50 google duplex
Disentangle representation in hierarchical manner.
Lex's Russian is limited. His statement about Russian poetry was a bit.....ok......but his father should have kept that Russian alive in him!
What if the lights went off because robots from the future are warning us? haha
I hate how easily men dominate this field because of the wealth in AI