Ah dude just discovered your videos!! Just what I needed. Can't believe, have 6 year degree in engineering, work in AI and I can still learn from TH-cam.mad when you think out it. It's a new paradigm of education
I've just been reading these papers for the openai retro competition. Your video went into a lot of depth, which is really hard to do with complex ideas, bravo!
Holy shit. I have been working on this problem for months and to see that professionals are getting almost the exact same answers as me is pretty cool. There are a whole bunch if ideas in here I have not tried yet as well. Super useful
The video quality is great but the topics are just not interesting for many people. And of course few subs makes it hard to find this channel. I'm glad I did though. This is a great overview.
This a very effective strategy for personal productivity as a programmer with ADHD. I augment my unreliable reward-signaling system with Test-Driven Development.
I was really touched by the ending of the video. We need research on models and the social-economic consequences of the AI models...and I don't mean that terminator, Butlerian jihad crap. I mean human side: job losses, bias, morality, misuse...etc
AMAZING! The prediction-reward algorithm in the first mentioned paper is very similar to how humans learn, at least based on a computational neurobiology course I took in college.
It's always interesting to see how ideas around curiosity have taken off in reinforcement learning (I think about the "Never give up" paper and atari57
This is a marvel. I read a book with similar content, and it was a marvel to behold. "The Art of Saying No: Mastering Boundaries for a Fulfilling Life" by Samuel Dawn
Maan it is so damn interesting and good video. I come from a completely different area - game development. And I wanted to understand some basics of A.I because I really want to dive deep into this to eventually teach for example rocket to fly, flappy bird to jump, snake to play efficiently. Reading papers is really difficult without knowledge of some basics, and the way you explained all these things is so good. I still don't understand the terminology and all these formulas, but at least I got one step closer :) Thank you for this brilliant video :)
Amazing video again! Clear and concise as always, all but trivial with this kind of topics. I am very curious to see what you will be focusing on next!
This channel is really amazing initiative as I've always found ArXiv extremely interesting but don't have the time to read all the papers. :) This question may sound very silly, but - How do programs play game like Mario and Reversi ? What I mean is, don't we need some kind of hardware like a keyboard or joystick to play these games ? How do software agents play this game ? I have always been curious about this. Please explain my doubt if anyone has my answer. :)
It's not that hard to hack the game engine so that an RL agent controls the game inputs via an API (so you can do that from eg Python) in stead of via a controller/joystick. In most gym games there's even an option to train your agent from the raw game state in stead of the rendered pixel version!
So "HER" basically starts off as "if I do this action, I can get to this goal", and then gradually learns how to flip the statement to "if I want to get to this goal, I need to do this action". Pretty nice.
Nice video. I didn't get the last part: how does it learn faster if it sets virtual goals? If it gets the same reward for a virtual goal as for the real goal, then it will just learn it can shoot at any point which is made a goal but the real goal will never be found. If it gets a lower reward then it learns that shooting at goals gives a reward but it tells nothing about the proximity to the real goal. I'm obviously missing something here and I'm really curious what it is. Thank you :)
I sort of feel the same way. We shouldn't make any public policy decisions until we see actual damage happening, and not just overexcited predictions. So far it seems DL/ML is creating net additional jobs and increasing average salaries. If that changes, then maybe it is time to think about new public policies. In the meantime, I would recommend retargeting the time spent worrying about AI into time spent learning about AI to increase your human capital. www.wsj.com/articles/workers-fear-not-the-robot-apocalypse-1504631505 www.forbes.com/sites/bernardmarr/2017/10/12/instead-of-destroying-jobs-artificial-intelligence-ai-is-creating-new-jobs-in-4-out-of-5-companies
Agreed. And even imagining the worst scenario, where AI replaces all jobs, we still will be capable of owning bots and renting then. We will live like gods on earth.
The question here though, is WHO will be owning these robots, and how will these jobs be distributed? For highly educated and resourceful people, this will probably not be a huge issue. But there are something like N million truck drivers in the US, which will have a much harder time adjusting. Going from blue-collar to white-collar is probably not as easy.
A feedback on your video: Trim your content, and be more entertaining for the videos. Watch how Siraj does it. From my point of view, I dozed off a couple of times, even though the accuracy of the content is high. Bascially use less words, less images, less intro, less buildup and focus more on the crux, while going faster to keep your audience on edge and curious. Hope my view is productive to you. Good luck.
Do it like an AI optimizer does it. Minimize and use simplicity as much as possible until you reach the goal: Communicate the idea you want to convey, in as little time and actions as possible.
![[LIVE] : ONE ลุมพินี 85 | คู่เอก "ยอดเหล็กเพชร vs ผึ้งหลวง"](http://i.ytimg.com/vi/Qq_19bnnxEo/mqdefault.jpg)
Your teaching style is incredible! Can you please do a video on Capsule Networks?
Seriously great, I'd love to see an updated video with the newest research!
Ah dude just discovered your videos!! Just what I needed. Can't believe, have 6 year degree in engineering, work in AI and I can still learn from TH-cam.mad when you think out it. It's a new paradigm of education
Haha, glad to hear that! You're welcome :)
I've just been reading these papers for the openai retro competition. Your video went into a lot of depth, which is really hard to do with complex ideas, bravo!
Holy shit. I have been working on this problem for months and to see that professionals are getting almost the exact same answers as me is pretty cool. There are a whole bunch if ideas in here I have not tried yet as well. Super useful
fantastic content lad!
Instablaster...
no clickbait , good video quality , good sound, relative nice topics for some people, but 16k subs Excuse me , wtf
The video quality is great but the topics are just not interesting for many people. And of course few subs makes it hard to find this channel.
I'm glad I did though. This is a great overview.
This a very effective strategy for personal productivity as a programmer with ADHD.
I augment my unreliable reward-signaling system with Test-Driven Development.
Love your passion for what you are talking about!
I was really touched by the ending of the video. We need research on models and the social-economic consequences of the AI models...and I don't mean that terminator, Butlerian jihad crap. I mean human side: job losses, bias, morality, misuse...etc
AMAZING! The prediction-reward algorithm in the first mentioned paper is very similar to how humans learn, at least based on a computational neurobiology course I took in college.
Fantastic video! Making me gain time and in an enjoyable way.
Many thanks
It's always interesting to see how ideas around curiosity have taken off in reinforcement learning (I think about the "Never give up" paper and atari57
This is a marvel. I read a book with similar content, and it was a marvel to behold. "The Art of Saying No: Mastering Boundaries for a Fulfilling Life" by Samuel Dawn
need more deep RL stuff ^^
Maan it is so damn interesting and good video. I come from a completely different area - game development. And I wanted to understand some basics of A.I because I really want to dive deep into this to eventually teach for example rocket to fly, flappy bird to jump, snake to play efficiently.
Reading papers is really difficult without knowledge of some basics, and the way you explained all these things is so good. I still don't understand the terminology and all these formulas, but at least I got one step closer :)
Thank you for this brilliant video :)
Always impressing and I never get bored watching your videos. Good job and keep it up 👍
Really happy to find your channel, really sad to find out few videos in it.
Recommend to read "Curiosity-driven Exploration by Self-supervised Prediction"
it's really awesome paper.
I would like to see a video on meta reinforcement learning. Its an exciting field now!
if it wasn't for this channel I'd have never have known it wasn't pronounced 'ark-ziv'
Same here, at least we got it corrected without embarrassing ourselves IRL
@@ritajitdey7567 INR
Amazing video again! Clear and concise as always, all but trivial with this kind of topics.
I am very curious to see what you will be focusing on next!
Your videos are awesome!! Im going to tell all my frieds about you
This is so cool, specially the "HER" method. Wow!
Excellent video! Thx.
This channel is really amazing initiative as I've always found ArXiv extremely interesting but don't have the time to read all the papers. :)
This question may sound very silly, but - How do programs play game like Mario and Reversi ? What I mean is, don't we need some kind of hardware like a keyboard or joystick to play these games ? How do software agents play this game ?
I have always been curious about this. Please explain my doubt if anyone has my answer. :)
It's not that hard to hack the game engine so that an RL agent controls the game inputs via an API (so you can do that from eg Python) in stead of via a controller/joystick. In most gym games there's even an option to train your agent from the raw game state in stead of the rendered pixel version!
great content , great purposes . please do more videos asap . im studding at the same field would you suggest some links for up to date good articles?
Great channel. Thanks for this and other videos.
Great video, I can now look to read the papers. It would be great to post the links of the papers here
All links are in the video description! :)
amazing content(s), you are a very good teacher
you are doing great, keep it up
Hey dude, awesome video as always! Could you do one for the Relational Deep Reinforcement Learning paper of Zambaldi et al. ?
Nice video. Question: Is DDQN efficient at solving sparse reward environments? Say I only give an agent a reward at the end of an episode.
So "HER" basically starts off as "if I do this action, I can get to this goal", and then gradually learns how to flip the statement to "if I want to get to this goal, I need to do this action". Pretty nice.
Thanks for the nice explanation.
Great vid! re: the ending of the video, what do you think about creating something on AI safety or ethics?
Actually, that's a really good suggestion! Added to my pipeline :)
Have you seen Robert Miles' channel? He has some good stuff on AI safety, but posts rather infrequently.
Awesome video as usual!
You make high quality videos A+
great stuff well done man
Great videos and channel. Why don't you make any more videos? :(
Hey, very nice video :)
What is the source for that video containing the boat in a behavioural circuit?
Very nice video. Thanks you :)
if some one want to contact you directly is there any way ?? i have some questions related to my thesis topic. thanks in advance for your efforts .
Nice video.
I didn't get the last part: how does it learn faster if it sets virtual goals? If it gets the same reward for a virtual goal as for the real goal, then it will just learn it can shoot at any point which is made a goal but the real goal will never be found. If it gets a lower reward then it learns that shooting at goals gives a reward but it tells nothing about the proximity to the real goal. I'm obviously missing something here and I'm really curious what it is. Thank you :)
Awesome video
C a n. you do an example for RL?
Make a video on the MuZero paper
Can you tell me where you find these articles?
Website appears to be Arxiv. Searching for DeepMind and OpenAI papers will yield results too
you are amazing
What about delayed rewards?
7:56 where the main point starts
What's the website you used in 2:23?
brother please explain about capsule network
Aurelien Geron has a great video on CapsNets, no need to redo his video, its already perfect! th-cam.com/video/pPN8d0E3900/w-d-xo.html
+Arxiv Insights thanks bro
Hi Xander, I made a Patreon account just for you! Keep it up!
Thx a lot Cody!! Getting this kind of support from people I've never is such a great motivation to keep going! Many thanks :)
I really like machine learning because it feels like training a pokemon sure it sometimes take a very long time to get it set up but yeah...
can you suggest a link of research paper on reinforcement learning?.
The number of views of your videos is not proportional to their quality. Looking forward to new content!
any coding videos?
15:29 Modi
lol!!
Smart guy
I don't see any social problem automation can cause.
If you let the market free, it will ajust itself as it always did.
I sort of feel the same way. We shouldn't make any public policy decisions until we see actual damage happening, and not just overexcited predictions. So far it seems DL/ML is creating net additional jobs and increasing average salaries. If that changes, then maybe it is time to think about new public policies. In the meantime, I would recommend retargeting the time spent worrying about AI into time spent learning about AI to increase your human capital.
www.wsj.com/articles/workers-fear-not-the-robot-apocalypse-1504631505
www.forbes.com/sites/bernardmarr/2017/10/12/instead-of-destroying-jobs-artificial-intelligence-ai-is-creating-new-jobs-in-4-out-of-5-companies
Agreed.
And even imagining the worst scenario, where AI replaces all jobs, we still will be capable of owning bots and renting then.
We will live like gods on earth.
The question here though, is WHO will be owning these robots, and how will these jobs be distributed? For highly educated and resourceful people, this will probably not be a huge issue. But there are something like N million truck drivers in the US, which will have a much harder time adjusting. Going from blue-collar to white-collar is probably not as easy.
I just want my computer to grind levels. Not take a my job.
why his head bigger then the body? Alien?
big brain filter
Her?
louder pls
what happened to this channel..
VOLUME TOO LOW!!!
A feedback on your video: Trim your content, and be more entertaining for the videos.
Watch how Siraj does it.
From my point of view, I dozed off a couple of times, even though the accuracy of the content is high.
Bascially use less words, less images, less intro, less buildup and focus more on the crux, while going faster to keep your audience on edge and curious.
Hope my view is productive to you. Good luck.
Do it like an AI optimizer does it. Minimize and use simplicity as much as possible until you reach the goal: Communicate the idea you want to convey, in as little time and actions as possible.