I am very well aware of the existence of stacked autoencoders, and was looking for an entire separate episode for that (while mentioning that we were only scratching the surface here). It would be great presenting it together with PCA and some matrix factorization techniques like SVD that I really wanted to do for a while. Still trying to find a way to do it in a way that is visually and intellectually exciting. :) Thanks for the feedback!
I think the main advantage of AE compression over the standard compression techniques is that it is possibly a bit more general as opposed to something like JPEG which is only limited to images
Wow. It's fascinating to see what this channel was like when it was sprinting up. The style is largely the same, but less fine-tuned. Karoly had learned a lot more about engaging speech, and the icon looks just a little different. Also, we have two favorite phrases that have basically become a culture: 1) "Hold on to your papers" (and variations stemming therefrom), and 2) "Just two more papers down the line" (and variations therefrom).
1:48 Shouldn't we call it a very dense representation instead of the sparse one? Here's how I think about it: the less number of neurons has to compress the data from a large representation into a very dense small one. Compressing should mean that you are making things dense, isn't it? And usually, we refer to a sparse vector as a really large representation.
It's good that you raised this point, thanks! It is dense in a sense that there is likely "a lot of stuff" that neuron would be firing for, but the mathematical description of that representation is sparse in a sense that the basis vector is containing a tiny number of elements (the # of neurons, that is).
A great application could be in denoising before vectorisation of mid-lines or in animation when you need to automatically morph complex shapes. It seems to do that with quite a lot of understanding of what lines are.
I glad to see this kind of ratio on youtube at the likes-dislikes, it's well deserved! keep up the good work! (egyik kedvenc csatornám, nagyon jó témákat szedsz össze!)
I love machine learning and simulations and I don't want the videos about them to stop; however, I think that this channel would attract a wider audience and lead the viewers to do more research on their own if two minute papers also reported on other topics like astrophysics, quantum physics, bioengineering, nanotech, and the plethora of others available. Either way, keep up the good work
I completely agree, we have episodes on these topics every now and then, but widening further is definitely on our todo list. However, since these topics are further away from my field of expertise, and therefore require even more preparation, which is currently not possible with a full time job. If it will be possible in the future to do Two Minute Papers as a full time thing, I can't wait to do more of those. :)
Concise and truly informative lecture! I’m just wondering-after we obtained the most important features from the bottleneck of our trained neural network, is it possible to apply the denoising capability of the autoencoder to a live feed video that is somewhat highly correlated to the training images? Will this be better, or even recommended, instead of using traditional denoising filters of OpenCV for real-time videos? I’d love to learn more from your expertise and advices as I explore this topic further. Thank you for the insightful explanation and demo by the way! Subscribed! :)
Kim sublime text is also one of the more widely used text editor. .There is this cool feature of multiple text edit in single go which I find quite time saving..u can have a look at this too :)
there are absolutely stunning results about writing in a given style of handwriting given just single handwritten note primer examples. The networks can also serve to "beautify" handwritten text simply by making it a bit less divergent. I suspect with a correspondingly extended dataset you could train those to faithfully generate hand signatures and, on top of that, manage to write entire books in a given signature style. Wanna read a novel in Dr's Claw font? :D
Came here from The Coding Train. And now you are sending me to sentdex. I knew about you all. Means I am on the right track
Just discovered this channel. Would call it my best online discovery ever. Thanks a lot for this. :)
Thanks so much for the kind words and happy to have you around! :)
The next episode is going to be about Two Minute Papers itself, and after that, we'll be back to the usual visual fireworks. :)
I am very well aware of the existence of stacked autoencoders, and was looking for an entire separate episode for that (while mentioning that we were only scratching the surface here). It would be great presenting it together with PCA and some matrix factorization techniques like SVD that I really wanted to do for a while. Still trying to find a way to do it in a way that is visually and intellectually exciting. :) Thanks for the feedback!
@@TwoMinutePapers You've evolved a lot since five years ago! ❤️
I think the main advantage of AE compression over the standard compression techniques is that it is possibly a bit more general as opposed to something like JPEG which is only limited to images
Wow. It's fascinating to see what this channel was like when it was sprinting up. The style is largely the same, but less fine-tuned. Karoly had learned a lot more about engaging speech, and the icon looks just a little different. Also, we have two favorite phrases that have basically become a culture: 1) "Hold on to your papers" (and variations stemming therefrom), and 2) "Just two more papers down the line" (and variations therefrom).
I think you explain it much better than some of the others.
Its really nice of you to promote a good channel like sentdex.
1:48 Shouldn't we call it a very dense representation instead of the sparse one? Here's how I think about it: the less number of neurons has to compress the data from a large representation into a very dense small one. Compressing should mean that you are making things dense, isn't it? And usually, we refer to a sparse vector as a really large representation.
It's good that you raised this point, thanks! It is dense in a sense that there is likely "a lot of stuff" that neuron would be firing for, but the mathematical description of that representation is sparse in a sense that the basis vector is containing a tiny number of elements (the # of neurons, that is).
I have to put my paws to the 'like' button immediately!
Very clear and to the point!!! Why my teacher can't just talk in this way?
A great application could be in denoising before vectorisation of mid-lines or in animation when you need to automatically morph complex shapes. It seems to do that with quite a lot of understanding of what lines are.
I'm glad I found this channel, thank you!
Thanks for pointing us to such a valuable channel :D
+Károly Zsolnai-Fehér (Two Minute Papers) and of course as usual, thanks for the awesomeness you give us ;)
I glad to see this kind of ratio on youtube at the likes-dislikes, it's well deserved! keep up the good work! (egyik kedvenc csatornám, nagyon jó témákat szedsz össze!)
Nagyon orulok, hogy tetszett, es udv a klubban! :)
this aged like fine wine
The inner nodes represent abstract concepts!
excellent explanation
Amazing channel.
YOUR daily dose of research papers (get the reference?).
Wasted you chance to say 'bear necessities' at 1:41
I love machine learning and simulations and I don't want the videos about them to stop; however, I think that this channel would attract a wider audience and lead the viewers to do more research on their own if two minute papers also reported on other topics like astrophysics, quantum physics, bioengineering, nanotech, and the plethora of others available. Either way, keep up the good work
I completely agree, we have episodes on these topics every now and then, but widening further is definitely on our todo list. However, since these topics are further away from my field of expertise, and therefore require even more preparation, which is currently not possible with a full time job. If it will be possible in the future to do Two Minute Papers as a full time thing, I can't wait to do more of those. :)
Though we weren't asked, but I'm holding on to my papers! Might squeeze a bit too! :)
Thanks for explaining
I love this channel, thank you! I am setting up a Patreon account asap :)
Happy to hear that you are enjoying the series. Thank you so much for your generous support! :)
I love what you are doing. Pleasure to watch your videos!
BEST CHANNEL EVER!
Nice video as usual! Thanks
Damn that map at 3:05! Crazy stuff
Concise and truly informative lecture!
I’m just wondering-after we obtained the most important features from the bottleneck of our trained neural network, is it possible to apply the denoising capability of the autoencoder to a live feed video that is somewhat highly correlated to the training images?
Will this be better, or even recommended, instead of using traditional denoising filters of OpenCV for real-time videos?
I’d love to learn more from your expertise and advices as I explore this topic further. Thank you for the insightful explanation and demo by the way! Subscribed! :)
Can you give link of research paper which uses autoencoder to generate handwritten digits?
thank you for the great lecture!
Any chance you know the video of Sentdex's where you show the tank game?
I have asked him about this through twitter, let's see if we can find it out! :)
thanks!
Thanks a ton for the link. It'll probably help with my schol dts
do you have a link to the video that explains how to build the 'tanks' game shown at 3:24?
This is amazing
Hey, just wanted to ask what IDE/text editor you use for coding.
Also, what operating system?
Generally, I have projects spanning all 3 major operating systems - whichever is fit for the job at hand. As an editor, I use vim 90% of the time.
Okay, thanks for the info. Which language do you actually use?
Kim sublime text is also one of the more widely used text editor. .There is this cool feature of multiple text edit in single go which I find quite time saving..u can have a look at this too :)
Nice video as usual! :)
Thanks for watching! :)
But, regular (non variational) autoencoders are generative models too!
nice music at the ending :D
Hi Dear, thanks for the video. How do you make that script at ~ 0:29 min?
SOURCE in the top-left corner
Thank you..
imagine using this to create datasets from very few samples
Why SoftMax is better than svm with autoencoder
if you have paper explain that
Now I get why they compare it to PCA!
I see nefarious applications for both captcha breaking and signature forgery.
Captcha breaking? How so?
there are absolutely stunning results about writing in a given style of handwriting given just single handwritten note primer examples. The networks can also serve to "beautify" handwritten text simply by making it a bit less divergent. I suspect with a correspondingly extended dataset you could train those to faithfully generate hand signatures and, on top of that, manage to write entire books in a given signature style. Wanna read a novel in Dr's Claw font? :D
thanks
Am I the only one thinking about impostor syndrome when he says "dear fellow scholars"
can you collab with sirag rival or Udacity and their self driving AI nano degree. It will help you grow your channel.
Can u send me the cat and dog detection source code
Damn, I just realized I'm a hardcore nerd
WHERE'S YOUR ACCENT
1/7 like ratio :D
I'm getting so addicted with AIs... :/