How Stable Diffusion Works (AI Image Generation)
ฝัง
- เผยแพร่เมื่อ 25 มิ.ย. 2023
- Get NordVPN 2Y plan + 1 months free here ➼ nordvpn.com/gonkee It’s risk-free with Nord’s 30-day money-back guarantee!
Support me on Patreon: / gonkee
Kaggle fish dataset: www.kaggle.com/datasets/croww... - วิทยาศาสตร์และเทคโนโลยี
Get NordVPN 2Y plan + 1 months free here ➼ nordvpn.com/gonkee It’s risk-free with Nord’s 30-day money-back guarantee!
Could you do more videos about 2D soft bodies, 2D physics simulation? Your videos super helpful.
that was an interesting experience... i've seen some videos on this topic, most left me with more question marks then i had before. but this was somewhat like opening my brain and pouring a full book in there. like in matrix. i can't really tell what i've just learned, just that it was alot, and that it will be helpful later on. you surely are some dark magic ninja teacher :D
It’s insane just how informative this is. When I watch a Gonkee video, I expect a funny video, but this has taught me more than any wikipedia article ever could.
Agreed 👍
To be fair WP articles are mostly pretty shit on anything unless you already bring basic knowledge in the methodology a certain science field uses, it's pretty hard to make anything of a detail out of it.
Buddy, youtube needs more creators like you, I watched a lot of videos on stable diffusion but non of them made this much sense, please upload more deep learning content like this, the way you summarized computer vision is just amazing.
please make more videos like this regarding AI. I've learned so much from this in 30 min than the past 3 hours I've been studying. Informative, entertaining and hilarious. You sir a gem 🙌
This is, by far, the best explanation I've come across in my search to understand how SD is doing what it does. Bravo sir, and thank you!
I found your channel close to 3 years ago off a reddit post and commented on your very first video. I did not know this was the same person going into this video, and I was absolutely MIND BLOWN. Insane progress and I am so proud of your videos. This video was incredible and actually blew my mind. Great job.
Same
Excellent, excellent video. So refreshing to have someone who pulls back a bit from the camera and doesn't talk in an obnoxious, gamer way, and instead explains very clearly and precisely, using helpful accompanying materials. Definitely one of the best deeper SD explanations.😃
Before watching this video, I had no idea how any of this stuff worked. You were able to explain these concepts to me in a way that many other videos failed, and in only 30 minutes as well. Wow.
21:01 yo I had to stop the video just after you said 'if you don't get anything from here on now don't stress out...', to tell you that I think you are amazing for daring to making videos like this, where you maybe don't have the biggest audience (yet), but provide people who actually care with so much value. I feel like you really stand out with this combination of explaining it in easy terms (in relation to the complexity of the topic) but sufficiently enough to give others an actual grasp of the topic and enabling people to make more advanced research afterwards. I think that in some weird sense the saying: "Give a Man a Fish, and You Feed Him for a Day. Teach a Man To Fish, and You Feed Him for a Lifetime". describes pretty well how I think about your content. Thank you very much for your efforts Gonkee and keep it going!
An important aspect of this that a lot of people misunderstand is that the things which are learned are kernels and visually semantic text embeddings. Which are very different from just memorizing/copying the training data, despite so many people insisting these models are, in fact, just copying/stealing training data. This is much more akin to how humans learn to make art: studying existing works, extracting those observations into features and techniques (kernels), learning how words describe visuals by... learning to talk, basically (visual semantic embeddings), and then combining it all to make new images. Although the diffusion model is more like "learning to remove stuff that doesn't match the requested visuals", there's a famous quote attributed to Michelangelo about how his sculpting is just "removing the marble that is not David" from the block -- very similar.
yea, by that logic every artist is basically stealing art, because he learns on and from already existing art and have that art influence his own work. those thinking ai is stealing art need to reconsider the way art is actually made. people don't understand the concept at hand, and they are afraid of things they don't understand, and that is the actual problem here.
@@algee2005They're afraid of the consequences of capitalism, but they either don't realize that or they don't want to blame capitalism, so they project their fears onto the AI that's making them face it and make up rationalizations for why they think we should fear the AI.
Capitalism is what enforces the idea of "if you can't sell it, then it's not worth doing and you deserve to die"; AI isn't what says that.
@@algee2005Yeess! That was exactly what I was thinking when I saw artists say I demand to get payed for these models trained on my art. But duude what about all the people that like your art and are learning how to replicate it, should they pay you as well? NO, lmao. You put it up for the public. One consequence of that is that other people (meat or machine) can learn your style. And I'm pretty sure he himself learned from others.
Yay Gonkee video
Yay Gonkee video
Yay Gonkee video
Thanks for the video!
The receptive field of each convolution is also effectively enlarged by doing several convolutions in sequence, not just by pooling operations.
27:51 break; literally 😂 ❤love your style. Congratulations
Absolutely wonderful effort. Much liked and appreciated, Gonkee.
Literally the BEST video on this topic on the sight, everyone else fills too much jargon but you keep it straight forward and break down concepts Very well
This is an amazing video, I've been struggling with the concept, well, and laziness but this video has inspired me to continue ny project which contains some aspect of stable diffusion, thank you
Gonkee, you are a gifted trainer/explainer! This video makes so much sense (even though I am a total noob) because your visualizations walk through the concepts so beautifully. I am so glad I found this!!
I now follow you and look forward to reviewing your other vids. Thank you for helping me (not a math person, but an artist and visual learner) become more familiar with how AI image generation works.
I should note that if you are having trouble connecting to a wireless printer (or a chromecast in my case) check that you're _not_ connected to a VPN
Lol
This is the first video I have watched on this channel and I am absolutely wowed by the way you have explained it all. Thanks a ton.
This was a fabulous explanation! Makes it way more trivial to wrap my head around!
I've spent the last few weeks consuming 10s of hours of content on deep learning from neural nets through transformers and found this when trying to get into stable diffusion. Honestly, this is some of the best informative content I've ever consumed - totally outdoes everything else on coursera/youtube/wherever for visual explanation. Plus you got bants as a bonus, what a guy, please keep it up!
wake up babe new gonkee vid just dropped
very impressed by Gonkee's intuitive grasp of semantic segmentation and U-net. One of the best lecture
bro god bless you for how much effort you put into this, you have learned what people study in uni for years, i look up to you, thank you so much for the educational content
Thank you for the encouragement, I’m at the 21 minute mark and I’ve struggled despite your clear and straightforward explanations thus far. Great video.
Congratz on the 110.000 my dude, absolutely crazy!
This is such an impressive video, I remember you from your first videos and it’s so impressive how far you’ve come
Great explanation for people of all levels. Keep it up!!
Thanks for making this! Learned a ton and didn't need to get a computer science degree first to understand it!
Thank you! I've read half a dozen blog posts where it was clear the author had no idea how it all worked, then finally I saw your video and got a great overview of the whole thing!
You have an amazing ability to teach with visuals to make intricate concepts accessible.
Appreciate your work. Although I could not grasp many things explained, I realized this is a darn lot of processing & amazing to just being able to type and get a video clip or an image!
Great video very well explained. Would love to see a similar video on LLMs
It clarifies a lot about how these generative ais works. Thank you!!
Finally, you didn't make the video too informative or too funny. I like this kind of videos. Keep up the good work! (im waiting for 1M subs)
this blew my mind! But was totally digestible. Thanks for making this!
Super detailed video - very much enjoyed it!
Bravo! Well done. The right dose of mathematics and the mention of U-Net make it really easy to understand the basic concepts of how stable diffusion works.
This is really good！ Deep，conceptually accurate, and clear! Thank you for sharing!
the best video on stable diffusion out there , that deserve so much more what it gets now , i can see how much efforts he put frame by frame
Excellent presentation. I especially like your statement, "If you have made it this far in the video? That's already pretty impressive."
What is truly impressive is the level of detail that you deliver in a short amount of time.
Thank you,
~3K
Terrific Explanation, Thanks ! Now I understand how clicking a button will give you a verbal description of an image (just the reverse of the text prompt).
Amazing job breaking this down, highly comprehensible!
Thanks a lot for the video, this was really informative overview of the things i feel that i need without diving into the direct math, since there is a few years since ive done it by now ...
Definitely went quite a bit into things ive budget into and have had questions on how they work together in a conceptual level.
awesome video, helped me grasp a pretty complex concept
Even though I probably won't make use of the knowledge in the close future, I watch your videos in general becase the topics and your explanation are top notch. I really wish we had uni teachers/tutors like you. Straight to the point, no bullshit, keeping it interesting, maintaining the attention of the viewer, well done! 10/10
Awesome explanation, really clear and excellent visuals. Sure to be a source of information for many in the future, thanks!!
One of the best video tha I have ever seen about AI.
Damn the video is detailed but at the same time easy to understand for a beginner person like me. Thanks for the video!
Simply the best video to stable diffusion I found so far. Thanks a lot! I like your humor.
I've seen your previous videos and, as a grad student majoring in AI, I'm very impressed by how you delivered! Learned a lot here, so definite thumbs up and share!!
Is this taught in your university program?
@@thesocialinception no
@@seyedmatintavakoliafshari8272 what they teach instead of this?
This is next level! I owe my understanding of these fundamentals to you. Keep up the amazing work bro!
Wow this video is amazing, really well made, and informative, thank you
the "2 hours to connect to a printer" got me! Yesterday I tried it for the 4th time with my super smart hp knobhead. The little smart effer finally made it ^^
Stable Diffusion finally make sense. I watched many other videos and they always talk about "denoising" an image which makes absolutely no sense when it comes to image generation (by itself). This is exactly when some creators explain generative AI as just "next-token-predictor" as if this is sufficient to explain how it really works. Thank you for the wonderful video and the geniuses behind these technologies.
Love your hoodie
The "London - England + Japan = Tokyo" example really blew my mind, because it makes totally sense, yet I never saw this logic approach this way before.
Think of "London" and every aspect of it: This is the Vector (Mind-Map). Now remove the Vector of "England" from that London-Vector,
and you will be left with the most prominent aspect of it: "A Capital City". Add the "Japan"-Vector to that and you basically end up with "Capital City of Japan"
Insane explanation. One of the best.
Crazy good video nice job gonk
Amazing! Thank you so much for making this :D
Love your channel bro
The only explanation which I was looking for, Ausome Brother❤
Wow your explanations are brilliant, thank you.
Finally, a nerdy Gonkee video
Excellent Explanation, fully worth the time. Thanks a lot 🙏🏼
This really made a lot of sense. I understood self-attention before, and now I magically know cross-attention! Thanks
@Gonkee
This is a great video. However, I've watched a lot of videos on Stable Diffusion recently, and I've found that there are a few important questions that none of them have addressed. Perhaps you could make an addendum and address these questions because I'm sure many people want to know.
1. Is the "seed" for Stable Diffusion the same as an image containing maximum noise?
2. Does Stable Diffusion use a randomly generated image with maximum noise as the starting point for the new image it will generate?
3. If so, are the pixels in this maximum noisy image truly random, or do the pixels already have a pre-chosen mathematical relationship to adjacent pixels or to images from the training library?
4. The training of the neural network appears to work in 2D with the pixels of the training images, but the images are usually 2D representations of 3D objects. Does the network develop an understanding of the 3D characteristics of the objects in the images, or does it strictly build up probabilities of pixel colors (or something else) based on pixel color patterns from the training images?
5. When building a new image, does Stable Diffusion just find ways to insert the pixels of components or subcomponents from objects in images from the training library into the new image, or does it build the images strictly based on the likely pixel colors (pixel by pixel) deduced from the neural network, or some other process entirely?
6. Do you think the way Stable Diffusion builds new images is similar to how the human brain can see objects or animals in a Rorschach inkblot test or in the shape of clouds in the sky, or would you say the process is not similar?
Thanks for asking these questions as many of them have perplexed me and I cant find any resources that give an explanation.
really amazing video, thank you very much for sharing! subbed :)
A great self explanatory video full of information...
Thank you for this masterpiece of STEM education. Incredibly well made.
Sure you’re not some future tech AGI sent to help us get to your timeline? No other explanation for such an extensive lossless compression into 30mins. Bravo!
I'm working on a very new approach I call Focus-Select-Image-Generation, which is an image-evolution process from often clicking real-time generated thumbnails almost like the image-enhancing process. Main difference is... we can have full control to get what results we want, although not as a text-to-image generator. My version will still require A.I. for it to capture important details such as correct light refractions, correct proportions, correct shadowing... etc.
Thank you very much for this.
This is really good. I actually got most of it until the cross attention part.
Basically like traditional painting using the ala prima method, but instead of handling brush strokes everywhere in the canvas evenly, it's a handles every damn pixel in the screen.
This is one of the best videos on ai
Great explanation. Thank you
bruh .. I can't describe in words how amazing this video is!
great video. Could youplease provide relevant papers for each concept you explained?
Excellent primer!
best explanation i've watched
Amazing video. Thanks
excellent video, i'm ready to go in the most absolute techinical part of it, thanks
Very well explained , i feel lucky to have clicked your video
This is pure quality this is insane.I want you to explain transformer architecture for next
what was the sources that you used to get this information? How can get a clear explanation on NNs ?
Gonkee VIDEOO LETSS GOO!!!
What a great video!
I understood like half of it, can’t wait to start with CSE 👍 great video regardless
Very good explanation .. ! Thanks.
Such a wonderful explanation. Bravo! I learned a lot from you. I wish i could find your personal website or google scholar😅
Very good explanation ☺️ thanks
Insane video, thanks for this
Cool, Ilike this informational video format
Thankz 4 uploading, I'm having fun with these Ai generators, I saw a Diffusion footage a month ago & said 'how' funny enough I shot some footage 2day that I hope I will b able 2 put Diffusion 2 work, thankz 4 the explanation, it makes sense 2 me cause I'm a computer geek from college dayz 1984 when I left & I've been working with them until now, the future is Ai like your self I'm not concerned about Ai taking over, cause u can just pull the plug.
Guidance & Protection
Mannerz & Respect!!
Shovel == sold. Subbed.
I’m revisiting this video after having learned ComfyUI. Much easier to understand Stable Diffusion now.
query key and value are just SVD, they correspond like query = U, key = Sigma and value = V 26:12
Can you please share how you did research for this video or what sources did you use most heavily?
So what you mean at around 30:00 is that the Unet is trained (VAE frozen) to reproduce the clip images injecting the clip text embeddings into the Unet Layers via cross attention? Is that correct? @Gonkee @Everyone