I want to thank everybody for taking the time to write compliments and words of encouragement. I really do appreciate all of them and they honestly motivate me in releasing more videos. Let me know if there are topics you'd like to see covered and thank you all again!
These are fantastic videos. I am wondering if there is a way to use IPadatper to only transfer color pallet or other facets of an input image (but not the whole). I think for SD 1.5 there is a way to take only the color pallet with the t2iadapters but not with SDXL - maybe you know of a way?
I don't think there's a color controlnet yet for SDXL but you can use img2img with a certain grade of success. Set the colors how you want them laid out with a paint software then use that reference image as base for your img2img with a very high denoise. That should kinda work.@@EH21UTB
@LouisGedo Thank you so much for all you efford.Actually I am trying to make a flow in order to let a model wear some specific cloth provided as a picture. I tried lots of times, but the clothe weared by the model generated by the flow always different with the one I provided. I really want to understand how to do it . can you please explain about this .
I’ve finally gotten into IP Adapter. Combining it with depth and pose control nets and ReActor face swap yields incredible results. For instance, I took photos of my parents and photos of vintage Christmas cards and produced a nice vintage style Christmas card that looks like them as a gift.
I just tested it and it's amazing! The results are impossible to obtain with a normal prompt, this bring so many possibilities. Thanks a lot for your videos!
Hey there! I rarely comment on videos, but I feel compelled to express my appreciation for your unique approach. Unlike many creators who merely guide us to mimic their actions, you delve deeper, offering insights into the 'why' and 'how' behind each step. This approach not only makes your content easy to follow but also empowers us to adapt and understand the process, fostering genuine learning. I've eagerly watched all your videos, and the knowledge I've gained is invaluable. Your response to a comment in another video about the tedium of covering basics resonated with me. It's true that many overlook the importance of fundamentals. Your explanations are a rare gem in a sea of superficial tutorials; they enable us to think, not just copy. To alleviate the repetition for you, perhaps consider creating a series of detailed videos on these basic concepts. This could serve as a reference point for your viewers, and it's also a strategy that tends to be favored by the TH-cam algorithm. What captivates me the most, however, is watching your workflow, especially in segments like the anime and pixel art transformations. Your real-time commentary adds immense value. Regardless of how many times a topic has been covered by others, your unique perspective and method of presentation make your videos a must-watch, even on well-trodden subjects."
There's not that many videos yet on your channel, but every video is a diamond. One of the most interesting and valuable content I've met on youtube so far. Thank you VERY much for what you are doing.
A wizard in action! :) So this is how you are supposed to work with masks! I had to pause this video several times, so much information in such a short time, well done, very useful!
I want thank you for your great work, not only this video, but also other videos and the comfyui_adpater_plus, which help me learn great knowledge about how to control the AI model to draw images.
Mateo, this blows my mind, I'm so inspired by your great work, I can't express my gratitude enough. Your guidance hit the mark in a simple and easy to understand way which was definitely what I needed. Thanks again for the great work you do.
Jesus christ, ive been in love with IPAdapter since its release and this just completely unlocks all the possibilities. This is an insane value tech, thanks a lot for the contribution.
Gamechanger! There are many, many methods to achieve these end results; however, as we all know, they're tedious and extremely mind-numbingly time-consuming. Matteo's IPAdapter with noise method works the best. Work smarter, not harder!
that's beautiful, that's exciting. exquisite, incredible work! you are very honored. Thank you very much for everything, a great mind. you have no idea how many people you're helping, making our projects more fun, easier and better!
This is pure (AI) magic and will help soooooo much in composition! Amazing results in your demonstration, and your tutorial is spot on, very clear to understand. Thanks so much for your hard work!
Wow! You have unleashed one of the best things for Stable Diffusion since ControlNets! Thanks for developing these great tools and showing us how to use them!
Your work is unbelievable. This is tremendous and I just can't believe we get to watch you develop in real time these tools that will revolutionize AI image generation.
Thank you for your work with IPAdapter. I've only been using it ever since I found your videos on it. It's so great, being able to have 1 image loras without the need to download others, and can just very quickly create them. The one Issue I've been having is it's been transferring the hair to every character design (I'm using a Harley Quinn reference I made for the adapter image and it's copying the pigtail hairstyle and face on pretty much every character lol)
Very valid concentrated information... thx a lot! - I wished all these special infos would be provided as "note-nodes" explaining things right in the json-example. It is obvious to me that your knowledge about all these components and how they work together is superior to some other "random-masters" on YT. It is difficult though... to remember all the little facts, like which model needs what other model and so on...
I hear you, the problem with comfy (and all generative ai) is that things move so fast that any documentation is outdated in 3 months (sometimes less). That would mean reviewing all the workflows every now and then and it's a huge amount of work. I'm thinking of writing some articles especially for more complex topics... but do people still read? Everything seems to be video or burst
@@latentvision You are right Matteo, thank you for your answer. I also know that my "wish" included more work for you... I didnt mean it in a demanding way, I am thankful for any piece of information on a journey into comfy UI. The problem is, that I like to understand things in depth... while it seems to me, that some are ok if if only some nice picture result in the end... and in the beginning of research it is still difficult to seperate the good from useless sources of information. Not many developpers are as good in teaching as you are, or they do not teach at all. I think, much of the information, like - basic relations - will not be outdated so quickly... once the main principles are understood... understanding coming updates can also be challenged :-)
Love your voice dude, bet you do lots of "BFF" out there , I have a question if you don't mind, can I replicate this exercises (all the old tutorials) with the current version of the nodes or I'll see some huge differences?
Thanks a lot for your work on this most excellent tool. This has given me so much possibilities regarding composition, and easily as well ! Less hassle and much better control/results. Impressive stuff.
I've only recently discovered your content, but I just had to tell you how blown away I am at your knowledge and skill in this field. It's just breathtaking stuff you're getting up to. Kudos to you, and all the brains that make this technology possible. Could you imagine travelling back in time even just 20 years and showing this to people? It'd be science fiction.
really incredible -- great demo, I can't wait to use this. I've been experimenting with some of your other tutorials to make animatediff clips. Excited to see the control I might be able to get from masking areas and being able to prompt each one.
Creasy stuff i have to say... I used A1111 and now have switched to Invoke AI, because as strong as Comfy ui is, for a company, using architecture ease of use is the most important feature, and here it gives you as well a linear standart interface (the best out there) and also nodes.. and usal users that have not only to use nodes but dozens of programes are better off with a simpler userinterface where the nodes and inputs dont change place each session.. But i have to say wow.. realy realy impressive
the biggest advantage of comfyui is how fast it is developed and how easy it is to develop an extension for it. This is of course not always a good thing because as you say a company needs stability and ease of use. but for bleeding edge comfyui is really amazing
If invoke AI adopted ComfyUI as their node backend they would have access to all the amazing custom nodes rather than have to develop theirs from scratch... just saying... They are kind of re-inventing the wheel... they should adopt rather than compete.
@@BernardMaltais I believe invoke.ai uses diffusers which is an established standard but it doesn't move fast enough in this incredibly volatile technology. Building a tool like invoke over comfy would be no easy task as there are no update cycles in comfy and your code could break any day. I hope things will get easier in a couple of years when the technology settles a little
@@BernardMaltais agree as an enduser i would welcome this. also i havent yet looked into the nodes of invoke. but never the less it looks promissing. i am teaching invoke to a big architectural company that starts to integrate image ai into their workflows. Here in my opinion invoke excels because of its unmatches ease of use. this is key in more complex company workflows, because each teammember has to deal with a dozen of different and often even much much more complex CAD and BIm tools. So an interface like comfy ui is somewhat far overdone for them. never the less things will become easier and we even cant imagine which programs and workflows in 5 years will excel
it is called FULL because it takes the whole 256 vector space to describe the face. As a comparison the plus models use 16 tokens. The result should be a very detailed face.
@@latentvision tyvm, so that is why it sometimes needs lower weight in apply. Ok, one more question. In Encode IPAdapter image, best practice is that sum of weights needs to be 1.0 or it's just relative and it can be something like 1.0, 0.8, 0.5? Oh, and 1.0, 0.0, 0.0 gives different result than disconnecting 2nd and 3rd image from input in Encode IPAdapter node, bug or I don't understand how it works?
yeah at the moment you can set any weight (it's relative to the image). a weight of 0.0 is actually 0.00001 because otherwise we would send a zeroed tensor which is not the same as sending no image at all@@Dunc4n1d4h0
3:42 Pro tip: If your mask for the attention mask is off-centered and you include the name of the subject in your prompt, you may see additional subject being generated. For example, if I want to put the warrior on the right side of the image, it will often generate another warrior near the center of the image. To avoid this, just don't mention any character in the prompt.
stable diffusion will generally try to create the main subject in the center (no matter the attention masking), to avoid that you can use masked or positional conditioning
is it possible or will it ever be possible for ip adapters to be used on bodies? so say someone has a tattoo that i want to replicate which is something that isnt very possible with loras will that potentially be a thing in the future?
This is yet another great video, thank you so much !!! I have one so many questions as I'm new commer from A1111 to ComfyUi and I just can't have enough of it, it made me feel I'm free and the limits are my imagination. I was wondering, what method is best for IP adaptor, if I want to use many photos for different stuff in my final image without using inpaint of masks, I'm trying to make a robust workflow that can take inputs and get an image that is as close as to the original prompt as possible, can IP adaptor help me with this or it is more like Loras where somthing has to be picked in start to control the outcome. One way I'm thinking to use it is to use it in a looping fashion, like generate an image with basic prompt, use that image in IP adaptor, use new more specific prompt and generate an image, use that image in an IP adaptor with new more specific prompt and so on.. Can this method yield a good results ? It is like using very large prompt with high CFG but without the problem of burning the images.
is it possible to use this to add jewelry or accessories to ai images? I have to place some watches and other stuff but I lack the skills on photoshop and they look.... "fake"
WOW! this is going to solve a huge problem i've been having. i want to create an image with a cat and an owl next to escorted as friends. until now i can only get two catowls. thank you
I want to thank everybody for taking the time to write compliments and words of encouragement. I really do appreciate all of them and they honestly motivate me in releasing more videos. Let me know if there are topics you'd like to see covered and thank you all again!
These are fantastic videos. I am wondering if there is a way to use IPadatper to only transfer color pallet or other facets of an input image (but not the whole). I think for SD 1.5 there is a way to take only the color pallet with the t2iadapters but not with SDXL - maybe you know of a way?
I don't think there's a color controlnet yet for SDXL but you can use img2img with a certain grade of success. Set the colors how you want them laid out with a paint software then use that reference image as base for your img2img with a very high denoise. That should kinda work.@@EH21UTB
👋
@LouisGedo Thank you so much for all you efford.Actually I am trying to make a flow in order to let a model wear some specific cloth provided as a picture. I tried lots of times, but the clothe weared by the model generated by the flow always different with the one I provided. I really want to understand how to do it . can you please explain about this .
I’ve finally gotten into IP Adapter. Combining it with depth and pose control nets and ReActor face swap yields incredible results. For instance, I took photos of my parents and photos of vintage Christmas cards and produced a nice vintage style Christmas card that looks like them as a gift.
Could you please share your workflow? Must appreciated
Bro I need to talk with u can u share ur insta id
IPA Plus has been the most game changing thing I've found yet. It's capabilities are insane. Can't ask for much more.
You're such a great example of an open source dev. Always listening to feedback and working with the community.
I just tested it and it's amazing! The results are impossible to obtain with a normal prompt, this bring so many possibilities. Thanks a lot for your videos!
Hey there! I rarely comment on videos, but I feel compelled to express my appreciation for your unique approach. Unlike many creators who merely guide us to mimic their actions, you delve deeper, offering insights into the 'why' and 'how' behind each step. This approach not only makes your content easy to follow but also empowers us to adapt and understand the process, fostering genuine learning.
I've eagerly watched all your videos, and the knowledge I've gained is invaluable. Your response to a comment in another video about the tedium of covering basics resonated with me. It's true that many overlook the importance of fundamentals. Your explanations are a rare gem in a sea of superficial tutorials; they enable us to think, not just copy.
To alleviate the repetition for you, perhaps consider creating a series of detailed videos on these basic concepts. This could serve as a reference point for your viewers, and it's also a strategy that tends to be favored by the TH-cam algorithm.
What captivates me the most, however, is watching your workflow, especially in segments like the anime and pixel art transformations. Your real-time commentary adds immense value. Regardless of how many times a topic has been covered by others, your unique perspective and method of presentation make your videos a must-watch, even on well-trodden subjects."
A comment made by AI for a video about AI😅We live in weird times! I really enjoyed it thanks for the kind words
I used A.I. to touch it up but its really how i felt
This is just mind blowing at this point. I'm really really glad I came across you (and IPadapter) in my AI learning path!
The merge of styles is insane!
There's not that many videos yet on your channel, but every video is a diamond. One of the most interesting and valuable content I've met on youtube so far. Thank you VERY much for what you are doing.
A wizard in action! :) So this is how you are supposed to work with masks! I had to pause this video several times, so much information in such a short time, well done, very useful!
Just started going through these playlist; This is truly a gem. Thanks much for sharing.
If you get a chance, do list the machine specs you use for controlNet + animateDiff +IPAdapter? It does take a long time even on a 16GB GPU. TIA
You’re now my #1 TH-camr for ComfyUI . Your channel deserves so much more subs - And it will!!!
Overnight Latent Vision becomes top SD instructor
You, kind Sir, are a treasure. I absolutely love IPadapter. I am very very thankful.
Matteo il MAESTRO!!! Many thanks for the great latent wisdom you give us!! ❤️🇲🇽❤️
I want thank you for your great work, not only this video, but also other videos and the comfyui_adpater_plus, which help me learn great knowledge about how to control the AI model to draw images.
thanks! And have fun with AI! 😄
This... IS... CRAZY !!!
Thank you so much for sharing your fantastic work !
I'm using IP+ andd I'm impressed by the results, tanks to you !
Fantastic! A truly superb tool and fantastic explanation. Thank you!
This is awesome Bravo. I tested the channel penalty this morning, it improved the result as it handles well weights more than one
Mateo, this blows my mind, I'm so inspired by your great work, I can't express my gratitude enough. Your guidance hit the mark in a simple and easy to understand way which was definitely what I needed. Thanks again for the great work you do.
Jesus christ, ive been in love with IPAdapter since its release and this just completely unlocks all the possibilities. This is an insane value tech, thanks a lot for the contribution.
Gamechanger! There are many, many methods to achieve these end results; however, as we all know, they're tedious and extremely mind-numbingly time-consuming. Matteo's IPAdapter with noise method works the best. Work smarter, not harder!
that's beautiful, that's exciting.
exquisite, incredible work!
you are very honored. Thank you very much for everything, a great mind.
you have no idea how many people you're helping, making our projects more fun, easier and better!
You are a legend, loving the IpAdapter and your vids are wonderful, simple in style yet so informative ...Love em..You are appreciated..
Brilliant - thank you for these and for sharing the workflows
omg. amazing stuff... unbeatable feature.. you are brilliant
This is pure (AI) magic and will help soooooo much in composition! Amazing results in your demonstration, and your tutorial is spot on, very clear to understand. Thanks so much for your hard work!
Wow! You have unleashed one of the best things for Stable Diffusion since ControlNets! Thanks for developing these great tools and showing us how to use them!
Fantastic! I will have to watch this several times!
This is a really powerful tool, thank you Matteo.
Amazing job as usual, what a great new feature update!
Wonderful content and wonderful tech, thanks for your hard work!
Holy! That was so impressive. Love your videos man! So much to learn and see it in action.
Your work is unbelievable. This is tremendous and I just can't believe we get to watch you develop in real time these tools that will revolutionize AI image generation.
Amazing! Keep up the incredible work.
Thank you for your work with IPAdapter. I've only been using it ever since I found your videos on it. It's so great, being able to have 1 image loras without the need to download others, and can just very quickly create them. The one Issue I've been having is it's been transferring the hair to every character design (I'm using a Harley Quinn reference I made for the adapter image and it's copying the pigtail hairstyle and face on pretty much every character lol)
just to say thank you for you work and dedication !
This is just absolutely amazing!
This is amazing. I cannot express my feeling after seeing your video. This blows my mind. ❤😊
I agree with others. Mind blowing feature. Thank you! 🤯👌🤘
I am grateful...
This tech is unreal! Your channel deserves to blow up. I'm loving your tutorial format.
Amazing Work as always!
I used to love ipadapter now I adore it 😍😍😍
Bella scoperta, un italiano! che bello. Iscritto subito
Fantastic work, thank you so much!
Very valid concentrated information... thx a lot! - I wished all these special infos would be provided as "note-nodes" explaining things right in the json-example. It is obvious to me that your knowledge about all these components and how they work together is superior to some other "random-masters" on YT. It is difficult though... to remember all the little facts, like which model needs what other model and so on...
I hear you, the problem with comfy (and all generative ai) is that things move so fast that any documentation is outdated in 3 months (sometimes less). That would mean reviewing all the workflows every now and then and it's a huge amount of work. I'm thinking of writing some articles especially for more complex topics... but do people still read? Everything seems to be video or burst
@@latentvision You are right Matteo, thank you for your answer. I also know that my "wish" included more work for you... I didnt mean it in a demanding way, I am thankful for any piece of information on a journey into comfy UI. The problem is, that I like to understand things in depth... while it seems to me, that some are ok if if only some nice picture result in the end... and in the beginning of research it is still difficult to seperate the good from useless sources of information. Not many developpers are as good in teaching as you are, or they do not teach at all. I think, much of the information, like - basic relations - will not be outdated so quickly... once the main principles are understood... understanding coming updates can also be challenged :-)
Great job as always!
bravo , matteo! 10/10 questa roba! 🔥
You blew me away with compositing using multiple masks. That is so freaking cool!
WOW ! you are the BEST ! It's just so hard just by looking at video but might be able to replicate by doing. Thanks for that man !
Love your voice dude, bet you do lots of "BFF" out there , I have a question if you don't mind, can I replicate this exercises (all the old tutorials) with the current version of the nodes or I'll see some huge differences?
check the most recent videos, but more or less it's the same process
Sei un grande!
Beautiful, simple, explosively relevant. You're inspiring.
That is pretty cool, thanks for the update and the tutorial
Thanks a lot for your work on this most excellent tool. This has given me so much possibilities regarding composition, and easily as well ! Less hassle and much better control/results.
Impressive stuff.
Thanks a lot! it was very very useful!
Mateo, you are a GOD! Thank you so much!
Always a treat when Mateo puts out a new video 🙌
Beautiful, simple, explosively relevant. You're inspiring. Love you so much.
Truly amazing. Many thanks
such a fantastic tutorial
Superb , Awsome work
Completely blow me away! Thanks so much for creating the Adapter and these tutorials! ✌
I've only recently discovered your content, but I just had to tell you how blown away I am at your knowledge and skill in this field. It's just breathtaking stuff you're getting up to. Kudos to you, and all the brains that make this technology possible.
Could you imagine travelling back in time even just 20 years and showing this to people? It'd be science fiction.
Thank you for the work. Amazing tool
Really awesome stuff! Brilliant!
5:29 how did you copy the ip adapter node with all connections intact?
shift-ctrl-v
thank you
amazing tools and workflow! Insanely impressive!
thank you, this is amazing!
Wow! This is a great update!
Incredible, thanks a lot
This is amazing! Thanks
This is awesome - thank you 😎
Wow, just wow. So detailed explanation and so easy to follow one of the best channels on Comfyui. I am always looking forward to your videos.
really incredible -- great demo, I can't wait to use this. I've been experimenting with some of your other tutorials to make animatediff clips. Excited to see the control I might be able to get from masking areas and being able to prompt each one.
amazing~!! Thank you very much !!
che lavoro della madonna però, grandissimo
damn I had no reason to use comfyUI until NOW, this update is crazy
Excellent work!
Great Work again 💪
Outstanding
Where do you come from you hero!! Amazing explanation once again! Thank you.
Creasy stuff i have to say... I used A1111 and now have switched to Invoke AI, because as strong as Comfy ui is, for a company, using architecture ease of use is the most important feature, and here it gives you as well a linear standart interface (the best out there) and also nodes.. and usal users that have not only to use nodes but dozens of programes are better off with a simpler userinterface where the nodes and inputs dont change place each session..
But i have to say wow.. realy realy impressive
the biggest advantage of comfyui is how fast it is developed and how easy it is to develop an extension for it. This is of course not always a good thing because as you say a company needs stability and ease of use. but for bleeding edge comfyui is really amazing
If invoke AI adopted ComfyUI as their node backend they would have access to all the amazing custom nodes rather than have to develop theirs from scratch... just saying... They are kind of re-inventing the wheel... they should adopt rather than compete.
@@BernardMaltais I believe invoke.ai uses diffusers which is an established standard but it doesn't move fast enough in this incredibly volatile technology. Building a tool like invoke over comfy would be no easy task as there are no update cycles in comfy and your code could break any day. I hope things will get easier in a couple of years when the technology settles a little
@@BernardMaltais agree as an enduser i would welcome this. also i havent yet looked into the nodes of invoke. but never the less it looks promissing.
i am teaching invoke to a big architectural company that starts to integrate image ai into their workflows.
Here in my opinion invoke excels because of its unmatches ease of use.
this is key in more complex company workflows, because each teammember has to deal with a dozen of different and often even much much more complex CAD and BIm tools.
So an interface like comfy ui is somewhat far overdone for them.
never the less things will become easier and we even cant imagine which programs and workflows in 5 years will excel
Great job, simply WOW. Little question, can you maybe say something about "full face" adapter?
it is called FULL because it takes the whole 256 vector space to describe the face. As a comparison the plus models use 16 tokens. The result should be a very detailed face.
@@latentvision tyvm, so that is why it sometimes needs lower weight in apply. Ok, one more question. In Encode IPAdapter image, best practice is that sum of weights needs to be 1.0 or it's just relative and it can be something like 1.0, 0.8, 0.5? Oh, and 1.0, 0.0, 0.0 gives different result than disconnecting 2nd and 3rd image from input in Encode IPAdapter node, bug or I don't understand how it works?
yeah at the moment you can set any weight (it's relative to the image). a weight of 0.0 is actually 0.00001 because otherwise we would send a zeroed tensor which is not the same as sending no image at all@@Dunc4n1d4h0
3:42 Pro tip: If your mask for the attention mask is off-centered and you include the name of the subject in your prompt, you may see additional subject being generated. For example, if I want to put the warrior on the right side of the image, it will often generate another warrior near the center of the image. To avoid this, just don't mention any character in the prompt.
stable diffusion will generally try to create the main subject in the center (no matter the attention masking), to avoid that you can use masked or positional conditioning
Chapeau Mattè!
My Comfy does not seem to have the preview mask node. Can you please tell, where that is from?
Found it: Comfyui Essentials
it's in Comfy_Essentials
Glad I checked the comments and thanks for asking! I was looking for the same node
is it possible or will it ever be possible for ip adapters to be used on bodies? so say someone has a tattoo that i want to replicate which is something that isnt very possible with loras will that potentially be a thing in the future?
you can train your own ipadapter model and/or clip vision encoder
@@latentvision is there a tutorial on how to do that? :o
that's material for another video...@@NeuralAlchemy
@@latentvision sure is hope to see a tutorial for it in the future!
Amazing. Is this workflow from video available somewhere?
wow, that is great🥰
Would love to see how you hook a ControlNet into this...🙏🏻
There's an example in my previous video that covers the basics
this is amazing!
This is yet another great video, thank you so much !!!
I have one so many questions as I'm new commer from A1111 to ComfyUi and I just can't have enough of it, it made me feel I'm free and the limits are my imagination.
I was wondering, what method is best for IP adaptor, if I want to use many photos for different stuff in my final image without using inpaint of masks, I'm trying to make a robust workflow that can take inputs and get an image that is as close as to the original prompt as possible, can IP adaptor help me with this or it is more like Loras where somthing has to be picked in start to control the outcome.
One way I'm thinking to use it is to use it in a looping fashion, like generate an image with basic prompt, use that image in IP adaptor, use new more specific prompt and generate an image, use that image in an IP adaptor with new more specific prompt and so on..
Can this method yield a good results ? It is like using very large prompt with high CFG but without the problem of burning the images.
I would start with the main elements and attention masking, then upscale and inpainting
is it possible to use this to add jewelry or accessories to ai images? I have to place some watches and other stuff but I lack the skills on photoshop and they look.... "fake"
Well i struggeled with one part.. i cant get the "Prepare image for Clipvision" Node.. What do i get Wrong?
Thank you so much for your insight :)
wow, great job! Thank you!
Fantastic!
.
WOW! this is going to solve a huge problem i've been having. i want to create an image with a cat and an owl next to escorted as friends. until now i can only get two catowls. thank you