How to make an AI Instagram Model Girl on ComfyUI (AI Consistent Character)
ฝัง
- เผยแพร่เมื่อ 1 มิ.ย. 2024
- How to make AI Instagram Model Girl on ComfyUI (AI Consistent Character)
🔥 New method for AI digital model • The "Secret Sauce" to ... 🔥
Learn how to make an ai model girl using Stable Diffusion ComfyUI. In this tutorial you'll learn how to create an aitana ai model looklike. You'll have full control on your model, a Consistent Face, Clothing and environment of your ai instagram model.
🌟 All Useful Links & Workflow Visit: aiconomist.cc/ai-model-workflow
#aigirl #aimodel #stablediffusion
🖥️ my PC setup:
GPU - amzn.to/3PAbjP6
CPU - amzn.to/4cngN9A
RAM - amzn.to/494I5ig
SSD Storage - amzn.to/3x739r4
Prebuilds PC for Generative AI - amzn.to/3TQDTOQ
For Business: info@aiconomist.cc - วิทยาศาสตร์และเทคโนโลยี
🔥 New method for AI digital model th-cam.com/video/nVaHinkGnDA/w-d-xo.html 🔥
maybe itll look decent this time
This was excellent. Thank you for showing people there are other and better options than the Midjourney face swap method which of course limits your flexibility tremendously. I'm actually in the process of doing this exact thing and was building my ideal workflow, but what you did with the outfit and masking is really fantastic. Very helpful.
perfect video , only consistent and detailed video i was looking for . this is gem.thank you so much
This was Absolutely AMAING! I've watched countless videos, spent a good amount but nothing as detailed and as great as this.. Definitely subscribing to this channel
thanks for making this video, I just bought your workflow
Great video. I find using the prompt, "staring directly into the camera" works well for portrait shots or using "portrait". I'm also glad you're using low quality prompts instead of high quality and cinematic photography. Most average phone users don't have access to high quality cameras. 😁
That's actually really incredible the psychology and systems that go into making that much money
this is wild! Thanks.
great tutorial... very easy to follow. thank you!
Love it! 🤠
Fantastic video. Simple, straightforward and well explained.
Much appreciated!
Excelente video hermano, bastante interesante.
Woaw, it seems very difficult but great in the same Time. I will try tomorrow
There's nothing comfy about ComfyUI
This 🤣🤣
@@xviovxthen you should do it manually on a1111 to get the idea why it’s called comfy
Agree😂
The flexibility it gives us over other tools are justified
😂😂😂
This is great stuff.
Amazing! Any recommendations on how to optimize it for SDXL? For a reason I can’t explain if I update all the models I’m getting worth results with SDXL compare to 1.5… 🤔
load clip vision model. what model do a load ? where to find this model.safetensors
where do you get all the images for clothing and poses from?
it worked, thanks, where i find the openposes to download?
Great video, one question: why if I change the initial checkpoint despite keeping or removing the LoRA and connecting the model directly to the IFAdapter the whole process stops working because of a different size of the matrices?
I wish I'd have watched your video sooner. Well, if you posted it earlier 😂😂 just today I have come to a similar solution in order to achieve this. And now I still have a question: what if you want to switch to full body figure, or want to have a profile or rear view of your model, do the masks and the images going into the IPadapters remain unchanged? Or do you have to switch IPadapter's image and mask accordingly?
Eres grande!
Hey thanks for the video! I cannot find the Ultimate SD Upscaler. has it been removed? If so is there something else you would suggest in its place?
God bless you! Tysm
Awesome......
Amazing content. Thanks for sharing.
Is it possible to place her in a specific environment by providing a reference image of the environment?
Excellent video!
Glad you liked it!
How can you increase the accuracy for retaining the face? The face, although quite subtle, was noticeably different in each generation, which is noticeable to a follower as I noticed just in this video. Thanks!
How can I use multiple prompts at the same time? Say put 5 into the queue and then move onto the next one? So the same that with the stable dif default UI can be done by using the texfile or textbox on the very bottom?
Cool video!
Got my KSampler blocking (loading 0% over 25 steps) after IP Adapter, don't know why but maybe related to the AMD graphic card I am using?
Generation of image and upscaling was working...
Cool, but what about a different perspective view of the face? it seems like the face always keeps the same perspective regardless of Openpose settings. is there any way to fix this?
Perfect tutorial, thank you.
I'm always thankful. Rather than first creating a female model as a prompt, is it impossible to import a photo of a female model?
any idea what kind of graphics card you can pull this off with???
I have a rx 6700 xt and an old laptop with a Gtx 1050 so it's clear i will need to upgrade but what is like the minimal card so i don't have to spend a lot
You have shared everything thank you for that. If you could also share the openpose image and the character dress one would be appreciated
This is a good tutorial. Face swap maybe is a more fitting title in general
Whats ur Clip vison model?
hey, nice tutorial, really well explained in detail. I am getting an error when running Ksampler and i was wondering if you could help me with that:
"It seems that models and clips are mixed and interconnected between SDXL Base, SDXL Refiner, SD1.x, and SD2.x. Please verify. "
one thing that is different from my workflow and your workflow is that in the clip vision loader I am using "clip_vision_vit_h.safetensors" instead of "model.safetensors" because I couldn't fine the file you are using on the web, any chance you could post a link to that file or help me out resolve this error?
thanks in advance
my model is coming out with two heads all the time, do you know how I can solve it? I've tried several negative prompts but it doesn't help.
If I get a Macbook M3 pro , can I easily install Comfy UI and work?
Please make a video about the posing and where to get this, and how you make the outfits
I am trying to find a course on creating a virtual influencer, so if you can tell me when you make it will be great!
Thanks for the great tutorial and the sample json files! I was able to do almost the same thing using the sample Json, but for some reason the face part is broken and does not show a beautiful face like your tutorial. For Automatic1111, Adetailer can be used to beautifully redraw face images as well, but currently Adetailer is not available for ComfyUI. Is there something I should do?
There is a plugin called Face Detailer but of course, it needs more nodes and connections making the workflow more complicated.
Where can I download the model for clip vision?
What if I just wanted to change the pose alone, no change of clothes or anything else, how do I go about that pls
Hey i have a question, how can i do all of this, if i have already generated model in stable diffusion?
where should I put ipdapterplus models? I put in "custom_modules->ComfyUI_IPAdapter_plus\models" but it didn't detect the model?
New to this, why not combine with faceswap?
IPAdapterApply node fails every time I try to use the workflow. I'm a noob help please :(
Hi, thanks for your content !
Great stuff and efforts
I have a little request would it be possible to make a video to explore AI models with the Multiarea conditioning .
it would a great asset
Thanks and regards !
thank you for your content, Please make a video how to use stable diffusion for creating designs for merch by amazon
does that work on Macbook machines?
Wow, this is nice, I wish there was an easier way to do this or this is too complicated to me :(
I have an issue with the load clip vision doesn’t load the safetensor
When I use a same phto of clothes, almost similar characters appear, but when the image of the clothes changes, a completely different character appears. What should I fix?
how do you do to see ksampler and upscaler progress ??
I'm searching for it and i can't find it
PLEASEE
I am going to ignore that you took MKBHD's voice and thank you for the tutorial :P
Hey thanks for the video, but I where do you download all the controlnets from and how do you install them in to ComfyUI as well as where did you get the Clip Vision model from ?
huging face
Can u give is a link to this model?
I have also struggle, have you found it yet?
Can u help me? Why is sometimes the facy ugly and sometimes perfect, depens which pose i take ?
How can i make a fashion model?! I mean same person with different outfit that i choose. Thanks
So what is the miimum system req?
where did u get the IPadapter, how did u config and install it, which CLIP vision did u use, where did u get it? where did u get the open pose? i tried to find all by my self, but the end result is that my faceswapping looks like dogshit, can u help?
I was the same when I saw the video, frustrated because it doesn't explain many details, but I was able to make it work, but it was on my own, I took the time to look for everything you mention separately and watch videos, and I was able to get what was missing.
So i tried and everything works. But the next type I open comfyui the character face is getting change how to fix that can you make a video for this
How to consistent up to 3 character or more just style change with prompt
And another question: what's the purpose of setting the denoise value to 0.75 in the ksampler at 7:45 with an empty latent?
There is none. Cause an empty latent image is just pure noise. He likely meant to convert an image into latent space or something.
partially right .. however i think the latent isn't totally empty . there is openpose . and the generation after the first one gets seeds and clips from last one . less denoise = less changes ....
@@JustFeral indeed, this must be related to the IPadapter in some way or I can't see the point, as he's starting from an empty latent. What's the point of partially denoising the noise.
I get this error while using your workflow from gumroad: ClipVision model not found.. help me please
can you do an advanced tutorial for automatic1111?
Still using a1111, I love the simplicity.
You can do more with comfy.
How to add custom clothing of my brand
Hey! Thank you for the video. Can you advice about one problem? I used your workflow, but I catch this error: size mismatch for proj_in.weight: copying a param with shape torch.Size([768, 1280]) from checkpoint, the shape in current model is torch.Size([768, 1024]). I don't understand where it comes from
Could you solve it? I have the same issue and don't understand how to proceed
So for that I had to get the correct clip_vision model.
I don't know that it will let me post a link in the comments so here is how to find it:
Go to his link to "All Useful Links & Workflow Visit:" in his description.
Go to "IPAdapter plus Models HuggingFace Link"
Go to the main directory, then the "Models" folder. Go to the "Image_Encorder" folder. Download "model.safetensors"
From there you have to put the model you downloaded in your comfyUI, clip vision model folder.
That same place also has alternative IPAdapter models.
@@tiggy4591 thankyou very much it worked like charm
@@sunnyandharia907 Awesome, I struggled with it a bit last night. I'm glad it helped.
@@tiggy4591 i love you! you are the GOAT
Maybe you address this in another video, but to me, the faces were vastly different from one another, evolving on every pass and getting away from the original one (before adding the SMILE in the prompt).
I have a question, if we have a clothing or jewlery brand deal, how can we make the model wear that product?
Where did you installed? Wich folder
Can you please do the same for A1111. PLEASE!!
It look so complicated to start any easiest way to learn with all those arrows connected?
Can you run this in chrome?😅
Very good, but the face painting is not very like the reference, the clothes can not change the same, are generated a little similar, but still very different, what is a good way
the ipadapter apply node is not found, can't figure out how can i fix this? any solutuons?
I have the same problem, try use others but not work
Nothing in ComfyUI is beginner freindly. There is pain, there is frustration, there is lost sleep and then more pain. I miss Lawrence wont take this unkindly, these arrows looked rarher painfull 😂.
good video but there were things left to explain, for example: installing the models, in which folder to install it
video is great, but you did not provide the links to download the models.
I have downloaded your worflow, tried to install all models same as you have, and always get an error.
I'm sure the problem is on my side. but you could take more time to explain the details.
InsightFace must be provided for FaceID models. any one getting this error ?
where to download open pose model?
how download clip vision model ?
cant get my characters eyes to look normal :( any tips?
why wont it show the preview image on my screen?
i cant find ip adapter apply nodes , what should i do ?
I'm updating this workflow because a lot has changed since then. +++ IPAdapter version 2 is even more advanced now. Be sure to check out my latest videos for all the updates.
@@Aiconomist Please update this, i try use other nodes and adapt something similar that you .json file, but nothing work for me :(, appear a error shows "copying a param with shape torch.Size([768, 1280]) from checkpoint, the shape in current model is torch.Size([768, 1664])"
Please help us and update the .json file in the web, thank u very much
Did anyone happen to figure out what Clip Vision model was used?⁉
please do a tutorial for automatic1111
I was/am finding this extremely usefull. However, am I the only person who can't seem to find any reference to this CLIP Vision file? pls help 🙏🏻
I was looking for 2 hours yesterday no chance 😢
manager > install models > CLIPVision model (IP-adapter) if you used this guide exactly you want the SD1.5 version
i cant make IPAdapter work, make a video downloading pls
Hm... i finally got all needed models and nodes and shit but it still does not work as shown... I get an error message "Error occurred when executing IPAdapterApply: Error(s) in loading state_dict for Resampler: size mismatch for proj_in.weight: copying a param with shape torch.Size([768, 1280]) from checkpoint, the shape in current model is torch.Size([768, 1664])." And then it goes on with execution.py line 85, line 78, ... but i think the cause is something with the resolution of the images I put in? Is that somehow relevant? Like all input images have to be the same resolution?
read the comment from @alexalex9511 someone postet an answer
Good video but you left a lot of info out, and its making me mad cause it wont work.
1. I keep getting errors, i think its because i got a random clip vision model
2. You did not show how to create or get a pose or how to even use the controlnet. I dont have any images like you i have to input my image, and dont know how to make one
its so interesting and amazing how this is now. I don't know what many of the terms he says mean though. like dpmpp_sde.. .. and that kind of stuff. I feel like a total idiot watching this. There is no way I can learn this now and keep up with it. It's really so cool, but it sure makes me feel stupid.
Great video, although i have followed the video step by step, i keep getting deformed faces that look similar to my target model but not even close to it. What can i be doing wrong?
Same here
Me too
Same. I feel like the input images/masks into IPAdapters must be super important.
@@wulfster1234 Yes, I realized the IPAdapter images must be of high quality too. Even the parts that are not included with the mask.
Thanx, makes the pain a bit less.
Are they really consistent? I don't see Jennifer lawrence in any of the final generated samples!
The face of Lawrence is only for reference to AI.
the "model.safetensors" file at 5:07 is too large for the file system to install, what can i do ?
i've been trying to find this
Whats the config to do the clothing swaps with XL models, or is that not optimal? Also, do you inpaint to remove defects? Is there a separate workflow in comfy UI that you use to do that?
you can get clothing images from amazon 😉
@@Aiconomist How do you deal with deformed hands lol.. do you inpaint or do you just keep generating till you get something decent, or do you crop them out of frame when you post the image on IG?
try using a mix of controlnet to edit the fingers and a bit of photoshop to fix the nails
@@aindmix
Can you make a proper video of how to set up the work space before following steps in this video? As the video you are directing to is missing heella lots of parts and nothing works?
Thanks for the tutorial, but could you create such a video, but in an automatic 1111?
Sure thing, I'll try to make an A1111 video next.
@@Aiconomist Second this! :)