Matt3o... you're an absolute gem of a teacher, developer, and entertainer as well! Your casual humor really makes this mountain of info so much easier to climb! Thank you so very much, and wishing you joy in everything you do!
FANTASTIC! Just what the doctor ordered! These align nodes will be very nice to play with too! This may be a long shot with the current technology, but I am hoping at some point I can find a way to get my faces to take a reference expression and copy that expression to another face or just straight up better control expressions in some way. unfortunately, right now, stable diffusion doesn't seem very flexible with expressions and it changes the face a lot so this will be helpful to help me constrain the face to be the same person. With lukc, there may be a way though so I am gunning for it.
@@latentvision You should consider looking at a new paper that came out this week titled "Face Adapter for Pre-Trained Diffusion Models with Fine-Grained ID and Attribute Control", it published with code and a huggingface model. It does exactly what I hoped, takes a reference image and copies the expression to your target face, it isn't perfect but it is definitely an improvement and the best I have seen so far for Stable Diffusion. Unfortuantely I think it only works for SD 1.5 but they have a demo and I did a bunch of test faces on it and it is pretty great. I don't know how related it is to IP-Adapter, but considering your stint on face analysis and swapping, I figured I would comment on here and let you know in case you missed it because I think it is something you would be interested in.
@@latentvision In case you missed it, I definitely think you should take a look at the paper with it's associated hugging face model and githubio titled "Face Adapter for Pre-Trained Diffusion Models with Fine-Grained ID and Attribute Control". It came out right before this video and it's exacty what I hoped, even if it only works with sd15
Mateo your work is excellent! you always surprise all of us with your progress! The workflow you show in the video is uploaded somewhere? Thanks a lot!!!
Hi, Mateo. I understand you are the one creating the nodes for the IPAdapter. There is a node IPAdapter Encoder, it has a mask. I tried to connect the image and image as a mask, but did not understand what it is for. If possible, please tell me how to apply this mask correctly in this particular node. Thank you again.
Do you know that meme where someone is in mathclass and the professor writes 1 + 1 = 2 and he thinks it is easy and then he is distracted for a second and the board is full with the most complex formulaes? That is what your videos feel like, luckily you can pause this and return if you missed something😂
Great video as always! a question.. Where do I find the "Face segmentation" node? I don't have it and If it's a custom node to install I'm not finding it :( Thank you
@@latentvision Thank you, that's what I imagined. It's just my bias and the fact that FaceId is so good that I end up using it in almost all the images I do haha.
@@latentvision Thanks for the reply and thanks for the amazing videos! You are an excellent communicator! For doing "face transfer", is InsightFace the only option?
Error occurred when executing FaceAnalysisModels: Can you tell me what's wrong? Error occurred when executing IPAdapterUnifiedLoaderFaceID: IPAdapter model not found.
Is there a node or workflow that takes 2 images of the same ai person and generates an image that represents the halfway point between the two? Idea being to make frames for video / gif
Hello Latent Vision! What's the best method to get the most similar and realisic face? Using nodes as Controlnet, PulID or training LORA for this face?
@@latentvision I'm focusing on similarity. When I try to generate images of babies in cute scenes and costumes, I realize that maintaining facial similarity is harder with babies than with adults. My idea is to incorporate scenes and costumes in Lora to create the style I want and then use your PulID workflow to achieve the best facial results. My goal is to get the realistic face details combine with my desired photography style.
If you only got as far as including the models (as I had) it still has more to do. This is how I got it working with portable windows Go to the provided link for "Face Analysis for ComfyUI" Installation Section: For DLIB download (4 models) Check which 'python_embedded' python --version in ComfyUI portable (mine was 3116) Download the Precompiled Dlib (for Windows e.g., 311) (into ComfyUI portable root folder) run the command python -m pip install 'the exact spelling of the downloaded wheel file' UPDATE: Well this does get the dlib into the dropdown, but I celebrated too soon: Error occurred when executing FaceEmbedDistance: setting an array element with a sequence. The requested array has an inhomogeneous shape after 1 dimensions. The detected shape was (4,) + inhomogeneous part. Sorry, if someone else can help both of us that would be appreciated!
Downloaded the workflow but getting this error on the FaceEmbedDistance node, any ideas? I've tried to pictures of the same person that were taken on the same shoot and look very similar. "Error occurred when executing FaceEmbedDistance: setting an array element with a sequence. The requested array has an inhomogeneous shape after 1 dimensions. The detected shape was (4,) + inhomogeneous part."
@@bwheldale I reinstalled Windows over the weekend (File Explorer has been playing up and been putting it off for ages), working fine for me after setting Comfy back up . Would have installed the updated version you mentioned.
I tried to install instant id and face id from comfy ui manager but is shows import fail error, could it be because of my low vram, cuz I have only 4gb vram or could there be any other reason?
Great, I have a request, now facial analysis can only process one person's image, I think three people together, analysis of the face may produce three different images,Not in the same picture
@@latentvision The same for me... I installed the dlib models into dlib directory and installed dlib library too. However, I can´t select dlib (only insightface).
Ì was in the middle of performing open heart surgery but then I heard the new Latent Vision video dropped. Patient will have to wait.
even better invite the patient over
lol its worth it. The heart has to come after.
I was watching Latent Vision when the new Latent Vision dropped. I obviously died.
@@context_eidolon_music 🤣
You can always create better face for the patient 😂
Matt3o... you're an absolute gem of a teacher, developer, and entertainer as well! Your casual humor really makes this mountain of info so much easier to climb! Thank you so very much, and wishing you joy in everything you do!
Thank you for explaining how this works. This type of information is very useful when delivered by someone that is also a great teacher.
"It will hurt your feelings" 😂 happens to me alot when I thought I got a good likeness
FANTASTIC! Just what the doctor ordered! These align nodes will be very nice to play with too! This may be a long shot with the current technology, but I am hoping at some point I can find a way to get my faces to take a reference expression and copy that expression to another face or just straight up better control expressions in some way. unfortunately, right now, stable diffusion doesn't seem very flexible with expressions and it changes the face a lot so this will be helpful to help me constrain the face to be the same person. With lukc, there may be a way though so I am gunning for it.
it's possible to change expression but it only works with extremes (very angry, very happy... or neutral)... we miss everything in between
@@latentvision You should consider looking at a new paper that came out this week titled "Face Adapter for Pre-Trained Diffusion Models with Fine-Grained ID and Attribute Control", it published with code and a huggingface model. It does exactly what I hoped, takes a reference image and copies the expression to your target face, it isn't perfect but it is definitely an improvement and the best I have seen so far for Stable Diffusion. Unfortuantely I think it only works for SD 1.5 but they have a demo and I did a bunch of test faces on it and it is pretty great. I don't know how related it is to IP-Adapter, but considering your stint on face analysis and swapping, I figured I would comment on here and let you know in case you missed it because I think it is something you would be interested in.
@@latentvision In case you missed it, I definitely think you should take a look at the paper with it's associated hugging face model and githubio titled "Face Adapter for Pre-Trained Diffusion Models with Fine-Grained ID and Attribute Control". It came out right before this video and it's exacty what I hoped, even if it only works with sd15
Fantastic job, Matteo. The amount of knowledge you're sharing in your videos is always amazing.
...that last picture 🤣
Mateo your work is excellent! you always surprise all of us with your progress! The workflow you show in the video is uploaded somewhere? Thanks a lot!!!
it's in the discord but... I pasted it here too pastebin.com/4tYRceiK
@@latentvision thanks so much!!!! 😃
You are the real master and you are so generous to share those techniques. Thank you so much.
Thank you for making this. It was very helpful.
brilliant and fresh as ever, keep up the great work matteo! ;)
Thanks!
Woowwww!!! this video is a masterclass
Grande Matteo 😁👍 anche per le spiegazioni tecniche dettagliate su queste cose difficili spesso da comprendere
Hi, Mateo. I understand you are the one creating the nodes for the IPAdapter. There is a node IPAdapter Encoder, it has a mask. I tried to connect the image and image as a mask, but did not understand what it is for. If possible, please tell me how to apply this mask correctly in this particular node.
Thank you again.
Maestro... grazie!!
Do you know that meme where someone is in mathclass and the professor writes 1 + 1 = 2 and he thinks it is easy and then he is distracted for a second and the board is full with the most complex formulaes? That is what your videos feel like, luckily you can pause this and return if you missed something😂
don't worry... happens to me all the times
Thank you 🙏
Love your videos and tutorials....best out there and I learn a lot
Another excellent video, thank you
Thank you Teacher!
Now I just need a faster GPU...
Excellent video - thank you.
Does anyone know how I can get the value and dist data shown in the image preview?
Just waiting for this to be as good as photomaker.
Can you explain the concept of "embeddings" in general? What function do they serve? What do these numbers represent?
Great video as always! a question.. Where do I find the "Face segmentation" node? I don't have it and If it's a custom node to install I'm not finding it :( Thank you
update then refresh, you will see it when you search for faceseg..
Is it possible to make caricature image with similar workflow?
Top 👍
trouble changing within the node "face Analysis Models" from insightface library to Dlib library, (I did make a Dlib folder within Comfyui Models )
I am stuck too
Thanks for the video Matteo! But doesn't FaceID load insightface already by default? Why use dlib then?
not all face models require insightface
@@latentvision Thank you, that's what I imagined. It's just my bias and the fact that FaceId is so good that I end up using it in almost all the images I do haha.
face align could be really funny to work with ^^ :D
As far as I understand, Insight Face is for non-commercial use - what are alternatives?
depends what you want to do. for face analysis you can use dlib
@@latentvision Thanks for the reply and thanks for the amazing videos! You are an excellent communicator!
For doing "face transfer", is InsightFace the only option?
Which node in maneger is “Face Warp", or github address? I can't find it.
it's in the face analysis extension. You probably need to upgrade it if you have it already
Very useful
Error occurred when executing FaceAnalysisModels:
Can you tell me what's wrong? Error occurred when executing IPAdapterUnifiedLoaderFaceID:
IPAdapter model not found.
Is there a node or workflow that takes 2 images of the same ai person and generates an image that represents the halfway point between the two? Idea being to make frames for video / gif
you may need a controlnet of the face turning
@latentvision does control net have head position points for faces that are turned beyond 90 degrees (like back of head/hair for turning around)
Hello Latent Vision! What's the best method to get the most similar and realisic face? Using nodes as Controlnet, PulID or training LORA for this face?
depends on the source material and the kind of image you want to generate (eg: can the colors and pose be the same as the original?).
@@latentvision I'm focusing on similarity. When I try to generate images of babies in cute scenes and costumes, I realize that maintaining facial similarity is harder with babies than with adults. My idea is to incorporate scenes and costumes in Lora to create the style I want and then use your PulID workflow to achieve the best facial results. My goal is to get the realistic face details combine with my desired photography style.
I got that working but only with insight face. How do we install Dlib?
If you only got as far as including the models (as I had) it still has more to do.
This is how I got it working with portable windows
Go to the provided link for "Face Analysis for ComfyUI"
Installation Section:
For DLIB download (4 models)
Check which 'python_embedded' python --version in ComfyUI portable (mine was 3116)
Download the Precompiled Dlib (for Windows e.g., 311) (into ComfyUI portable root folder)
run the command python -m pip install 'the exact spelling of the downloaded wheel file'
UPDATE: Well this does get the dlib into the dropdown, but I celebrated too soon:
Error occurred when executing FaceEmbedDistance:
setting an array element with a sequence. The requested array has an inhomogeneous shape after 1 dimensions. The detected shape was (4,) + inhomogeneous part.
Sorry, if someone else can help both of us that would be appreciated!
@@bwheldale I always have problems with the pip well install stuff I'll try to figure it out and then give an update on how to do it.
I can verify the Dlib was installed succesfully, the other issue was something else and has been resolved with the latest update.
Downloaded the workflow but getting this error on the FaceEmbedDistance node, any ideas? I've tried to pictures of the same person that were taken on the same shoot and look very similar.
"Error occurred when executing FaceEmbedDistance:
setting an array element with a sequence. The requested array has an inhomogeneous shape after 1 dimensions. The detected shape was (4,) + inhomogeneous part."
Me too
MIne is working now with the latest update of Face Analysis
@@bwheldale I reinstalled Windows over the weekend (File Explorer has been playing up and been putting it off for ages), working fine for me after setting Comfy back up . Would have installed the updated version you mentioned.
Can FaceID node use dlib too instead insightface so we have free commercial option for FaceID IPAdapter?
unfortunately not at the moment
Hello and thanks, I am on your discord on workflow section but I can't find how to download it...
Great video! Anyone know where I can find the 'Image Random Transform' node?
ComfyUI Essentials, link in the description
Why not use face alignment by default in all ipadapter nodes? This node is awesome but should be a default thing in ipadapter.
we can't foresee all scenarios, up to the user to pick the best workflow for their needs
I tried to install instant id and face id from comfy ui manager but is shows import fail error, could it be because of my low vram, cuz I have only 4gb vram or could there be any other reason?
4GB won't be enough for InstandID but it could work with SD1.5 models and faceID. check the repository for installation instructions
Thx sir q
Great, I have a request, now facial analysis can only process one person's image, I think three people together, analysis of the face may produce three different images,Not in the same picture
how to install Dlib ?
check the repository issue tracker or my discord
😍
just fyi "likeliness" is a probability. "likeness" describes similarity.
can you share the workflow?
My Manager says dlib is installed, but i can't select it :/ The things you can do with it are pretty awesome!
check the repository, you'll find installation instructions
@@latentvision The same for me... I installed the dlib models into dlib directory and installed dlib library too. However, I can´t select dlib (only insightface).
Well, I installed the dlib library using the ConfyUI portable environment and, now, I can choose dlib.
@@rinpsantos please check the discord for help or the official repository
@@rinpsantos Hey man, can you elaborate on that, I was hoping to find a "venv" for virtual environment but I can't..., please help, thanks a lot!
ty where is the workflow?
🖖
What's the name of that beautiful girl
that would be Rebecca Ferguson