Very clear tutorial. Maybe some chekcpoints models stylize so strongly that they wash out the features of the referenced faces... At least that's my brief experience with InstantID.
I appreciate this explanation, I have been trying to do this with various different setups (FaceID, InstantID, Reactor) but don't get the results I'm looking for. Or blow up my notebook when running faceid.. Could be because I'm trying to rig Pony to behave with InstantID for consistent characters. One thing I would like to recommend, post processing of the audio. Your audio has a lot of wet sounds, as if your mouth was either try or trying to keep gum in your mouth. Not sure how I can try to point it out in the kindest way I can, but its one of those sounds that sticks out to me and made it hard to stick with the video.
Great idea for a tutorial but I couldn't get it to work quite right and think I noticed some issues in your workflow once I started previewing the face keypoints and masks. I noticed the masks were just giving me a full black and white mask instead of half and half. I think that is because you had multiply and it should be add for the MaskComposite node. Also I noticed when I previewed the invert image that's used for the face keypoints it was just inverting the colors on the image and not actually flipping it horizontal. I found the Image Flip node and that did the trick. But thanks for the tutorial either way, found some new tricks and learned some stuff! I might also play around with separate positive prompts but seems to work ok combined like this now that i figured out the masks and keypoints properly.
I apologize it didn't work out as well for you; but you are correct, the MaskComposite node should've been 'add'. Thank you for bringing that to our attention, so we can make a correction. We are glad regardless though that you were still able to get good information from our video. 🙂 Also, when you play with the workflow you can always modify it so that not only does each subject get it's own prompt, but also its own pose.
Very clear tutorial.
Maybe some chekcpoints models stylize so strongly that they wash out the features of the referenced faces... At least that's my brief experience with InstantID.
I always preferred face Id over instant Id, for example because of the key points needed.though they help to be able have two characters in one image.
These instantID tutorials are exactly what I needed, big thanks
I appreciate this explanation, I have been trying to do this with various different setups (FaceID, InstantID, Reactor) but don't get the results I'm looking for. Or blow up my notebook when running faceid.. Could be because I'm trying to rig Pony to behave with InstantID for consistent characters.
One thing I would like to recommend, post processing of the audio. Your audio has a lot of wet sounds, as if your mouth was either try or trying to keep gum in your mouth. Not sure how I can try to point it out in the kindest way I can, but its one of those sounds that sticks out to me and made it hard to stick with the video.
Afaik up to this date control net does not work/work well with pony.
None of this makes since to me, but all I know is that you have a great ASMR voice.
Great idea for a tutorial but I couldn't get it to work quite right and think I noticed some issues in your workflow once I started previewing the face keypoints and masks. I noticed the masks were just giving me a full black and white mask instead of half and half. I think that is because you had multiply and it should be add for the MaskComposite node. Also I noticed when I previewed the invert image that's used for the face keypoints it was just inverting the colors on the image and not actually flipping it horizontal. I found the Image Flip node and that did the trick. But thanks for the tutorial either way, found some new tricks and learned some stuff! I might also play around with separate positive prompts but seems to work ok combined like this now that i figured out the masks and keypoints properly.
I apologize it didn't work out as well for you; but you are correct, the MaskComposite node should've been 'add'. Thank you for bringing that to our attention, so we can make a correction.
We are glad regardless though that you were still able to get good information from our video. 🙂
Also, when you play with the workflow you can always modify it so that not only does each subject get it's own prompt, but also its own pose.
Great tutorial, really love your work.
Please share workflow download link
Shouldn't it be Image Flip instead of Image Invert? That's very different.
You are correct, that was a mistake made on our part, for best results using the Image Flip Node is best.