Well, that works fine with big hands but not very good with like 3-4 characters in the picture and little hands, closed hands, specific poses. Somewhat the MeshGrapher gives bad results. But it's definitely this path to use for correcting details without altering too much of the original seed. I'm impressed how that works.
So grateful I 'm starting to understand how things flow in Comfy UI without feeling too lost. It sounded like Chinese to me a couple of months ago. Now it's like German. Still rough but somehow familiar. 😆 Thank you for this!
@@sedetweiler I've tried with 4GB VRAM and, 16GB RAM.. it takes 2:16 hours to generate and upscale 1 image. RTX 4060 8GB VRAM with 16GB RAM ✌️or RTX 3060 12GB VRAM with 16GB RAM✌️or RTX 3060 8GB VRAM with 16GB VRAM✌️.... (I have i7 12th gen) Which one do you prefer between these three? Don't know which one would be the best for faster image generation and upscaling.... Thanks for your earlier response 🙂
@@furiousnotch7914 VRAM takes priority, the more the better. Then think about the speed of the card. The new 4070 Super seems to be a happy middle ground of the latest generation. Smaller budget? 4060 Ti 16 Gb. Bigger budget? Think 4080 Super or 4090. Of the 30 series, I would take the fastest one with at least 16 Gb. But honestly, I would save up a bit more and go straight to 40 series.
Hi That is very cool,and works well for me. Once again your explanations are clear and very simple to follow. As an old guy who learns best by reading these are great.
One more thing that you can do is send the final image to fooocus image prompt > inpaint>improve face, hands (2nd option), paint both hands, and use the quick prompt called detailed hand. Edit: This is AFTER you have refined the hands using the above tutorial.
@@sedetweiler this sounds interesting, if you tested this and you think it's effective, we would love to see a part 2 of this video doing these extra steps for a perfect result
Thank you for making a tutorial by building nodes manually, it really helps clarify each function of the nodes, unlike other channels which present workflows with ready-made nodes
Hi Scott! First of all I want to congrats you for yours amazing tutorials. Thank you!! Could you please create another version of this workflow where instead use prompt to create an image we will upload an image?
This is super useful and your patient explaining is much better than many of the rushed jobs on youtube. However I found the meshgraphormer rather disappointing, especially where you've several people. Segment anything Ultrav2 seems to work quite well though (with a prompt of hands)
Please try different hand poses you will know it never fix hand. When the ControlNet depth preprocessor gives you bad depth hand, you will still get bad hand. Even it gives you good preprocessed depth hand, for different hand poses it will still generate flip, or reverse bad hand. I am so sorry to tell the true.
@@sedetweiler Lol that's wishful thinking. It only works well when the hands are prominent in the image and in a common pose, not interacting with anything. It ends up messing up perfectly good hands more than fixing bad ones.
@@matthewfuller9760 Models are getting better and soon bad hands will be extremely rare. That said, yes you can redraw images or pose models with depth information. I redraw and edit, then inpaint the area with a low denoise.
It cannot be completely eradicated. Only post processing with pts AI can help, and sometimes when the hand is quite stable , it may provide an additional glove or piece of steel on the hand,
This is great. Thank you for making it so clear and simple. Would you happen to have any videos on maintaining consistency of characters across multiple renders? Many situations require more than just one shot of a character but I find consistency almost impossible to achieve just by text alone.
For some reason the hands from the picture I am trying this on don't get detected. I guess this method only works for hands that are already clear enough they are hands.
I would like to try it, but I can't see the workflow attached here or in the community tab. Although I'm not sure if it will work due to hardware limitations (rx580) and software differences (sd 1.5, torch, nodes).
I made it to 4:30 and then nothing shows up in Controlnet Models, "undefined". I went to manager > install custom nodes > Fannovel16 which says "NOTE: Please refrain from using the controlnet preprocessor alongside this installation, as it may lead to conflicts and prevent proper recognition." Not sure how to proceed. Is my ComfyUI installation bad?
I use to enjoy your mid journey tutorials and workflow. Can I ask why you stopped? Now that the models are even more powerful, i wish we can turn to expert like you.
Thanks for this. I see this video is now 5 months old. When attempting to install the Controlnet preprocessors in the latest version of ComfyUI, there is the following warning in red: NOTE: Please refrain from using the controlnet preprocessor alongside this installation, as it may lead to conflicts and prevent proper recognition. What do you advise?
Great vid, thanks Scott. Guys, if your using A1111.. It takes just two clicks to enable Hand Refiner in Controlnet and fix hands lol But the noodles are much more fun, if you have time to kill.
The difference for me is I know how it works. with much of A1111 you check a box and the magic happens. With Comfy you actually control and learn how it all goes together. It is the difference from just eating in a restaurant and knowing how to cook as well.
The Hand Refiner in ControlNet isn't as powerful as the fine control you have in ComfyUI. One-button solutions always have issues. I've used both and always get better results with ComfyUI.
I got to the point where the Meshgraphormer is added to the Ui , however all it generates is a black box. I installed the comfyui manager and such. Are there some videos I should go back and watch before trying the methods in this video?
Great video, thanks for making it! Have you tried it with a person holding something? I’m wondering how well it works if part of the hand is meant to be not visible 🤔
Can you next time go more on SD3 Creative upscaler? IK don't find much info on it. So you don't use it with a 2k image? it sats 1000 or less? I'm trying to figure out if it is worth it at 25 cents per upscale. Thanks!
I am getting an error "Error occurred when executing KSampler: mat1 and mat2 shapes cannot be multiplied (308x2048 and 768x320)" Does anyone know what this is? am running the inpaint depth hand control model that is recommended on the github Seems to be an error with the Ksample
Do you have any solution if im getting "new(): expected key in DispatchKeySet(CPU, CUDA, HIP, XLA, MPS, IPU, XPU, HPU, Lazy, Meta) but got: PrivateUse1" error while using MeshGraphormer? PS. Greate video, i just would make it run on my amd pc xD
It doesn't work with every model either. Graphormer has its problems with hands that originate from 2D, 2.5D models. Apparently the depth information that Graphormer needs to recognise that they are fingers is missing.
Just tried that with flux model and a flux control net … sadly not getting any good result on the second image. Its just some random glitch stuff put on top of the old image.
Amazing video! Learnt so much from this Scott! A new random question arises, what's the name of the plugin that gives you info on which node is executed at runtime on the top left? :)
Is there a way to split the image to background and person, fix the hands and then recombine? Maybe also model a the pose (body and hands), so any animation of that can be done very precise and consistent?
I can't figure out how to make this work. Even if the MeshGraphormer produces good results and the hands look nice in the depth map, the hands in the final image often look worse than in the image before MeshGraphormer. It seems that the second KSampler does mess up the hands again. Is there anything to avoid this?
Even I used Juggernaut model, but if I change the style to comic, this workflow doesn't work, the Meshgraphormer could not identify hand in comic style. Any suggestion if I do need to fix hands in comics?
They are in the community tab here on TH-cam. That is the only method they give us for communication, unfortunately. Thank you for supporting the channel!
Scott great stuff! I ran into some snags applying this to a workflow with 2 other controlnets ( Depth + Openpose) Im not using Advanced contronet for the other 2 and 1 Ksampler. Do I need 2 Ksamplers like your video?
The first one creates the flawed image, and the graphformer can then spot the hands and the second sampler fixes them. So, I am using 2 samplers for that reason. Because this works so well with just depth, I am not throwing all the controlnets at it, as it just works as is quite often.
I got my workflow to work with one KSampler using 1.5 model ( Im using Controlnet for the body (DWopenpose + Depth) and now MeshGraphomer) and got to that point where i generated great hands but the image totally changed , so I added the Set Latent noise mask with samples going into a empty latent image (replacing the one from the KSampler) and the image is totally gone. So frustrating as i was almost there.. Any guidance would be appreciated
Hello! Is there a way to integrate two json files with different functions in comfyui? One is to do the inpaint function, and the other is to maintain a consistent character through faceid, but I'm having trouble linking the two.
Hi Scott, now it works. I think my input image was not the right choice for that. I changed it now to the girl in your video with six fingers as input, and now its fixed and i get five fingers. Thanks! @@sedetweiler
Hands are finally fixed but what about the rest of the body in SD3. You did say you were head of quality assurance at Stable diffusion, are you all hiding under a table there?
amazing! i couldn't get it to work though, it won't detect the hands (the "display mask" box is just a black square every time, and i can't work out why). still.. something to work on :)
when i run the preview of the MeshGraphormer it give me this error: MeshGraphormer-DepthMapPreprocessor shape '[1, 9]' is invalid for input of size 0 couldn't find a solution for it online can anyone help ? i followed each step exactly same resolutions and everything AMD gpu thu
Thank you so much for another amazing tutorial! I’m trying to figure out what the best way is to combine this with the refiner. Would I go through both the base and the refiner for the full image first, and then do base and refiner again for only the hands? I tried something like that, but the results are not that great as the hands don’t really match the visual quality of the rest of the picture.
@@sedetweiler Refine everything together you mean? How would you do that if you want to do 80% of the processing in the base and 20% in the refiner? Fix the hands even with some noise of the base left?
yup. that is what I would do. Since the position of the fingers is probably already determined by that time, additional refinement isn't going to undo that.
i clicked update all in the manager, now my comfy doesn't work anymore. i get this error: raise AssertionError("Torch not compiled with CUDA enabled") AssertionError: Torch not compiled with CUDA enabled any ideas how to solve this? everything worked fine before the update
just noticed the sampler he used , isnt that one meant for like art/digitalart/3D models AND Euler_Ancestral is best for realistic images or am i missing something here?
This only seems to detect 1 set of hands even when there's multiple people and it doesn't detect parts of fingers or hands that are occluded. And there is very often noticeable artifacts around the bounding boxes themselves even if the hands are done well. Any ideas how to refine this?
If you go to the git for any node suite by clicking on the name in the manager, it will tell you what additional files or models are needed and where to get them.
same, "load controlnet model" box list empty. Did get mesh things when installing fannovel16 pack but that list is empty.. continuing to loo for answer.
Hi thank you for this idea, but i had problem. i generated 3 persons but the refiner only got 1 person hand left and right, the second and third person's hands are not detected. So i only fixed one person hand. What is the problem here?
@@sedetweiler i tested it again with a simple prompt of a waving woman, using empty latent Image and a resolution of 832x1216 (using a custom sdxl merge) and it works fine. The First Time I tried I did img2img of a stylized toon character which output hands already look quite alright. However the meshgraphormer refuses to recognize the hands of said character.
@@sedetweiler yeah, thats what I expected and it seems to be the case. It doesnt properly recognize cartoony proportions, even though in my opinion cartoony hands come out better in general, due to the fact that they are bigger and give stable diffusion more space to generate them a bit better.
Yeah, those original image hands were already pretty great -- I'd just fix it in photoshop. I guess this method is fine for people with ZERO artistic ability.
So cool that this works! Love the ingenuity that it must have taken to figure this all out.
It was a bit of a pain to watch if you check out the live stream from last Saturday. That seed was the major issue.
super specific use case, when the subjects hands are literally like the image your using, if not the depth maps it comes up with a straight trash.
Thanks for all your videos.
I was a little lost with all those nodes versions but, now, I'm starting to understand better how to use Comfyui
Well, that works fine with big hands but not very good with like 3-4 characters in the picture and little hands, closed hands, specific poses. Somewhat the MeshGrapher gives bad results. But it's definitely this path to use for correcting details without altering too much of the original seed. I'm impressed how that works.
So grateful I 'm starting to understand how things flow in Comfy UI without feeling too lost. It sounded like Chinese to me a couple of months ago. Now it's like German. Still rough but somehow familiar. 😆 Thank you for this!
Glad it was helpful!
@@sedetweiler I just wanted to know, what's the minimum system requirements for running comfyUi smoothly, without any problem?
Appreciate you 🙂
Probably 4gb of vram.
@@sedetweiler I've tried with 4GB VRAM and, 16GB RAM.. it takes 2:16 hours to generate and upscale 1 image.
RTX 4060 8GB VRAM with 16GB RAM ✌️or RTX 3060 12GB VRAM with 16GB RAM✌️or RTX 3060 8GB VRAM with 16GB VRAM✌️.... (I have i7 12th gen) Which one do you prefer between these three?
Don't know which one would be the best for faster image generation and upscaling....
Thanks for your earlier response 🙂
@@furiousnotch7914 VRAM takes priority, the more the better. Then think about the speed of the card. The new 4070 Super seems to be a happy middle ground of the latest generation. Smaller budget? 4060 Ti 16 Gb. Bigger budget? Think 4080 Super or 4090. Of the 30 series, I would take the fastest one with at least 16 Gb. But honestly, I would save up a bit more and go straight to 40 series.
Thank you immensely! Now I just need the hand detailer and face detailer to combine into a final image.
The best video I have seen so far. Very clear and it gets to the point. Nothing to add. Thanks
Hi That is very cool,and works well for me. Once again your explanations are clear and very simple to follow. As an old guy who learns best by reading these are great.
Great to hear!
One more thing that you can do is send the final image to fooocus image prompt > inpaint>improve face, hands (2nd option), paint both hands, and use the quick prompt called detailed hand.
Edit: This is AFTER you have refined the hands using the above tutorial.
Thanks for sharing!
@@sedetweiler this sounds interesting, if you tested this and you think it's effective, we would love to see a part 2 of this video doing these extra steps for a perfect result
Thank you for making a tutorial by building nodes manually, it really helps clarify each function of the nodes, unlike other channels which present workflows with ready-made nodes
Love this! Have learnt a lot from this entire playlist, thanks!
Awesome man, trying this now, your tutorials are great and easy to follow. A godsend!
Glad I could help!
Hi Scott! First of all I want to congrats you for yours amazing tutorials. Thank you!! Could you please create another version of this workflow where instead use prompt to create an image we will upload an image?
This is super useful and your patient explaining is much better than many of the rushed jobs on youtube. However I found the meshgraphormer rather disappointing, especially where you've several people. Segment anything Ultrav2 seems to work quite well though (with a prompt of hands)
Thanks for your video. You can use the global seed if you set the seed in an extra primitive node and fix it
Cool, thanks
The way of explaning is awesome. You earn a sub.
Please try different hand poses you will know it never fix hand. When the ControlNet depth preprocessor gives you bad depth hand, you will still get bad hand. Even it gives you good preprocessed depth hand, for different hand poses it will still generate flip, or reverse bad hand. I am so sorry to tell the true.
It isn't perfect, but again this works in 90% of the situations where we get bad hands.
I would say that it improves 50% in the photo-like images. But maybe 10-20% in painting or some low CFG styles.
@@sedetweiler Lol that's wishful thinking. It only works well when the hands are prominent in the image and in a common pose, not interacting with anything. It ends up messing up perfectly good hands more than fixing bad ones.
@@matthewfuller9760 Models are getting better and soon bad hands will be extremely rare. That said, yes you can redraw images or pose models with depth information. I redraw and edit, then inpaint the area with a low denoise.
@@matthewfuller9760 You can also model the object. As for drawing, you just need to know how to draw.
It cannot be completely eradicated. Only post processing with pts AI can help, and sometimes when the hand is quite stable , it may provide an additional glove or piece of steel on the hand,
This is great. Thank you for making it so clear and simple. Would you happen to have any videos on maintaining consistency of characters across multiple renders? Many situations require more than just one shot of a character but I find consistency almost impossible to achieve just by text alone.
For some reason the hands from the picture I am trying this on don't get detected. I guess this method only works for hands that are already clear enough they are hands.
Very nice tutorial. Looks like compositing^^ so as a comp-artist, i love this workflow :)
I would like to try it, but I can't see the workflow attached here or in the community tab. Although I'm not sure if it will work due to hardware limitations (rx580) and software differences (sd 1.5, torch, nodes).
I made it to 4:30 and then nothing shows up in Controlnet Models, "undefined". I went to manager > install custom nodes > Fannovel16 which says "NOTE: Please refrain from using the controlnet preprocessor alongside this installation, as it may lead to conflicts and prevent proper recognition." Not sure how to proceed. Is my ComfyUI installation bad?
Same here, not sure what im doing wrong
I use to enjoy your mid journey tutorials and workflow. Can I ask why you stopped? Now that the models are even more powerful, i wish we can turn to expert like you.
I guess I just need to make some. I have a few ideas on them they I have not seen covered. Thank you for the suggestion!
Thanks for this. I see this video is now 5 months old. When attempting to install the Controlnet preprocessors in the latest version of ComfyUI, there is the following warning in red:
NOTE: Please refrain from using the controlnet preprocessor alongside this installation, as it may lead to conflicts and prevent proper recognition.
What do you advise?
I have now tried this method and it still messes up the hands big time.
Thank you for all the useful information!☺
Hey Scott, really suprised you're not ahead of the curve with somethging about a SD3 howto.
very clear and well explained, many thanks for sharing!
Great vid, thanks Scott. Guys, if your using A1111.. It takes just two clicks to enable Hand Refiner in Controlnet and fix hands lol But the noodles are much more fun, if you have time to kill.
The difference for me is I know how it works. with much of A1111 you check a box and the magic happens. With Comfy you actually control and learn how it all goes together. It is the difference from just eating in a restaurant and knowing how to cook as well.
The Hand Refiner in ControlNet isn't as powerful as the fine control you have in ComfyUI. One-button solutions always have issues. I've used both and always get better results with ComfyUI.
I got to the point where the Meshgraphormer is added to the Ui , however all it generates is a black box. I installed the comfyui manager and such. Are there some videos I should go back and watch before trying the methods in this video?
did you have a hand refiner without going through KSAMPLER again?, the first image created was always different to the 2nd
thank you! i'm getting great results using this...
Great video, thanks for making it! Have you tried it with a person holding something? I’m wondering how well it works if part of the hand is meant to be not visible 🤔
Not sure, but it is worth trying!
AWESOME video. Quick question. where do you get the depth files for the load control module. Newbie here
Can you next time go more on SD3 Creative upscaler? IK don't find much info on it. So you don't use it with a 2k image? it sats 1000 or less? I'm trying to figure out if it is worth it at 25 cents per upscale. Thanks!
This may be a dumb question but does this process also work for cartoon/anime models?
I am getting an error
"Error occurred when executing KSampler:
mat1 and mat2 shapes cannot be multiplied (308x2048 and 768x320)"
Does anyone know what this is? am running the inpaint depth hand control model that is recommended on the github
Seems to be an error with the Ksample
Do you have any solution if im getting "new(): expected key in DispatchKeySet(CPU, CUDA, HIP, XLA, MPS, IPU, XPU, HPU, Lazy, Meta) but got: PrivateUse1" error while using MeshGraphormer?
PS. Greate video, i just would make it run on my amd pc xD
Finally! FLUX is the future!
Thanks for this video. Have you tried to see if this works with SDXL workflows?
The control net model doesn't work with an amd setup, save the time homies.
Nice follow up, thanks Scott
Any time!
Grate video how can I grab the controlnet from the manager.
Have you seen, that it messes up the background when you choose the large boxes „original“ ?
same here, have you got any solution ?
HI Scott. IS it possible to use ComfyUI to do inpainting on the pre-existing image?
Thank you, that works perfectly!
Glad it helped!
It doesn't work with every model either. Graphormer has its problems with hands that originate from 2D, 2.5D models. Apparently the depth information that Graphormer needs to recognise that they are fingers is missing.
So far I have had great luck with it, even using non-AI images as starting points. I think it is a pretty flexible tool.
Wonderful! Thanks for sharing! 👍
Thank you! Cheers!
Great stuff! Do you know if there’s a community node for Invoke for this? I’m not sure how interchangeable or inter-compatible the nodes are.
I don't know. I love the Invoke project for a lot of reasons, but I just have not used it lately as I live in comfy most of the day.
Just tried that with flux model and a flux control net … sadly not getting any good result on the second image. Its just some random glitch stuff put on top of the old image.
Amazing video! Learnt so much from this Scott! A new random question arises, what's the name of the plugin that gives you info on which node is executed at runtime on the top left? :)
That is from the PythonGoSsssss pack.
Is there a way to split the image to background and person, fix the hands and then recombine?
Maybe also model a the pose (body and hands), so any animation of that can be done very precise and consistent?
now that's pretty cool!
I am loving it!
I can't figure out how to make this work. Even if the MeshGraphormer produces good results and the hands look nice in the depth map, the hands in the final image often look worse than in the image before MeshGraphormer. It seems that the second KSampler does mess up the hands again. Is there anything to avoid this?
you can always use a different model for the 2nd sampler. Be sure you use a different seed! That was one I tripped over.
@@sedetweiler wish this helped. I'm using the same model you are in the video and it just makes it worse.
Hi!! in my version of confy ui i don't have the Manager button why is that? .so i can incorporate nodes.
How do I get to see your live streams?
Thank you! Can you share how to do this with moving hands in a video?
use the "image batch to image list" node as input for this hand fixer
Even I used Juggernaut model, but if I change the style to comic, this workflow doesn't work, the Meshgraphormer could not identify hand in comic style. Any suggestion if I do need to fix hands in comics?
I am not sure, as I don't really do a lot of comics. I think the Swiss7 model or something similar was helpful there.
@@sedetweiler Thanks, will give it a try.
hi. Great content. Thank you . where is the workflow json for the video? thank you
They are in the community tab here on TH-cam. That is the only method they give us for communication, unfortunately. Thank you for supporting the channel!
Thank you very much for this!
You're very welcome!
Thanks for the tutorial!
You are welcome! Thanks for taking the time to leave a comment. Cheers!
Scott great stuff! I ran into some snags applying this to a workflow with 2 other controlnets ( Depth + Openpose) Im not using Advanced contronet for the other 2 and 1 Ksampler. Do I need 2 Ksamplers like your video?
The first one creates the flawed image, and the graphformer can then spot the hands and the second sampler fixes them. So, I am using 2 samplers for that reason. Because this works so well with just depth, I am not throwing all the controlnets at it, as it just works as is quite often.
I got my workflow to work with one KSampler using 1.5 model ( Im using Controlnet for the body (DWopenpose + Depth) and now MeshGraphomer) and got to that point where i generated great hands but the image totally changed , so I added the Set Latent noise mask with samples going into a empty latent image (replacing the one from the KSampler) and the image is totally gone. So frustrating as i was almost there.. Any guidance would be appreciated
Got it working! thanks@@sedetweiler
awesome! it sounded like you were SO close! that is great news!
@@scottownbey9340did you end up adding another ksampler or staying with one?
😯so simple. I love ComfyUI
It really is, for such a terrible issue. Cheers!
How do you make it so you don't see the 2 squares in your end image where it repainted the hands? can even see them in your youtube video.
Hello! Is there a way to integrate two json files with different functions in comfyui? One is to do the inpaint function, and the other is to maintain a consistent character through faceid, but I'm having trouble linking the two.
Hi Scott, thanks for the update. I'm also trying this with img2img but I can't get it to work propperly. Maybe an idea for another video?
Sure! that should be as simple as replacing the empty latent with a VAE Encoded image and use the samples off of that.
Hi Scott, now it works. I think my input image was not the right choice for that. I changed it now to the girl in your video with six fingers as input, and now its fixed and i get five fingers. Thanks! @@sedetweiler
Hands are finally fixed but what about the rest of the body in SD3. You did say you were head of quality assurance at Stable diffusion, are you all hiding under a table there?
amazing! i couldn't get it to work though, it won't detect the hands (the "display mask" box is just a black square every time, and i can't work out why). still.. something to work on :)
I have installed the ControlNet but that node not appears to me
I can use it normally under the SD1.5 model, but I always get an error when I use the SDXL model.
Good job!
Thank you! Cheers!
when i run the preview of the MeshGraphormer it give me this error:
MeshGraphormer-DepthMapPreprocessor
shape '[1, 9]' is invalid for input of size 0
couldn't find a solution for it online can anyone help ? i followed each step exactly same resolutions and everything AMD gpu thu
does that work for all kind of hand positions? e.g. hands grabbing a handle, hands tipping on a keyboard or piano, hands clapping ....
does it also work on hands which dont wave directly at the camera or for cartoon models ? i dont think so
can this handle an image of a couple holding hands? Thanks. its impossible in Krita and Firefly I tried it already..
Thank you so much for another amazing tutorial!
I’m trying to figure out what the best way is to combine this with the refiner. Would I go through both the base and the refiner for the full image first, and then do base and refiner again for only the hands?
I tried something like that, but the results are not that great as the hands don’t really match the visual quality of the rest of the picture.
I would refine at the very end.
@@sedetweiler Refine everything together you mean? How would you do that if you want to do 80% of the processing in the base and 20% in the refiner? Fix the hands even with some noise of the base left?
yup. that is what I would do. Since the position of the fingers is probably already determined by that time, additional refinement isn't going to undo that.
Thank you, I really appreciate your input!
i clicked update all in the manager, now my comfy doesn't work anymore. i get this error:
raise AssertionError("Torch not compiled with CUDA enabled")
AssertionError: Torch not compiled with CUDA enabled
any ideas how to solve this? everything worked fine before the update
just noticed the sampler he used , isnt that one meant for like art/digitalart/3D models AND Euler_Ancestral is best for realistic images or am i missing something here?
Can you share a downloadable workflow for this
This only seems to detect 1 set of hands even when there's multiple people and it doesn't detect parts of fingers or hands that are occluded. And there is very often noticeable artifacts around the bounding boxes themselves even if the hands are done well. Any ideas how to refine this?
Hej Scott :) i cant find this graph in the community area. Did you delete it?
HUGE THANKS !!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!
sure! happy Friday!
my controlnet model list is empity snd I can't find where to download them
If you go to the git for any node suite by clicking on the name in the manager, it will tell you what additional files or models are needed and where to get them.
@@sedetweiler @ 4:20 when you are selecting your model in the controlnet list, you are full of models, my list is empity!
@@sedetweiler and, another question: Is it working on text video?
same, "load controlnet model" box list empty. Did get mesh things when installing fannovel16 pack but that list is empty.. continuing to loo for answer.
How do you get this level of control though with colab notebooks and python code?
Bold choice, spending 5 minutes setting up nodes you explicitly tell us not to do, only to have those nodes be required steps in the tutorial.
Is this possible to be done with other WebUi, like Forge WebUI?
Hi thank you for this idea, but i had problem. i generated 3 persons but the refiner only got 1 person hand left and right, the second and third person's hands are not detected. So i only fixed one person hand. What is the problem here?
have you got any solution ?
Is there anything similar in the works for FEET?!
Hi Scott, any new videos? Theres some new stuff we need to learn
Thanks for this video
Most welcome
ty for sharing !
My pleasure!
Funny how I have the proper controlnet installed but I don´t have this specific one for hands.... What am I doing wrong? thx.
check that you are up-to-date and restarted.
My hands aren't being detected it's iust a black preview. My image is a person with hands on hips
I have two GPU's how do make sure comfyui is using the most powerful of the two nvidea cards.
The meshgraphormer puts put only a black Image. I have everything installed and updated. Any help?
Hmm, is it not seeing the hands at all? If they are really messed up, it will not see them. I would just check the mask to see if it found them.
@@sedetweiler i tested it again with a simple prompt of a waving woman, using empty latent Image and a resolution of 832x1216 (using a custom sdxl merge) and it works fine. The First Time I tried I did img2img of a stylized toon character which output hands already look quite alright. However the meshgraphormer refuses to recognize the hands of said character.
It might not be good with cartoons. Not sure, I don't tend to go for that type of artwork personally.
@@sedetweiler yeah, thats what I expected and it seems to be the case. It doesnt properly recognize cartoony proportions, even though in my opinion cartoony hands come out better in general, due to the fact that they are bigger and give stable diffusion more space to generate them a bit better.
@@beatemero6718 maybe you could try DWPose?
all models! nice
cheers!
Not trying to sound facetious here but surely it would be far less of a ballache just to photoshop extra fingers out, far quicker 🤷♂️
Yeah, those original image hands were already pretty great -- I'd just fix it in photoshop. I guess this method is fine for people with ZERO artistic ability.
Hi Scott, where is the wf please?
wf? sorry, not sure I follow.
@@sedetweiler that’s ok, I tedter your workflow for graphormer
but how to set the number of the fingers for humanoids or the creatures? anyone knows? your tutorial working great but only with the humans
Thanks man
Any time
yup!