EASY Inpainting in ComfyUI with SAM (segment Anything) | Creative Workflow Tutorial

แชร์
ฝัง
  • เผยแพร่เมื่อ 28 ก.ย. 2024

ความคิดเห็น • 77

  • @cXrisp
    @cXrisp ปีที่แล้ว +10

    This looks great! I will come back when I am ready to fully embrace ComfyUI. Invoke has nodes now so I'm uncommitted.. And thank you for NOT adding music to your videos while the instruction is happening.

  • @wuhtan2731
    @wuhtan2731 10 หลายเดือนก่อน +8

    When you are so addicted to comfyui and forget you watching a TH-cam video then try to click and drag the page down to comment section... 🤦‍♂

  • @HannibalCaine
    @HannibalCaine 5 หลายเดือนก่อน +1

    Great walkthrough. But instead of just 1 result, how would you inpaint with a batch result of multiple images?

  • @yiluwididreaming6732
    @yiluwididreaming6732 7 หลายเดือนก่อน +3

    3050

  • @SumNumber
    @SumNumber 5 หลายเดือนก่อน +1

    Very clear. Thank you for sharing. :O)

  • @britebay
    @britebay 4 หลายเดือนก่อน

    Great tutorial! Thank you!

  • @murtazaeng
    @murtazaeng หลายเดือนก่อน

    Hi,Thank you, it is a nice tutorial, I would like to use inpainting to show a model/character showcasing product in hand or any other way, I will look forward to try this , also doing this in a video would be excellent

  • @arothmanmusic
    @arothmanmusic 4 หลายเดือนก่อน +1

    My workflow appears to be the same as yours, but when I run the prompt the masked area doesn't change at all. What might I be missing?

  • @cheezeebred
    @cheezeebred 6 หลายเดือนก่อน

    Damn how did you get your node lines to look so angular and clean?

    • @DreamingAIChannel
      @DreamingAIChannel  6 หลายเดือนก่อน +1

      Hi! Here i've explained how to put the straight lines: th-cam.com/video/AjwfswzLmxU/w-d-xo.html

    • @cheezeebred
      @cheezeebred 6 หลายเดือนก่อน

      @@DreamingAIChannel thanks love

  • @HiramLNoise
    @HiramLNoise 3 หลายเดือนก่อน +1

    That's like Photoshop with extra steps.

  • @u-N16z0rz
    @u-N16z0rz 9 หลายเดือนก่อน +2

    The whole point of comfy is to be able to reproduce workflows by simply importing a json or photo w/ metadata. So tired of seeing tutorials and guides that don't have the file attached.

    • @DreamingAIChannel
      @DreamingAIChannel  9 หลายเดือนก่อน

      "You know nothing, Jon Snow."

    • @u-N16z0rz
      @u-N16z0rz 9 หลายเดือนก่อน +4

      @@DreamingAIChannel Dude just attach the fricking file, it takes two seconds, and it saves us 10 minutes.

  • @윰-c5s
    @윰-c5s 4 วันที่ผ่านมา

    안녕하세요 영상 잘 보고 있습니다!
    설치를 하면 ERROR: To modify pip, please run the following command:
    C:\Users\PC\AppData\Local\Programs\Python\Python310\python.exe -m pip install -r requirements.txt 이런 문구가 뜨는데 어떻게 해야 할까요?ㅜㅜ

  • @christiannilsen2835
    @christiannilsen2835 2 หลายเดือนก่อน

    10 months later, what is the best solution for inpaint for ComfyUI? Thanks!

  • @Bikini_Beats
    @Bikini_Beats 11 หลายเดือนก่อน +4

    Nice and simple, Thanks. Subscribed. Could you explain how to save this workflow so i can pull it out everytime is needed, please? And any other simple additional workflows such as Controlnet, Image to image etc? Thanks and keep them coming

    • @DreamingAIChannel
      @DreamingAIChannel  11 หลายเดือนก่อน +3

      Thanks! Do you mean the templates? Just press CTRL and select all the nodes you need with the mouse, then right click in an empty space of the board and select "Save selected as Template" and then you can recall those nodes every time you need right clicking and going in "Node Templates" -> "name of your templates"

    • @Bikini_Beats
      @Bikini_Beats 11 หลายเดือนก่อน

      @@DreamingAIChannel thank you. I'll give it a go.

    • @helloofthebeach
      @helloofthebeach 10 หลายเดือนก่อน +2

      Any image you create using the workflow will have the complete workflow's layout in its metadata, so you can just drag and drop the image from a folder into ComfyUI and everything will become exactly as it was when you hit Queue Prompt.
      You can create an image with this specifically in mind using the most basic settings (so that you won't have to overwrite a bunch of stuff every time you want to use it) and keep it in a folder somewhere to pull out at a moment's notice!

    • @nachoChapaaa
      @nachoChapaaa 7 หลายเดือนก่อน

      @@helloofthebeach super useful thanks

  • @Shafly_
    @Shafly_ 9 หลายเดือนก่อน +3

    Great tutorial, simple and easy to understand, thank you so much!

  • @iresolvers
    @iresolvers 11 หลายเดือนก่อน +1

    never mind I found it didn't know it was built in to comfyui, to change this just goto settings at the bottom under link render mode select straight

  • @eckhardEhm
    @eckhardEhm 9 หลายเดือนก่อน +1

    good clip, thanks, it is funny the load image node is not to be found under loaders if you dont have that node search plugin installed...
    i played around with successfully with clipsegs txt2mask, your approach looks much more interesting.

  • @lilillllii246
    @lilillllii246 7 หลายเดือนก่อน +1

    Thank you. Is it possible to apply a consistent character created with ipadater and controlnet instead of textprompt in inpaint?

  • @Satscape
    @Satscape ปีที่แล้ว +2

    Great stuff, I saw an alternate way where you can use a word instead of dots, so "T-shirt" to get the SAM to select the T-shirt and change it's colour.
    Has anyone asked yet...What are you using to make the AI generated voice-over....it's very good, but not perfect 😉
    (don't be saying....damn! that my real voice dude!)😁

    • @DreamingAIChannel
      @DreamingAIChannel  ปีที่แล้ว +4

      Thanks! But THAT'S MY RE.... nope is not 🤣 i'm using more than one tool (bark + VITS + custom script/batch) and ALOT of patience! I' will make a video someday like if i will ever reach my 1000 subs or so! Yes i'm aware about using words to detect part of what i want to inpaint but i don't believe that is an efficient way to work!

    • @jdsguam
      @jdsguam ปีที่แล้ว +2

      You referring to the CLIPSeg Node. It does work well, but this method may provide better control.

  • @LucidFirAI
    @LucidFirAI 4 หลายเดือนก่อน

    I tried this, and some other tutorials, for fixing hands. The hands remain garbled. Please help?

    • @Bikini_Beats
      @Bikini_Beats 4 หลายเดือนก่อน +1

      Hands are a different story. Maybe the model you are using is not good with hands. Try a different model or a Lora to help with the hands.

  • @simondiaz184
    @simondiaz184 8 หลายเดือนก่อน +1

    Outpainting please

  • @pruebalandia5189
    @pruebalandia5189 ปีที่แล้ว +2

    Is there a way to do inpaint with Comfyui using Automatic1111's technique in which it allows you to apply a resolution only to the mask and not to the whole image to improve the quality of the result?

    • @DreamingAIChannel
      @DreamingAIChannel  ปีที่แล้ว +4

      I'm actually looking for something like that myself, the problem is that I haven't yet found something capable of reproducing the same results as A1111. As soon as I find it, I'll let you know!

    • @polaroidsky
      @polaroidsky 5 หลายเดือนก่อน

      @@DreamingAIChannel Any luck so far? Very curious about this.

  • @ricardocosta9336
    @ricardocosta9336 ปีที่แล้ว +1

    Please for all that is holy, the new and old gods. please make a tutorial in how to create custom addons/nodes. I searching and did not yet found good docs.

    • @DreamingAIChannel
      @DreamingAIChannel  ปีที่แล้ว

      🤣 yes, I know that there is no doc whatsoever and that's one of the reasons why I haven't made a tutorial yet, I like to explain things when I'm pretty sure of what I'm doing. In custom node programming, on the other hand, I pretty much always reverse engineer the already made nodes, once i will have more knowledge i will try to make some tutorial for it!

  • @theteknologist9574
    @theteknologist9574 3 หลายเดือนก่อน +1

    Awesome video. No filler, just the goods.

  • @achimstromberger
    @achimstromberger 10 หลายเดือนก่อน +1

    also, music is great!

  • @rsunghun
    @rsunghun ปีที่แล้ว +3

    This is going to be so useful. Thank 😊 you!

  • @miracle__worker
    @miracle__worker ปีที่แล้ว +1

    К сожалению, это несколько не то, чего бы мне хотелось. Как сделать так, чтобы именно дорисовать. Например, у меня есть арт, где нарисован ковер. И я хочу, чтобы с помощью inpaint можно было выделить область, прописать туда "человека сидящий на ковре" и нейросеть нарисовала его в том же стиле, что и основной арт. Пока у меня не получается достичь результатов, которые выходили, когда я пользовался Автоматиком.

    • @DreamingAIChannel
      @DreamingAIChannel  ปีที่แล้ว

      Hi! You are talking about normal inpainting so you simply have to exclude the SAM part and in the loaded image do Open in MaskEditor and draw the mask there manually. However, I can't guarantee that the results will be the same as A1111 because things are handled a little differently. There is a thread on reddit about this (www.reddit.com/r/comfyui/comments/15rvnlh/masked_content_and_inpaint_area_from/).

    • @miracle__worker
      @miracle__worker ปีที่แล้ว

      @@DreamingAIChannel лично у меня абсолютно ничего не получается в inpaint в comfi, в отличии от Автоматика.

  • @hakandurgut
    @hakandurgut ปีที่แล้ว +2

    Great video, thanks

  • @LGBRadio-hf5ii
    @LGBRadio-hf5ii หลายเดือนก่อน

    I love this guy. Thank you for starting from blank.

  • @musicandhappinessbyjo795
    @musicandhappinessbyjo795 ปีที่แล้ว +1

    You know in A1111, the inpaint is such that only a portion of image is inpainted while nothing is done to rest of the image but in comfy The whole image is rendered even though only a small part is changed.
    Is it possible to do A1111 like inpaint in comfy?

    • @DreamingAIChannel
      @DreamingAIChannel  ปีที่แล้ว

      Uhm i didn't tried yet but i think Is totally possibile that someone made an extension for A1111 that use SAM

    • @musicandhappinessbyjo795
      @musicandhappinessbyjo795 ปีที่แล้ว

      @@DreamingAIChannel I am sorry but that's not what I meant. In A1111, you can set inpaint to masked only at render only that region where as in comfy it renders the whole image, even though we inpaint a small area.

    • @DoozyyTV
      @DoozyyTV ปีที่แล้ว

      @@musicandhappinessbyjo795 I also thought it was weird that a tiny masked area took just as long to render as a full image even though the rest of the image stays the same, hope there's a way to fix that

    • @DreamingAIChannel
      @DreamingAIChannel  ปีที่แล้ว

      sorry I read your message too quickly! The way comfyui does inpainting is quite different from the way A1111 does it, but I know you can use the VAEEncodeForInpainting node which more clearly limits the inpainting to the area you want to redo, but I haven't tried it yet. Otherwise I think you can refer to this thread on reddit for more info (www.reddit.com/r/comfyui/comments/15rvnlh/masked_content_and_inpaint_area_from/)

    • @musicandhappinessbyjo795
      @musicandhappinessbyjo795 ปีที่แล้ว +1

      @@DreamingAIChannel thanks, I will have a look.

  • @archi_designer
    @archi_designer 6 หลายเดือนก่อน

    What about using VAE encoder for inpainting ?

  • @aminbenhassin561
    @aminbenhassin561 11 หลายเดือนก่อน

    awesome ! can you share your Json worfklow file ?

  • @sebas1111_
    @sebas1111_ 8 หลายเดือนก่อน

    what would be the best way to use this to correct badly generated hands? When I try to use this workflow, it's still generating bad hands, even if the masking and everything else is working perfectly xD

    • @DreamingAIChannel
      @DreamingAIChannel  8 หลายเดือนก่อน

      Well, "hands" are the black sheep of stable diffusion models.... I would simply recommend you to change model, I have seen that models like CetusMix WhaleFall2 many times does it pretty well

  • @arcangeel4828
    @arcangeel4828 11 หลายเดือนก่อน +1

    What a great video!

  • @steveyy3567
    @steveyy3567 5 หลายเดือนก่อน

    thanks, you help me a lot.

  • @iresolvers
    @iresolvers 11 หลายเดือนก่อน +3

    how did you get your Node Lines to be striaght like that as you create the connections? thanks

    • @CatMasseurWithoutBorder
      @CatMasseurWithoutBorder 10 หลายเดือนก่อน +2

      simply find in Link Render Mode in settings of the ComfyUI, set it to Straight

  • @fariborznajafi3810
    @fariborznajafi3810 10 หลายเดือนก่อน

    hi thank you soo much for creating this awesome tutorial is there any way to tell that it generate more than one resault ? (like Empty Latent Image node )

    • @DreamingAIChannel
      @DreamingAIChannel  10 หลายเดือนก่อน

      Uhm I don't know if exist something that can pass the same image more than once, stimulating a batch. You can for sure set more than one queue with the native setting in the main menu!

  • @jeterpilled_memester
    @jeterpilled_memester ปีที่แล้ว

    i installed the comfyUI impact pack but the SAm detector does not seem to be working. Is there any fixes you would suggest for this?

    • @DreamingAIChannel
      @DreamingAIChannel  ปีที่แล้ว +1

      Hi! Do you have any errors?

    • @jeterpilled_memester
      @jeterpilled_memester ปีที่แล้ว +1

      @@DreamingAIChannel after a long day of carefully reinstalling more packages, no I don't have more errors

    • @DreamingAIChannel
      @DreamingAIChannel  ปีที่แล้ว

      @@jeterpilled_memester Prefect! I'm glad to hear it!

    • @jeterpilled_memester
      @jeterpilled_memester ปีที่แล้ว

      @@DreamingAIChannel maybe want to add that you have to download SAM to your video description, otherwise excellent guide

    • @DreamingAIChannel
      @DreamingAIChannel  ปีที่แล้ว

      @@jeterpilled_memester oh so the problem wat that you didn't have the same models? Weird!🤔 I never downloaded SAM, Impact-pack did everything when I've installed it, I just followed the step in the main page of the repository!