ComfyUI Tutorial Series: Ep14 - How to Use Flux ControlNet Union Pro

แชร์
ฝัง
  • เผยแพร่เมื่อ 26 พ.ย. 2024

ความคิดเห็น • 104

  • @pixaroma
    @pixaroma  2 หลายเดือนก่อน +3

    Join the conversation on Discord discord.gg/gggpkVgBf3 or in our Facebook group facebook.com/groups/pixaromacommunity.
    You can now support the channel and unlock exclusive perks by becoming a member:
    th-cam.com/channels/mMbwA-s3GZDKVzGZ-kPwaQ.htmljoin

    • @iamdihan
      @iamdihan 2 หลายเดือนก่อน +1

      Could you do a vid on Flux.1-dev-Controlnet-Upscaler

  • @makadi86
    @makadi86 2 หลายเดือนก่อน +11

    When I watch one of your episodes, I still feel the same excitement I had when I first started learning, as if I haven't learned anything at all

    • @pixaroma
      @pixaroma  2 หลายเดือนก่อน

      I started because of you with comfyui ☺️ just need it a little push

  • @StrikerTVFang
    @StrikerTVFang หลายเดือนก่อน +2

    I can't begin to express how thankful I am for these videos. This whole comfyUI subject has been so overwhelming to me, but your calm and detailed approach to explaining everything has made this such a joy to work with. Thank you so much!

    • @pixaroma
      @pixaroma  หลายเดือนก่อน

      you are welcome 🙂

  • @nahlene1973
    @nahlene1973 2 หลายเดือนก่อน +1

    You are an amazing teacher! I always find ComfyUI confusing, but after binge-watched your tutorials now everything makes sense, even other tutorials that were collecting dust in my playlist now suddenly makes sense. Can't thank you enough!

    • @pixaroma
      @pixaroma  2 หลายเดือนก่อน +1

      Glad I could help, thank you so much ☺️

  • @FiXANoNada
    @FiXANoNada 2 หลายเดือนก่อน +3

    literally the best guide ever. You have no idea how I had to self learn all this months ago and now seeing you who carefully puts all the pieces together exactly how it should be. Wish I watched this sooner haha. But maybe because I had to learn it alone first, I get to know that you are doing it correctly. Thanks and keep up the good work.
    With the updates and changes of these tools and nodes though, what we learn today is already outdated the next day.
    This guide is very comfyUI-new-comer-friendly for someone who wants a decent step-by-step explanation and the right tool for the right job without a bunch of pointless talking and messy instructions.

    • @pixaroma
      @pixaroma  2 หลายเดือนก่อน

      thank you 🙂

  • @c_huntermc
    @c_huntermc 12 วันที่ผ่านมา

    Great video, this is really helping me learn Comfy UI!

  • @david_ce
    @david_ce หลายเดือนก่อน +1

    You've done really well with this video, informative, helpful and actually fun to watch. Thanks a lot and looking forward to more from you

  • @GenoG
    @GenoG 2 หลายเดือนก่อน

    Another excellent video... and as always, you throw in extra helpful tidbits about ComfyUI to boot! Well done! I'll be a Legend now!! 😀 I struggled a little with the Error that you mentioned, but your Discord is super helpful and I found the Windows "Long Path" solution there and BAM, it's working fine! Again, thanks!!

    • @pixaroma
      @pixaroma  2 หลายเดือนก่อน

      thank you, yeah that long path limitation on windows is annoying not sure why windows didnt fix that by now.

  • @jmagick7281
    @jmagick7281 2 หลายเดือนก่อน +1

    Your videos always add to my growing knowledge of AI art. Thanks!

  • @tapirko1
    @tapirko1 2 หลายเดือนก่อน +1

    Thank you! Very useful, easy to follow and practical tutorial as always. I would still hate ComfyUI if it weren't for your channel! I feel very comfy working in it now :)

    • @pixaroma
      @pixaroma  2 หลายเดือนก่อน

      Thank you so much, glad I could help ☺️

    • @devon9374
      @devon9374 หลายเดือนก่อน +1

      You could say, that you've gotten COMFY with ComfyUI ;)

  • @aitechwitht
    @aitechwitht 2 หลายเดือนก่อน +1

    Pixaroma you are an incredible teacher! I've learned so much from you about comfy UI! THANK YOU!

    • @pixaroma
      @pixaroma  2 หลายเดือนก่อน

      Thank you so much for your support, glad I could help ☺️

  • @jigneshparmar678
    @jigneshparmar678 2 หลายเดือนก่อน

    You are doing great man 💯 Teaching and giving the knowledge to others 👏🏻

  • @pedrosm
    @pedrosm 2 หลายเดือนก่อน

    Results are amazing! Thanks for sharing!

  • @RamonRodgers
    @RamonRodgers 18 วันที่ผ่านมา

    I got a different error, that it could not find "cudnn_graph64_9.dll". But the fix was the same. I knew I already have CUDNN installed so it had to be that. Thank you so much!!! This one is useful in a lot of ways

  • @rmeta3391
    @rmeta3391 2 หลายเดือนก่อน

    Thanks for the tip on Flux Resolution Calculator, I was using Comfyroll's Aspect Ratio which has not been updated but worked. Always learn something from your EP's.

    • @pixaroma
      @pixaroma  2 หลายเดือนก่อน

      Glad it helped 🙂

  • @59Marcel
    @59Marcel 2 หลายเดือนก่อน

    Thank you for this well explained tutorial and for your discord channel that has so many knowledgeable and helpful members.

    • @pixaroma
      @pixaroma  2 หลายเดือนก่อน

      thank you for all the help 🙂

  • @whimsydraws
    @whimsydraws 2 หลายเดือนก่อน +1

    amazing!! AI is getting better day by day

  • @7393977
    @7393977 2 หลายเดือนก่อน

    I found this video helpful. Like button was pressed. Comment written. :)

    • @pixaroma
      @pixaroma  2 หลายเดือนก่อน +1

      thanks 🙂

  • @SebAnt
    @SebAnt 2 หลายเดือนก่อน +4

    WOW - This is what I was waiting for! Thanks!

    • @pixaroma
      @pixaroma  2 หลายเดือนก่อน +1

      Thank you so much for all the help ☺️ you are the best

    • @Uday_अK
      @Uday_अK 2 หลายเดือนก่อน

      👌🏻

  • @Uday_अK
    @Uday_अK 2 หลายเดือนก่อน

    🥂 Cheers to channel legends 👑

    • @pixaroma
      @pixaroma  2 หลายเดือนก่อน +1

      ☺️👑

  • @MostafaSamir-h2w
    @MostafaSamir-h2w หลายเดือนก่อน

    Really helpful tutorial

  • @SvenMurmann
    @SvenMurmann หลายเดือนก่อน

    Thank you very much for the great and detailed tutorials. Great job.

    • @pixaroma
      @pixaroma  หลายเดือนก่อน

      Thanks for joining and support ☺️

  • @TohkaTakushi
    @TohkaTakushi หลายเดือนก่อน

    Thank you again for a wonderful tutorial. Finally got the poses working correctly after like a week of trying and it not working!

  • @piergiacomomacri492
    @piergiacomomacri492 หลายเดือนก่อน

    tank you... very well explained

  • @SumoBundle
    @SumoBundle 2 หลายเดือนก่อน

    Nice one. keep up the good work

  • @etiennejulius1179
    @etiennejulius1179 2 หลายเดือนก่อน +1

    Thank you for a most excellent video. Your speaking style is pleasant and to the point. Subscribed. 🙏👌

    • @pixaroma
      @pixaroma  2 หลายเดือนก่อน

      Thanks and welcome 🙂

  • @CalsProductions
    @CalsProductions 2 หลายเดือนก่อน

    Your tutorials are really well presented, Thank you!

  • @59Marcel
    @59Marcel 2 หลายเดือนก่อน +1

    Thanks!

    • @pixaroma
      @pixaroma  2 หลายเดือนก่อน

      Thank you so much 🙂 for testing and support and everything

  • @telecaster566
    @telecaster566 2 หลายเดือนก่อน

    excelent thank you!!!

  • @saarhadad
    @saarhadad 26 วันที่ผ่านมา

    tnx alot amazing

  • @nomorejustice
    @nomorejustice 2 หลายเดือนก่อน

    Tysm man ❤❤

  • @ByFlerk
    @ByFlerk หลายเดือนก่อน

    Thanks for the explanation - What extension/plugins are you using for the monitoring of CPU/GPU and for the saving of .json with an image

    • @pixaroma
      @pixaroma  หลายเดือนก่อน

      for monitoring I use
      Crystools. The workflow is save in any image you generate with comfyui, so if you drag any image generated into comfyui you get that workflow that was used to generate that image.

  • @tetragrammaton3
    @tetragrammaton3 2 หลายเดือนก่อน

    comment :) thanks for the tutorials.

  • @saarhadad
    @saarhadad 26 วันที่ผ่านมา

    tnx alot

  • @egerdrawings9468
    @egerdrawings9468 หลายเดือนก่อน

    Hello, thank you for your guides, they are easy to follow. Tho i have one question. I already have a depth image, so I don't need the preprocessor. How do I use that ?

    • @pixaroma
      @pixaroma  หลายเดือนก่อน

      I didnt try without it, but it should work if you load directly to the image input of the apply control net. if that doesnt work you can also try to add a node
      "SetUnionControlNetType" just after load control net model node and select depth from there

    • @egerdrawings9468
      @egerdrawings9468 หลายเดือนก่อน

      @@pixaroma Yeah i just load the depth image into apply controlnet. Thanks 👍

  • @konnstantinc
    @konnstantinc 2 หลายเดือนก่อน

    Tumbs Up

  • @pollapatjampeeklang7493
    @pollapatjampeeklang7493 2 หลายเดือนก่อน +2

    • @pixaroma
      @pixaroma  2 หลายเดือนก่อน

  • @nibtreak5308
    @nibtreak5308 2 หลายเดือนก่อน

    Great video. It works great!... But it is so slow compare to just using just using Flux. Any parameters I can play with to help? It the full ControlNet 6GB end up in VRAM?

    • @pixaroma
      @pixaroma  2 หลายเดือนก่อน +1

      It is slow because flux already takes a lot of resources and even those with 24gb VRAM struggle with full dev, that is why used q8. You can try q4,q5 dev to see if it helps, or maybe change the vae encode and vae decode to vae encode tiled and vae decode tiled there you can try 512 or 1024 tile

  • @burskyozbekov
    @burskyozbekov 2 หลายเดือนก่อน

    So how do we add extra Lora's? Thanks for your work. It helped lot.

    • @pixaroma
      @pixaroma  2 หลายเดือนก่อน

      check discord, on the pixaroma-workflows channel, i added an example workflow there

  • @nektrs
    @nektrs 10 วันที่ผ่านมา

    Everytime i install ControlNet auxiliary completely brakes my comfyui and i get error "RecursionError: maximum recursion depth exceeded" after restart and everytime i try to run it.

    • @pixaroma
      @pixaroma  9 วันที่ผ่านมา

      you can try to install this version on a separate folder that has all the nodes installed, just to make sure is not some dependencies error github.com/Tavris1/ComfyUI-Easy-Install

  • @HiramosCM
    @HiramosCM หลายเดือนก่อน

    How can I get this workflow? Discord invite link is invalid.

    • @pixaroma
      @pixaroma  หลายเดือนก่อน

      the one from channel header should be always valid, try this discord.com/invite/gggpkVgBf3

  • @fungus98
    @fungus98 2 หลายเดือนก่อน

    can you use more than one controlNet preprocessor with Flux? Like use the stacker like in the sdxl version, or maybe line them up like loras or something?

    • @pixaroma
      @pixaroma  2 หลายเดือนก่อน +1

      the one I used for sdxl doesnt work with flux, asked for a vae and that node apply multi control net didnt have it, so I didnt found a solution yet for flux. But probably from settings you can find one preprocessor that does a good job for what you need

    • @fungus98
      @fungus98 2 หลายเดือนก่อน

      @@pixaroma thanks 😊

  • @Relax-kb7tf
    @Relax-kb7tf หลายเดือนก่อน

    Hi, I'm using flux schnell, is there a controlnet union for flux schnell?

    • @pixaroma
      @pixaroma  หลายเดือนก่อน

      the one for dev should work with schnell also, I am not aware of a schnell only controlnet

  • @tiffanyw3794
    @tiffanyw3794 2 หลายเดือนก่อน +1

    Can this be used for lower vram 4060 8gb vram

    • @pixaroma
      @pixaroma  2 หลายเดือนก่อน

      I dont have a way to test it, maybe try with schnell version first. The q8 dev probably will take too much even if it works, so maybe q4 but try with schnell first. Flux is quite demanding when it comes about vram

  • @TUSHARGOPALKA-nj7jx
    @TUSHARGOPALKA-nj7jx 24 วันที่ผ่านมา

    Is there a flux controlnet model for the normal map

    • @pixaroma
      @pixaroma  24 วันที่ผ่านมา

      Not sure, i mostly use canny and depthmap, only if you try to see

  • @AInfectados
    @AInfectados 2 หลายเดือนก่อน

    Would like to add to this WF the node Power Lora Loader (rgthree)

    • @pixaroma
      @pixaroma  2 หลายเดือนก่อน +1

      Check the discord I added today a workflow with both control net and Lora, i used load lora only node

  • @Tamam-e8e
    @Tamam-e8e 15 วันที่ผ่านมา

    Does anyone know a way to render the backgrounds sharp in Flux? I have tried models but they reduce the quality of the output.

    • @pixaroma
      @pixaroma  15 วันที่ผ่านมา +1

      I think i saw a lora that unblur somewhere on civit ai, but depends also on prompt if you prompt like a portrait in reality the background is blurred because subject is in focus and there is depth of field, like if you look at your hand the hand is in focus but everything else is blurred

    • @Tamam-e8e
      @Tamam-e8e 15 วันที่ผ่านมา

      @@pixaroma I have tried this Lora but have not been able to achieve any really good results so far. That's true, but unfortunately various prompts have not produced really sharp images for me, even with landscape images etc. Do you have a video of better prompts for sharp images in Flux?

    • @pixaroma
      @pixaroma  15 วันที่ผ่านมา

      @Tamam-e8e try to use 30 steps instead of 20 and try different samplers and schedulers

  • @huetre4244
    @huetre4244 หลายเดือนก่อน

    Sorry, but this doesnt work. If I put the output of the canny line preprocessor in the
    Controlnet with the Union Controlnet I just get the Lines from canny in the KSampler output.
    Same for depth, hed etc. The whole union controlnet models is broken.

    • @pixaroma
      @pixaroma  หลายเดือนก่อน

      Did you use the workflow i put on discord and didn't work? Show me a screenshot om discord

  • @Martin_Level47
    @Martin_Level47 19 วันที่ผ่านมา

    Edit: "--reserve-vram 2" seem to solve this problem. It still fill up the VRAM but it doesn't fail anymore 🙂
    I cant make this work. As soon as I use the Controlnet I get a OOM error. It destroy my VRAM. I got 16GB and it's filled up in sec. I have tried with X-flux too - same. What the H am I doing wrong? I can run FLUX dev (and GGUF Q8) fine, but as soon as I activate the controlNet I kill it? Before I start Comfy I use 550Mb VRAM so it's not something else that use it..

    • @pixaroma
      @pixaroma  19 วันที่ผ่านมา

      It might be too much with control net and flux together, if you try like smaller size does it work to make sure is not something else, also post on comfyui chanel on pixaroma discord server maybe someone has the same card and can test it

  • @Im_that_guy_man
    @Im_that_guy_man 2 หลายเดือนก่อน

    is it possible to use flux control net in forge? if so, can you make a tutorial for it? doesn't seem to work for me

    • @tetsuooshima832
      @tetsuooshima832 2 หลายเดือนก่อน

      I've found no good news about this. So far, it's not supported in Forge sorry

    • @pixaroma
      @pixaroma  2 หลายเดือนก่อน +1

      I am not focusing on forge right now since the update are slow, I saw this comment on the issue page: "The rewrite of ControlNet Intergrated will start at about Sep 29. The estimated finish date is about Oct 7. When this note is announced, the main targets include some diffusers formatted Flux ControlNets and some community implementation of Union ControlNets. However, this may be extended if stronger models come out after this note."

    • @tetsuooshima832
      @tetsuooshima832 2 หลายเดือนก่อน

      @@pixaroma hey thta's good to know ! But did you notice that Forge gives nicer Flux outputs than ComfyUI ? I noticed that once I started to make a few Flux loras, it's almost night and day sometimes... Inpainting is easier too.
      Of course it's possible to do nice things in Comfy as well but it's a lot more difficult, just like before with SD models...

    • @pixaroma
      @pixaroma  2 หลายเดือนก่อน

      @@tetsuooshima832 if the models is the same generation should be similar just the same seed is not the same on forge with comfyui, one generate seed on cpu and one on gpu, so comparing the same prompt and seed will give different results. But if you just generate with same model I dont see how they are nicer, probably depends on workflows if has something behind the scene that does something extra, not sure. I only use comfyui these days since I can make the workflows how i want and with one click it does all for me, generate a prompt, using it, upscaling, saving etc.

  • @k.jatuphat9785
    @k.jatuphat9785 2 หลายเดือนก่อน

    How to used both Lora and controlnet to this workflow?
    I want lora for charecter face and controlnet for pose.

    • @pixaroma
      @pixaroma  2 หลายเดือนก่อน +1

      You need to add a lload lora node between load checkpoint and clip text encoder and redo connection so it goes through that lora

    • @raininheart9967
      @raininheart9967 2 หลายเดือนก่อน

      @@pixaroma can you share this workflow with the lora conection ? its is help a lot 😄

    • @李用-k1d
      @李用-k1d 2 หลายเดือนก่อน

      GGUF cannot recognise lora

    • @WanderlustWithT
      @WanderlustWithT 2 หลายเดือนก่อน

      @@李用-k1d I use loras with GGUF with no issues.

    • @pixaroma
      @pixaroma  2 หลายเดือนก่อน

      @@raininheart9967 I shared the workflow on discord, is in the pixaroma-workflows channel

  • @lakislam.photoArt
    @lakislam.photoArt หลายเดือนก่อน

    Noap. I cant do it. it seems that people here are computer nerds. You should take into consideration that there are people like me who need a more detailed explanation and step by step proceedure if you want us to follow you.

    • @pixaroma
      @pixaroma  หลายเดือนก่อน +1

      I assumed people started from episode one not just jumped to episode 14 if want to understand all, I can not explain the same basics on each episode. I include the workflow on discord so if is too much info you can just download the ready made workflow and load it in your comfyui. If you have problems and questions then discord is quite active and people can help and answer questions. for control net already explained more slowly in the sdxl control net episode.

    • @lakislam.photoArt
      @lakislam.photoArt หลายเดือนก่อน

      @@pixaroma no I just have problem with the Aio preprocessor. All the rest I'm good so I couldn't go and watch further on yr vids which is pity

    • @pixaroma
      @pixaroma  หลายเดือนก่อน +1

      mention me on discord, show me a screen with an error I am sure it can be fixed, is either the long path problem on windows that dont let you download all the files automatically because the path is too long, or the comfui didnt update to latest version.

    • @lakislam.photoArt
      @lakislam.photoArt หลายเดือนก่อน

      all good now after watching again and again this video and with the help of chatgpt i fixed the problem .But now after i queue prompt i get " clip text encode none type object has no attribute devise. the problem is on the negative prompt note. i don't know what the hll is this now.