ComfyUI: CosXL, CosXL Edit InstructPix2Pix (Workflow Tutorial)

แชร์
ฝัง
  • เผยแพร่เมื่อ 6 ก.ย. 2024

ความคิดเห็น • 50

  • @unsound-methods
    @unsound-methods 4 หลายเดือนก่อน +3

    One of rare gem channels in SD world. Awesome content. Would be so nice to see your take on fixing hands in comfyUi!

    • @controlaltai
      @controlaltai  3 หลายเดือนก่อน

      Thank you!!

    • @Nrek_AI
      @Nrek_AI 3 หลายเดือนก่อน

      Agreed 100% and I too would love to see what can be done about fixing hands

  • @sudabadri7051
    @sudabadri7051 4 หลายเดือนก่อน +3

    I was about to sleep but now i gotta keep watching for half hour more haha. Keep up the great work.

  • @TutoView
    @TutoView 4 หลายเดือนก่อน +1

    Best channel! in ComfyUI! I liked the content, so I signed up for membership.😁👍

  • @gimperita3035
    @gimperita3035 2 หลายเดือนก่อน

    Really, thank you for this. Started playing with CosXL and I looked for an explanatory video, but this workflow and the insights on which is doing what blown me away.

  • @jamesharrison8156
    @jamesharrison8156 3 หลายเดือนก่อน

    A wonderful tutorial! I learned a lot more about ComfyUI. Thank you so much for taking the time to create this. Also, showing how you created the workflow and following along myself works much better as a learning tool.

  • @dannywei
    @dannywei 2 หลายเดือนก่อน

    It's an amazing course. This has made a lot of practical improvements to my original workflow. Thanks a lot.

  • @kaibuddensiek8580
    @kaibuddensiek8580 4 หลายเดือนก่อน

    I am a Beginner in ComfyUI and it is hard for me to understand all. But i love it. Thx for the great work. Learn more and more when i watch your videos.

  • @sudabadri7051
    @sudabadri7051 4 หลายเดือนก่อน +2

    Absolutely incredible

    • @controlaltai
      @controlaltai  4 หลายเดือนก่อน +1

      Thank you!!

  • @ayazrashid7357
    @ayazrashid7357 4 หลายเดือนก่อน

    wow what a great video watched through the whole thing and set it up myself. I also realized i was upscfaling my images wrong (facepalm). Im going to binge your videos great work buddy!!!

    • @controlaltai
      @controlaltai  4 หลายเดือนก่อน

      Thank you. Btw there is no wrong way to upscale. Every way is the correct way only different....😉

  • @moviecartoonworld4459
    @moviecartoonworld4459 4 หลายเดือนก่อน

    Thank you for the fantastic lecture~!~!!😍🤩😍

  • @AI_Creatives_Toolbox
    @AI_Creatives_Toolbox 3 หลายเดือนก่อน

    Amazing Tutorial! Why is it better to use the sampler custom advanced instead of a default k-sampler with all the widgets turned to input nodes? For organization purposes?

    • @controlaltai
      @controlaltai  3 หลายเดือนก่อน

      Thank you!! More advanced and fine tune controlling for CosXL. For best results use sampler custom advance.

  • @cptblood1981
    @cptblood1981 27 วันที่ผ่านมา

    Anyone know where to get the node samplercustomadvanced? I just cant find it...

    • @controlaltai
      @controlaltai  27 วันที่ผ่านมา

      It's build in within comfyui. Update comfy to the latest version.

  • @fc5130
    @fc5130 4 หลายเดือนก่อน

    wow! AMAZING. One question, can u merge cos edit and realvis? and edit images with the quality of realvis?

    • @fc5130
      @fc5130 4 หลายเดือนก่อน

      and one more question, an u use ipadapter with cosxl edit?

    • @controlaltai
      @controlaltai  3 หลายเดือนก่อน +1

      Cosedit edit causes some errora but works. I will try it. Ip adapter I have not try. What are u trying to do with ipadapter let me know I will try that.

    • @fc5130
      @fc5130 3 หลายเดือนก่อน

      @@controlaltai it would be amazing for example to change the material from a sofa and give it the reference of the material with ipadapter. i was trying that.

    • @controlaltai
      @controlaltai  3 หลายเดือนก่อน +2

      You don't need IP adapter you can describe the material. Thats The point of cosxl edit. Just say plastic sofa, leather sofa etc and it should work.

    • @fc5130
      @fc5130 3 หลายเดือนก่อน

      @@controlaltai yeah but what i need is the exact texture, imagine a pattern and i need to edit the sofa with it. Thank u to answer

  • @Thank_you_USA
    @Thank_you_USA หลายเดือนก่อน

    When im trying to merge checkpoints realvis4 with the cosXL im getting vram allocation memory error i have 15GB vram . anything i can do to fix it please? ty. ps perhaps its because coseXL+ sdxlbase+realvis= more than 15gb ?

    • @controlaltai
      @controlaltai  หลายเดือนก่อน

      Actually no, and it's cosxl minus sdxl base then plus realvisxl. Unless your are merging all three by mistake.

    • @Thank_you_USA
      @Thank_you_USA หลายเดือนก่อน

      @@controlaltai I was doing as you said in the video not sure why im getting the out of memory error :( Error occurred when executing CLIPTextEncodeSDXL:
      Allocation on device

    • @controlaltai
      @controlaltai  หลายเดือนก่อน +1

      Okay, just confirmed it. It does take above 50% VRAM and System Ram on my system. You need around 24GB VRAM and about 64GB system RAM for this. I am running this on a 4090 (24GB VRAM). 16Gb VRam should work, as it did not go beyond 50-55%, however not the full 16GB must be allocated to PyTorch depending on your environment.

    • @Thank_you_USA
      @Thank_you_USA หลายเดือนก่อน

      @@controlaltai ty perhaps i should run it via --normal-vram instead of high

  • @manolomaru
    @manolomaru 4 หลายเดือนก่อน

    Treeeemendous video like always!
    ...although too advanced for me 😅😭😅
    ✨👌😎😮😵😮😎👍✨

  • @SerginMattos
    @SerginMattos 4 หลายเดือนก่อน

    Thanks for this tutorial. I'm having a problem. The cosxl_edit.safetensor model in Pix2Pix is returning a grainy green image that barelly resembles the original image. Any hint for me, please?

    • @controlaltai
      @controlaltai  4 หลายเดือนก่อน +1

      Check the dual cfg connections. They are tricky. Recheck cfg. Ensure image scale to total pixels is correctly connected. Close command prompt and restart comfy from cmd. Try again And let me know.

    • @SerginMattos
      @SerginMattos 4 หลายเดือนก่อน

      @@controlaltai Thanks for the answer! I checked the connections you mentioned. ComfyUI is updated. I downloaded safetensor again. And lastly, I looked for a similar workflow on civitai. I keep getting the same result. Now I just installed a clean Comfyui. Still the same problem. Really weird. Anyways, thank you for this video. You explain very well!

    • @controlaltai
      @controlaltai  4 หลายเดือนก่อน +1

      Send me an email with your workflow, image and the prompt. I will have a look. There must be something wrong, I don’t think it’s comfy. mail @ controlaltai. com (without spaces)

    • @SerginMattos
      @SerginMattos 4 หลายเดือนก่อน

      @@controlaltai I sent the email. But it's working... For some reason the 2 first times I downloaded the safetensor, it was corrupted. -.-"
      3rd for the charm. Thank you so much! It's working and It's beautiful!!!!

  • @nkofr
    @nkofr 2 หลายเดือนก่อน

    is it possible to use COSXL with Controlnet? it seems not to be working
    Cheers

    • @controlaltai
      @controlaltai  2 หลายเดือนก่อน

      I just check and no. Doesn't work. Even with a merged checkpoint.

    • @nkofr
      @nkofr 2 หลายเดือนก่อน

      @@controlaltai interesting, thank you for trying

  • @eucharistenjoyer
    @eucharistenjoyer 4 หลายเดือนก่อน

    What's the minimum VRAM requirement?

    • @controlaltai
      @controlaltai  4 หลายเดือนก่อน +1

      I don't think it's anything specific for just the model, it's a simple sdxl based model just fine tuned. Whatever is required for SDXL, same here. Except for the upscale. If you don't refined or upscale 6 to 8 gb would work.

  • @cmlshn
    @cmlshn 4 หลายเดือนก่อน

    Hi, great work! I get this while merging cosxl_edit model with another sdxl model ->>> WARNING SHAPE MISMATCH diffusion_model.input_blocks.0.0.weight WEIGHT NOT MERGED torch.Size([320, 4, 3, 3]) != torch.Size([320, 8, 3, 3])
    Any thoughts?

    • @controlaltai
      @controlaltai  4 หลายเดือนก่อน

      Are you merging the sdxl model?

    • @cmlshn
      @cmlshn 4 หลายเดือนก่อน

      Yes finetuned sdxl model. Do u know how many ram u need for saving a merged checkpoint?

    • @controlaltai
      @controlaltai  3 หลายเดือนก่อน

      The cos xl edit model always will give an error. It's not designed to be merged. However it does work. But I would not recommend it. Vram is not an issue here. Merge only the cos xl model not the edit one.