ControlNet Union ProMax, Pixart Sigma 900M & More New Stuff!

Lots of new free stuff for ComfyUI this week including the new ControlNet Union ProMax Model, Pixart Sigma going to 900M, a better background remover and more!
Nb. New schedulers (gits, ays) are available via github.com/pam... :)
Want to support the channel?
/ nerdyrodent
/ controlnet-union-10850...
Repos:
huggingface.co...
github.com/pam...
github.com/joh...
huggingface.co...
github.com/cit...
github.com/xin...
huggingface.co...
Learn more!
New Samplers & Schedulers in ComfyUI: • A look at the NEW Comf...
PixArt Sigma: • Pixart Sigma - Low VRA...
== Start your ComfyUI Journey! ==
1. Installing Anaconda for MS Windows Beginners - • Anaconda - Python Inst...
2. Installing ComfyUI for Beginners - • Install Stable Diffusi...
3. ComfyUI Workflows for Beginners - • ComfyUI Workflow Creat...

[@juanjesusligero391]

Oh, Nerdy Rodent, 🐭
he really makes my day! 🌞
Showing us AI, 🤖
in a really British way! 🍵

[@Derjyn]

Dude! You're about to hit 50k. Milestone on it's way 🏆

[@NerdyRodent]

Woohoo! 🎉

[@MrSporf]

Loving the new controlnet. Really easy to use and you're right about the outputs, as they are some of the best I've seen!

[@bgtubber]

Love it! Gotta try the new union model. I gave it a star.

[@NerdyRodent]

Yay! Everyone should give it a star! 😉

[@frazuppi4897]

amazing video! thank you so much, sending love form switzerland

[@banzai316]

Love it, updated a few of my workflows 👍

[@boroborable]

you may use KJNodes/color match node to restore the color by reference image as well.

[@lastword3386]

I can't use the schedulers even after update, they don't show up. any help?

[@ritpop]

"britsh way" lol

[@TheDoomerBlox]

Toying with masked inpainting tells me someone needs to toy with Differential Diffusion.

[@anduvo]

Hi Nerdy 🐀
As some of the comments already said, after comfy update, I still don't see the new schedulers.
How did you got them ? Maybe via a node ?
Does somebody in the audience knows ?

[@NerdyRodent]

Which version of ComfyUI are you running? 2024-07-22 or later?

[@anduvo]

@@NerdyRodent 2024-07-06
Via the manager that is the latest I get when I do update all

[@NerdyRodent]

@@anduvo ah, so an old version then. Try updating to today’s release and see

[@anduvo]

​@@NerdyRodentok after asking the manager several times to update I got 2024-07-22 but still no luck, I don't have the new schedulers. I only see : beta, ddim_uniform, simple, sgm_uniform, exponential, karras and normal.
I am using the portable version for windows.
Maybe are you using some other branch than the main branch ?

[@NerdyRodent]

@@anduvo interesting… I’ll have to have a dig and see if it’s actually a custom node changing the main one!

[@fk680061]

how does he get that better default ksampler? I updated my comfyui but not seeing ays scheduler.

[@RamonGuthrie]

Same I don't see it either

[@NerdyRodent]

Turns out an old custom node I had installed added to them in to the default ksampler - github.com/pamparamm/ComfyUI-ppm

[@fk680061]

@@NerdyRodent You are an incredible content creator. I was expecting someone else to answer it, but you actually took time and look into it, appreciate.

[@tr0ublem4kerWZ]

I'm really interested in the repaint example. Can you go more indepth into it? Looks like you're face swapping the woman face with the owl. But I'm confuse with how you go about it. Thanks

[@NerdyRodent]

Yup, you got it! The masked area gets changed to whatever you prompt for 👍🏼

[@DaveTheAIMad]

Do you have a link to the workflows you used ? I am curious to see the colour fixing of the out painting, and didnt fully understand what you meant by putting the image back to it for inpainting.

[@NerdyRodent]

It’s basically the old BrushNet workflow - github.com/nullquant/ComfyUI-BrushNet

[@DaveTheAIMad]

@@NerdyRodent Much appreciated, will take a look at it after work :)

[@hamtsammich]

My eyes just glaze over when I look at comfy ui, lol
I have no idea why I'm struggling with it. Maybe it's because it looks like a crazy board?

[@NerdyRodent]

Colours and boxes. That’s what I do anyway…

[@RespectFalseIcons]

where do you get the ' Set union control type' node, I cant find it or install it

[@NerdyRodent]

As you can tell from the node badges, it is built- in!

[@juanjesusligero391]

If you don't have it in your installation you should probably update ComfyUI

[@RespectFalseIcons]

@@NerdyRodent ah, thanks for the tip, I'll go update my comfy, but what do you mean by "badges"?

[@knoopx]

what is the cute fox icon on top of each node? xD

[@Dave_AI]

It tells you that node is part of Comfy default. To enable it, you have to open manager and under the badge dropdown, select "nickname." Now there will be a little badge at the top of nodes telling you what pack they come from.

[@shareeftaylor3680]

Can someone please make a video how and where to put files!! ComfyUI please😢

[@hindihits9260]

pixart 900 can run on 4gb vram but the t5 encoder is quite bulky itself, so it doesnot work

[@farslght]

previous model working well with sd3 t5. 900m model outputs crap for me idk why.

[@hindihits9260]

@@farslght can it run on 4gb vram though?

[@testales]

I don't the point of these inpainting methods, why not simply setting a latent mask so the rest of the image remains guaranteed unchanged? You can still do a bit sampling on the whole thing to make it more consistent.

[@leiyangalable]

all abt control

[@LouisGedo]

👋

[@LeftToSaveHerOwnSanity]

🧀🍓🍒🍑

[@NerdyRodent]

⭐️