วีดีโอ

Hey, This is Matt, but using my personal account. I don't cover much Comfy, and even after all this time, I still don't use it if I can accomplish the same thing with Forge. I've made the most insane Comfy workflows, and when I go to revisit them I can never remember all the little adjustments. You can easily enough replicate this with Comfy, you just have to install the Ultimate Upscaler node, and there's a few workflows out there for free that do the same thing I present. You can also email me and I'll send you my Comfy workflow collection.

@matthallett4126 Cheer's Matt. I work in house at an arch practice as a visualiser and they have pushed comfy UI (we had to license it) so no access to automatic1111. I think it would be much simpler to use that instead,but no one listens to me, anyway cheer's for the reply. I'll reach out over Christmas via email 👍

Thank you! I'm going to make a new video showing my custom night conversion script if you want to subscribe and see then when its ready. It will be free to use.

​@@matthallettai I was wondering how you learned loRa. Do you make a video of this as well?

There are many tutorials how to train a LoRA. I use OneTrainer, but you can use whatever is new. You can start with CivitAI, they have a really easy online method for training SDXL and FLUX models. Start with something simple, don't try using a 1000 images like I have, it will melt your brain and GPU.

Thanks man! Appreciate that.. Right now the best image to video is Runway, Kling and Minimax. Which are all online services. For local Cog is very popular, LTX just came out, and its a year old now, but Stable Video Diffusion. If you don't like the online generators, you won't like the local stuff! There's not frame to frame methods as of now that I know of.

You can delete the entire program from \Data\Packages\ That will work.

There are a few solutions for AMD GPUs. Each package has a command line you need to add.. Stable Diffusion and many other AI architecture has been built for us with the CUDA platform developed by Nvidia. AMD GPUS are great affordable gaming cards, I use to only buy AMD GPUs.. Still only buy AMD CPUs. Its too bad they're not useful for the AI tech that's come out in the past few years. Thats why Nvidia stock went through the roof btw.

Oh there could be so many reasons. Check the logs in the Comfy Tyflow dialog box. Can't remember were that is at the moment. Make sure it can "see" the depth of the model and your resolution,.. model checkpoint. Also try installing Comfy or A1111 on its own and test your Stable Diffusion workflow outside of Max.

Not sure what you mean, but I have other video and there are other videos on TH-cam about using SD to edit your renderings in post

@@matthallettai i mean that can i render a photo and put it in ty diffusion and make it to generate just grass only for example

@@ibdesign8207 I would only use TyDiffusion for 3D models you want to quick turn into an AI image. What you're talking about is inpainting. Its best to take that image outside of 3ds max and use dedicated tools for AI photo editing like Forge, Comfy, Fooocus, Invoke. etc.

Glad you found it useful!

So nice of you

That error means your controlnets are mismatched. You have to us SDXL controlnets with SDXL checkpoints,

Cheers!

Just found something I think works, I'll post it on the Facebook group so I can include visuals. Assuming you're there as well. If not execute the 'run_ComfyUI.bat' in the root directory of the Tyflow install. In the CMD window look for the host copy and paste it to your web browser. it looks like this... http. 127 0 0 1 : 8188 but I can't paste it into the comments.

Thanks Alessio! My production quality could be greatly improved, but I do my own editing, and by the time I get to that stage, I'm over it :)

I've tried that using before in A1111 using an output ""object color" element like you're describing and removing the preprocessor in controlnet with the Segment model. It kind of works, this was last year and the model was shit at straight clean lines and small detail, so in a case like this were the subjects are far away it won't help. I was testing it making a kitchen and controlling single elements like floors and cabinets with a segment mask outputed from Max. I've always come back to using some type of base image with the colors I want in img2img and adjusting the denoise like I did here. But things change so quickly and often it comes down to the quality of the controlnet model. When flux has a segment model I'll try it again, Flux is amazing at straight and clean lines.

Thanks! Glad you liked it.

I think you're talking about controlnet? Instead of generating a Zdepth pass, Stable Diffusion can make one with a preprocessor and a Depth model. Its actually the most common method when using AI since most users don't start from a rendering program. Just turn controlnet on, selected Depth and the defaults should work. You need a SDXL controlnet for SDXL checkpoints. Thats the quick youtube comment reply, it can get a lot more complicated.

Yes, you can make a batch filled with images and use a generic prompt and a denoise like 0.55. There's a batch node in Comfy somewhere, but last time I tried to find it, I could figure out which one. I mostly use Forge, its batch generation is dead simple. If you can find my email address email me and send a message,maybe we can figure it out together. It also sounds like you could be asking about IPAdapter, which is another beast.

Depends on your app! This is just Matrix, its an app manager for image generators.

It works like any other channel, just click the "Show Shaded Material in Viewport" make sure you have your bitmap and your UVW set to 2.

Thanks man! I appreciate the comment.

Yes, we can do that now. Remember we tried last year with your 3D characters. There's easier tools to achieve this now without a Lora for each character.

Only works for me with Chrome, and its because I have all popups blockers disabled. Try the regular Adetailer, not the Udetailer, I think its better now.

As I mentioned on facebook they're inspired frames. I used img2img to create a few frames because I couldn't get flux to create anything like what I wanted with just text to image. I was more interested in seeing how those images would animate with Runway.

Glad it was helpful!

You can download models required on Hugginface or Civit. Then you have to place them in the appropriate download directory. If you use a Local AI manager like SD Matrix, it has a download menu you can use for automatic placement. Best to start with a startup video for Forge or Automatic1111

You're welcome!

Its a late reply, hopefully you have it figured out. If all your packages get that error then its a problem with Matrix or Windows security perhaps. IF its just one package, that happens during some updates, there's usually a fix posted quickly on Github. Or you have to revert back to a previous version.

Thank you!

I extracted frames from some movies and built a Flux LoRA, the base model of flux has very limited WWII data.

Thanks but its Tyson Ibele whos' the genius!

There are AI addons for Blender, but I dont know if it has this cool unwrap feature.

Yes and no. In TyDiffusion you can share a few model directories, but not the main Comfy. The first version of TyDiff had issues with installation and kept having to reinstall so I kept it away from Matrix. TyDiff has very limited model use, so if you have 20GB, I would keep it all separate from now and just use a few checkpoints TyDiff.

Thanks for the comment. Glad I could help.

Thanks for the comment. If your using 3ds max check out TyDiffussion. SD right inside the max window.

@@matthallettai I've left Max though - Too expensive. Haha. Is there a version / anything similar in Blender ?

Slava Ukraini!!

You're always going to have that weird morphing effect with frame by frame SD animation. No matter what tricks you try there no frame is 100% the same as the last. At least currently. I'm sureone out there is working on it. Ai Video you see now is made with video trained models. What we need is a hybrid or controlnet designed for frame by frame denoising img to img. The current tech is animatediff, deform. - see example on this channel. Personally I like SVD but that has little control.

@@matthallettai well the issue I'm having is not the difference in frames but the initial outcome is completely different when doing a single frame with the same settings as when I hit animation. I said not wildly different but sometimes they are... I train a model to be something which I want for each frame but when I go to animate it's like I've used completely different prompts.. I'm lost

​@R1PPA-C Depending on the complexity of your scene the more interpolation the AI does with what it "sees" the examples you've seen of other animations look smooth because of their simplicity in size and materials. Leaves and grass for example with change dramatically between frames no matter what you do. Small details change so much it's not worth it. Trust me it's not you.

That's exactly how I describe it to. Morphing. We can't escape it yet.

Don't bother with any model that claims it's good for it, interiors or architecture. Unless it's a Lora addon to experiment with adding certain looks. My favored checkpoints right now are AlbedoXl 2.1 for exteriors. NightVision. EpicPhotogasm. Real Vision XL some others and spelling is off...I'm away from my PC. Best to download popular XL models that are for photorealism. Portrait examples are OK. And compare them with the XYZ plot script at the bottom of A1111 or Forge. Makes a handy grid for you to compare.

Not true. Although language is an integral part, with complex node based processes, it's only a fraction of it.