Stable Diffusion ComfyUI And Diffutoon Create AI Videos - Domo AI Alternative?

Stable Diffusion Animation - ComfyUI And Diffutoon Create Deflickering Videos - Domo AI Alternative?
We're diving into the world of Stable Diffusion's animation and exploring a fascinating new project called Diffutoon. This project takes video-to-video transformations to a whole new level by turning dance videos into anime or cartoon-style videos.
Related Video:
Stable Diffusion Video To Anime Style • How To Make Stable Dif...
Resources :
For Patreon Supporters: / 106877649
Diffutoon Page: ecnu-cilab.git...
Github: github.com/mod...
For ComfyUI: github.com/AIn...
Throughout this video, I'll be explaining how Diffutoon functions as a pipeline, linking up various diffusion models like ControlNet and AnimateDiff Motion model. We'll also discuss the integration of ComfyUI extensions, which allow for smooth video generation and rebranding of images.
I'll guide you through the process of setting up and running Diffutoon in Google Colab, highlighting the required diffusion models, line art, depth maps, and soft edges. We'll also explore the benefits of using ComfyUI's custom nodes like "smooth videos" and "My OpenPose" for creating stunning animations with low VRAM consumption.
Moreover, I'll showcase the DiffSynth pipeline, which transforms original videos into alternative styles using diffusion models. We'll delve into the concept of image-to-image techniques and how they can be utilized in the Diffutoon project.
To provide you with a comprehensive understanding, I'll break down the workflow steps and demonstrate the differences between using the smooth video JSON file and the smooth video with batch size JSON file. We'll also touch upon the significance of ControlNet and K-sampler in achieving desired results.
So, if you're interested in exploring the world of video-to-video transformations and creating captivating anime or cartoon-style videos, this video is a must-watch for you! Don't forget to hit that subscribe button and turn on the notification bell, so you never miss an update on all things AI-related.
If You Like tutorial like this, You Can Support Our Work In Patreon:
/ aifuturetech
Discord : / discord

[@michaellong5871]

what "haters" say about your video or channel? I think you're one of the very few people talking about deep stuff not like others just scratch the surface of AI to make a quick buck.

[@Suresh-br2zz]

tried diffutoon, it is not that good & very slow

[@TheFutureThinker]

You mean the Python code itself, Comfy or the Colab Notebook?

[@MrJgrez]

I get error at realistic line art for some reason? Do you know how to resolve this? Thanks

[@TheFutureThinker]

Sometimes, it cause by resized image problem, or the AI model itself, or the Comfyui need update.
You have to check what is the error message related to.

[@TommySheng-s7y]

This problem is bothering me. Can you help me solve it?. SmoothVideo
CuPy failed to load nvrtc64_120_0.dll: FileNotFoundError: Could not find module 'nvrtc64_120_0.dll' (or one of its dependencies). Try using the full path with constructor syntax.

[@SFzip]

This is incredible! What is the input-video resolution size limit and length? Is there any point in capturing my videos in 4K?

[@TheEconoVision]

I don't think you can generate 4K, its SD1.5 he's using. You can upscale your video after process.

[@SFzip]

@@TheEconoVision Ok, so down-res my 4K footage to 768x512 before running it in ComfyUI. Is there a limit on the length of the footage?

[@TheEconoVision]

@@SFzip actually , you don't need to down-res your video file.
In Comfyui, use load video, connect images to Image Resize node. So you can set the dimension. Way faster.

[@sandeepm809]

this is worse than animdiff

[@iamtoufick]

Can 8gb vram handle this😅

[@vaporchickenwave6980]

i have 4090 24gb doesnt handle properly

[@TheFutureThinker]

That‘s a waste for the 4090 😅

[@iamtoufick]

@@TheFutureThinker 😂😂

[@vaporchickenwave6980]

@@TheFutureThinker what you mean? I tried to use it, that plugin use all my vram and is very slow!!

[@TheFutureThinker]

I am not sure... From my 4090 setup it works. evidence showing in the video. 😉

[@peacetoall1858]

Cool stuff. Would have been good for dance videos but sadly will get a copyright strike on TH-cam.

[@TheFutureThinker]

Thats why the better way to change character and background, only use the movment.

[@pxrposewithnopurpose5801]

can we use a images style as reference ?

[@crazyleafdesignweb]

This is fun , 1 code can do anime video. I will try it.

[@TheFutureThinker]

Yup 👍

[@huichan5140]

will get blurry result if the stylize image pattern (edges, contrast) is different from the original image due to the blending algorithm; Need extra steps to deblur

[@TheFutureThinker]

Good test👍

[@iamtoufick]

@@huichan5140 thanks for telling

[@ysy69]

This is wonderful. I assume this is not SXDL ready yet, right?

[@TheFutureThinker]

02:10 - they have list SDXL. 😉 Img2img in ComfyUI and Diffutoon script Good to go

[@ysy69]

@@TheFutureThinker really!!!! I will check it out!!! thank you!!!!

[@정보리-k9t]

I watched the video and tried to follow along.
I saw this error message on the video combine node side.
Error occurred when executing VHS_VideoCombine:
Cannot handle this data type: (1, 1, 512, 3), |u1
The only thing I changed the settings to is
The SD1.5 version checkpoint I have and
This is about the size of a sample video.
The rest of the settings were the same, but an error occurred.

[@정보리-k9t]

Try changing the size as it was in the original example file.

[@정보리-k9t]

How can I fix this error?

[@정보리-k9t]

Fortunately, I changed the example file and it worked.

[@TheFutureThinker]

Great you can do trouble shooting 👍

[@greenTech88]

GTX 1650 super work ?😢😢

[@TheFutureThinker]

No 😊

[@CyberPhonkMusic]

Is it possible to make it up to 30 seconds?

[@TheFutureThinker]

depends how many VRam u have. usually, we can set a frame cap, then skip frame to continue generate frames.

[@MaghrabyANO]

does Google Colab approve usage of stable diffusion notes?

[@TheFutureThinker]

Why not. Its only limited vram for free account, and gradio library for webui public link

[@MaghrabyANO]

@@TheFutureThinker what do u mean?

[@UnsolvedMystery51]

cool ! will try it , thanks!

[@TheFutureThinker]

Have fun!

[@CodyMysteryStories]

Cool! Tiktok trending video style.

[@TheFutureThinker]

Yes, and I know agencies are doing it in Tiktok.

[@drucshlook]

Imma try it tomorrow. Cheers

[@digitalflick]

thanks! where was the comfyui node/workflow?

[@TheFutureThinker]

In the example folder

[@digitalflick]

@@TheFutureThinker ok its paywalled?

[@TheFutureThinker]

@@digitalflick in the Github, for freebie geeks.

[@SjonSjine]

@@TheFutureThinker where then? don't see it

[@peterfontein9227]

Thank you! Inspiring.

[@TheFutureThinker]

Welcome

[@kalakala4803]

Looks fun Diffutoon, will try it

[@TheFutureThinker]

yup it is. :)

[@Vashthareaper]

2 hours and smooth video node has not moved an inch, with vid 2 vid , 60 frames cap , lcm cp and lora, tried again and again

[@TheFutureThinker]

Recent comfyui need update, I have experienced that 2 days ago

[@cfcmoon1]

Fantastic work, like always

[@TheFutureThinker]

✌️✌️