CogvideoX With ControlNet Pose For AI Animation - No More Boring Camera Scenes
ฝัง
- เผยแพร่เมื่อ 10 ต.ค. 2024
- CogvideoX Update With Control Pose
In today's video, we delved into the exciting updates and features of Cogvideo X, AI video generation. With a parameter size of 5 billions parameters, Cogvideo X offers enhanced capabilities compared to its predecessor, opening up new possibilities for creating captivating videos. From ComfyUI custom nodes to control pose experimentation, we explored the latest advancements in the AI landscape that are sure to spark creativity and innovation.
Article: thefuturethink...
Workflow available in the custom node example folder.
Workflow Demo Used In This Tutorial / 113667767
CogVideoX 5B In ComfyUI Better Quality - Local AI Video Model That Truly Works
• CogVideoX 5B In ComfyU...
CogVideoX 5B AI Video Model Updated With Img2Vid In ComfyUI
• CogVideoX 5B AI Video ...
ComfyUI-CogVideoXWrapper github.com/kij...
Alibaba-pai CogVideoX huggingface.co...
We took a deep dive into the functionalities of Cogvideo X Fun 1.1, showcasing its ability to generate videos-to-videos and animations with extended context windows and free noise. By leveraging ControlNet and GGUF quantization models, we demonstrated how users can guide animations and enhance video creation processes. The video also highlighted the significance of LoRA integration and the impact of ControlNet preprocessors on shaping dynamic video content.
In this video, we explored the intricacies of Cogvideo X's pose models, ControlNet features, and the application of LoRA technology in video generation. From experimenting with different context options to fine-tuning control strength, we navigated through the diverse functionalities offered by Cogvideo X. Join us on this journey of discovery and innovation as we unravel the potential of AI-driven video creation. Stay tuned for more exciting experiments and insights in upcoming videos!
If You Like tutorial like this, You Can Support Our Work In Patreon:
/ aifuturetech
Discord : / discord
#CogvideoX #controlnet #posemodel #aivideogenerator
Workflow available in Custom Node examples/ folder
Demo Used In This Tutorial www.patreon.com/posts/113667767
CogVideoX 5B In ComfyUI Better Quality - Local AI Video Model That Truly Works
th-cam.com/video/v9KGQoaqhkw/w-d-xo.htmlsi=GYd8qGsJXz2fmi4m
CogVideoX 5B AI Video Model Updated With Img2Vid In ComfyUI
th-cam.com/video/sy6XHF2LEfI/w-d-xo.htmlsi=0waT9GIp7qAeNkhS
ComfyUI-CogVideoXWrapper github.com/kijai/ComfyUI-CogVideoXWrapper
Alibaba-pai CogVideoX huggingface.co/alibaba-pai
Great news! We are getting there.
And really don't know why Gen 3 , Kling AI, they don't provide ControlNet. For this.
Well, as we said before. Some gambling need in order to charge you.
Interesting.
There must be a way to create great videos from this that Benji laughed at with the 3 legged Wooly Mammoth!
😅
So there will be 6 legs , 2 person on the screen
what is the difference of vvid2vid and pose2vid? both are using reference video
Both are similar capture the motion. Vid2vid are more like a Lineart CN only
COG LORA = 4 legged wooly mammoth!?😊
Haha😂😂😂
The output video could be upscaled ?
Yes it could
The action scene is the most challenging for video. Even in real life video, its hard to take a good shot.
Yes it is. That's why we have to breakthrough
nice
Almost there, this model have the potential
What is the min. vram for GGUF model?
About 16 GB can be done.
so this is like v2v animatediff?
Yup yup👍
Use depth anything v2 its soooooo much better than v1
Yes v2 use for image gen. But for Cog, even you give it too detail it can't generate detail...
@@TheFutureThinker nice, I just downloaded cog to try, seems to copy many settings from animate diff. I like how they are working locally, as I refuse to use online tools. Hopefully they continue to update
@@aivideos322 Yes, I really like the ControlPose idea from this version. As I shared previously, I don't like the gambling flow that I experienced with all existing AI Video generator out there. Gen 3 , Kling, Luma, and even MiniMax , yes , they have good quality with high parameters and cloud GPUs. But no control, that is a big draw back.
The node setting concept , it does come a lot from AnimateDiff. Because KJ did a lot with AnimateDiff and other extend features of it. So I think when he create the code for this wrapper, he put a lot of that concept similar to AD. That is a good sign, as we play around with AD for a while.
when you're waiting for a generation and you play music, it's very bad. you should just jump ahead.
Oh really? Sometimes I do sometimes I don't. Depends on mood.
But haven't got this picky feedback from others.
@@TheFutureThinker hey dont worry man, i find a way to bitch about anything on youtube