ComfyUI CogVideoX 5B With Dimension X An Image To Video Generation - 3D/4D Video With 1 Image

[@domovoi_0]

Incredible. Thank you.
Love and blessings!

[@contrarian8870]

@5:15 Is it me or does DimX have trouble with the round table & the window bars behind it? It seems like the table morphs in and out of these bars.

[@insurancecasino5790]

Wow. Won't be long now before we can literally have an open sourced Kinng on our potato PCs. Amazing.

[@TheFutureThinker]

Fingers crossed!

[@imoonsea]

Báo lỗi:
Prompt outputs failed validation
CogVideoDecode:
- Exception when validating inner node: tuple index out of range

[@geoffphillips5293]

It's an interesting alternative to the Tora/Spline idea, which has been very entertaining to use. I suspect it won't be so good at what's effectively pretty much impossible, creating a 3D of say a movie scene where it won't have the context of what someone or something looks like from the front Looking forward to Cog 1.5 if that can be persuaded to run on 24 Gig cards!

[@TheFutureThinker]

Yes , looking forward to 1.5, I tried in server side btw, looks ok at the level of Mochi server edition, and higher res.

[@AB-wf8ek]

Oftentimes I find the hallucinations more entertaining

[@cmeooo]

Is it has NSFW Capabilities?

[@hicks100]

The default setting for each generated video is 6 seconds. Is there any limit to the maximum length? Why did I extend the time to 10 seconds (change num_frames from 49 to 80) and the generated videos are all grainy? The memory is 16G .

[@TheFutureThinker]

I did another method for extending video, yes its limited to 48 for img2vid

[@hicks100]

@@TheFutureThinker How to extend video time?

[@alexandreb.8350]

Hi, when i launch the QUEUE with all parameters like you indicate, i have this message ! "DownloadAndLoadCogVideoModel
'CogVideoXTransformer3DModel' object has no attribute 'encoder'" what can i do please?

[@SeanieinLombok]

can cog do generative image to video, or only the control net panning styles? O may have missed an earlier video or forgotten.

[@TheFutureThinker]

Yes, we have Control Net .th-cam.com/video/757I1wf1Slw/w-d-xo.htmlsi=ovuFFjfvK94GL_Qy
And there are some more updated CN Model available in updated version

[@TheRoninteam]

great video, thank you!

[@CHATHK]

Im gonna try this on my 3080ti 12gig vram and let you know!

[@TheFutureThinker]

Yes please

[@as-ng5ln]

that is insane stuff

[@kalakala4803]

that is awesome !

[@TheFutureThinker]

try it tomorrow ;)

[@VFXShawn]

I keep getting this error:
Prompt outputs failed validation
CogVideoTextEncode:
- Exception when validating inner node: tuple index out of range
Any ideas?

[@TheFutureThinker]

Update your comfy, update the custom node.

[@VFXShawn]

@@TheFutureThinker I did, I installed the updated comfy wrapper, updated the requirements, and updated my comfy, all the other cog video models and workflows work, not sure why this one is giving me trouble

[@michelmahieu6304]

I also encountered this after updating. Manually removing the custom node directory and reinstalling still didn't fixed it. 'My' version of the CogVideoXWrapper has a 'vae'-input instead of a 'pipeline'-input....

[@elukonoe990]

have anyone found a solution? i'm having this problem too, i installed from ComfyUI Manager Menu, then used update all, and update comfyui itself, but it doesn't help

[@michelmahieu6304]

@@elukonoe990 No solution found, would love to hear a solution!

[@TheEconoVision]

how can we extend video using Cogvideox ?

[@TheFutureThinker]

Thats great idea, will craft one later.

[@aerlantil]

Can I run this on Linux and with just a 2060s RTX ? what are the requirements

[@geoffphillips5293]

No, I don't think you can use CogVideo5B on your PC. You can use Runpod though, maybe 24 Gigs VRAM?

[@TheFutureThinker]

I ran this and consume about 7-10GB VRAm

[@CHATHK]

@@aerlantil i heard that in linux you will need more vram than in windows,

[@user-zi6rz4op5l]

​@@blender_wikiand you need to get a PC 😂😂