AnimateDiff Legacy Animation v5.0 [ComfyUI]

AI Abstract Animation in Comfy UI and Animatediff
This Tutorial Explains the Making of : • Yad (Sped up) - Loopin...
Links:
1) Workflows: drive.google.com/drive/folder...
2) Mistoon Model : civitai.com/models/24149/mist...
3) Pyromancer Lora : civitai.com/models/131189/pyr...
4) My Other Free Workflows and Tutorials on my Patreon: / jerrydavos
5) My Discord Server : / discord
Other Resources:
Temporaldiff-v1-animatediff
huggingface.co/CiaraRowles/Te...
Put in : ComfyUI\custom_nodes\ComfyUI-AnimateDiff-Evolved\models
-------------------------------------------------------------------------------------------------
Song Credits:
NIVIRO - I'll Be There [NCS Release]
Rameses B - Keep You [NCS Release]
Its All Right [CreatorMix]
-------------------------------------------------------------------------------------------------
SEO:
Animatediff control net
Animatediff animation
Stable Diffusion animation
comfyui animation
animatediff webui abstract art ai art video
animatediff controlnet
animatediff github ai art animation
animatediff stable diffusion
Controlnet animation jdcn
how to use animatediff
animation with animate diff comfyui
how to animate in comfy ui
animatediff prompt travel
animate diff prompt travel cli
prompt travel stable diffusion
animatediff comfyui video to video
animatediff comfyui google colab
animatediff comfyui tutorial
animatediff comfyui install
animatediff comfyui img2img
animatediff vid2vid comfyui
comfyui-animatediff-evolved
animatediff controlnet animation in comfyui
ai animation
ai video animation
ai animation in comfyui
ai animatediff video
abstract ai animation
-------------------------------------------------------------------------------------------------

[@david_ce]

This guy and latent vision are a God send for the community

[@grafik_elefant]

true 👍

[@SahiShah-ru3ib]

Agree 💯

[@MisterCozyMelodies]

can`t believe this tutorial is out, thanks a lot!!

[@jerrydavos]

You're welcome!

[@MisterCozyMelodies]

@@jerrydavos thanks, today i tested and worked!! do you know where i can find OpenPose Library?

[@HooIsit]

Thank you!

[@grafik_elefant]

Looks very interesting as always. Curious about your face fix workflow which looks a bit different then previous versions? Version 3 made some problems with slightly blury results and faces went a bit too dark. Dunno what i did wrong. Have you ever tried text to video with controlnet combined? I really like what i get out but i struggle to get a stable background :(

[@jerrydavos]

Hey, previous face fixer worked on LCM, which can cause blurry faces, I'll be working on tutorial for background changer next.

[@YSakhAlex65]

Thanks for the lesson, I did it! Just one question: in the "OpenPose_Directory" group, you have the value 170 in the OpenPose column in the star_index parameter, what does this mean?

[@jerrydavos]

Ummm... I must have missed to change it. The value should be back to 0.
Btw I skipped 170 frames so It would also skip some dialogues of the reference video so only face motion is capture... not lips.

[@imbodo1549]

Is it possible to use this workflow to animate a video? I mean the animation moves according to the original video, not a moving photo? If so, what do I need to do?

[@jerrydavos]

Nice Idea but I don't think it can be done yet....

[@MisterCozyMelodies]

i`m getting rough transitions moves, do you know how to get smooth consistency, steady like yours ? in the group Saving, already put frame_rate 8, another think my Sequence OpenPose has 170 images, is it means my batch size is gonna be 170? if i want to use the whole OpenPose Sequence

[@jerrydavos]

1) I had render like 20-30 small videos first then pick one of the best video. It's a trial and error game.
2) you can play with animatediff's motion scale settings, for getting less motion.
3) Yes, You are correct, put 170 in the batch size same as number of openpose image.

[@provi1085]

@@jerrydavos Hey thanks for the vid!
1) you mean test generating like first 10 frames, and note down the best performing seeds?

[@jerrydavos]

@@provi1085 Yes, I change seeds, motion models, motion loras, it's weights and see which variables has the best result then I render that in longer video then upscale.

[@johnyoung4409]

Thanks for the tutorial! Can we animate real image? Using real image as input.

[@jerrydavos]

For openpose you can input real images... but can't animate like this with real image..... surely face can be swapped later

[@user-sb8bo5xc4s]

Error occurred when executing ACN_AdvancedControlNetApply:
'NoneType' object is not iterable

[@jerrydavos]

Check that prompt travel is not enabled...

[@LoFi-Odyssey519]

Can it be possible without GPU? I have a Lenovo laptop with Intel HD graphics. This is possible in my system?

[@jerrydavos]

Unfortunately No, It would be impossible to render this on Intel Graphics.

[@LoFi-Odyssey519]

@@jerrydavos I have one more question. If I rent a GPU Windows RDP rather than buying high GPU pc. The RDP should need full admin access or without full admin access it can be done?

[@jerrydavos]

@@LoFi-Odyssey519 Windows RDP does'nt have a RTX card I think... You might wanna go for Runcomfy.com or Runpod.io
It should work fine as long as you can access the input and output folders.

[@LoFi-Odyssey519]

@@jerrydavos OK. Thank you. Which plans should I choose? What kind of minimum GPU power needed to Generate this kind of high quality animations?

[@Lucas-uk6fj]

Can you provide pictures of openpose? Thanks

[@jerrydavos]

Here you go:
drive.google.com/drive/folders/17qs6fVPk6HgxJDEhH-dmF3YxXvkWik_U?usp=sharing

[@Lucas-uk6fj]

@@jerrydavos thank,Bro! I have succeeded，

[@arcanumopus1712]

Hai, wanna ask, when i activated the open pose, i get this kind of error , any advice ? Thanks
Error occurred when executing ACN_AdvancedControlNetApply:
AdvancedControlNetApply.apply_controlnet() missing 1 required positional argument: 'image'
File "D:\ComfyUI_windows_portable\ComfyUI\execution.py", line 151, in recursive_execute
output_data, output_ui = get_output_data(obj, input_data_all)
File "D:\ComfyUI_windows_portable\ComfyUI\execution.py", line 81, in get_output_data
return_values = map_node_over_list(obj, input_data_all, obj.FUNCTION, allow_interrupt=True)
File "D:\ComfyUI_windows_portable\ComfyUI\execution.py", line 74, in map_node_over_list
results.append(getattr(obj, func)(**slice_dict(input_data_all, i)))

[@jerrydavos]

Make sure you are connected to the proper reroute nodes.... Single or Directory, The Reroute nodes should be linked appropriately.

[@arcanumopus1712]

​@@jerrydavos Oh nooo thanks for the clue! wrong connected image to controlnet . it works now Thanks :D