Cinematic AI Video With Stable Diffusion and LeiaPix
ฝัง
- เผยแพร่เมื่อ 22 ก.ค. 2024
- AI cinematic video maker tools, like stable diffusion are very powerful and you can create Amazing videos with it.
In this tutorial I will show you how to use cutting-edge artificial intelligence AI video editor tools to generate stunning videos.
We will dive into the intricate world of a free AI generator, called Stable Diffusion using Controlnet, Temporal Net, Tile Control Net, and Deforum. We'll explore how these elements work together within the Stable Diffusion framework to help you master the art of AI-powered video editing.
We'll also be taking a closer look at LeiaPix, a free tool that you can use to create dynamic videos from your images.
-Base_Deforum_settings file and Lightwrap tool:
ko-fi.com/digitalmagic/shop
-The Videos about in depth info about creating ai video with stable diffusion:
• Temporal Control net F...
• Unlock The AI Video Po...
0:00 Intro
0:09 the 5 aspects that affect consistency of ai video
2:13 create dynamic background with LeiaPix
3:17 create Navi character with free settings file for deforum in stable diffusion
5:53 weight start and end control settings for the tile controlnet to have influence on end result
7:22 use free light wrap tool to seamlessly blend foreground onto background
Links:
-convert.leiapix.com/
-obscurious video:
• 10 Free AI Animation T...
DISCLAIMER: No copyright is claimed in this video and to the extent that material may appear to be infringed, I assert that such alleged infringement is permissible under fair use principles. If you believe material has been used in an unauthorized manner, please contact the poster.
Music: TH-cam Library - Eternal Garden - Dan Henig - แนวปฏิบัติและการใช้ชีวิต
Nice! Looking forard to trying some of these tricks on our next project. Thanks for sharing.
you are welcome 🙂
Absolutely awesome video
i am glad you liked it 🙂
great approach i am also trying different settings..more videos on my channel..everyone is doing experiment with settings...but it feels good to have a good community member like you who is helping ....great work
thanx for your nice comment, i feel the same 🙂
I just found and subscribed to your channel. Looks **awesome**!!!
thanx i am glad you like it 🙂@@aaronvond
Thanks 😊
your welcome 🙂 i hope you enjoyed it...
Super!!!!😊
i am glad you liked it 🙂
Just used your setting in my latest video... thanks for that controlnet starting schedule setting i set tiles to 0.7 it gave amazing results and one more good thing i found is hybrid schedule to 0.05 give more stable result and CFG scale 3...my latest Avenger video is result of that settings
awesome, i will look at you channel for the video. i will try that with hybrid schedule to 0.05
did you mean your legend of zoro video?
it looks awesome!!
no just released ...sorry i forgot to make it public at the time of this comment...my bad
@@digital_magic
Having issues with getting the tile controlnetmodel to work in defourm. Is this a common or known issue?
no it isn't, have you tried to update controlnet?
@@digital_magic Thanks for the response. I think the issue was I was not going into img2img first? Not exactly sure but it started working. Anyways, I am actually trying now the tokyojab method in SDXL. Have you tried this yet? Also have you tried using the IP Adapter tool? Seems like an updated video could be good!
what i generate thru deforum doesn't appear anywhere. i cheked. is there a link between img2img and deforum? because i made all u did in this tuturial and other, and in img2img works all good, but when i try deforum is generating something else...
no there is no link between im2img and deforum. In deforum make sure to set the same settings. then you have to try generate multiple times in deforum, tweaking settings. Even the same settings vary a lot and can sometimes have amazing resukts and sometimes not so great results. Try and error....till you get the desired result 🙂
I follow exactly what is in video. Hit generate and...Error. :-( I´ve got this every time. Spend many days trials and...nothing worked for me. Error all the time everywhere. I don´t know, why it is sooooo difficult.
have you tried disabling all big extensions and re-install controlnet and deforum?
You could also ask for help in the deforum discord group?
Here is the link:
discord.com/invite/deforum
Why aren't you using AnimateDiff Motion Modules?!
Hey that sounds like an interesting idea do you know any good tutorials about it or articles?
Why not use open pose to track facial expressions?
i have tried that but didn't got good results.
is there a new open pose model? or how do you use it?
@@digital_magic There is open pose face, which takes face only. Also, there is mediapipe_face, which uses a different controlnet.
Maybe if you let the face controlnet start late you get better results?
Canny might be another good option. Tile is good to track the consistency then use canny for the facial movement.
@@aiartbx thanx for the tip, i have also tried that, but for this video these settings worked best for me. i think we are still in a fase where we have to trial and error a lot,...every video has a different approach i have the feeling at the moment.
@@digital_magic theres a new one, called DW openpose, i dont have the link right now, but i'm sure you can find easly, it has better tracking than the others, but takes a little more time to render
You could run 0.7 and 0.4 control starts and just mask the mouth out in post!
yeah for sure, good idea. i did something similar in my 2nd tokyojab tutorial
Kindly have an eye on future thinker tutorial he had an amazing technique but i am not able to load multi controlnet open pose options in last step kindly give try..
I am almost done with Google colab..
Please don't hesitate to use Google colab it is simple please give a try..
Which video do you mean from future thinker?
@@digital_magic th-cam.com/video/wnlFV9uE-Gg/w-d-xo.htmlsi=9qo_T2X-Q4Hy6PgZ
Simple and easy tutorial with Google colab
I am just not able to install multi controlnet with open pose..
Love all ur videos and fact my heavenly daddy who recently crossed over name is Lenny ❤
Thank you for your nice comment, I'm sorry to hear about your dad. I hope you are doing well and wish you all the best.
@digital_magic so sweet of u to.takd time to reply. It's a roller aster as healing tends to be but grief taught me things life never did. One day at a time and finding my way back learning top notch skills from magical creators like yourself. Thank u for being you. Super inspiring and starting to use all the tools I learn to turn pain to power on new channel 😉 ttys keep up the phenomenal work does not go unnoticed. Agaon thank u from myself my family and dad 😉 as his Lenny's life motto will live on #lifeisgood
@@agnesslovehealz Thanks again for your nice comment, especially when people like you who take time to write nice comments like you do, then you automatically want to take time to reply. I also recognized what you said about, that grief can teach you things life never did before. I have experienced this as well. sometimes it is hard when hard stuff happens in your life, but most of the times it makes you stronger. I wish you all the best and hope to keep in touch
Are you AV actor?
hahaha, i am a wanna be actor
Light wrap is 5$. I guess they watched your video and bump
He there and thanx for your comment, i am sorry i don't understand what you mean? which lightwrap are you talking about?
@@digital_magic I am an idiot. I didnt use your link and google lightwrap and got some "some" lightwrap wich costs 5$
Set the price to 0
yes you have to set the price to 0
Yeah thanks for the video but this still looks terrible.
slowly, slowly catch the monkey, ai will get better and better
hide your face!
what do you mean?