RunwayML and Leonardo.Ai Tutorial - Ai Text to Image/Video/Animation Generator - Ai Tutorial
ฝัง
- เผยแพร่เมื่อ 14 พ.ค. 2024
- Learn how to use AI to create a 3D animation video from text in this tutorial! I'll show you how to generate a 3D animated video using just words by leveraging the power of AI technologies like Leonardo.AI, Runway ML, and Adobe Premiere Pro. First, we'll use a prompt in Leonardo.AI to convert text into an image, then take that image into Runway ML's GEN 2 feature to style it into a 4-second animation clip. Since Runway has a time limit, I'll demonstrate a technique at the end to bypass it using Premiere so you can extend your animations. The goal of this AI tutorial is to craft stylized 3D animated videos entirely from text without any design or animation skills. So join me to discover how simple it is to leverage cutting-edge AI like neural networks and machine learning to auto-generate creative video content from words!
00:00 - Intro
00:30 - Process
00:45 - Text to Image - Leonardo.AI
03:11 - Image To Video - RunwayML
04:50 - Extend Video Length - Premiere Pro
07:55 - Outro
Another Artificial Intelligence (AI) Tutorial :
Generative Fill AI Photo Editing
• AI Image Editing - Ado...
Adobe Firefly AI Tutorial: Generate Stunning AI Images Better Than Midjourney
• Turn Your Text Into Re...
Adobe Firefly Tutorial : Text To Image AI - Free & Online Art Generator
• Bring Creative Ideas t...
Freepik's AI Image Generator Tutorial
• Freepik AI Image Gener...
LEONARDO.AI Tutorial
• LEONARDO.AI Tutorial -...
Adobe Firefly AI Free & Online : Generative Fill & Text-to-Image AI Tutorial
• Adobe Firefly AI Free ...
My TH-cam :
/ imanglobal
![ตรงที่เดิม - ฝน พรสุดา [ต้นฉบับ : เบส ขวางหวัน]](http://i.ytimg.com/vi/c5YnbGEztI8/mqdefault.jpg)
Awesome tutorial! I actually had a trick to extend the Ai videos... but this one actually takes it to a whole new level. Thank You for sharing it!❤p
I'm glad you found it helpful! Thanks for the kind words.
Awesome tutorial! I actually had a trick to extend the Ai videos... but this one actually takes it to a whole new level. Thank You for sharing it!
You're very welcome! I'm glad you found the tutorial helpful
Hi good morning can you tell me how can increase the tutorial limit my I have been finish my fist task of Runaway and That required purchase plan while I m learning And dont have the more skill 😊😊😊❤❤
@@Awwcatsandpets Like the above tutorial teaches, once you generate (animate) the first 4 Second Video of an image, place it in your favorite editor, then (very important)... grab a Still Frame from the very-last-frame of your first Runway video animation. Save the last still frame on your desktop, and re-upload that same still frame back into Runway, and create a NEW animation from that last Still frame. Runway will then create an animation "starting" from your still frame. Once you have the NEW (2nd) Runway animation done, you can then bring it to your Editing System and paste it back-to-back to your previous animation, and your animation will double its length to a total of 8 Seconds. And you will not see a jump-cut on the video, it will be seamless. If not, you may have not selected the very last still frame from your first animation.
Nice and smart tutorial! Keep this valuable work on .
Thank you, I'm glad you found the tutorial helpful.
Your video production quality is top-notch. keep it up! 😄
You're welcome ❤
Great job&teaching❤Thank you Dear
You're welcome 😊❤
Great tutorial! I think it could be really interesting for video editing enthusiasts.
Hey, thanks so much for taking the time to leave a comment! I'm really glad you found the tutorial interesting and useful.
That's because you are not using negative prompts
Awesome tutorial! I actually had a trick to extend the Ai videos.. thanks your sharing
You're welcome! ❤❤
Awesome tutorial and thanks for that.
Thrilled you took the time to comment.
Awesome tutorial and thanks for that. My question is can we add subtitles and custom audio to these videos? if yes, please create a tutorial for it. Much appreciated.
Yes, it's possible to add subtitles and custom audio to videos. I'll create a tutorial covering that process in an upcoming video. Thank you for the feedback and suggestion - please stay tuned!
Yes do it in post
Bro you’re monster in Ai thanks so match ❤❤
Thank you so much! I'm glad you find the AI content helpful.
Thumbs up for the content man.
I appreciate your positive feedback on the content. Thank you!
your teaching process is Very nice
Thanks and welcome ❤
thanks so much. Your video is very helpful
Glad to hear that!
It came out very quickly, you helped me a lot, thank you 👍👍👍👍
Glad I could help.
Can we monetizethese videos?
Yes, such videos can be monetized, but in any case you should read the rules of the AI that you use to create videos and abide by them.
Great video!!! One question, if I want to use the same character from my image to make a new scene how can I do this? As I want them to look the same and be wearing the same clothes but in a different scene?
Keep up the great work!
I completely understand your problem. The Seed system is used for this purpose but the point is that some AIs still don't have tools in this area or the Seed system doesn't work properly in them. I will soon prepare a tutorial for this issue. Please wait.
Excellent
Thank you so much 😀
Awesome! Thank you!
You're welcome!
Awesome 🎉
Thank you, I'm glad you enjoyed it!
good trick!! Im gonna try this instead of adjusting my speed to make the animation longer 😂😂
Great, hope it works well for you!
Cảm ơn đã chia sẽ!. Tôi thích kênh bạn. Rất lợi ích.! ❤❤❤❤❤🎉🎉🎉😊😊❤😊😊
Thank you kindly for taking the time to leave a comment!
Thanks for valuable information ❤
I'm very happy to have you here. Thank you so much for the comment, I'm really grateful. ❤
This was a great video!
I'm happy you found it worthwhile.
That was really good!
Your kind words put a smile on my face, thank you!
Thank you making amazing video.
Thanks, I'm glad you enjoyed the video! It means a lot to hear such positive feedback.
@@ImanGlobal Keep the spirit alive
Amazing!!
Appreciate you! More videos on the way.
that was so good thanks
you're welcome
AMAIZING
Thank you!
Amazing video
Thanks for the visit
awesome thanks 😀
Welcome 😊
Wow amazing 🎉
Thanks 🤗 ❤
nice work
So glad you liked the work! 🌟😊
Subscribed , nice tutorial. Thanks!
Videos downloaded are not working in Cap cut and not getting uploaded in Canva for editing. Pl any Clue for me to edit
Thank you!
The downloaded videos are in MP4 format and should work in all editing software such as Premiere or even online platforms like Canva. Perhaps there was an issue when you downloaded them initially - try re-downloading the files.
Or you can convert them to a usable format using converter software as a last resort.
Great tutorial. Thank you very much. How do you add text so that they can talk?
Thanks. I will cover this topic further in upcoming tutorials. Please stay tuned.
nice tutorial
Thanks
Hello, man! I recently saw your video, and loved the results. But I do have a question... do you know how could i get the runway AI to make my android robot talk? I can't make it open and close the mouth of my character.
Thank you!
You can use Motion Brush on the mouth region, mask it, and include words in the prompt like "talking", "conversation", "discussion", etc. so that the AI focuses its attention on animating the mouth.
thank you!!!
You're welcome!
0:53 avanco social é o melhor de todos pra bombar o tiktok
I apologize, I did not understand your meaning.
Awesome......🎉
Thanks ❤
Thank you
I'm grateful for your feedback.
nice one that I watched in youtube
Thank you so much for watching the tutorial and for leaving this comment. I really appreciate it 😊💖🌺
Bro that's great i see all the video and i was following your steps but does Adobe premier pro works on Ethiopia i wanna creat an account but it doesn't works so does Adobe works on Ethiopia??
Thanks for watching. Unfortunately I don't have info on Premiere Pro availability in Ethiopia. Some good free alternatives to try are OpenShot, Shotcut, VSDC Free Video Editor, and Lightworks. Best of luck with your video projects!
thanks
You're welcome!
Excellent!! How to get the same character in a different scene? Each time the character look different
You need to use fixed numbers in the Seed section for this purpose, so that the faces remain consistent. In the near future, we will have a tutorial on this topic. Please stay tuned.
Bravo
Thank you!
That’s really smart
Thanks 😊❤
Is it possible to generate a specific action sequence based on the ai generated picture? How would one do that?
My opinion is to first ask an AI like ChatGPT to provide you with a prompt containing different angles, settings and all the details of the action sequence, then use an AI like Freepik to convert the prompt into an image based on it, then convert the images into a video using an AI like Pika. Finally, you can edit it and get the output using software like Premiere Pro - Capcut.
Hi please tell me can we generate the same character or image from Leonard AI for the continuation of our project
Yes, it is possible. I will definitely cover this topic in upcoming tutorials.
отлично!
Thank you for your comment. I appreciate the positive feedback.
Мы с другом поспорили, я напишу как есть: " я из Казахстана". Ты знаешь такую страну? Я думаю не знаешь))) Ответ твой : знаешь, не знаешь@@ImanGlobal
Конечно - это к твоему делу не относится, но всё же
Merci
You're welcome! 💕😊
Would be helpful if the AI can actually create a 3D model for such character animation, that can be imported into Blender, not just continuous 2D images of the 3D character.
Thanks for the feedback. Generating 3D models from AI that can be directly imported into Blender is an interesting idea. I'll look into the capabilities of different AI techniques and see if there are ways to produce 3D output in the future. Stay tuned!
There is already something like this. I saw a video about 3 d planes you can put in blender and created by AI
@@ImanGlobaldon’t waste your time. It is not possible. Models generated in AI have a very bad topology not suitable for animation.
Nice
Thank You
Bro which software do you use to zoom in and that yellow highlight thing while showing the steps?
I use Filmora. Good price and has everything a basic and advanced editor needs. Within most video editing software there's something called "crop and zoom".
@@AvisTwinkleTimeStories but filmora is paid software right? And also has watermark
I use Camtasia.
@@ImanGlobal ok thanks bro
Pls I will like to learn how this is done, as a complete beginner
I did a video a week back.. it was a guge disposable cup flying.. when the cup fly then textture of the cup changes.
I asked many people all they said was something to do with motion ..but did not explain clearly.any solution?
You've posted this several times in my TH-cam channel. I've already responded to it before, and there's no need to repeat it.
Nice video. What marketing do you use to promote your videos and channel?
I don't do any advertising or marketing. I have only been creating content on TH-cam for about three years now.
Ok thats cool. Nice video!@@ImanGlobal
*Should we only use adobe premiere pro on part 3? Are there alternative application beside it??*
Yes, you can use all video editing software such as DaVinci Resolve, Final Cut Pro, Edius, etc.
@@ImanGlobal *are those free too??*
The software that I mentioned are not free, but you can find free alternatives to them with a simple online search.
I'm a newbie. So basically I cant create a 10-second+ video on LeonardoAI. If I want to go beyond 4 seconds I need Adobe Premiere? thanks
In the tutorial you commented on, I showed a technique to increase video length. Watch it carefully so you can create videos longer than 4 seconds on Leonardo.
How can I use my photo as model to generate 3d image? As well as in animation using my image. Thanks
That tutorial you commented on is actually about this topic, so it would be better if you took a closer look at the tutorial. AI tools like Runway have an image to video feature where you can upload your own image and then type in the prompt text box the desired style, which in this case is 3D animation. It will take your image and transform it into an animated video in that style. Checking out the tutorial more carefully could help explain how it works.
Great tutorial! What about voice with lips sync ?
Thank you. I will cover this topic further in upcoming tutorials. Please stay tuned.
So for a one minute video you would need at least 10 images and then to animate those images. How long does that process take? It takes me days just to make a 1-2 minute TikTok explainer video changing images every 2-4 seconds. Trying to decide if this could be done in less time because I am starting to burnout. I haven't taken a break in two months. Like from the time I wake up till I go to bed, seven days a week.
I completely understand your situation. Producing high quality videos does indeed take a lot of time and effort, and can really only be sustained if you truly enjoy the work. I face similar challenges making my own videos, but the good thing is that over time things do tend to get easier as your experience and skills grow. As you gain more practice, tasks become quicker and more streamlined.
how can use same face throught out the video?? Please make a video at this.
You need to use the Seed system. In the virtual influencer tutorial, I covered this topic with a new method called Face Swap. Watch the tutorial on my TH-cam channel to learn this technique. I will be making more tutorials on this topic in the future as well. Please stay tuned.
Are there any other free platforms that can do the extended video trick?
Pika and Runway now have a completely systematic option inside themselves to increase the length of video. It is presented with something like an "Extend" button.
Pls how do you insert audio into it. Make the images to talk.
There are two solutions:
The first solution is that you add words like (talk, conversation, dialogue etc.) in the prompts so that the AI can create a talking style for the character and then you can add your own voice to it in editing software.
The second solution is to use AI avatar builders and create a dialogue mode for images in these AIs.
In the near future I will create a tutorial for this topic.
Curious Refuge hosted an AI "Film" contest using just Runway Gen 2 last week. I noticed all the artsy images had very little movement because Runway Gem 2 is crappy at movement and I had to hold my breath because when there was more movement than usual, I was positive the next second it would distort into a super scary face/body like my videos do using Gen 2. No wonder almost all of the videos were Sci-fi or Horror. Hands and even arms are a disaster and don't try to make a cartoon for kids - no kids allowed, because their censor just assumes you're a pervert. I can't wait until Moonvalley will accept reference images, I don't care if it's expensive. It can't be as much of a ripoff as Runway Gen 2 (just figure out what your little experiment is going to cost. You'll be shocked.) I'm even willing to repeatedly use Pika for a few seconds and just line the clips up using a separate "Final Frame" tool to get something long enough to use - anything to not use Gen 2.
I too have faced the problems that you mentioned, but with repetition/testing/experiments/attempts and error, I was able to achieve good results. I hope your issues can also be resolved and that Gen-2 improves.
It's look like good one question how to add audio?
Adding audio deserves a separate tutorial, I will create one about it soon. It's better to use desktop software like Premier Pro or mobile apps like CapCut or online editors like Canvas for adding audio to your edits.
Great job 💯 , but is it for free??
Do we get 125 sec credit every 24 hrs in runway like in Leonardo ai?
Unfortunately with the free Runway account, credit is not refilled after being used up. You'd need to switch to a paid plan for continued access after the free credits expire.
nice
Thanks
These type of AI videos are able to monetise on youtube or not? Do these videos comes under community guidelines of thr youtube
Yes, such videos can be monetized, but in any case you should read the rules of the AI that you use to create videos and abide by them.
Okay, next step is a writing the AI network in Blender! And everyone can create a themselves cartoon and movies, cause a models is a lot in the internet!
And this is why the AI never replaced a human, because only human can imagine something odd and new, which never excisted in universe!
Good point. AI can be helpful for generating some content, but humans will always be needed to push creative boundaries with novel ideas. Looking forward to seeing what people produce using these tools!
Hi. Leonardo has image to video? Please why didn’t you use it or is this other image to video better than Leonardo?
At the time of publishing this tutorial, Leonardo didn't have the image to video feature. This feature has recently been added to Leonardo but is still in its early stages and lacks many capabilities. However, it's certain that more features will be added to it in the near future.
how di you make your characters walk so clearly?
By continually refining prompts and feeding more data, along with repetitive effort, we can collaboratively reach novel outcomes.
Sir, a video on how to add lipsing with emotion in this video❤❤❤❤
In RunwayML, you can use the Motion Brush tool to mask the mouth area and also during Generate, add words like (speaking, conversation, discussion, emotions, etc.) in the prompt text so that the AI focuses its animation on mouth movements expressing the intended emotions.
Like this...
Thanks
How to make similar characters? in leonardo, with diferet positions, scenes;
You should use the prompt system to generate different character poses, and use the seed parameter to keep the character itself consistent. The prompt system allows you to describe poses and configurations for the character to take, while the seed ensures it remains the same identity across different prompts. Wait for future tutorials.
Good info but very limited if I can't create a video from my personal art.
And in general it's not that fun for me to follow a tutorial with a narration of an A.I voice.
Thank you for your feedback. I tried to make the tutorials step-by-step. You can even mute the audio and just follow along visually. Also, please note these tutorials are free. I appreciate you taking the time to watch and provide feedback to help me create better content.
Please tell me about the voice you used from ELEVENLABS! Please
In future tutorials I will discuss this topic. Wait for it.
Like dado 🎉
Thank you for taking the time, I'm glad you're liking it!
❤❤
Thanks 😀❤
Please help me , how can i work in premier pro, it's not easy
There are many Premiere Pro tutorials on TH-cam. With time and practice, you can learn. The software is designed to be accessible.
Hi, if ì wish to create a children song , how can I do it? I have the words and tune
I am currently working in the field of creating artificial intelligence-based animation videos. However, I will soon be preparing some tutorials for creating music with artificial intelligence as well. So stay tuned!
any info for text to voice free one?
Some free TTS options are Natural Reader, Ivona Text to Speech, and Fluency. They allow converting a small amount of text daily without charge.
Hi ,i am using mobile
Actually I opened Leonardo .ai app but I cont able to create 3d animation images
Please show me clearly
And how to create gen2 image also
Adobe premiere pro how to use and
Runway Ml
Pls explain clearly sir
In this tutorial that you commented for me, everything has been explained. Watch this tutorial thoroughly and carefully. Additionally, there are many other tutorials on my channel about Leonardo's artificial intelligence and Runway. Browse through all of them so you can use artificial intelligence to create the images or animations you want.
If you need the characters to talk, I guess you use D-Id
Yes, using a D-ID face avatar is one way to have characters talk in videos. I will cover facial animation and speech synthesis techniques in an upcoming tutorial. Thank you for the suggestion - please stay tuned for more details.
Aslamualekum brother i from india❤
❤ Thank you for your comment. I'm glad the tutorial was helpful for you in India.❤
Adobe premiere pro how to use explain clearly
While I'm currently focused on AI, there are many great Premiere Pro tutorials available on TH-cam that can help explain how to use the software. I'd recommend checking some of those out as they'll provide comprehensive guides to Premiere Pro's full capabilities.
Great job 💯 but is it for free?
Both Leonardo and Runway provide you with free credits upon creating a user account to use their features. These credits are recharged every 8 hours in Leonardo, but they are limited in Runway.
How to add voice in this and lipsing too.
I'll be covering this topic in upcoming tutorial videos, so stay tuned!
Will this website work well on mobile?
I only work with desktop PCs and I have not tested it on mobile.
Why not just use the "Extend 4s" feature in RunwayML instead of doing it manually?
At the time this tutorial was created, the "Extend 4s" feature in RunwayML did not exist.
@@ImanGlobal Haha it did, it's in your video but you missed it. 🧡
I am very grateful that you paid attention to this important point. To be honest, I recorded this tutorial based on the requests of viewers of this channel, to remove the time limitation that exists in most AIs like Pika, Moonvalley etc. When I recorded this video, I did not think that this feature existed in RunwayML, probably it had just been added around the time I recorded the tutorial. Thank you for pointing this out, it will help me improve the accuracy and quality of my future content.
@@ImanGlobal Your tutorial is excellent either way. You left no way for any new beginner to be confused or lost.
I really appreciate your kind comment. Thank you so much.
Hello, how to put voice on the video?
You should use a video editing software like Adobe Premiere or an online editor such as Capcut. I will be uploading a video about this topic in the near future.
Thank you, I am waiting your video about this topic
👍👍
Thanks
I have a silly question. It is a free app.?
Both Leonardo and Runway give you free credits and tokens after creating a user account. On Leonardo, the credits recharge every 8 hours but on Runway they do not recharge. Both also have paid plans in addition to the free plans.
How can I make ai version of myself ? Please tell any free app
You can input your own photo into an AI system like Leonardo and, through the image-to-image process, transform your image into a variety of styles such as cartoon, anime, and so on. Alternatively, you could take that image to a tool like Runway and, using their image-to-video capabilities, convert it into an animation or video.
Make a long ai video by these arrangements
Thank you for your suggestion, I am thinking about it, maybe I will do this work soon.
But how we can remove water mark
In the services that are included in the paid membership plans for these AIs, the watermark is removed. If you have a free plan, you can blur that section of the photo or video using editing software.
You can do the same thing in Runway without using Adobe but no matter what approach you use, the quality will get worse the more times you do this.
Thank you for your comment, I appreciate you taking the time to provide feedback. In my view, Premiere has a large number of features and the tools used can vary depending on different needs and requirements.
@@ImanGlobal Using AI to reply to youtube comments? :D
@@dragosdydy I personally read all the comments because they are very valuable and important to me and I have tried my best to personally respond to all the comments on this channel very respectfully. In today's world, we can take help from artificial intelligence to solve important challenges, but ultimately we humans control artificial intelligence and use it for our own benefit. Thank you for commenting.
It’s funny no one talks about limits of AI, the huge amount of terrible images before a right one, the incoherence between images that make not possible create even a serious and middle quality short movie, and so on.. everyone talk about incredible power of AI, and nothing about how silly it is in great part of the workflow. I thank you for your video, but seriously, those animations sucks.
Ai is not good in general
You're right that in its current state, AI has significant limitations and struggles to produce truly coherent work. However, I believe we're still in the early stages of AI development - the technology is rapidly evolving and advancing at an unprecedented pace. In the near future, I'm confident AI will progress to a point where it can generate images and content of much higher quality. For now, the focus should be on the learning process.
Solve the Prompts, learn them. It’ll all be fine
I thought you did well , don't listen to the haters 💖💖💖💖💖💖💖💖💖💖🥰
You done it well bro thanks.
Is this considered a copyright?
Yes, all content uploaded by me or other channels on TH-cam is copyrighted. Nobody has the right to reupload full videos or significant portions of them without permission from the creator. For more information, it is best to review TH-cam's copyright laws and policies.
How to add story?
I didn't understand your meaning! It's better to watch the tutorial again with more attention.
Que show
Thanks for taking the time to leave a note.
🎉
Thanks