Animate MidJourney Images - Full AI Animation Workflow.
ฝัง
- เผยแพร่เมื่อ 15 พ.ค. 2024
- Checkout a cheaper and quick V2 of this type of workflow here.
• Bring 2D AI Characters...
In this detailed tutorial, I'll take you through all the steps to create a unique animated character and 3D scene from an original AI-generated image.
Find out more about AI Animation, and register as an AI creative for free at aianimation.com
Download some sample character and scene images (generated with Midjourney) for free here:
aianimation.com/ai-animation-...
Tools Used in this tutorial:
- MidJourney (You could also use Leonardo.ai or Stable Diffusion)
- Eleven Labs
- D-iD
- Runway ML
- Adobe Photoshop
- Midas (via Hugging Face) huggingface.co/spaces/jonjhig...
- Adobe After Effects (Plus paid plugin, 'Optical Flares')
- Adobe Audition.
Upscale Midjourney Images or video exports (i.e. from Runway ML)
Topaz Labs Video AI: (affiliate link)
topazlabs.com/ref/2271/
Times
0:00 - Intro
0:55 - What we're going to make
1:02 - Compromises
1:18 - Upcoming AI Tools
1:57 - Start of Tutorial - Image Generation
3:34 - Photoshop - Firefly
4:50 - Depth Map
5:35 - AI Voiceover
7:17 - Animate Character Head
8:19 - Runway ML - Background Removal
9:42 - Recap
10:05 - After Effects
23:07 - Finished Result & Outro
I've been using AE every day for over a decade and this is the first time I've seen someone connect the displacement map H and V values to the camera X and Y. Wow. Great technique!
Cool, I've had a few people say that's one of their big takeaways from the video. I was admittedly pretty pleased when I first tried it and it worked.
In this other video, I use the free Displacer Pro plugin for After Effects, which works a little differently so you can link up a camera created using the Camera Tracker in After Effects. (Which used orientation). Whilst it might not work in every instance, it's another handy technique.
th-cam.com/video/c3L7O-0gRiQ/w-d-xo.html
Also the simple but handy 'layer stalker' effect, used in that video, opens up lots of ideas too, that I'd not considered before in After Effects.
th-cam.com/users/shortsP6EzZmdq_ac?feature=share
As good as the AI stuff in this is, the most surprising take away for me is using a layer as a source for Optical Flares, I had no idea you could do that - so thank you!
Great work, high quality indeed, we need more tutorials from you. Thank you.
Im a complete novice in AE, been staying away from it and just usinf Premiere pro to render my finished animations. But my animation program now has a pipeline so Im finally throwing myself in. This looks so amazing, gonna make my kids storybook reading videos sooo lit once I finallt get it in to my brain!
I was looking for this everywhere but couldn't find it until I found this video. Thx so much 🙂 this is incredible 💯 best I have seen so far
Amazing ! Thanks for taking time to create and share with us this great tutorial.
This is super helpful! I've been looking for a tutorial just like this! Thank you!! And your website is awesome! I will sign up after I create my portfolio 😃
That was incredible. The depth pass and displacement map technique absolutely blew me away!
Thanks. Loving the content on your channel too. 👍
Great tutorial, thanks!
Ive used a lot of these tools, it's cool to see them in a full workflow
Great Tutorial! Love your flow and style. Thank you
Great tutorial, workflow and final result... Thank you!
Looks incredible, going to play with this for my next AI powered mockumentary
Great tutorial Jon!
I'm actually just starting a project of mine and you have no idea how much this helps. Thank you sir :)
Thanks for all the positive comments and for those that have already subscribed. Honestly, a little bit shocked as I checked last night and the video had 150 views after 3 days... then this morning it was at 3000. Thanks for the positive feedback, I'm working on a 2nd video with a deep dive video into using some more AI tools (with a good dose of traditional digital animation techniques). Also, I've added some high res character/scene images to download for free and try out the process in this current video yourself. aianimation.com/ai-animation-tutorials Cheers!!
Edit: Sheesh we've crossed the 100k views mark in under 2 weeks. 🤷♀
another thing, INO is better to remove the character and add the green screen before you submit to DI, it is cheaper and faster and you get better results.
@@AIBizarroTheater . I've not come across INO and google isn't helping. Care to share a link?
@@AIAnimationStudio sorry I meant in my opinion. what I do is: create image in Midjourney, separate character from background in Photoshop and add green background, import image to D-ID then export. your looks good too but this is way faster does not require runway. loved the tutorial :)
@@AIBizarroTheater 😅... oh.. my bad... 🤦♂. Cool, and yup 100% skip the RunwayML step and separate the character in Photoshop or similar. Think I got carried away trying to use more AI tools. 👍
@@AIAnimationStudio I did it like that too until I discovered D-ID works with a green background as well. Anyway come have a look at my work if you have time I am new to after but been learning quickly. would love to hear your thoughts :)
I’ve been making faceless videos but now I know why they suck so bad. I was just zooming the camera in and out. I need to get their mouth is moving and heads turning. Thank you for opening my eyes.
Completely mindblowing, thank you!
With so much ai hype you stand out in the crowd. Keep it coming brother!
I LOVE IT, a really good inspiration way to start animating with AI ♥ Thanks!
Wow blew me away subscribed for sure. A lot more techie than my knowledge but I am willing to learn. Great video
Love this video!!! Amazing work. I can't wait for the next one.
Thanks so much. A few more tutorials are now live.
Keep up with the great content. 🤘This was awesome!
Crazy how in 23mins you could inspire so many possibilities in how I work potentially forever. Thank you sir
Arrr... cool. Thanks very much.
I think this is the first video on TH-cam that uses a variety of AI tools combining with traditional design tools to create an amazing result! keep up the good work, looking forward to see how we all could do in the future a longer and wider scene without limits
Thanks.
It's interesting to see how we can all utilise the different AI tools to create something that isn't completely uncontrollable but still has a crisp finish and kinda efficient. Lots to learn, and different workflows to try out.
The one I'm working on now should be another interesting mix of AI and digital animation techniques, though I might try and make more of a story with it first.
@@AIAnimationStudio looking forward to it mate
Nice work. One suggestion is to isolate the character and put on green BG before D-ID. That way you can easily key it out when without Runway artefacts
Good tip.
I definitely recommended that approach to save the unnecessary Runway step. 👍
And also upscale x2 before You will use D-ID. You recive mp4 :) it will be easier to keyig with more data :)
Love it coz you even explained in depth ie - -ar 16:9 for landscape image not square. The way you speak it’s so soothing and easy to listen. Subscribed as soon as I saw the thumbnail.
Wow this is really cool! Happy to have found this video!
Great tutorial! Keep it coming. Ty much.
That was amazing. Thank you so much.
Great tut, clear and to the point… many thanks!
Thanks for commenting. Good motivation to make more. 👍
Ive been animating ai images for about 40 hours total. It's so fun and satisfying to see them come to life. It's true that the ai images typically need a few touchups and a color grade, but the end results are beautiful. I made a cyborg enchanted SS Blue animated wallpaper that looks insanely cool.
Im def going to try some of the tricks in this vid! Thank you :)
Great to hear. The various AI tools are opening up a lot of creative options, and when combined with some more traditional animation/media skills the outputs can be great!. Good luck.
This is wonderful! Absolutely wonderful! I've been working very hard to learn different techniques and expand my animating skills. This is exactly what I was looking for. It's very easy to understand and follow and you don't zoom through it and skip over steps. Thank you so much!
Thanks so much. Likewise I've been jumping through a wide range of new AI tools to find ones shown in the video (and others) that I like and can be combined with traditional techniques to create something a bit controllable.
what sort of AI tool do you use sir? Are you working alone or you have a team with similar interest and goal?
Amazing work!
Congratulations for your creation
Very incredible video , appreciate for sharing 🙇♂️
This is brilliant. Thank you so much!
Thank you for sharing .. so important - Love it! 🙂
the map displacement trick was *explodes* mind blowing
Thank you for your video, it's exactly the kind of animation I would like to make. Perfect for a beginner like me who is looking for his answers, can't wait to try your method.
Absolutely fantastic
incredible.. thanks, learned a lot of things along the way😮
Bravo! I am amazed that this can be done with such ease!
😅 yeah, that was super easy.. For you maybe. For person who never had anything common with animation, like me it's a magic. So much steps, different website(subscriptions plans) just for 5s animated picture 🙈 at least I know now how hard is to make professional animated movie
Great video! Concise and to the point. Keep it up
Cheers! I'll definitely try and get into the habit of making more over the coming weeks and months.
absolutely awesome! Thank you 🙏🏻
Fantastic work mate. Well done bouncing back from the system crash too! Always the way isn’t it! 😂
Mate! Whoah! Much respect for sharing your workflow. I have long been using AE etc and was wondering about how best to get into Ai for a while. You have kicked open the door to a whole new wold. Cheers!
! Thanks so much. Glad you liked the video. Coming from a world of hand-drawn and digital animation for the past 20 years... I was also (after the initial panic) keen to find out ways to integrate some of the new AI things into my day-to-day work. Still can't beat the control of a well-crafted AE project for exact client work, but this AI stuff does open up a lot of new ideas and possibilities.
This is wonderful! Absolutely magnifique :D
Wow..thank you for your video ! Learned something new ! Subscribed ❤
Absolutely fantastic video, one day definitely my channel will be at this stage. Good Work man 👍🏼
Great work. thanks for sharing!
Very cool animation!
This is amazing!! Keep creating! 💖🫶🏻
Very impressive!!
Really really awesome video.
Pure simple beauty... 🔥
Thank you, this is a fantastic tutorial!
Thank you! This really helped me out.
Cool, great to hear.
This video deserves more than a like or subscribe. Thank you!
Glad this popped up . .you got mad skills
😀 Thanks... appreciate the 'mad skills' comment.
omg, this is so beautiful 🙂
Great! Thank you very much.. I just learned cool new stuff.. 😎✌🏻
top shelf resources and quick composite.
Incredible!
Thank you! I’ve wanted to try this with my videos on my channel. 😊 Subscribed!
Amazing, thank you!
The Ai kids looks like you as a kid. Also, I'm glad I can rewatch this tutorial, it has so much good information
🤣.... errrrm... thanks 🤷♂
At one point everything sounded so foreign to me. I'm sure after I watch a couple of more times I'll get it. Thank you for this!
Thanks for commenting. Hopefully, you'll get there in the end. The After Effects a bit can deffo seem a bit over whelming if you're not familiar with the software. Good luck.
this is so beautiful, man. +1 subs
thanks! great work
This is very impressive. Thanks for the share
from a guy who has no idea of how to use adobe premiere this process looks extremely hard and time consuming ,especially given the tech limitation .but thank you for sharing this detailed workflow, much appreciate it.
the amount of money and time you have to spent just to create this short few sec video is crazy
Thanks.. yeah it does take a good bit of effort to create a more involved scene. For a simpler version, you could just use a wide image of the scene with your character and send that to D-ID and just use that output, but you'd miss out on the 3D depth effect. But then have a look at something like Leiapix to add some extra motion relatively easily. (*I've not tried it out myself).
Fantastic! Thank you!
Great Thanks for the video. Subscribed!!!!
This is super cool.
That was great bro looking forward to learn more from you new sub 🎉
That's a huge talent, my easy hack, will be a very detailed prompt with midjourny ( dept of field and all ), then dale E, and of course elvenlab, and will sort the camera movement with FCPX and/or Capcut for flare and lighting. Thanks for the video it really nice
Great lesson, thx buddy 🙏
mind-blowing
It's Really Amazing Superb !
Holy shit this is nuts
thx for making this
wow that was awesome.
Parabéns que conteúdo incrível,merece um like , perfect
Great video. Thank you very much!
Amazing!!
Great work and tutorial...I loved it.
encore..thank God i found this channel..i want to explore and learn more.. keep it up sir..
Thanks very much. A new 1 hour long video using Wonder Studio / Blender / Mid Journey/ Runway ML / Topaz AI / Chat GPT ... and a lot of After Effects should be live later this evening.
Very very good!
amazing, thanks so much!
Nice!!!!
Really Great Video.
At the right time, we will have a conversation, AI Animation. I promise you will not be disappointed 😊
awesome 👍
13:02 Linking displacement map to a camera and separating two compositions to differents windows were eye openers to me
incredible!
Cheers...
Thats amazing . Thank you for sharing . A little intimidating but I'm convince I could learn how to do this.... With time, and patience.... Lots of it...
very helpful video, thank you
Awesome tutorial video, I am gonna fail to get this done on my Pc
I've subscribeed. I got lost after the Runway part :)
Thanks for subscribing... good feedback... sorry if the After Effects bit was a bit too quick or too techy.
i love you. great tutorial
Wow, thank you. Quite a lot of commands going on there for a rusty old retired person, but extremely cool video, and very inspiring, things sure have changed. Subbed.
Thanks @gilldanier4129. Feel like a rust old person here too. Hopefully, the 'version 2' video I'm working on for this will be a 'little' bit more straight forward. But yep, it's all changing quite rapidly at the moment. For example, Dalle 3 for image generation is now live this week (currently available via Bing Image Creator), which is providing some good results and provides a free alternative to Mid Journey. (*Not yet as good or as controllable, but it is another option).
Thank you, I will check out Dalle 3.@@AIAnimationStudio