How to use Runway's Motion Brush
ฝัง
- เผยแพร่เมื่อ 8 ส.ค. 2024
- Elevate your AI image-to-video skills with Runway's Motion Brush, a versatile tool that introduces a new level of control to your generative AI creative process. Runway's new Motion Brush tool in Gen-2 lets you choose which part of an image you want to move, as well as which direction it should move. This is supercool for AI image-to-video generation, giving AI video creators even more control over the videos we create. This demo was my first look at Motion Brush and here are some chapters:
HERE IS A NEWER VIDEO ABOUT MULTI MOTION BRUSH:
• AI animation control u...
📖 CHAPTERS
00:00 Intro
00:36 Motion Brush gives more precise control over animation compared to previous image-to-video
04:03 Text Prompt and Motion Brush for more emotive, non-directional movement
06:09 Camera Movement and Motion Brush can be used together and moved independently
08:05 Do you always get the best result using Motion Brush for image-to-video?
UPDATE: You can also use Motion Brush on text-to-video preview images!
• Runway Motion Brush #r...
#aivideo #aivideocreation #aivideotools #runwaygen2 #runwayml #runwaymotionbrush #motionbrush #imagetovideo #gen2 #aivideotutorial #howtomakeaivideo #howtomakeaivideos #createaivideo #aivideoeffects #aivideoediting #aiart #generativeai #aiinnovation #aivideos #aivideotrends #futureofai #aivideocommunity #weirdAI #AIImageToVideo - ภาพยนตร์และแอนิเมชัน
Here's a tutorial on the newer Runway Multi Motion Brush: th-cam.com/video/P41bfQrsgDY/w-d-xo.html
Proximity is used to move in the Z-axis direction, toward the viewer or away from the viewer.
Thank you for taking us along on your testing. Picked up some tips. 👍
Oh, awesome man, thanks for showing me how to brush. I can't wait to make a short film
Awesome, I'm glad it was helpful! Good luck with your short film
Excellent inspiration!
Thank you for watching!
I began using it a few days ago, and I often just want little movements like the fire animation in the fireplace, or candle flames, and the result is usually hit or miss. And sometimes, it adds ships in the water on its own. It works great on clouds though.
Anyways, Thanks for the video!
I had the same issue with a fireplace. I wish there was a brush that was like a negative prompt ("don't add motion to this area").
I add things to my prompts that act like negative prompts. For example, "Clouds moving left to right, while the moon is static." The bit about the moon is the pseudo-negative prompt that reduces potential morphing. I paint the direction of the cloud motion over some of the clouds AND adjust the motion sliders. The length of the brush strokes, combined with sliders, can create nice slo-mo effects.
@@georgew2014 Thank you, I appreciate it
I want to use this to animate movement on a fireplace does this work correctly for it? Or is there an alternative for animating a fireplace please? @@aivideoschool
@@georgew2014This tip is awesome. Thank you!
Bah-rooooooooo!!!! I knew it, I kneeeeeew that I was going to LOVE the future (Speaking of 10 year old be back in the early 90s) Well, there are things about the modern age but this is cool
Great video. Which video editor software do you use to have better animated flames in the fireplace behind the dragon. Can you make a video to animate flames in fireplace.
I usually use CapCut but I used Premiere for the dragon fireplace video because it was easier to mask. I generated 5 or so versions then did a reverse mask so the animation from the fireplace played over the still image.
8:45 AI will still read the entire image and respond, which is great. Note. from the girl in the train it made the girl eyes wink to the sun rays. So here, it made all that it identified as "water" to also animate. I think the brush is mainly to control direction and fine detail, like the dragon and fireplace. but it still tried to adjust room lighting to the flames.
If you paint only one side of a head and then use the horizontal control to move the head a tiny bit, the back of the head might not move. It's tricky
I wish I had tried this in the demo, it seems like the right approach
Everything on image animation is "tricky".
I haven't been able so far to make any decent looking video no matter what I try or what website I use. Much less get the exact movement I need.
I feel like giving up on AI video generation.
@@ronilevarez901 I hear that. One has to tailer story telling to what outputs the generator provides. It is super-hard to write like that. The other suck is the artifacts in everything, there's AI artifacting in what were once reputable shows, it cheapens them to forego editing out artifacts where possible. This is why I do what I do, it is something that AI is passable at.
@@RoofAndAMeal4UsAll Well, I can write stuff from anything I get put in front and steering the story to anywhere necessary. That wouldn't be a problem. The thing is, I don't want to do that anymore.I want to tell the story that I already have in my mind/paper so I need to make the exact animation I need.
Sometimes I wonder if these tools weren't created to show us how much professional animators are needed! XD
@@ronilevarez901 I understand. With the short Sasquatch film I made I wanted to do much more than the tech would provide. Runwayml Lip sync doesn't work on animated characters as i'm sure you know which makes it about useless. th-cam.com/video/rQ9r3dAqiOc/w-d-xo.html. th-cam.com/video/_hjXcRiQcHA/w-d-xo.html. I think we have to perservere until such time as the tools mature enough. If we want to upset the status quo and move up from fine artist to storyteller/producer. Keep pushing forward!
What system and browser are you using? My version doesn't look anything like that on windows chromium.
I'm on a MacBook and use Chrome for Runway. (Runway seems to work better on Chrome than Safari for Macs.)
Can we get a topaz video upscale ai enhancer alternatives video and pricing with free alternatives?
I'm not totally sold on video upscalers but CapCut has one that does 2x that's free. I want to do a video on all the AI magic tools in CapCut because I think they've surpassed Adobe Premiere in that regard.
Can you make a list in order from best to worst for moonvalley, runway ml gv2, pika labs 1.0, Google text to video. And I don’t need a full video. A comment really is fine because I’m trying to use image prompts
For image to video, Runway and Pika 1.0 are the best ones I've used in terms of staying close to the original image and being able to inpaint/outpaint the generated video. Which one is better seems more like a preference in how you like to work. If you prefer classic video editing tools, then Runway. If you prefer something that feels closer to editing a social post, then Pika 1.0. Either way, you'll have to constantly play around with motion settings and prompts to get the result you want, but that's part of the fun imo.
Does it eat up more credits applying it to genereated videos?
Whoa, I didn't realize you could use text-to-video image previews. Looks like it uses the same credits as a normal Gen-2 four second video though. th-cam.com/users/shortsHF9Rjnl_zFw?feature=share
do you recommend using the paid version of runway or free version is fine?
Im a newbie but I find this so interesting
I'd recommend trying all the free ones you can, while they're still free. Discord has a lot of servers with free AI generation ability. Runway and Pika are both making great tools on their paid plans.
How did you get the dragon not to move at all in the last one? Even if I do not paint over something it will still assume it is moving
It might have been luck, but I painted the fire in the fireplace and used the prompt: "the fire crackles in the fireplace." Maybe the combination of prompt and brush focuses the motion to just those elements??
Cool to see the examples, but the Runway tutorial quickly shows proximity is z-axis in and out. Not what this video says. Still helpful to see someone play around with it!
I was wondering how I missed that and then saw Runway updated their tutorial video (and interface) since I recorded the demo. The X/Y/Z axis labels help out a lot, thanks for pointing that out.
To me it looks like you were painting too much. Example lady turns to window - shouldn't you have only painted her head/hair - With the sword should you have only painted around the blade?
Yeah, I definitely over-did the brush on the subway woman. The sword seems to have worked great until I added the camera motion but if I were to do it again, I would add a text prompt describing the sword effect more.
isn't proximity how close or far something appears? Would make more sense no?
You're right, it is
i cant see the brush... i click on motion brush but my cursor is not an purple dot.... some1 help pls
Throw your pc from the window. That might work
Is the free version safe for commercial use?
According to their website it is: help.runwayml.com/hc/en-us/articles/18927776141715-Usage-rights
"As a user on any of our plans (Free, Standard, Pro, or Unlimited) you retain complete commercial rights to all content generated or edited using Runway. You're 100% free to use any content you create using Runway both commercially or non-commercially, and all copyright for your creations and generations is held by you."
@@aivideoschool Thank you
9 months since gen 1 ai. and we can make a good video trailer.i I hope next year the video generator can be up to 30 seconds
I can't believe it hasn't even been one year
if paint his arm it will move as well
°•°• I believe we are meant to be like Jesus in our hearts and not in our flesh. But be careful of AI, for it is just our flesh and that is it. It knows only things of the flesh (our fleshly desires) and cannot comprehend things of the spirit such as peace of heart (which comes from obeying God's Word). Whereas we are a spirit and we have a soul but live in the body (in the flesh). When you go to bed it is your flesh that sleeps but your spirit never sleeps (otherwise you have died physically) that is why you have dreams. More so, true love that endures and last is a thing of the heart (when I say 'heart', I mean 'spirit'). But fake love, pretentious love, love with expectations, love for classic reasons, love for material reasons and love for selfish reasons that is a thing of our flesh. In the beginning God said let us make man in our own image, according to our likeness. Take note, God is Spirit and God is Love. As Love He is the source of it. We also know that God is Omnipotent, for He creates out of nothing and He has no beginning and has no end. That means, our love is but a shadow of God's Love. True love looks around to see who is in need of your help, your smile, your possessions, your money, your strength, your quality time. Love forgives and forgets. Love wants for others what it wants for itself. Take note, true love works in conjunction with other spiritual forces such as patience and faith (in the finished work of our Lord and Savior, Jesus Christ, rather than in what man has done such as science, technology and organizations which won't last forever). To avoid sin and error which leads to the death of our body and also our spirit in hell fire, we should let the Word of God be the standard of our lives not AI. If not, God will let us face AI on our own and it will cast the truth down to the ground, it will be the cause of so much destruction like never seen before, it will deceive many and take many captive in order to enslave them into worshipping it and abiding in lawlessness. We can only destroy ourselves but with God all things are possible. God knows us better because He is our Creater and He knows our beginning and our end. Our prove text is taken from the book of John 5:31-44, 2 Thessalonians 2:1-12, Daniel 7-9, Revelation 13-15, Matthew 24-25 and Luke 21. Let us watch and pray... God bless you as you share this message to others.