Consistent AI Characters in any pose: Tutorial
ฝัง
- เผยแพร่เมื่อ 26 พ.ย. 2022
- In this tutorial, I go through step by step, how to create a consistent character for your comics, books and creative projects. (▰˘◡˘▰)
✨Free Written tutorial coming soon on:
promptmuse.com/consistent-ai-...
🖱️Step 1: / discord
You can use any Text to img generator you like, I just choose MJ :)
🖱️Step 2:
Thin Plate Motion Colab Notebook (For adding animation to your character's face)
colab.research.google.com/dri...
🖱️Step 3:
Out Painting (Creating your character's features, you can us inpainting for this as well)
colab.research.google.com/git...
Get your Hugging Face Security Token (Make a free account first)
Hugging Face:huggingface.co/
🖱️Step4:
Dreambooth (Training a model based on your character)
colab.research.google.com/git...
🥤If you want to buy me a coffee, I'd really appreciate it:
ko-fi.com/promptmuse
🕹️Many thanks to Sixhaunt for his pipeline, advice and information and for letting me demo his Genevieve model, he's doing amazing things for the AI community.
Please check his website out here:
xanthius.itch.io
#aiactor #ai #aiart #midjourney #stablediffusion - แนวปฏิบัติและการใช้ชีวิต
Hi, there is a great help forum here github.com/yoyo-nb/Thin-Plate-Spline-Motion-Model/issues.....but if you are not having any luck please try this alternative method: huggingface.co/spaces/CVPR/Image-Animation-using-Thin-Plate-Spline-Motion-Model
the form no longer works :'(
Can you redo this where its completely on a local machine?
I accidentally had this on loud as I was out in public, some old guys head exploded as this was too much for his mind to comprehend. Data overload. Thanks for the great content
You are a gem!
@@Arkhkalos she accidentally added the "....but" into the link. just copy the important part and paste it into the address bar for it work.
We’re in the early days of AI, this channel will likely have millions of subscribers with in the next 5 years.
haha thanks, I just do it as a hobby as it’s really interesting and the best way I learn is by teaching 😂 so it’s a win win! But, thank you !
In Planet earth they are not 5 millions of people smart enough to understand what this channel speaking about
@@blender_wiki lol
Totaly agreed! Simply because she is a great tutor! I will defenitly follow and recomend!
Millions of subscribers where AI now wants to learn how to render itself?
Finally! A video that doesn't assume I have any coding experience and goes slow enough for a numpty like me to follow step by step.
It was nice to see such a complete, full workflow for using these new tools and putting them towards practical uses. Great video!
Love how you've broken down in easy-to-understand terms so many different tools here. This gives me real hope for the future of AI, where communities work together to build tools that work not just for techheads, but for anyone. You're fulfilling an important role in that chain, which is as a very experienced non-technical user explaining things to other non-technical folks who want to get started. That's a link often missing, so thanks!
This is another level, didn't expect to see something like this on TH-cam at all. I am blown away! Please keep it up!
This does NOT help my obsession with wanting to create more "cool stuff" :). You've put together the most complete workflow I've seen. It's a credit to your insights and passion and I'm really happy for you. It's becoming a bit of a crowded space of TH-camrs already, but you're bringing something different and in my opinion, unique and better.
Thank you very kind. I haven’t been outside due to these obsessions, is the sky still blues ??? Thank you for the kind comment, really nice. Cheers!
She showed us, but lets give some love to Sixhaunt for putting it together. Can't have one without the other. Both are helping the community immensely
@@rne1223 Totally !! I wouldn’t of known this workflow without him!! Also he shared everything with me. A true asset to the AI community 🙏
She could have saved herself a lot of time and trouble by just filming herself, as she has the look of an AI character.
That is how it works by design tho
0:00 Intro
====
1:06 Step 1 - Midjourney: Create the character face.
2:40 Setp 2 - Stable Difusion: Create a video from character.
10:20 Setp 3 - Adding body to character.
15:23 Setp 4 - Training AI on generated images.
====
And for this one! Thank you for taking the time to sort that :)
@@promptmuse You're most welcome.
I was blown away just by the animation part alone. So many possibilities.
Upvoted and subscribed. For the content of the video, for the lack of clickbait, for the written and easy-to-follow steps, for giving credits and visibility to people who helped you... This is quality content. Thanks a lot.
You are incredible. I, too, am obsessed with workflows but you're actually making videos about it and you're on another level.
In all of this TH-cam chaos, there are lights in the tunnel, your channel being one of them. Well articulated, no hokey lazy humor, deep demos and excellent instruction. If I had tons of money I would pour that into this resource, but alas, I'm here for the free teaching, so ahem, y'know. Keep rockin' AI artist sista!
Haha What a kind comment! I do it because I’m passionate about it. Also I love sharing the info and being involved in the community :) Thank you for your comment, it made my day !
Holy moly, this is so good! Thank you for this genius research and development. So many people looking for this.
one the best, most thorough tutorial vids i've ever seen. . . what a game changer!
I have been working on a personal story that went from book, to unity, to UE and I've always struggle with being one person doing everything. I guess that after 15 years of starting my journey, I've finally found my perfect ally in AI. I can clearly see the path ahead and how I can finally make my vision real... of course there is always a caveat... we just got a baby and I can't put the free time in the computer hahaha
Thanks for the tutorial, well explained and straight to the point! Subscribed!
I've been so addicted to learning and running my own stable diffusion I forgot there were other AIs out there. Going to have to try midjourney after I finish training my model. Nice to see alot of people getting interested in it.
This is the bright side of AI. Beautiful tools being explained by a competent and engaging person. Thank you for your hard work. It's channels like this that will teach the next generation to do amazing things.
Thank you for this incredibly detailed step-by-step guide. Exactly what I've been looking for. Thanks for distilling this convoluted process down and taking the time to put this tutorial together!
Holy shit, now this is how you do a tutorial. I was intimidated af at first seeing all of this, but you made it so easy to follow along with and I had a successful first go. Can't wait to see where I can take this! You earned a new sub. Can't wait for the next vids!
Glad to be able to say I was here at 4000-something subscribers! You are probably the best I’ve seen on YT teaching this stuff!
And also someone buy this girl a 3090!
Thank you for being here :) I hope you stay with me !
Brilliant stuff! I'm a former art/media student who has had a bad spell of many years, resulting in a lack of creativity and slight depression. AI and videos like this have really kicked my creative energy back into 1st gear! I'm now making scripts for all kinds of projects, images and design, and now, thanks to you, even animations! Thank you so much!
Yes, love that for you. So much to look forward to in this space, this is just the start :)
So happy to see this comment, i've been having an ongoing discussion with a friend about AI and it's effect on creativity... My friend thinks i'll be the end of creativity, and i argue the opposite.
@@BlackMoridin Definitely the opposite. I'm still using it and creating stuff. To be honest, it is mostly for myself to create stories and characters. However, until now, I have never had an instagram page in my life. Now I'm running two channels and putting stuff in there. Also, have written an article for Medium, which I hope to publish soon. So, all in all, am doing much better than before regarding my creativity.
I have followed the video with attention, and I can say you are a great teacher.
Unfortunately today I did not learn how to create a character in ANY pose, but I have learned how to create a consistent character.
I hope in the future your videos will reflect the title's promise.
Thank you, PromptMuse!
This is just brilliant! I've been using Stable Diffusion, but it looks like I'll have to get familiar with Midjourney, and come back for this awesome tutorial. Thanks!
Who else is amazed by AI yet at the same time feels like we've unlocked something forbidden and it is already way too late to prevent chaotic events from happening... our future seems crystal clear now
Out universe is full of unpredictable chaotic events. This is just a small blip. It will be okay 🙏
I'm amazed childhood ideas I feel like I'm slipping behind it's like Star Trek holodeck you're only limit as your imagination and it's probably a good idea if you have a degree art history I feel like being 37 years old I'm too old. Do you have to have a desktop or can I do this on my iPad
@@promptmuse Indeed, it will be okay in the long run. I'm still an AI enthusiast although I stopped posting my ai-generated visuals online ever since I realised how unethical Stablediffision deep learning models actually are... I feel guilty for contributing to the ai community lately, it's a conflicting situation since I am also an artist
@@promptmuse That's a dismissive and ingenuine response. Sure, blackholes are literal tears in space. catastrophic failures of reality to maintain time and reality in a way that's measurable or observable.
But that has NOTHING to do with what is happening in our lives right here and now on Earth. Sure if the entire history of humankind was erased, it would be a little blip and all would be fine, but that's in the eyes of God and infinity, not the eyes of us right here. It would be catastrophic for us for our world to collapse. And saying that that doesn't matter because...oh universe be big....nihilism...yadda its fine... isn't just ignorant its dangerous.
We can't ignore one dying or hurt person, because oh yeah, there are 8 billion more. We can't ignore our own planet because, the big old universe will get on fine without us. And we shouldnt ignore the potential horrors AI could cause....Just because it's fun to use...and yadda let's just say it will be fine when really it clearly won't be.
Ignorance of the inevitable is what makes it inevitable. Knowledge and resistance is the key to mitigating the issues we see coming.
My inner battle was won when I realized I'm like a songwriter.. I can't sing, I can't draw or paint, but my imagination is 1000mph and I deserve to have it imagined into reality:) if not just for my own sanity lol.
This is amazing! Perfectly condensed useful information and really well explained! This is going to be one of the top channels on this subject! Glad to be here from (almost) the start of the ride, when we were not millions of subscribers yet! XD
Thank you so much!
I work in IT handling files with PHI. This stuff is so much more exciting. I am so amazed by your videos. Thank you so much!
love it very resourceful. NGL these kind of videos should go as viral imo
BRAVO! you are an amazing teacher! thank you very much for sharing those information in a very efficient way. I will try with a drawing, or a painting soon!
I’ve watched several other videos trying to explain dream booth and just didn’t click for me. Thank you for this fantastic, concise and understandable tutorial!
This is a great tutorial! Can't wait to try it out myself. Thank you!
Wow, amazing video!!! Thank you for taking all the time to create a tutorial. You are doing an awesome job!
Phenomenal walkthrough and results!
Hello! I just started learning about AI generated images, and I have to say that your TH-cam channel has been incredibly helpful in my learning journey. Thank you for all of the valuable information and insights you provide! In addition to the great content on your TH-cam channel, I really appreciate that you are willing to allow a FAQ in the comments section. Not many TH-camrs are open to this, and it has been a huge help for me as I am just starting to learn about the subject. I just wanted to let you know that this comment was actually generated by an AI, but it does accurately reflect my thoughts and appreciation for your TH-cam channel. Thank you! :)
Wow. You are an awesome instructor. Thank you so much for putting this together.
This is just the beginning. Insane
just found your channel and wow i am impressed and THANK YOU so much for sharing. I really like your straightforward vids. Love from California !!
Hey, thankyou 🙏
This was a really clever workflow. Great job.
Wow, amazing tutorial and video, I liked it so much! 🥺😄👏
It's so useful because I'm making a virtual assistant, and the results are beautiful
Your tutorials are inspiring. Keep the good work!
Thanks for sharing! It's so well explained that I have no prompts for describing it😁
Yeah, we will be making ai driven short films here soon and I’m all for it. I tried learning 3D modeling but had a terrible time trying to model a realistic 3D character.
Here are some tips (it has helped me for complex poses and it may not be the most practical but it helped me) with the clipstudio program I made the exact pose with the camera angle that I wanted, then I took it to photoshop and painted a little, I basic so that SD understands, then in SD with the cara model that I had trained, use img2img some mask and that's it, it might seem like a lot of work but it's actually quite fast.
Great tutorials, jam packed with clear info.
Great video and thanks for making it easier for more people to get access to these tools. Your manner helps make a daunting "techy" activity actually doable. Well done!
Thank you ! I cannot even turn on a tv tbh haha
very complicated steps but they worth , thank you for that huge effort....and for this amazing tutorial
This was FANTASTIC! Thank you so much!
Awesome! Thanks a bunch for making the video, showing how to pull it all together :)
I think I saw a tutorial on building a space shuttle that took less steps... but it was an amazing video and you did a great job presenting all that madness. Wow... I hope it's useful in a lot of ways after all that.
Wow! Again, excitingly helpful and informative! thank you!
Thank you very much for this tutorial. It has given me a an idea for something that I hope works out.
Incredible and so helpful 🙌💖💖💖 Thank you!
I think what a lot of us are interested in is how to upload a posed image and have all those poses have the character rendered consistently using the reference images.
Sort of akin to tracking data for animation.
Did you have any luck figuring it out? I'm still having trouble!
@@Queenwraith nope.
I would imagine that this could work for that, just with a lot more steps? Like if you can fine-tune it to have an “idea” of your character, then you could use controlNet to make it make images of your character in whatever pose?
Though I would imagine that it would be possible-but-difficult for someone to make a model that would like, copy a character from one image and make it match another pose, instead of needing to fine-tune separately for each character?
thanks for sharing these techniques. it is a very clear tutorial
thank you so much my muse, amazing work
Thanks for the high density informative content!
Cool... subbed. Been using AI Images for my RPG livestreams. So many cool things computers can do.
This is ingenious. Good job and thank you. Subscribed.
great video but i got an error on step 3
ModuleNotFoundError: No module named 'demo'
do you know how to solve this?
Very cool! Lots of great information simply and nicely explained. Thank you so much!
Excellent video. Very complete and well explained. You are the BOSS.
Thank you. That is A LOT of info but fortunately I can come back
Great effort. I can see it take a a lot of focus on the steps. Thank you. ❤
OMG thank yeeeeeeeeeee :O I saw CS bloom while I was in my senior year of phil and wanted to jump on the train and I just started my first semester of CS but it's already gotten so far ahead of what interested me back then. O-O so cool
What an ingenious way of creating a consistent character. It's certainly a lot quicker and easier than the way I've been doing it. Great work and subscribed! Thank you!
Very nice workflow!
Bless you for this. BIG thanks.
This woman is simply my dream woman, what a personality and professional! Cheers!
Wow... You are amazing, please keep it going
These tutorials are gold. I'd be really keen to see what happens when you use 2 to 4 models in a prompt. What does it look like when you ask stable diffusion to create a scene with multiple models interacting with each other?
Good job, Amelia, good luck and freshy inspiration to you
Omg thank you so much! I run these locally never thought using these tools together like this to get ref video!
If anyone gets errors or needs any assistance, please just reply in this comment to form a FAQ for all, and I'll try my best to help you all out :)
Awesome vid, thanks for that!
Unfortunately the collab fails in step 3: "from demo import load_checkpoints" -> "ModuleNotFoundError: No module named 'demo'". I mentioned step 2 before but should have been step 3, sorry for that!
@@AnotherJoe Hi Joe, is that on the set up libs cell (The first cell), on the stable diffusion infinity notebook?
Usually that error occurs when some of the dependency’s have not installed correctly.
If you go to Runtime (top menu bar) and then > restart runtime and run the cell again…
Failing that just use the hugging face method which will run straight away :)
huggingface.co/spaces/lnyan/stablediffusion-infinity
@@promptmuse Thank you. I tried restarting the runtime but no joy. Perhaps I'll just have to start. again. It's fails in your video @6:42.
@@AnotherJoe Good spot! I think I ran the cell before the above one had completed, which caused my error on that one.
I’m just opening the notebook up again and running it to see if I can repeat the error 👍🤞
@@promptmuse I restarted the proces but it didn't make any difference unfortunately.
Very nice video and technique. I been working on something very similar but trying to get video/animation with stable diffusion.
Another great video! I was trying to work out how to do something like this the other day haha.
Thanks Jamie, the pipeline was down to Sixhaunt - No one else has done it quite like this so far.
It’s very quick once the model is set up to just churn out consistent character prompts!
Thank you for a well explained and useful material.
this is exactly the type of thing i've been looking for. i wanted to make some music videos to my songs with characters that arn't me.
Great tutorial! I wish i had run into this 8 months ago, wow! Your stuff is incredible. Have you seen what the Corridor Digital guys did for their animated show using diffusion?
that is the vid that will let me do AI, thanks!! workflow is gold
thanks so much! turned great!
Awesome way to do it! Thanks for sharing 👍
This is Brilliant! Thank you for taking the time to explain the workflow clearly and precisely. Will Definitely give this a shot. I am thinking if I train a model using my own Pictures, then I can become anyone using the power of AI. I can create talking head videos of myself as an astronaut, a professional fighter, a Rockstar, a pirate etc. I think we are not too far from being able to create our own homemade AI-enabled animation short films. Soon we'll have motion tracking and such. What a time to be alive!
That is very cool. I’d love to see the finished results ! For sure, exciting times are here 👍
This is insane!!! In a good way of course, I have a Mac though….😅
What a video!!! Thanks for sharing so much knowledge 🫶
Great explanation! There should be a service to just address this task in one shot. Upload 10 perspectives and emotions of a character, hit submit and done. 🙂
Generating redheads was also the first thing I've done with diffusion lmao.
Soldier redheads, cyborg redheads, old-timey redheads, old-timey cyborg redheads, etc.
Speaking of which, try generating anything with "autochrome". I just wanted to use the camera effect, but it makes everything look old-timey too. Even the robots looked like some Edwardian made them.
It’s such a striking feature is it. Very celtic. I was sfollowing on from Sixhaunts model as he really inspired me.
I’ll have to try that feature, that sounds a great effect for some red headed Edwardian Queen’s 👍
What a fantastic tutorial - very easy to follow (and it worked for me first time! Which is a first!) I'm curious, though, as I have come to this 4 months after you published it if the models have been updated (for example, I tried changing stable diffusion 1-5 to 2-0 and managed to crash it) I'm guessing there might be newer versions of Inpainting and Dreambooth?. Going to crack on with your more recent tutorials - that might answer my question! Keep this up - it's amazing work.
Hi, do you have any problems to play Step 4 in the colab?
Your tutorials are perfect
That's actually pretty cool.
Thanks for the tutorial. I was curious how to get persistent characters usind SD and this shows well the potential.
Very good demo and to the point. Subscribed.
Thank you so much!
¡Esto es muy creativo! Increíble
We are also working on Al Art recently, Al Art is the future! Thanks to the blogger for sharing.
WOW! Amazing results - from a bleeding edge process map...
Most terrific lessons:)) thank you
Captivating. Interesting computery stuff, too. :)
You should have more subscribers, really great videos! I do think someone will make it drop dead simple to 3D convert a photo/ai photo making it simple to drop into animation software(lots of steps here). I've seen some newer platforms making an attempt at this but wondering what you and others here have seen...
Lovely vid and very clearly explained. New subscriber ♥
thank you very much, this is so cool!!!! You're great!
Amazing, glad I found your video from reddit.
Awesome, thank you 🙏
Amazing video! Keep up the great work! So in order to create a image with several persons, all consistent character, I would just repeat the process for multiple persons, 'naming' each one and then import all into my local stable diffusion?
Thank you very much for this movie. It's genius ! 👍