Oh man this is a gold mine! Specifically consistent character on replicate, I've been trying to do this in Flux and ComfyUI for weeks and never got far...
As a professional editor for much of my career, it's interesting to watch how people are putting together sequences today in AI. It's basically a reverse workflow. Used to be we'd edit a scene with footage from the set with lots of problems. Actors on a stage with maybe a green screen behind them or nothing at all. We'd edit the scene based on their performance, imagining in our heads how it might eventually look. It would often be months before the special effects team would put them in the appropriate setting, and then things like color timing happen. Now it's like the color timer and visual effects department gets hired first, and then you try to find a place to stick in the actors, and if you are really skilled, you can figure out a way to make them actually talk!.
When I us AI, I often don't have a vision, just some sort of "vibe". It's very iterative where I give generators an idea, then iterate and refine what they give back, sparking new ideas and direction until I'm happy with it. I think it's a great way to work for those of us who may lack a grand vision
I have been editing, doing VFX and everything else for a long time. I have tried AI too. The reverse engineering actually kills the story flow. Just stitching visuals together is not editing. AI doesnt exactly obey you. It breaks all the rules. No rule of 180. The character at first is left facing. In the next its right facing. Thus breaking the context, the story. Very little continuity.
@@phill_ai Thanks for liking. AI today is a chaotic marketplace. Aspiring content creators, established artistes, professional studios and everybody else in-between seek a slice of that pie. Its democratised. Whereas, film production demands novelty. With the rise OTT, theatrical productions are anyways downhill. I am not sure if the big daddys of film production will embrace AI the same way. They will only do that that AI currently cannot do. They may use AI only as a low level tool here and there. Meanwhile, novice content creators will saturate the AI market breaking all rules of filmmaking. That will become the norm. And the world will embrace or get used to it. SD resolution ouput and subsequent upscaling is not the professional way. We all will have to wait for AI to mature. Companies like Runway are not familiar with real production needs. They are learning too. As of now, I fix my Ai problems by reprompting/rephrasing a million times untill I get it perfect. Iinfinite patience is the key. Whatever remains unachievable, I try workarounds, green screens, working on select regions of the frame, using alternate tools or edit stuff manually using traditional compositing software. I guess every professional is using a similar multiple workflow. Its definitely not as simple as joing clips back to back.
I used this replicate space to generate images for lora training some weeks ago in production! It’s really awsome. Regarding the short, I’m in, you sold me the pitch’s show 100% haha. At first I was really bored by the models aesthetics, but then saw the satire. It really made me laugh, specially the Zeus part. Well done!
It looks great in the same way the Super Nintendo looked "realistic" when the console was released. It will be a joke in 20 years but today it is simply AMAZING!
Fantastic explanation! I watched the entire tutorial, and it was exactly what I’ve been searching for-a complete and well-done guide. This is truly impressive. Keep up the amazing work!
I Appreciate so much that you share such valuable knowledge, its really helping me to fast-track in to the world of AI film making - my head is bursting with ideas, and can finally start to bring my film to life that I've been storyboarding for a few years now!
The trouble with Kling is that the lip sync is not very good. Runway Act One is excellent, but as I show in my test video (with two simultaneous lip sync characters) and you have shown here, you can't (yet) do whole body movement. It's all rather frustrating at the present time.
wonderful tutorial bro, spectacular workaround for consistent characters. Just train a lora for the liked character and continue generating consistent character images in different settings. Bravo !!
Very well done, I actually had an ad pop up with a trailer and thought it was still part of your video..LOL really some parts of that were getting real close to reality. We are very close, like a year from some real crazy good video. You're doing some great work with the tools we have, I'm sure you could prompt these things 10 or more times and get even better outcomes but it's just not cost efficient yet.
wow... I wasn't expecting such a long prompt... that's very helpful actually... I find I get more and more "random" looks the more things I add to a prompt. but I see now from your example that I may have been writing them poorly
That's quite an impressive workflow, very nice work .. your short AI film is actually one of the few that are quite promising and show how small teams and indie filmmakers might be making movies in the future (although I hope we eventually manage to get open source versions of all these tools, like we do with Flux). I'm also glad also I'm not the only one who noticed the Kling and Minimax are two of the best and frankly cheapest AI video sites out there, I was able to create some really cool action packed shots using both.
Thank you for your invaluable lessons; they have provided us with so much insight! I recently launched my own TH-cam channel where I share AI-generated movies. I'm curious to know if it's possible to achieve consistent character portrayal with Leonardo, or if there's a way to train the model for that purpose. From my experience, using a variety of tools is essential, as relying on just one may not yield the desired results. While Runway has made significant improvements, I've found that Hailuo can sometimes outperform it in terms of movement, despite being slower. When aiming to post twice a week, it's a constant balancing act between perfection and timely output! What tools do you recommend for achieving quick yet decent results?
amazing great for the awesome tut, quick question, can you also use this on animated characters as well? edit* sorry, i meant in freepic ai, or freepic best used for a realistic approach?
I'm an award winning filmmaker. My wife & I have written 4 Season One 6 episodes Limited Series scripts. Unable to submit our scripts to anyone due to the "not accepting unsolicited submissions" Hollywood rule, I am seeking an AI savvy co-producer-partner to produce the shows with AI. Will there be a market? Gonna happen sooner or later. Can you recommend someone? Thanks.
People like a good story, that's one of the evergreen market: good stories! If you have one, it doesn't matter the tools you use if you know how to tell them. Go ahead!
It is amazing, but it is as if Leonardo AI images are better at blending the foreground and background, I can't imagine how this video would be when created with Leonardo AI...?
Soon I will have German voice over (dubbed version) will be enabled in my account alongside 6 more languages. I'm waiting for TH-cam but I think it will be available in couple of weeks. (only for new videos unfortunately)
Watch these AI generation videos. Then watch the classic The Twilight Zone (1959) (Season 01 Episode 36) - A World of His Own Then you'll see the similarities. Remember that's 65 years ago.
This is a prime example, why I still am not buying it. The example is such a horrifying uncanny valley... Hopefully, given a couple more years, this might improve and "pass". But what I have experienced so far -- it is FAR easier to actually FILM necessary footage, with actual cameras and actual people. Current level of video/AI animation is perfectly fine for hobbyists, and Facebook bots. Kinda similar to the "collages" with roses and pasted faces my great-aunt sends to all family members during holidays.
While the tech isn't there yet, no it's not easier to film something like this with real actors and cameras, and it would require lots of CGI to achieve the same scenes, it will cost tens of thousands of dollars to produce a 20-30 mins short film, and not everyone has that kind of money laying around.
The best video on how to generate consistent AI characters . I have been struggling to get consistency until I found this one .
Thanks for always making awesome AI tutorials! Has helped me so much!
Thank you for generous tip 💚
Oh man this is a gold mine! Specifically consistent character on replicate, I've been trying to do this in Flux and ComfyUI for weeks and never got far...
💚
As a professional editor for much of my career, it's interesting to watch how people are putting together sequences today in AI. It's basically a reverse workflow. Used to be we'd edit a scene with footage from the set with lots of problems. Actors on a stage with maybe a green screen behind them or nothing at all. We'd edit the scene based on their performance, imagining in our heads how it might eventually look. It would often be months before the special effects team would put them in the appropriate setting, and then things like color timing happen.
Now it's like the color timer and visual effects department gets hired first, and then you try to find a place to stick in the actors, and if you are really skilled, you can figure out a way to make them actually talk!.
That is a really interesting take ! A reverse workflow ! Awesome thought
When I us AI, I often don't have a vision, just some sort of "vibe". It's very iterative where I give generators an idea, then iterate and refine what they give back, sparking new ideas and direction until I'm happy with it. I think it's a great way to work for those of us who may lack a grand vision
I have been editing, doing VFX and everything else for a long time. I have tried AI too. The reverse engineering actually kills the story flow. Just stitching visuals together is not editing. AI doesnt exactly obey you. It breaks all the rules. No rule of 180. The character at first is left facing. In the next its right facing. Thus breaking the context, the story. Very little continuity.
@@SantanuProductions Very interesting I love this conversation. So how would you fix it?
@@phill_ai Thanks for liking. AI today is a chaotic marketplace. Aspiring content creators, established artistes, professional studios and everybody else in-between seek a slice of that pie. Its democratised. Whereas, film production demands novelty. With the rise OTT, theatrical productions are anyways downhill. I am not sure if the big daddys of film production will embrace AI the same way. They will only do that that AI currently cannot do. They may use AI only as a low level tool here and there.
Meanwhile, novice content creators will saturate the AI market breaking all rules of filmmaking. That will become the norm. And the world will embrace or get used to it. SD resolution ouput and subsequent upscaling is not the professional way. We all will have to wait for AI to mature. Companies like Runway are not familiar with real production needs. They are learning too.
As of now, I fix my Ai problems by reprompting/rephrasing a million times untill I get it perfect. Iinfinite patience is the key. Whatever remains unachievable, I try workarounds, green screens, working on select regions of the frame, using alternate tools or edit stuff manually using traditional compositing software. I guess every professional is using a similar multiple workflow. Its definitely not as simple as joing clips back to back.
I used this replicate space to generate images for lora training some weeks ago in production! It’s really awsome.
Regarding the short, I’m in, you sold me the pitch’s show 100% haha. At first I was really bored by the models aesthetics, but then saw the satire. It really made me laugh, specially the Zeus part. Well done!
This is the first AI video I am genuinely enjoying (and not for the wrong reasons). Expert use of our current technology and limitations!
It looks great in the same way the Super Nintendo looked "realistic" when the console was released. It will be a joke in 20 years but today it is simply AMAZING!
Fantastic explanation! I watched the entire tutorial, and it was exactly what I’ve been searching for-a complete and well-done guide. This is truly impressive. Keep up the amazing work!
một kênh hướng dẫn cụ thể về AI, đúng là kênh ytb mà tôi đang cần tìm kiếm để học hỏi bấy lâu nay. thank you!
Very cool! Thanks for the detailed video and workflow, I shall follow it closely!
💚
Your AI videos is the best I've seen so far. Great job!
💚
Just wow, you put so much work into this, thank you for that 😌
Thanks!
I Appreciate so much that you share such valuable knowledge, its really helping me to fast-track in to the world of AI film making - my head is bursting with ideas, and can finally start to bring my film to life that I've been storyboarding for a few years now!
Great video. You make sense of things that, as an absolute novice, are at times overwhelming. Thank you. God bless.
Thank you 🙏🏻
Was it expensive to create it? I mean each rendered video costs credits, so every failed try costs money as my understanding.
That's actually pretty dang slick! 👍👏👏
I'm genuinely impressed
Totally mind blowing ! Impressive work 👏
this turned out freaking amazing man ! I only guess the patience of all the generations ! Good work man!
💚
The trouble with Kling is that the lip sync is not very good. Runway Act One is excellent, but as I show in my test video (with two simultaneous lip sync characters) and you have shown here, you can't (yet) do whole body movement. It's all rather frustrating at the present time.
wonderful tutorial bro, spectacular workaround for consistent characters. Just train a lora for the liked character and continue generating consistent character images in different settings. Bravo !!
Very well done, I actually had an ad pop up with a trailer and thought it was still part of your video..LOL really some parts of that were getting real close to reality. We are very close, like a year from some real crazy good video. You're doing some great work with the tools we have, I'm sure you could prompt these things 10 or more times and get even better outcomes but it's just not cost efficient yet.
The video is awesome, my friend! Congratulations.
💚
Wow pretty good. I would watch that Netflix show.
💚
wow... I wasn't expecting such a long prompt... that's very helpful actually... I find I get more and more "random" looks the more things I add to a prompt. but I see now from your example that I may have been writing them poorly
Great work, both the movie and the turtorial
💚
That's quite an impressive workflow, very nice work .. your short AI film is actually one of the few that are quite promising and show how small teams and indie filmmakers might be making movies in the future (although I hope we eventually manage to get open source versions of all these tools, like we do with Flux).
I'm also glad also I'm not the only one who noticed the Kling and Minimax are two of the best and frankly cheapest AI video sites out there, I was able to create some really cool action packed shots using both.
The Short film is just incredible 💯 and funny 🤣
This is nuts... I need to get into this...
Nice work. How do you deal with music for the whole movie and the Copyrights?
Thank you for all your helpful insights! ❤
💚
This is Awesome!!!
🙏🏾 Great film and tutorial, Many Thanks, Brother!!
I have been using Runway and I simply cannot get the system to create a consistent character or get the camera movement to where I want it.
Another question. While the character is talking, the rest of the scene is static. How do you solve the movements in the background?
Great video and great shorts.👏👏👍❤
Wow amazing job, thanks for all the tips and ai platforms!!
so Runway is the best in things of creating video from a photo? But it's also pretty expensive...
thank you for posting this. it is greatly appreciated!
do you use your own voice and then choose a voice on runway?
Good tutorial 🤩🤩 I am experimenting with something similar.
Why did your Zeus character keep changing looks yet you others stayed perfectly on point?
bu are kling allowed for commercial use?
Hi, Is the Macbook pro M4 10 core enough to do this quality of AI Videos locally? Or would I need the M4 pro, 20 core GPU?
latina soundtrack for a greek mythology movie ?
haah that also he should have let Ai decide
This just reminded me Netflix cancelled KAOS😩
really cool
but is flux dev for commercial usage???
Amazing, you are a genius
Awesome !!! Well done
Thank you for your invaluable lessons; they have provided us with so much insight! I recently launched my own TH-cam channel where I share AI-generated movies. I'm curious to know if it's possible to achieve consistent character portrayal with Leonardo, or if there's a way to train the model for that purpose.
From my experience, using a variety of tools is essential, as relying on just one may not yield the desired results. While Runway has made significant improvements, I've found that Hailuo can sometimes outperform it in terms of movement, despite being slower. When aiming to post twice a week, it's a constant balancing act between perfection and timely output!
What tools do you recommend for achieving quick yet decent results?
amazing great for the awesome tut, quick question, can you also use this on animated characters as well?
edit* sorry, i meant in freepic ai, or freepic best used for a realistic approach?
You can use the same tools and workflow for animated characters too 👍🏼
@cyberjungle interesting I'll have to try it out thanks!
I'm an award winning filmmaker. My wife & I have written 4 Season One 6 episodes Limited Series scripts. Unable to submit our scripts to anyone due to the "not accepting unsolicited submissions" Hollywood rule, I am seeking an AI savvy co-producer-partner to produce the shows with AI. Will there be a market? Gonna happen sooner or later. Can you recommend someone? Thanks.
People like a good story, that's one of the evergreen market: good stories!
If you have one, it doesn't matter the tools you use if you know how to tell them.
Go ahead!
Brilliant, great work!
Thanks a lot, this will help a lot of AI Artist and Content Creator out there
AI is improving
7:18 what to name that transition ?
footagecrate.com/video-effects/footagecrate-leaf-fan-out-transition
Thank you! !
Very soon Hollywood is going to be a dinosaur looking for the nearest tar pit, game design is going to be revolutionised, a lot happening!
Imagine when AI evolves, it will be like a Hollywood movie.
Noice! 😍
Amazing!
This is aamazing!!! But also you are more interesting than them, lol!
💚
Which application?
Name of the application?
25 dakika nasıl geçti anlamadım. harikasın 🙏😇
amazing
❤❤🎉🎉WOW 🎉🎉❤❤
It is amazing, but it is as if Leonardo AI images are better at blending the foreground and background, I can't imagine how this video would be when created with Leonardo AI...?
ERES E MEJOR THE BEST!!!!!
Congratulation My Friend, Winer Winer
3:28 those hands would give you nightmares 😅
Where are you from man? Your accent sounds familiar 😅
I’m from Türkiye
🐺🐺🇹🇷🇹🇷😻😻
@@cyberjungle I knew it 😂👍👍
Love it lol
Awesome work cyber jungle!
💚
The AI film with Trump and Biden seen lately on the net, someone knows which AI app ?
Thanks:)
💚
The blonde character looks exactly like a coleague of mine
Amazingly beautiful work❤
💚
why do they have Russian or Eastern European accents ??
I really want to know what is a cumbia doing in the middle of this greek gods corporate setting 😂😂😂
Can you please add German subtitles?
Soon I will have German voice over (dubbed version) will be enabled in my account alongside 6 more languages. I'm waiting for TH-cam but I think it will be available in couple of weeks. (only for new videos unfortunately)
@@cyberjungle It would be great if you could make a video and show us which software you use to make these great videos
I wish these platforms were cheaper.
The original superheros
who is like god?
She said Olympuss hihi 🎉
Watch these AI generation videos. Then watch the classic The Twilight Zone (1959)
(Season 01 Episode 36) - A World of His Own
Then you'll see the similarities. Remember that's 65 years ago.
bro, make a new Terminator or another season of the Simpsons 😛
thing is the mouth movement still look off which makes it still not useable for high quality stuff
consistent-character not free
3:31 ... cancer de tetilla !!!
👋 hi
Hi Louis 👋🏼
❤
ahahha olm çok iyi lan
Fantastic AI video, but we are still need help with those damn fingers! 😆
This is a prime example, why I still am not buying it. The example is such a horrifying uncanny valley... Hopefully, given a couple more years, this might improve and "pass". But what I have experienced so far -- it is FAR easier to actually FILM necessary footage, with actual cameras and actual people. Current level of video/AI animation is perfectly fine for hobbyists, and Facebook bots. Kinda similar to the "collages" with roses and pasted faces my great-aunt sends to all family members during holidays.
While the tech isn't there yet, no it's not easier to film something like this with real actors and cameras, and it would require lots of CGI to achieve the same scenes, it will cost tens of thousands of dollars to produce a 20-30 mins short film, and not everyone has that kind of money laying around.
Athena looks like Amber Heard
Ares looks like Leonardo Di Caprio
Hollywood is sooooooo death!!! 😂😂😂
It's all Greek to me
ahh, that's paid method replicate isn't working this model in free plan
muito legal da hora .
That was cool. Thanks for sharing. Much love. God bless.
💚