AI Screenplay to Screen: This is WILD!
ฝัง
- เผยแพร่เมื่อ 5 ก.ค. 2024
- Ever wondered how long it will be before an AI can turn a screenplay into a full feature film? The wait might be shorter than you think! In this video, explore the groundbreaking open-source project Open Clap by Julian Bilk, a visionary roadmap from AI script to screen. Learn how Open Clap, inspired by one of the greatest films of all time, "The Godfather," revolutionizes AI cinema by creating a modern prompt book for AI-generated assets.
🔍 Key Highlights:
Overview of Open Clap and its innovative approach to AI filmmaking.
Breakdown of how Open Clap transforms a screenplay into a structured prompt book for AI generators.
Introduction to Toon Crafter, a powerful AI animation tool that interpolates between cartoon images to create seamless motion.
A sneak peek into ReVideo, a point-and-drag video inpainting tool that adds motion and content control to your videos.
A look at the future of AI-driven video creation and the potential it holds for filmmakers and content creators.
🧩 Resources & Links:
Explore Open Clap: github.com/jbilcke-hf/OpenCla...
Try ToonCrafter: replicate.com/fofr/tooncrafte...
Check out ReVideo: mc-e.github.io/project/ReVideo/
Watch the Pandora Video Model Overview: • 5 Mindblowing AI Video...
Mickmumpitz's Channel: / @mickmumpitz
🚀 Get Involved:
Dive into the code, extend it, and make it your own! Links to all resources are provided.
Join the discussion in the comments: How do you think AI will change the film industry?
📈 Almost at 100k Subscribers!
The channel is so close to hitting the 100,000 subscriber milestone! If you enjoy the content and haven't subscribed yet, hit that subscribe button and join the community. Every subscriber counts and is greatly appreciated.
Thank you for watching!
🛠 Timestamps:
00:00 - Introduction to AI Script to Screen
02:30 - Overview of Open Clap
05:10 - Tune Crafter: AI Animation Tool
08:00 - ReVideo: Advanced Video Inpainting
10:30 - Closing Thoughts - วิทยาศาสตร์และเทคโนโลยี
Check out the video on Pandora (and 4 other amazing AI Tools) here: th-cam.com/video/7RmayLMnF7k/w-d-xo.html
You still got the naming wrong, because you need to first change it from "Motion and Content Control" to "Content Control and Motion" Then you'd have "ReVid CoCoMo" and then the Beach Boys could sue!
Haha, ahhh, man-- now I have Kokomo stuck in my head! It's gonna be there all night long!
...where's that icepick?
@@TheoreticallyMedia You're most welcome! 😎
@8:43 Bill was chatting with the old M-1000. The latest model, M-2000, has a beard, gold chain and fluffier locks.
Haha! That new model is SOOO lifelike!! Remember the first version that seemed like it was a lizard person? Man, technology has gotten so good!
💯Facts. Pimp My Bot "Yo dawg, I heard you like privacy, so we put a robot in your robot to steal your data while it steals your data!"
I think the M-1000 has rubber skin making it easier to spot. Oddly, it also has bad breath.
Whoa - whoa - whoa -- what about LTX Studio??? Their "visions" workflow is sick.
Video coming up on that soon! Actually, I'm finishing off a whole other LTX video tonight. And this one is pretty awesome. Special Guest Star!!
@@TheoreticallyMedia you put a smile on my face. Thanks!
Former Disney feature animation artist here (analog), and YIKES! Nope, the animated examples are *not* ready for Prime Time.
(We worked at 12-24 fps, BTW).
I'm sooo curious to know what kind of computers (CPU/GPU especially) are used to edit/work in a professional setting, do you have any nuggets of information about It? Cheers!!
Sad thing is, the crowd will eat it anyway. The big corps will get the money. And we Moviemakers will beg for crumbs on the street very soon. This whole development is hell on earth. Why do churches even exist?! It's clear, that we burn in the fires of hell.
Oh that's awesome! I'm a big fan of that analog era-- And yeah, agreed that the animation examples aren't quite there yet, but you can see that they're getting closer. I actually really appreciate the potenal for the tech, as it almost serves as a backdoor for a new generation of artists to discover traditional animation. I'm thinking like, the artsy (non technical) high school kids who want to work on a animated short and postpone hopping into 3d software.
Good to know the FPS at Disney! I'll say, it really shows when you compare it to old Saturday morning cartoons! ha!
That empty space on the wall right behind you to your left looks like it's juuuuust the right size for a silver TH-cam plaque lol 😉
Haha, I've heard there is a bit of a lag to when you get the plaque-- hoping to be back in Studio A by then! But, if not: You're right!!
100k is not just a number. It’s an accomplishment! LFG!
Haha, I know-- I try not to think of it that way-- but, yeah-- it for sure is a crazy number. Sometimes we get lost in those Mr.Beast billions, or whatever. But hey-- for a little AI channel, 100k is sort of mindblowing.
Wow thanks Tim, I was JUST about to start looking for something that can fill gaps in footage... and tooncrafter is very very close! If you know if any apps that can more directly help to re-fill the gaps between vintage film footage (between reels or bad cuts).... like bridging the gap in a song switching between track on an 8-track tape. ... film restoration stuff. I love this future we have!
Hello Tim. can I install Clap locally or is it only possible online? Kind regards Anton
As always great stuff Tim! Thank you!
Thanks so much!! I’ve got one really awesome video next week that I can’t wait for you to see!
Open Clap (and those that will follow) will change the way screenplays are actually written, as much as give an ability for a good, unshot screenplay to see life.
What I mean by this is there are already differences for example between a spec script, and a shooting script. A modern AI screenwriter will be writing beyond these styles/rules in that the script will include direction and details that completely go against the norms of how a script is written in the entertainment world.
Hope you get to 100K real soon..... you deserve it. :)
Thank you, Tim. Some very interesting stuff here.
The space is moving in some really cool directions right now! I think it's going to be pretty non-stop until November again! Here we gooooooooo!
Looking Good. Almost there Story/Script to A.I. Video ... Coming Soon. Also, Quick Nod to LTX Studio, I need to go do some more testing over there.
: )
LTX video coming up soon!! I'm actually working on it tonight! This one...is a bit different? But cool!
Minus color was really good in the theaters. Better than I expected
Can you recommend a site onto which I can upload an original song with lyrics, and type in my lyrics, and create a 'music video' that artistically reflects my song and its content?
I think at some point in the future... maybe within 5 years, we will have AI generated, interactive VR experiences. All you'll do is ask the AI to create your world, or maybe have some pre-defined worlds as templates (or continued experiences)
I think we'll see the very opening stages of that this year. I've seen a few projects that are close to it. And, of course-- we've already seen AI Girlfriends, so having NPCs for those worlds is already do-able!
Earth might already be VR Prime 1 - we would never be able to tell.
Finaly Fantasy Advent Children getting mistakened for Devil May Cry XD
Open Clap looks interesting however I can’t find anything on it online?
I got the link posted down below now! Sorry, I hit publish before finishing off the description section!
@@TheoreticallyMedia thank you! Love the vids btw.
Thanks for the content
I been using LTX Studio for my workflow. Not sure I will change at this time......
LOVE LTX. Working on a video for them right now. That said, we live in an age of embarrassing riches. Use ALL the tools!
Could you provide a link to the video at 7:24 please. Or his channel.
Thank you! I missed putting that in the description! It is there now! (I think comments tend to bork links, so I had to pop it there! Sorry!)
Thank you
Thanks, as always, Tim! I'm happy I have a "go to" channel to learn about new and updated gen AI apps. Keep up the great work!
That is excellent to hear! Welcome aboard!!
The cgi images that were being viewed at around 5:27 are from Final Fantasy Advent Children. Awesome cgi fight scenes from 2005. The images are specifically from a fight scene about to unfold between Tifa and Loz (I think that's their name, based off a quick search).
Get ready for millions of crappy screenplays flooding the internet!
Haha. Oh yeah. Back the in Hollywood days, I briefly had a job as a “reader” where I’d have to read and do, basically a book report, on various submitted scripts…and man, I’d say 97% of them were horrible.
But. That 3%? Some amazing gems. Fun fact, one of those scripts was Harold and Kumar Go to White Castle.
Yep. Exactly that. Millions of people who think, their "My protagonist, who is me wakes up and has a boring life filled with Sex and Action and Aliens and War, and I... uhm I mean, my prot is the ultimate hero"-story is the biggest art in motion, ever written. 😒 Can't wait for the film festivals of the future. No, seriously. That's no development humanity needed and it will cause so much harm. I am happy, that I had the chance to live a nondigital childhood and experienced the internet in it's prime. I didn't knew how blessed I was. It was an honor. We will meet in Valhalla.
@@TheoreticallyMedia Great story 🙂
@@TheoreticallyMediadon’t forget, David S. Ward's spec script for The Sting was pulled off a slush pile, almost randomly, by a reader.
Ward won an Oscar for it, and the film won best picture.
I wanna be apart of it. It's the funniest thing to me. I'm determined to make it crappy despite any advances ai has. XD lmao
You must have at least 7m subscribers 🎉
Godzilla Minuas one is on Netflix? I just bought it on Apple+ two days ago. SMH
I know right?! I was super surprised to see it show up on my home page! Scavengers Reign as well, the HBO SciFi weirdness animated show as well. That one is super cool of you haven’t already seen it.
Greetings from Vienna.
But when you hit 100k you turn into a pumpkin, right?! Oh oh! Please someone, send in a url to a video of Tim turning into a Pumpkin!! He should then show that video and maybe some other Subscriber's video animation attempts in a "Subscribers Special", video. Right, Tim? 🙂
A pumpkin in a blue suit, of course!
One of these days I promise I'll watch the 3 movies of "The Godfather" just to understand why some people refuse to accept there was a 3rd movie. 😁😁
The first one holds up, but in the context of modern cinema, it might take a minute to digest. It’s funny, we’ve seen so many iterations of it as source material, it almost might dilute the original.
The sequel? That’s one of those rare follow ups that almost eclipse the original.
After those two, you might black out for about 2 hours, and when you wake up, you’ll wonder why they never made a third movie!
I'm working on a full length film script right now, hopefully when I am done the tech will be ready to do script to movie ^^
wait for the swarm, wait for it🤣
These programs are catching up fast, I'll even go as far to say a team who is willing to do clean up and fill in the gaps can put these to use. That Berserk fan adaptation will consume these in no time on a form
Godzilla best movie of the year for sure
It was sooooo good. I watched Godzilla/Kong shortly after-- and while, I don't hate those movies, I also couldn't shake how stupid it was in comparison. GxK are very much "brain off" movies-- but Godzilla Minus really shows how GOOD a Godzilla movie can be.
@@TheoreticallyMedia exactly
I watched this weekend and was amazed. How come we got so used to the plastic feel of hollywood? A japanese film made with 10x less money and 10x more brain. It's almost a vindication for the real Japanese creators of Godzilla, the point of view of a country that lost the war is extremely effective to the horror of the genre.
Let's go revidmococo and godzulla minus one 🔥 and yay let's go 100k 🎉which just means already like 1m ❤
I mean, if no one takes revidmococo for a title, I'm totally going to make it into an ice cream flavor!
@@TheoreticallyMedia ha being my husband is obsessed w ICe cream I'll be 1st one to try it it's time for smellavision lol 😆
"Get The Clap!" "I wrote my screenplay with The Clap" "I love The Clap"
Oops. Someone named their product without doing any market research.
I'm still on my 300th rewrite of my ChatGpt screenplay.
Identify the difference between the two clips at 8:39 to 8:50...they're the same clip
I need this for my movie, I am thinking next year, I will do my movie
I still say start now!! Maybe a prequel?
@@TheoreticallyMedia yes, I have already the script, I write the book, the story and the script. I also have 400 prompts ready to generta each scene .. jaja . but yet not decent plataform.. so waiting my time :)
@@TheoreticallyMedia watch?v=xgi4vEMBKyk the trailer, also done, so so
@@Comic_Book_Creator I am curious. Why won't you learn how to do it yourself? Why wait god knows how long so someone else can make your movie?
@@SholvaBeats I am wating for the platform.. how can I make a movie?¿ its 7M budget movie . lol
What the hell is happening in studio a?
👍👍👍
It's not devil may cry. It's the movie Final Fantasy 7: Advent Children😅
Ahhhh, thank you! And that’s funny: I’ve seen that movie! To be totally honest, didn’t love it though. Just felt like a 2 hour cutscene!
@@TheoreticallyMedia Hey that's similar to what my friend said too. I loved it though. Watched it too many times so I remember it by heart😂
OPENCLAP? ohh hell no, of all the names to choose 😂😂
2nd :P will have more to say after the vid lol
Can't wait to hear your thoughts!
What if God was AI, and it was prompted: Create a world with water and trees and mountains and deserts. Fill it with plants and vegetables and fruit for food. Now create a diverse ecosystem of all kinds of animals from tiny to giant. Have them live in the oceans and rivers and across all the land. Make some crawl, some walk and some fly. Now create pockets of people, male and female, vary them by shades of skin, hair and eye colors and spoken languages. oh and make the weather exciting. -- And then we are all here.
that prompt misses creating all the evidence that it didn't happen that way
Maybe we'll get there in a hundred years
Your prompt forgot to include: "btw make sure they 100% f*** it up on almost every level"
Well then God would be the user of the AI
*sigh* .. aaand mac users will see all of these tools when it's finally out in the commoners' playground in early 2027. At the same time also on Iphone, Apple watch, Apple deepfryer (not yet out), and when even your grandma will shrug when someone says "AI" as she'd have Sora V.4 creating all her shows live from voice command (on her PC) for 1 year and a half.
If you're a moving image creative with a love for video games, buy a PC. Mac is just expensive shiny decoration that sometimes get emails.
Haha, as a Mac guy, I can’t say I disagree. I mean, to be honest, I’m platform agnostic, and used/maintained PCs at most of my jobs. I’m the “you know computers, right?” guy.
That said, Apple had better come out swinging at WWDC this year. They lagged hard on the AI front and are playing catchup now.
They have a powerhouse in the M chips, so the potential is there. We’ll see in about a week.
@@TheoreticallyMedia urgh. I feel for you *sigh*
5:30 gotta love how the ai examples always have to use someones IP to steal from to showoff like bruh
Haha, I get it- but at the same time, it’s the easiest way of showing an audience something familiar and going: “look what this tool does”
It’s mostly because it shorthand’s the audience’s
Perspective. Like, quick access to the iconography section of the brain. (Sorry, this got cut into two comments because the mobile app sucks!)
@@TheoreticallyMedia also an easy way to piss off all Japanese that value their anime.
Correction it's only one Godfather lol
Haha, 2 is good!! I actually think it's better than the first one! Those might be fighting words to you?
8:14
😆 🤣 😂 😹 😆
I really want that job!!
@@TheoreticallyMedia
I'd definitely hire you for that!! 😉
ha. g3 is not so bad if you watch it as a miniseries w the others. it has some memorable scenes for sure.
It’s been years since I’ve seen it, so maybe I’ll do a marathon next time around. I just did that with the Pirates movies, and while I’ll say the first 3 work better as a binge- the 4th is still terrible.
I’ll try it out with the Godfather trilogy soon!
@@TheoreticallyMedia i loved the first pirates. did not really like 2 and 3 so much. 4 and (?0 had aspects that were good. From a CGI angle, the films 2-5 had some great and some horrible moments. i will never acknowledge anything wrong with the first one :)
👋
Heya Louis!! I feel like this video just got the blessing of the yellow wave!
@TheoreticallyMedia
It's kinda my fasto way to support a channel trademark.
MattVidPro has commented similar to your comment regarding my wave on his vid comments sections.
👍
Your name is Tim.
And I thank you for watching!
You know what's funny? I started doing that for 2 stupid reasons:
1) It's TH-cam, and for the most part, no one cares what your name is when you click into a video.
but 2) it had this unintended effect where, when I see my name in the comments, I know that someone has (at least once) watched a video all the way to the end!
Thank you for watching until the end!!
@@TheoreticallyMedia Hah! That was my point... till the end! Good video.
There are only two.
As soon as you said God Father was a "good" movie, much less a great movie, I checked out. There was nothing good about any of those movies.
Haha. I mean, taste is relative, but it is generally thought of as one of the top ten AFI films of all time. The third one, we agree on! That one is terrible.
I agree, Godfather 3 was baaad 😂
The day when EVERYONE can create "content" with zero effort, is the day NO ONE'S content is worth anything. Everyone in the current content creation business can pack it in and move on to...oh I don't know, mowing lawns or something. (AI lawnmowers will probably be doing that, so maybe scraping sewers or something?) I have no idea why creative people are waiting with baited breath for that day to arrive. I don't even make my living creating content... and still I loathe the almost inevitability of it at this point.
Because creative people don't know, what they should do?! Maybe?! AI is coming for every job. The rich will stay rich, the rest will die by starvation. So, why should we change careers? As soon as you get a new job, you will been replaced. And those who think, the government will give them money, mistaken that the government is run by big corp and multi billionaires. And they don't help others. They take. If you have nothing to give, if your work is worthless, then why should they let you live? You are just a resource-wasting little rat for them. We will all die very soon.
No, because most people will either not do it or make horrible content. The ability to make good content will still be the defining factor.
What is the point? Film making is an art. Why would anyone do this? If you can't draw, learn it. If you can't 3d model, learn it. Can't play music? learn it.
There is satisfaction in making something yourself and getting better at it. The end result is always better than some generic ai crap.
Great technology, but it makes everything mindless and boring.
First
You have won the chicken dinner! I'll send it out in the mail tomorrow...I figure a few ice cubes should keep it fresh!!
I can’t even fathom why ai engineers are even working on this.
Please go back to working on new ai/ml based tools for software. I love Ai when it helps me rotoscope quicker, color match, pull mocap animation from video, etc…. Things that help artists do their jobs. Not things that take artists jobs.
This is straight dystopian. It’s almost spiteful. Who hurt those poor ai engineers. Why are they working so hard to unleash this evil.
In the case of OpenClap, I don't see it that way. Julian is coming at this from at artist perspective, and although OpenClap does have the screenplay "prompt book" idea in there, this isn't generating anything. It's just a smoother way to work with assets. And since you can stuff anything into a Clap, that also includes actual filmed sequences if you're an indie filmmaker.
Both of those other tools featured mostly are artist focused as well. Animation is super tedious, and the ReVidoMococo-- I mean, that's basically tracking and roto in one.
@@TheoreticallyMedia that’s completely fair and you make some great points. I’m just starting to get scared lol. Not necessarily for jobs but for the psychological effect on humanity. At the very least it will be interesting to watch .
I agree. Great technology to use as tools, but it has no place in any art form.
They work hard on it because there is big money in it. Most people have no creativity and even more are too lazy to put the years in.
so most people want this tech. I hate it. Personally i would rather spend 100 hours on a pencil drawing or countless hours on modelling something in 3d.
Took me years to get here and it feels good. Got bored with ai "art" within an hour.
@@SholvaBeats keep it up. My cope is telling myself that as non-ai artists we’ll be able to form a sort of counter culture movement that eventually drags people away from the generic garbage that is AI art (and corporate, focus grouped art too).
Like hopefully years of shoving the most generic soulless AI content down people’s throats will open up an opportunity for weird unique art that might not have even been successful in the pre-AI focus grouped lowest common denominator era of entertainment.
Mainstream art is already so generic and sanitized and AI will push it even further in that direction. I really hope this means the future is unique human created art.
I keep getting tricked by your thumbnails..., but I keep visiting your channel . I'm hopeful and appreciate all you do BUT these apps are not ready yet or take more work with a steep learning curve to be useful. If i hear some chad twell me that this app can make a movie from prompts I have to keep calm....,ooosssaaaaa.
That AI animator is the antithesis of animation. Imagine thinking skipping the artistic part of art is a good thing.
Nice clickbaity title that completely fails to deliver.
Whomever created that product name should be fired. Never name your product after a venereal disease.
can you just go away?
Where would I go?
Don't go away I like your content.
Detroit@@TheoreticallyMedia
As tribal leader of the Ballchinians, do you not like Tim's content?
@@TheoreticallyMedia the luddites are out in full force