Did We Just Change Animation Forever?
ฝัง
- เผยแพร่เมื่อ 25 ก.พ. 2023
- ANYONE can make a cartoon with this groundbreaking technique. Want to learn how? We made a ONE-HOUR, CLICK-BY-CLICK TUTORIAL on www.corridordigital.com/
Watch the full ROCK PAPER SCISSORS anime on Corridor ► • ANIME ROCK, PAPER, SCI...
This project has been a huge labor of love, and it is due to the amazing open-source community that we have this technology available to us. We hope that by sharing our discoveries and techniques that we can help push this technology forward for everyone. If you want to dip your toes into this tech, there are many amazing online communities ready to help teach you, including ours!
With Your Support, We Can Make More! ►
This project exists because of the amazing members of CorridorDigital, our INDEPENDENT STREAMING PLATFORM. All memberships begin with a 14-Day Free Trial and you can Cancel Anytime. Consider becoming a member yourself! www.corridordigital.com/learn-...
Anime Rock, Paper, Scissors Shirt?! ►
Available only until March 6th, we have a limited-edition Anime Rock Paper Scissors t-shirt and longsleeve design to celebrate this release. Check it out here! corridordigital.store/
Design by Kendrra Thoms kendrrathoms.com/
Gear Used ►
Puget Systems Computers: bit.ly/PC_Puget_Workstations
Lighting by Aputure: bit.ly/CORRIDOR_LIGHTS - บันเทิง
I see a lot of concern, especially from animators, that tools like this will eventually make them obsolete.
This isn't a replacement for someone that knows how to animate, nor someone who can draw. Tools constantly evolve, but making something visually captivating always requires those same core skills. It still takes an artist to make art. That hasn't changed.
What we figured out here is a very advanced form of old-fashioned rotoscoping. Animation takes a lot of forms; Traditional, 3d, stop-motion... They all have different strengths, and enable different stories. Our method here isn't a replacement, but an attempt at something new.
What excites me is that this tech makes it easier to bring my visual ideas to life. Ideas that were otherwise impossible. When I said this democratizes animation, I'm referring to the near-insurmountable mountain of work needed to make a full-length narrative animation. Currently that requires large studios and large budgets. Doing it on your own is nearly impossible.
But I see potential in these tools to change that! That's what I'm so excited about. Imagine one person, or a few friends, bringing their crazy ideas to life. Imagine if a traditional animator could automatically have their drawings inked and colored. Imagine eliminating the uncanny valley on cgi faces. These tools have the potential to do that. We're trying to figure out how, and sharing our journey. If we want community-controlled AI tools, we need to develop them as a community, otherwise they become proprietary tools locked behind a company.
And yes, this can be done with your own style. We trained our model, not from hundreds of artists, but from ONE film- Vampire Hunter D Bloodlust. We've been very open about this, and I think it's important to be. But this is also an experiment and a loving parody of this era of anime. I consider it no less ethical than the countless other videos on our channel that borrow from pop culture to tell their story.
Sudden change can be scary, especially if it feels like your passion or livelihood is on the line. But that's why we're out here exploring it. Hopefully we can help shine a light into the fog for everyone.
-Niko
People will just adapt just how engineers are using CAD programs nowadays instead of doing it with a pen and paper.
@@laurenswintek895 Bruh this saves millions in costs and enables a solo dude like you do it on your own. How is that pro big corp ? It's literally made to help the tiny guys that don't have studios or equipment.
Ty
Please don’t let the haters get to you guys. I’ve watched your videos for well over a decade now and seen you all grow into adults with children for peat sakes. I feel old just reminiscing. I can’t help but have a sense of fear for the future as an artist but I am excited to see what you guys come up with next. ;)
btw this comment section is filled with trolls pretending to be people who care about artists. Please for your own sanity just stay up here.
@@Lemosa3414 saving millions at the cost of the software literally building it’s foundation off of stolen art and talent. no matter how you look at it, a lot of ai tools relating to art creation is based one some type of engine that was trained off of art that had no consent to being used. we cannot look at this in a positive light until work from artists that were stolen has been acknowledged, reimbursed, and evaluated.
As an animator... this scares me. I've dedicated my life to draw and know how to recreate motion within the drawings. Only to be replaced in a couple of years.
exactly. every time i see someone endorsing ai imaging my dream of being an animator dies a little
as an illustrator I totally feel that. At the moment I'm too aware of the possibility of clients just replacing me to be excited about the tech
I don’t think traditional animation will become obsolete, it may just be considered as a different style. Look at the painstaking hours put into stop motion. There’ll always be appreciation for traditional techniques
It's not like everyone will be able to create full cartoons just with couple of clicks though.
Look at search engines: those didn't kill marketing. There's still a skill and expertise required to make a webpage properly indexed by search engines (and there are whole courses to learn SEO, it's not just a 15min tutorial).
Just look at Sam's list of prompts he used. It requires time to learn what works and what doesn't.
It's another tool. But it still requires the eye of an animator to do it right.
I have the feeling "designed by human" is going to be a trademark soon
it seems that this will happen soon, and "designed by human" is simply a sentence, anyone can just lie about it
It's like "artisan" food; while it means something, companies just take the word and use it however they want.
A trademark is a protection of IP. How is "designed by human", as a phrase, IP?
The silver lining in all of this is that, hypothetically, AI-free Art will be more valuable and thus artists could actually make more money
@@viewsfromcairo How would it become more valuable?
In order for that to occur, supply must lower while demand increases.
Will demand increase? Or will there simply be more art?
Will supply go down? The same number of traditional artists exist.
You could argue AI art will cause more artists to give up but that's not really guaranteed. As it stands, most artists don't make a livable income off their art. They do it not as a career, but as a pursuit of life.
As an animator myself, this doesn't replace animation at all. It's another tool. There is now just one more new style. Painting moved digital a long time ago and cameras have come a long way and yet there are still somehow people buying and selling brushes and canvases painting portraits the old-fashioned way.
a gun's purpose was for hunting and self defense and look at how that turned out, you're putting a lot of faith expecting people not to abuse this
@@lawgx9819 I understand that you believe that opening up animation to more people will cause mass deaths, but I disagree. However, not to get too political, I do think that if the government begins regulating animation, there will be massive problems for people trying to survive in an ever-changing world.
@@lawgx9819 Really don't know where you got that idea from - military use has always been the preeminent driving force behind firearm development, going back to even the earliest examples like the Chinese 'fire lances'.
Hunting? Self defense? With advanced technology? That's not something that the poor ever got to do lol; outside of military use, firearms were toys for the wealthy over the majority of the history of firearms. Being affordable and accessible to the everyman isn't something that happened for a LOOOONG time.
The difference in it being a “new style” compared to a replacement is in how the medium is being used. Making AI based anime by essentially rotoscoping live action won’t be seen by big companies as a fun style but instead cheap and easy to manufacture product. Truth be told there’s nothing wrong with live action, I even find the live action version of this video to look better than the “anime” one but simply putting what can be called a filter over an existing product shouldn’t be glorified as a new tool since it doesn’t serve to make a process easier, it just alters something that was already made. Actual advancements using AI have been made such as Cadmium which is a program that uses a persons work to help color in their animation. That’s a tool, it’s helps make an already intended project easier. If you want anime made there’s nothing wrong with just admitting to yourself you don’t have the skill or time to learn. I’m not gonna make tools for a painter to be good at baking, that’s what a baker is for.
TLDR: Basically anything can be technically called a “style” but the actual application provides a cheap way to recreate other peoples work without actual work or talent in the field. Wanting to make anime with no care for the creation of anime is an incredibly ignorant mindset
@@jasonparada9596 I understand that you believe cameras (which I would consider a new style of making a portrait), really aren't a tool and that it takes no skill to use them. Only classical painters are the real artists eh? Electric hammers aren't tools either I guess and big companies or builders won't see them as such either. Maybe we should all just quit this new Photoshop "fad" since it will kill jobs and be seen as a cheap replacement instead of a new skill or style. To be completely honest, while I enjoy new styles like this, or Pixar, or old-school Anime for that matter, I also appreciate Disney's style, but still I appreciate claymation. There is room for all of it and the new stuff that'll come after. If anything it'll encourage innovation. Can't keep doing the same old thing and expect it to be tops forever. Just today though I saw someone killing it hand shadow puppetry doing stuff I've never imagined possible.
Around the 17:00 mark he says “Anime has no 3D camera movies”. Close to every modern anime does, even slightly older ones like Death Note had spinning 3D cameras in moments.
Akira comes to mind.
The next time you invite animators as guests, you should show this to them and get their reactions
I think they wouldnt like it that much
Since technology basicaly steals their jobs
Edit: jeez so many replys 😭😂
I do agree that that kind of video would be cool to see
But i as a digitital artist personaly dont like ai "art"...
at all :/
I dont think that the ones who dont agree with me understand how frustrating it is
it would be a good idea, maybe their larger audience would finally see them talking about the ethical and moral implications of using AI -based on stolen and unethically sourced work cof cof- seems like they only talk about it on podcasts
I don’t think they would like it, trust me
@@alexanimatess5552 Not... yet... this still looks very rotoscoped and the movement isn't stylized enough. Having said that... it's clearly coming. This might take the jobs of lower skilled animators like those who work on most anime, etc.. It's still a ways away from taking the jobs of people at Studio Ghibli, Disney/Pixar/ILM, etc.. Like I said though... I do smell the wind turning and this taking even a lot of those jobs away. Not all of them, but certainly a significant amount.
Ever watched Father Ted? Theres an episode where the woman who makes tea gets shown the new tea maker. I have a feeling it'd go the same way
I felt a great disturbance in the animation industry, as if millions of voices suddenly cried out in terror and were suddenly silenced. I fear something terrible has happened.
Eh...
Wow, very dramatic. Terrible? I think you've missed the entire point of the video.
This is the future inevitable and never ever going away not this time no US law can stop this
The way of AI can lead to animations some may consider... unnatural
@@MrForestExplorer star wars quote
Rotoscoping has been around since the dawn of time; we've seen it from Bakshi's Lord of the Rings, through A Scanner Darkly and more.
While the ability to convert oneself to a 'drawn' character is super cool, no ifs ands or buts, there's a world of difference between animation as a medium unto itself and then just having rotoscoped content.
This is a very different concept considering it literally can’t exist without art to plagiarize.
@@Potterphilly13 it doesn't plagiarize anything...
The models don't store any art
@@TragicGFuelyou do understand how ai art works right? it goes through segregated images and copies patterns it notices and tries to fill those in the best it can through either preexisting images (like the ones seen here) or by making something “original”, and either way it’s stealing.
@@jico5147 patterns or art styles are not ownable materials. They're not under copyright. That's whu two people can draw an apple in the same art style and not sue each other.
Also, your explanation of AI's working tells me you don't have a clue on how it works beyond the layman's explanation. Which explains why you think it's "stealing"
@@TragicGFuel no i know it’s stealing because i’ve seen real artists use it and explain how it works, this is literally how it works. it copies patterns it picks up from whatever it’s told to copy off of. i don’t think you understand how ai art normally works. in this case this artwork just takes art it sees, copies what it sees, and applies it to the frames of the footage, it’s how you get things like inconsistent designs and patterns. it’s literally just copying whats seen and outputting whatever it thinks is correct. i also never said anything about copyrighting art, though ai mystery meat cannot be copyrighted, while real art can.
This isn't animation, this is rotoscoping.
“Rotoscoping is an animation technique that animators use to trace over motion picture footage, frame by frame, to produce realistic action.”
@@legolorian3271There is not even tracing in this, so calling it rotoscoping animation is even a stretch (as the artist has to make important decisions about form, weight and movement if you are going to make rotoscoping with any artistic merit.)
this is "Anime" in the same way a Snapchat filter is anime. In the end, it isn't animation at all, but what they are good at: Video editing, VFX and post production. Calling it animation is extremely offensive to those who have dedicated their lives to the craft.
@MelloCello7 😭😭😭🧂
What’s so cool about this is that when I was younger I honestly thought cartoons were made from actual videos. So in my head I believed that when I was watching YuGiOh they actually filmed everything first then drew over it
That is a real animation technique but it is rarely the final product. I’m pretty sure they did that in the Lord Of The Rings animation for a few scenes.
That's how they made fire and ice
lot of companies make a 3d animation and draw over it cause 3d is easier than hand drawn
also they use stock footage like martial arts and stuff to get the fluid movement so you are quite close
Miayazaki used that style of animation in some of his work! Like in Castle in the Sky there's a scene of a brick wall getting broken, and it was a real brick wall they filmed and drew over.
Rotoscoping?
I'd be interested in seeing animators react to this.
We are all concerned and amazed at the same time.
Amazed a small production can put together something that looks so good.
Worried because it devalues our craft we've dedicated our lives to learn.
As a animator, i think more tools means more options.
@@PikaPeteypeople who used to make typewriters lost their jobs when PCs became widespread, now everyone on Earth uses PCs and they have given jobs to billions of people.
If skynet doesnt happen this will be a positive thing for humanity i believe.
@@PikaPetey there is no doubt in my mind that normal animation and art will always have a place.
@@MumboJumboZXC Things like GarageBand and other such programs haven't gotten rid of musicians using actual instruments, not in the slightest. So I think traditional art will be fine
This has made me consider copyrighting in a creative way I hadn't thought about before. If AI copying a style from human works becomes the norm, I'm worried new animator styles won't have a chance to develop because studios would rather not pay for staff. One of the things I love about anime is when you see a key animators style pop that sometimes doesn't even match what was the norm for the show. I'm thinking of that episode of samurai champloo where Mugen gets super high. While I see this tech could help a vision get made, it does so by copying previous works for the style. I'm worried of the long term implications of that, since we may see less new creative styles.
Yes these people dont give a thing about it
Honestly I think this new tech actually does the opposite. Is usually easier to stick to the same artstyle then it is to not only create a new one but to teach an entire team of dozens or hundreds of people a new one. With AI tools in the future, you'll not only be able to easily switch between artstyles, you will also be able to mix countless different artstyles. It is like the difference between being limited to the paint dye that you could locally source pre-industrial revolution, to having access to every color imaginable in the digital age. You can create a pretty much limitless number of artstyles by combining old artstyles. But on top of that it is easier to incorporate new artstyles since you only need to draw a few examples, and it can be learned and applied by the AI pretty quickly. Its easier for corporations to justify being ambitions, when it becomes cheaper/less time consuming to do so.
It's also important to remember that new artstyles that people creates are effectively combinations of existing artstyles anyway. There isn't really anything new under the sun, just creative ways of combining the same elements.
Very clever point, this could mean that we’ll not have an emersion of new styles and works of pure creativity.
Not gonna lie we better regulate the shit out of this tech.
When you have to do something badly for so long to be able to do it well, this alternative says why bother? It's a discouraging obstacle to new artists
Feature extraction should be a criminal offence, the rich like this shouldn't be using feature extractors to steal from poor and ethnic/minority artisans. It's basically technological classism, or rather fascism with a touch of ruthless social darwinism.
This is *not* animation. I think its very important that we make that distinction carrying this conversation forward. In order for something to be animation, the baseline prerequisite is that it must be animated.
This is simply another incredible example of what the Corridor Crew does best: VFX and Post work using AI.
Disney absolutely salivating about all the animators they won't have to pay once they get this tech sorted...
A.I art can't be monetised, you're scared for nothing
Yeah, they'll have to pay actors and VFX artists, alongside people who specializing in managing this tech to oversee each frame instead.
@@_xymi says who? It curretly can't be copyrighted, but bo one is stopping you from selling it.
Why just them? Wouldn't any company be tempted to do so? Even *normal people* are publicly embracing it, so it's not companies. It's society.
@@_xymiThere’s a person on DeviantArt who gets paid for it.
I love how we are in a time where, "It's designed by a human" is actually a selling feature.
I replayed that bit. Felt like a futurama gag
Handmade was a selling feature for over half a century now
But the image taken is AI, fed by screenshots of the anime.
@@michalslusarski usually the word "handmade" indicates higher quality but in reality it tends to just be pricier.
95% of it was all done by a human??? are you kidding me.
I think it's a gray area... There's a lot to be great use for Ai mainly in the health and medical industry however for the Arts and Entertainment Industries that's where the gray comes in. I can see where it can be useful however I completely validate the fact that people mainly artist will feel competitive with AI and might not beat that competitor. Studios and Hollywood in general is about making money and seeing how The Writers Guild Strike is going and people wanting more proper pay, I can see Ai being the cheap alternative and since it's new many people will go to it. So I validate the fear and nervousness for artists going against AI and it upsets me that with such a useful tool that can be used for again Health and Medical purposes it's now becoming a trend used popularly for social media and dipping into the Art and Entertainment Industry.
I agree in some areas but i do still think there is a world where we can have cool things like this, and more traditional art.
19:01 when i saw the short i was kinda worried that now that this has become like common that would affect negatively more independent artist...but while watching this making off i started shifting towards Niko's idea...and this here gave me validation.
Because normally only big teams were able tu pull stuf like this off, like, it was reeeally hard, but now any artist on a small team can do this with enough dedication.
yeah the other problem will be that it will be flooded with animation because everyone with a bit of money and know how will be able to make it devaluing animation exponentially to almost nobody is gonna see your work, it's hard to see the tree in the forest kind of situation.
and from there it's back to who can produce the best quality work again and that will go back to money and man power.
@@bobxbaker We could probably have said the same thing for cinema with the spreading of low-cost camera, adn the development of platforms like TH-cam.
@@blade7y156 yeah, and i watch youtube more than tv and movies combined, look the economical standpoint changes when new technological advancements happen, all the commercial prints used to be hand painted, there was a lot more work for those who painted before it became obsolete.
still people paint because it's a fun hobby and it's still a good pillar to understand visual interest, but do you need to paint in order to be a good artist anymore? not really, and look even if we do the most sought after art today is digital art made on a computer.
and the whole painting process have been revolutionized aswell even if we were to hold it in high regard, it's not quite the same as it used to be.
photography and digital softwares have changed the game immensely.
@@bobxbaker You need to paint to be a good painter though.
In chess AI have already destroyed humans so much we could never compeat, and yet there are more chess players than ever, more great players than ever, and almost all of them use AI.
The point is not whether or not it will change the field, because obviously it will, but whether or not it would make the field disappear, and I think not.
@@blade7y156 nothing that is enjoyable will disappear, wether you can make money doing it or work the same way you used to is always subject to change.
but with that said, there will always be someone who appreciates what you do if you do it well enough.
my point is that some people will not have a job or have a drastically different job description for the same work they used to do.
but then again when you go into any artistic field you can't go into it expecting to make money.
I'm so excited to see where you go with this
Nice video
great
Hi
Nice
Nice
As somebody who just graduated from college studying 2D animation; this video is pretty scary. It’s so impressive but it takes away years of progress that thousands spent their lives doing
Have drawn animation will never be replaced. It just has a different feel that I don't think can be replicated fully. In the future, who knows but I feel there will be a place for them for a long long time yet.
@@FullMetalAtheist it will. In the next 3-4 years at most, someone with just a single high-end RTX 60XX card will be able to ask an AI model to create entire anime series in just a few dozen hours (or a few hundred at most depending on the size of the project).
You could have it use a source like a Light Novel, Manga, or even an original anime, and ask it to make an adaptation, a sequel, or even a remake for it.
It will be able to make everything from story, to sounds, voices, and of course the art/animation. Also, have it come up with original stories based on your preferences will be entirely possible.
The same will be possible for movies, and early in the next decade (because of the sheer size, complexity, and required processing power) even entire games.
@@OnigoroshiZero this is the same argument I see for guitar amp sims... there has to be an original in order to emulate... there can be no output without input. The beauty in animation is the vastness of styles presented by different artist and if they all just copy the same sources then they will all devolve into the same style and no one will want them.
@@OnigoroshiZero i truly hope you are wrong because that sounds like hell
@@OnigoroshiZero Possibly but I have accounted for that in my statement. There will always be hand drawn animation, it's like how everyone thought practical effects in movies would be totally replaced by CGI, yet practical effects are still in use. CGI is common but there still exists a market for practical effects. I think there will be different markets and some may use AI enhancement to create things but there will always be those who animate by hand.
I recognize that this is an evolution of the medium using technology, akin to how Pixar leapfrogged digital animation,but it does put into question how the art form of making anime or cartoons is lost. In terms of commercialization and mass production of animated output is concerned, this will be an effective tool. But it does add another knife on the back of an already heavily injured art form. IMHO
But cool tech😊
Im pretty sure that its gonna be similar to 3d + 2d animations where you tweak what looks weird, make things look more interesting and I could even see it being a big fusion where you animate the character with 3d to show more interesting camera angles perspective, ai to make the scaffolding of the character, and 2d to tweak what looks weird and add smears and exaggerated expressions.
This just makes me appreciate Joel Haver's animated skits more
Aren't they AI generated as well?
@@avokka no, he hand edit every frame and adds the colors
He uses rotoscoping, which isn't really AI in the same sense, but does use computers to calculate the frames. He still has to hand draw the characters and such.
@@nintendomario007 that’s what I mean
@@nintendomario007 but isnt CC's method just rotoscoping as well? Their style in the anime video is nothing like the anime they trained the SD Algorithm with.
Also I love his style, checked out to remember, he uses Ebsynth. Sorry for my mistake
As impressive as this is, it's scary when you realize a lot of animation companies might take advantage of this and use it as an excuse to put a lot of people out of a job.
exactly my thoughts
As an aspiring animator, I couldn't agree more. I love innovation, but not when it can completely substitute, or steal an entire group of individuals life skills. Especially one that still requires a lot of skill and understanding of art from even its basic forms.
A.I. art and animation is a fascinating tool, but I feel it really increases peoples NEGATIVE perspective that art is just some push of the button or filter. As if it wasn't a real skill that requires years of training to acquire the talent to make everyone's favorite "funny cartoons."
@@jkrwhy It did, but now it won't require years of training anymore.
Then the companies will show themselves as enemies of the workers. They must not be allowed to create massive poverty for profit.
Are you guys also upset that 95% of the population aren't farmers? Or does it only bother you when it's the thing that you invested time into has a productivity tool that allows others to participate?
@CorridorCrew there is a background remover ai that should allow you to get rid of the green screen if you could create a consistent clothing ai then you could pick clothing let ai redress you regardless of the clothing you are wearing as well. Then if you can create a background with an AI say for instance a scene or a moving scene from video and then turn that into your anime style this would allow you to discard even more prep work or possibly all of it to move the production solely to acting and ai processing. With extravagant clothing and scenery. It is possible that all of this already exists.
I love how you are using the open source spirit to open source a workflow as well. This really has a lot of potential to become something truly democratizing to animation. I know you see it as an anime tool but I immediately though - this is basically the basis to how everybody might be able to create "A Scanner Darkly" on a super low budget with a tiny crew in the very near future and help improve the tools and the process.
I love it!
Is it open source though? From what I can see everything is locked behind a paywall on their website
Democratising animatio- stfu how about we "democratise" your home, your bank account, your memories, your life story, you're using that word as some kind of justification
This is a really unsettling video. I'm in animation school and there's a big fear of exactly this depriving the industry from respecting animation for what it is. Animation is respected as film so little already, stuff like this only makes it worse.
There's so much more to art than the end product. If that's all you're worried about, I'm afraid you'll forever question the field of your choosing.
@@RodasAPCTV they fact that people only value the end product is the issue here. artists have been exploited for years, this will only make it so that art, and any creative job, is less valued as a whole. that's a valid concern.
@@RodasAPCTV They're not concerned about the end product. This "style" of animation just makes it much easier to animate without creative hands. Many animators will have studied, for nothing. COMPANIES care about the end product, and don't care who they step on to sell it to the public.
@@RodasAPCTV you awnsered the issue and why ia "art" is bad yourself
embrace it, use it as a tool. it will enhance ur work
With the recent rise in your guy's AI videos, we've heard about the Law side of it, and the possibilities that you guys have shown, BUT I would really love for you guys to get a bunch of animators and artists on to talk about it and the future they see it bringing because as a group, they are the ones that will be most affected by this development. Hayao Miyazaki himself from Studio Ghibli has expressed his distain for it (which is why I was shocked to even see a Studio Ghibli scene referenced in this video), and I think if you guys are peddling it as a future resource so hard, it's really important you also express the views of the other side of things. In this video especially it felt like you glossed over that by going "We got it from an anime which is free on TH-cam" but that doesn't necessarily mean that those original artists gave you permission to use their style for this project.
You have animators on react, would just love to see their opinion on the stuff you've recently shown.
Agreed 100%.
exactly. they're gladly helping animation as a medium get killed off and replaced and pretending that this means "democratizing the medium". such bullshit. i'm so disappointed. had to unsubscribe
exactly. every animator i know is terrified of the implications of ai art for their field. this video just solidifies it. im pretty disappointed in these guys actually
Yeah, i agree. The result and the problem solving definitely looks impressive , but it was disheartening to hear them casually mention using Vampire Hunter D's style ( and that movie is insanely and lovingly animated by a lot of skilled animators that came with that style and put hard work in each frame. ) and just use that template to spew out anything in that specific style. Then again, for all the fun content this channel provides, i remember them hyping up NFT's so I don't have high expectations when it comes to their judgement for the moral/ethical use of new tech. Of all the mundane hard things we could use AI for making our lives easier, we decided immediately to use it for art "shortcuts" , forgetting that half of the fun as well as the knowledge/experience / growth as a creator comes from going through all the creative processes - ups and downs and everything. Well, can't wait for the inevitable AI mish mash of every franchise/art style flooding TH-cam.
@@andrewreynolds912 the solution is literally just them being asked if they want their work in the dataset. It’s not that hard. Several of these AI already allow you to issue a request to have work removed from the set
Please do an update on this! Looking forward to learn how it progressed :)
It progressed into a tool called Sora
@@chrisrogers1092but Sora is openAI pet :(
As an animator I'm not afraid of this AI technologies, actually I'm kinda glad, because I use them to make my work less loaded and more easier, we as animator know that this career is exiting but also can be life consuming, like crazy. This tool will not replace animators, not now, because the level of complexity and detail demanded by the clients is something that this techonology can't achive, at lest not know. To get the exact result that is in the mind of the clients/persons in general, you still need hands. Even midjourney can't acomplish that, not now, maybe in the near future. My advice for all animator, adapt to the new technologies. In the future the probably the job offers will be like "experience in this ai needed" so we need to adapt.
No! You are wrong! This will be used to exploit animators more. Watch Mother Basement video about it.
This won't make your work easier. This WILL REPLACE YOU.
@@arnowisp6244 Yeah,I don't think so. But that's your opinion
@@arnowisp6244 lol dude stop listening to that guy, he's the typical soyboy woke fear monger. E;r already left in evidence what a clown he is. I wouldn't take what he says as reference for anything
@@arnowisp6244lmao, imagine telling a field expert their opinion in their field of tech is wrong.
@@Deedo_67 Yeah, a random person in the comment section who has little credibility is as much a field expert as I am a surgeon. Are you really that shallow?
Awesome job, I've been testing with some things I created for while, things are getting very interesting right now!
Hi l am big fan
YOOOOOO!! Can't wait for it to drop
If you're not an animator - why don't you just work in a different aesthetic? Why not leave drawn art to people who draw - and you do art that isn't drawn, if you can't?
booooooooora meu jovem. bate com o piru na mesa do jeitinho que já tem feito, tu é o brabo!
@@ithurtsbecauseitstrue1922 You realise this can greatly aid animators as well right. Tools like this enable people who are solo artists to accomplish way more detail than what is otherwise humanely possible for them. It unlocks artists who are otherwise severely bound by economical differences.
This is 100% the type of thing I would have tried to do in film school. I absolutely love genre-bending multimedia filmmaking techniques, like Cloverfield's found-footage meets big budget sci-fi horror, or basically everything Linklater's been doing for like 25 years. Bravo, guys.
I’m curious… what if you feed the final output to EBsynth but only feed a frame (or a couple of frames) with corrected eyes? Or EB synth the face and composite them back together. Or spend a bit more time hand animating the janky frames?
Really it’s in the eyes. If that gets truly smooth out….
I used to love making animation, hated that it took so long to do, so I quit to do video editing, production, and marketing. Now, this technology makes me want to utilize AI and get back into it. Crazy how things come back around.
So now we're devaluating the work people took "so long to do" and, because it now "fits our schedule", it's the second best thing to whatever you went on to do? What about those who chose animation wholeheartedly, taking all those risks and making all that effort you never wanted to make? What an empath! Furthermore, as others stated far better, this won't change anything the way you seem to think it will. Not saying you shouldn't go have a try at it, but that's not what passionate folks seem to think about all this and you might want to look into that beforehand.
@Ioana Tbh yes I am. 🤣🤣🤣
@@ssj_roger skill issue
@@joanabug4479 why are u so angry, like you said it doesnt change anything its just a new tool
@@ssj_roger Skill issue is right. You don't have it. 'Waaa- it takes so long and I'm terrible at it any way so now I'll just steal."
Part of what gave Ren and Stimpy its signature psychological style was that the pilot was given to 3 different studios to draw. Despite having the same animation guide, 3 different interpretations were made, so from scene to scene the style changes, showing the inconsistency in Ren's brain.
i think i read that they never wanted the same style shown, always a different one ... i loved that show growing up and drew ren and stimpy all the time... i miss that classic show
ok
@@camquoc5718
Yep
@@camquoc5718 mkay
no wonder it sucked so much
This seems really good for static, or easy to produce camera shots.
But animation still has a leg up for complex sequences and crazy camera perspectives that you'd commonly see in fights/climactic events.
It's a matter of time though
Remember how mediocre AI art generation was when it first came out...6 months ago? Yeah, if it's gotten this much better in like half a year, how long do you think the "jank" is gonna be around? A year or two more?
@@sirdinkus6537 Even if they get past that, there's only so many styles to go off of. How long until it all gets old and they run out of styles to use?
And how long until laws regarding animation are put in place where AI art that is made to resemble a specific style without permission becomes illegal and artists will be able to file a lawsuit over?
Just as it's a matter of time before Artists are put out of business, it's just a matter of time before we'll need them again, because as obsolete as they are becoming, it's a lot less hassle to just go for a real animator. Plus they'll probably be in higher demand like animators were a little while after CGI was introduced and started taking over.
@@Karma-ji6ud they chose this style, but as they said in the video there were so many other types of styles to base their ai to work around. that’s just as limitless and subject to boredom as hand animated cartoons. i don’t see this as a way to entirely replace hand drawn work, but to complement as style evolves with it. whether you like it or not i don’t see this ever leaving the industry now that it has entered
@@sirdinkus6537 I think the jank will be for a while now. I draw but I also use AI a lot, I can say that the growth of the tech is not necessarily exponential, it has already hit a pretty hard ceiling and only minor improvements are being made at this point. But yes in a few years it will probably be able to do a lot more and with far more complexity. Will take a while though, don't expect it to be as fast as those last 6 months were.
Please. What software do you use to make this cartoon effect?
Here is an idea for flickering and inconsistency: What about use the previous frame as a reference for the next frame for stable diffusion? AS long as it is not a scene change, it should be similar.
Honestly, it's very similar to how rotoscope animation was done but instead of actual people it's AI.
or just get an animation team to do it
I find it baffling how a month ago, Jake gave a very in depth video regarding ai image generation and the "fair use" of it during the yet to be decided lawsuits, but corridor still releases this video basically showing they used vampire hunter d, a copyrighted series for training(with ads on the video), and the actual video on a for-profit basis
I guess they better hope they win haha
literally all anime back in the day looked like this. they don't have a copyright on generic 90's anime art styles... also the entire thing is free on youtube
@@retardedmonkey9000 The lawsuit is about if AI being trained on copyrighted material is a violation of copyright law. It was never about what the AI-generated images or training images look like. The images they trained the AI on are copyrighted, and that is all that matters.
I would say it's fair to use the style !
I'm sorry burst your bubble but I'm pretty sure you can't copyright an ART Style.
I like that this still required good filmmaking techniques. You guys did an incredible job seriously combining these tools to execute very interesting mimicry of anime.
o
@@andrewreynolds912 That's right, but in theory, a small animation studio can create a data set in a consistent style and feed the AI with them to learn. Now instead of ~60k drawings for a feature movie drawn on twos, they just do a thousand drawings, which significantly decreases costs. And at the end of the day, they can theoretize that they used only their own assets, creating what is a glorified video filter they can apply to live footage. It's not exactly animation, it's not exactly live filmmaking, it's just something new. Can be exciting when used correctly, probably will be abused and miusesd 100:1 :D
@@andrewreynolds912 no
@@KennethJAdams That sounds awful. I would never want to watch a half baked film like that. I want hand crafted animation from passionate artists, not the median of their skills.
@@KennethJAdams the whole point is that it is drawn by people, if it isn’t then it is just soulless.
This is good. It takes the power from the studios and gives it back to the artists. This is a good thing!
Great work, I want to learn animation from your work. Keep sharing tutorials, Thanks
Vampire Hunter D is one of my all time favorite works of animation. Specific artists created it. It's not "generic 90's anime" house style, as I see a lot of people in the comments saying. The designs are by Yoshitaka Amano, who is a world renowned artist whose work is instantly recognizable, and the animation was directed by Yutaka Minowa-- if people are praising the look of this AI generated style, I hope they realize that it has a specific source. If machine learning is going to be another tool in the pocket of artists, then the creative labor of artists can't be treated as a free resource. For instance, nowhere in the CC video is the original source material credited; Yoshitaka Amano and Yutaka Minowa are not listed under the "artists" section in the description. The modelers who made the 3D assets ARE credited, but not the animators and artists that pioneered the style and produced the *entire work* CC used to train the AI. Calling this work "Anime Rock Paper Scissors", rather than "Vampire Hunter D: Rock Paper Scissors!" or something similar, totally erases the origin of the material, and the subtitle of "Making Our Own Anime" is disingenuous on multiple levels. I remain excited for the possibilities of this new technology, I do think it'd be very cool to train an algorithm on an original style-sheet I made *myself* or by another *paid artist* hired for that purpose, but this right here is theft. It's fun to look at, and I appreciate deeply that there is a baseline level of artistry and film making craft necessary to create it at all-- but I feel like CC hasn't even followed their *own* cautionary advice about AI art and respect for intellectual property on this one. You haven't "democratizing the animation industry" by filing the serial numbers off of the work done by actual animators and repackaging it as your own merchandise. I think there's definitely a world where automated machine learning tools are used ethically to aid in the creation of original art rather than just digesting and reconstituting existing work, but that is not the precedent being set here.
It’s so crazy this happened bc the day before this dropped I watched that movie and fell head over heels.. then this happens
They are literally no better than people using a picture for commercial purposes with "I found it on google so it's free to take, right?" So disappointing.
I think they are real fan, using “generic 90s anime” is “dry British humour”. I’m sure they know who Amano is. (I have several of his art books)
@@pyropulseIXXI no, no they literally wouldn't... That's the whole point. There is literally no difference in them using the ai or if one of them sits down for two years, studies the style and then hand animates every scene. They don't have to pay to "original" creator or have to give credit to him/them because you can't copyright a style/color/method only individual art works. Even better, the only way the original creator would have any legal stands for compensation would be if they used the title of his work in thier title because then they would imply that they have anything to do with that creator...
@@kilor78 I think the point is those of us studying hand animation already don’t like the idea of a machine talking our jobs. It’s salt in the wound that they learned off of our work without compensating us.
I'm an artist studying animation and illustration. This is awesomely terrifying; I love it and at the same time it makes me feel scared. Not sure what the future will be like but god, media is changing forever.
This could actually save animation studios in the western world. I used to be an animator. animators haven't seen much of a raise in 20 years. They are the lowest paid department in all of film, which is why i moved into regular film work. They are paid a flat weekly rate, no mater how much over time they do, and it just isn't fair. everyone else in film gets paid tons of over time. There is NO JUSTIFICATION for why animators and CGI artists are being paid so low, especially when they require the most education. Then the pandemic came along and things only got SO MUCH worse, because now it has opened the doors to the possibility of hiring people who work from home, and now studios can hire animators from India and Indonesia who are willing to work for far less, driving down the incomes of artists in the west.
THIS might be the solution that fixes all that. This could see animation studios return to the west. They don't need long hours, or large staffs and can finally work under the constraints given to them without outsourcing to asian studios. This might actually be a GOOD THING.
There will always be a place for traditional art. As the style set will need to be created and further tweaked for production
@@squip7 yeah, all the jank could have been quickly touched up. Way faster than drawing frames from scratch
@@FablestoneSeriesyou think studios will use this as a reason to improve hours and rates? Bullshit. They will use this to pump out more content for less money. Executives will see huge profit but the situation for animators will not improve, if not worsen as their skills will no longer make them valable
The heart of the problems with this is the state of labor selling as an artist is extremely poor. LABOR SELLING ITSELF IS IN DISARRAY. There isnt any future for this tech that doesn’t displace entire classes of workers and to say thats for the greater good only condones the system of exploitation.
18:30 Where did you get the 'Anime Lines' from? Specifically the 'swish and point'.
The beginning is a little misleading. Animation studios have used video footage reference for decades and still do. Ethan Becker is someone who encourages people shoot their own reference footage and even draw over it (not rotoscoped but stylized like anime).
As soon as I began to gain confidence in my drawing ability this comes out
Don't waste your time thinking about it.
Well I feel that but what they did was just A. I rotoscope animation where you trace over film a popular technique Disney used and invented, most of the stuff that makes it look good are techniques developed by anime artists. If A. I becomes an industry tool there will be copyright put in place so only certain works can be used by certain people at least that's what we all hope for but the thing is if everyone stopped making art these A. I imitations have nothing to pull from and now one to prevent stuff from becoming boring or static, so don't give up because things look impossible see through the illusion of things abd persevere we need to make A. I our tool not our replacement.
@@HypArtz002 well said mate 🤝
Can I offer you some encouragement? Be yourself, no substitutions, every line, stroke, whatever medium you wanna work in. Bring yourself into everything you make. Love doing it. This video wasn't made with care, it was obscenely executed with stock anime effects thrown on top. The background is blocky and aimless.
Comparing yourself to something like this is self-sabatoge. This is a tech demo.
@@NicoleHam gave me a smile, thanks!
Someone should reanimated this and do a comparison between the two
Great idea. Might take time though..
that would take an ungodly amount of time even with a team backing the project.
@@milano7250 atleast the audio and reference pictures are there already
In the time it would take for a team to animate this, A.I. would have evolved to a point where it would be better than the animation done by the team. Seriously, A.I. art has been only been out for the public? 4-6 months? & we have already gotten to a point where we are already making A.I. animated videos in less than half the time of the actual teams creating videos without A.I. with less than half the crew.
@@ghostagent3552 if real animators tried itdd take over a year.
i think this should be another style of animation instead of it replacing literally every animator as a whole
As a student in technology with a lifelong passion for art and animation, I understand both sides of the debate on this method.
On one hand, it’s fascinating and opens up the door for new styles of animation and streamlining the tedious parts of it.
On the other hand, all this video shows is that it’s still a TOOL that needs improving, and that can’t truly replace animators. It still requires their work as a reference to draw from, and then to go back in and touch up on the frames. For more elaborate animation sequences or set pieces, they’re still required.
My only hope is, if it is implemented going forward, that it doesn’t then lead them to getting more underpaid/undervalued than they already are…
I think John Muir said something like "It's not blind opposition to progress, it's opposition to blind progress"
You're not nearly as excited about this as studio execs and producers with their finger on the "lay off" trigger
Exactly this
It’s not that people fear the possibility of bad things
It’s that people fear opportunists using those possibilities
Do you light your home with candles and get to work on a horse? If not, how DARE you put all those chandlers and ferriers out of business. You're an actual monster, jesus. /s
whatever, I'm not into hamstring progress to artificially create jobs
@@kjohn5224 Define progress. This seems like a total regression of the art form, yet passable enough to get an audience.
No, you changed the art direction of live action forever. The art of animation is as much about creating unique movement that can't be done in real life than it is about how it looks, and you can't recreate that by filming live action and putting a filter over it.
It's really like assisted rotoscoping, it'd be fine for a sequel to 'a scanner darkly' but it's far from an animation replacement, and insulting to think it's a replacement for the actual craft.
I think this is a good point. The process of live filming and conversion to an animated style is not equivalent to animation because the movement of the characters is restricted to what the real human actors can do. Animation, meanwhile, can do literally anything, unbound by the physical capabilities of real people. It's stylized live-action, not animation.
Thanks to this guys comment, I've now learned that everything I've ever seen in live action movies is 100% based in reality. I can't believe Henry Cavil can fly and shoot lazers out of his eyes. I always thought that was special effects and green screening. Who knew?
Also, your comment is dumb.
Couldn't they relatively easily take the model they've made and apply it to some 3D skeletal animation to achieve anime movements?
Just like they're physically acting things out they could take their body scans and animate them.
@@sirdinkus6537 wow someone who misses the point of the comment and the general fear of the devaluation of the vfx industry that's been going on for years
I just started learning animation, I don't do more than draw a practice sketch and run an animation every day for no more than 30-45 minutes. I think for the one thing I want to make in my life, this might make that personal project possible.
AI art is very much a moral grey area for normal single-piece digital art. But for animation? It could definitely save a lot of time and money.
And ruin it completely, if you can make it in an instant with no effort, then what's the point? Nevermind it's a twisted amalgamation of the work of all who came before you, it isn't adding or building on anything, it's spitting in its face, you're not using it to create your idea, you're feeding it to this amalgamation
Regarding the AI animation, I could see this tech being used for a pitch or maybe 70% of a film that looks in a rotoscoped style (character only moments and such). I think set-pieces would still need to be built by an animator because those moments require more care. I could also see this tech being used between key frames.
Adventure Awaits HUZZAH
You can still use this work process with 2d animation as base rather than irl footage. So an animator would be about to sketch or outline the relevant panels and still have the AI do the heavy lifting on the tedious parts.
I guess AI is inevitable... Hope it will be used as an artists "tool" rather than a "replacement" for the artists
I hope so too.
Depends really. When mechanical looms became widespread, weaving as a profession pretty much died out within a few generations. There are a few small brick and mortar stores that have been around for hundreds of years that still do it, but the vast majority of cloth for things like clothing, bags, backpacks, tents, ect are now all manufactured by large factory machines.
I sadly suspect it will become something similar for AI art. There will always be a market for hand drawn and hand made goods, but it'll probably become more niche as time goes by. Meanwhile graphic design, especially those for and by large companies, is almost assuredly going to move to all AI sooner or later
Maybe the hope is that imaginative animators can produce their visions quicker and without the constraints of budget or studio interference.
HAHAHAHA!
It is amazing how fellow artists have no imaginations.
Can you not project 5 years into the future?
I invite artists to get off the internet and sit by themselves. Conjecture and imagine how corporations, consumers, and creators fit into this puzzle.
This technology WILL replace artists.
@@sparklingwiz2459 it won't replace artist, it will enhance artists... Just like the camera didn't replace artists at the time of its creation in 1800s... Or how not everyone became a visual designer just because Photoshop was released to the public... Or how having a high quality camera on your pocket doesn't make you a professional photographer... Technology's not on the level to replace humans, yet. As you see in this video, they had to do countless tests to make it work right, and still it didn't work perfectly, so they had to work over it to create a expected result... It's not like you could get this same result just with 1 click, you still need experience, you still need the knowledge to make it look how you want...
The reason we record dialogue first. Is so the animators can draw lip sync to the sounds. And helps with timing our shots. I guess now you can time your motion and action to the dialogue tracks. Sometimes the audio can inspire certain actions
In Japan they actually do it the other way round though. Animate first, dub later. Recording first is a western thing.
@@lujho yeah. A quick way to work to a tighter tv schedule. Though there are definately major benefits to recording your actors first
@@mikeglasswell-gameplay I'm pretty sure as I played Destroy All Humans 2 - Reproded, I noticed the first time in years a lip synced audio for German, I think that must have been the first time ever I saw that. I'm almost certain Unreal Engine either has a tool for that or there is a middleware that now syncs lip movements to the lines spoken, it was too perfect and I'm almost sure they didn't do facial performance capture for every other language!....
@@Quast there are some lip sync generators in animation software we have used a couple. For 3d software it's easier as the mouth shape can be easier to manipulate. 2d Hand drawn mouth shapes are different. And you have to listen to the audio and draw the right shape for the sound. In Anime they like to save time and cash, so they will usually dub after the animation is done. The animator would animator just some open and closed mouth shapes. Hard consonants or hard vowels.
@@mikeglasswell-gameplay I'd certainly prefer if the audio still gets recorded in a studio and not during a performance capture, I really don't need the 100% respiratory rhythm of an exhausted human during a full body performance capture - that's where I wanted to go with this. :p
How about a "How close are we to making a Star Trek Holodeck" episode? How would @corridorcrew make this happen? Perhaps a @corridorcrew vs. @corridorcrew challenge to demonstrate various perspective solutions? Even in the ep. above the handoff between teams almost feels competitive or in the 'spirit' of competition - makes the ep. really watchable on top of mind melting happy face content.
the work is amazing!
but I'm thinking of one thing, what's the point if the rendering is the same as a well-made classic anime?
filming, time, money, personnel, 3D animation...
Basically I said to myself "great" the manga/anime universe is now really adaptable to the screen but if the rendering is almost identical I don't see how it becomes useful as much to make a classic animated film or I did not understand something?
5 years from now things are going to be so different, it's wild how things are changing fast
Just think about how 3d animation went from a novelty to everyday thing in 20 years.
@@andrewreynolds912 A lot of people are all for it tho. Now, which one will win?
@@andrewreynolds912 just like artists use other artists works to make their own art which is in turn used by even more artists to make their art and it goes on and on and on
@@shinigamisenpai3303 Wonder which one makes more money? AI? Well then that side will win.
A lot of this shit will be straight up illegal in 5 years. Japan is not going to allow their largest cultural export industry to be fucked up by morons with AI licenses. This will be made a serious crime in japan long, long before they allow a single domestic anime to be made with it.
18:15 The candles should be moving through the shot in the other direction, if you want it to look like the camera is orbiting around Nico's character. The background is moving right to left, which means that the foreground should be moving left to right, in the opposite direction. The way it is, it makes it look like the camera is dollying to the right, with Nico's character flying along with the camera through the room.
I was looking for this comment, it bugged me alot
thats what happens when people let AI do the job instead and dont understand what theyre doing
@@armandoalvarado3956 or, or... Maybe it's a mistake that slipped through before they finished the final product
@@armandoalvarado3956 It was composited in, not made by AI. That was a human mistake.
Glad someone else noticed this too! Incredible video regardless!
It relies on input so none of this technology exists without someone having created in the first place. It’s like someone cutting their own arm off because they feel the hand has evolved beyond the arm and body but will always rely on the foundation no matter how resentful the hand might get. You don’t want to end the addition people might add to the style catalogue of the ai because that just makes everything better. This could add more jobs for animators if they were hired for a job and did a bunch of single frames to create a style catalogue for the ai and boom the people good at filming can film the shot they want and animators get it done in the style they created.
I know there are a lot of other comments here that start with “as an animator…” but
As an animator, the whole speech about “democratizing animation” is at the very least, inaccurate. You don’t need a big studio to make something cool, all you need are the knowledge and skills required and an iPad with any drawing/animation program. Animation is a learned skill like riding a bike or playing guitar. If you learn the skills, all you have to do is put aside the time to create your vision, No art theft required! I just hope this gets used as another tool for animators rather than (like this video implied) a full replacement for us.
There's a level of objectivity to art determined on the basis of the highest common standard set in any field.
Consider playing a guitar, you could play the guitar like an absolute amateur chortling and clanging away on the strings but everyone knows that doesn't make you a "guitarist". You could recreate motion on a surface but doesn't make you an animator without a certain qualifying standard having been achieved. Art has a harmonious form to it, if you cannot achieve it then you aren't creating Art, you're merely churning out garbled permutations of information.
I'll admit with the amount of jank that was still in the Spiderman short, I didn't think you could take it to this level so quickly. Amazing work!
Anime’s first appeal for me has always been the impossible camera angles. Like in the Animatrix when the camera follows the bullet through the headshot hole and out the back. It may take longer to implement since this style will be using a real camera, in time this style will probably mesh with cgi for these more difficult shots though.
It'll be pretty easy to create that bullet thorough head shot though
@@asar2252 do it then
actually if this was actually animated then it wouldnt be that hard but this isnt animated
Nice point
@@sassythesasquatch1794 The background is an asset from the Unreal Store that was given a pass by their AI. You could quite easily do a CG bullet hole, then do a pass with the anime filter. Could also have an animator animate it and place it into the shot.
What software is used for this to put the video and turned into animation
You could probably remove the flicker further if you put correlative dots on the actors' faces for the AI to recognize complex facial movements, like the Hollywood studios use.
Niko: "Hey look, I figured out how to turn live action videos into anime, come watch it!"
Everyone: "I'm here for Kevin's sound design"
No
My university Final Year Film Project in 2009 was a 15-minute short film with a visual style derived from the rotoscoped look of A Scanner Darkly. I shot it live over 4-days and spent the next 4 months in the editing suite converting every single frame in Photoshop before exporting into Premiere 2.0 5-6 days a week, for 15+ hours a day.
It's amazing to see how far we've come in producing the very same look using technology
I was just thinking about Scanner Darkly and the work that went into it. I suspect ten years from now Anime/Pixar movies will be filmed just like Avatar. I think we are seeing a change in motion picture technology with AI similar to the CGI boom in the 1990s. Video Games as well.
I predict Animation will all be AI rotoscoped motion capture.
would you mind posting it on your youtube channel?
Can you post in on TH-cam
It's funny how all the bird people are complaining about the AI conversion tech, but seem to have completely forgotten about automated rotoscoping. I could only imagine what kind of films Ralph Bakshi could have made back in his prime with today's technology.
@@ZarconVideo pixar as a company is incredibly against motion capture, especially as live action acting doesn't have the same principals as animation
"Did we just change animation forever?"
The answer is no. No, you didn't. Rotoscoped animation has been around for the past century. It's nothing new.
Real
To me, and with the right pipelines for automation, this could represent the simplest and best way to storyboard animations possible. Imagine having a fully animated double to work off for reference.
With controlnet (extension for stable diffussion) you could maybe use depth, pose and normal maps to create even more consistent frames. You could pull the depth, pose and normal data from your original footage to use during generation. Would love to see this idea experiment with further.
Technology is moving so fast.
I was going to say the same thing but my guess is when they were working on this controlnet wasn't even available yet. Especially now that you can stack multiple controlnets along with other extensions like pose editors they can really get deep in the weeds. But high-level the concepts what they have presented here showcases what is possible and it's all just accelerating at a breakneck pace.
ControlNet came out a few weeks ago and they started this project months ago.
This tech is moving so fast. The next one they make will look completely different to this.
@@KeyTryer But this can be used as a foundation for that. Unlike 2 months ago where the idea was made from scratch, now they only need to improve it. It's easier to do something when you have a working guide.
I was on reddit and someone there pointed out that it was visible somewhere in the video but they never talk about it
As someone who's still learning art and dreams of learning animation, this video is scary.
Cool, absolutely but also terrifying.
so wiill you just change your carrer asking because iam larning art too
I mean ... That's life, innovation will always happen and further what we do and how we go about doing it. Art isn't the first profession to which this happened to nor will it be the last.
Don’t be scared of it. Learn to use it. Their will always be animators but their responsibilities will be different depending the available technology.
Hand drawn artist were afraid of computers replacing them. The only artist replaced were ones who didn’t know how to use the new tools (computer)
Hand drawn animation is the purest incarnate of the discipline. It will make you leagues more skilled and useful than people who pass it up to fumble with 3d models or whatever the workflow/learning process will be with this AI nonsense solely. It will never not be impressive to see someone sit with a pencil and sketchpad and limn something out accurately.
It should feel empowering. Right now they're using this tech to emulate old anime and make cool things from it.
Think of learning animation. Now think that instead of needing to join some big studio and work on some director's projects for DECADES before you have the skills and clout to direct your own series (at which point you'll hardly be doing any of the actual animation, at beast some storyboarding and keyframing and approving concept art) you can instead be your own studio. Use the AI to help you develop a cast of characters, train it on your characters, your settings, and your environments. Turn that tool into an entire animation studio at your fingertips. Now you don't need to work for a studio. You can just make what you want.
Now of course, will get you get paid? That's on you and whether others want to pay for what you make. So if you want a JOB, then you'll need to anticipate getting a job training the tools for some big studio.
where can I find information on how to aply the noise consistency and style models? would like to test this on my end and I'm lacking the documentation. are there any resources I could read? Thanks!
What's specs did your computer have to train a model in stable diffusion?
Dean: "animation has no 3D moves"
Me: Someone's never seen the opening of The Littles. Biggest animator flex I've ever seen.
They also need to watch all of James Baxter's works and see how wrong that statement is
"animation has no 3D moves" eh the fuck that even mean?
Not to mention a lot of 2D animation has been using 3D to help them create 3D moves in 2D space more easily. Quite literally using 3D in their production. Shoot, even comics make use of 3D to graybox out cities/backgrounds so they can paint over them.
I see you're all on Davinci Resolve now... maybe I should make the jump from Adobe to this as well!
Davinci is quickly becoming the standard over the oldies like Avid
The free version is very useable, I highly recommend checking it out!
adobe better start working on introducing nodes in AE
@@YatsuRL Lol Adobe should start by making their existing features actually work and run in a stable fashion. Almost everyone i have spoken to who has switched from Adobe to Resolve has done so because they were sick of having projects interrupted by showstopping bugs.
u should!
How can I do this? They link in the desc just takes me to their app website
Amazing video as always, love this topic. I know it can be a bit iffy at times but this genuinely gets me excited.
Imagine all the ways artists could collaborate with one another using tools like this. Expanding the horizon of creativity, I like how Niko puts it tho...
Fun fact. Vampire Hunter D Bloodlust has over 180 people credited as members of the animation department. Just wanted to throw them some credit, since the whole conversation of democratizing this technology didn't make any mention of just how much work went into creating the original art this AI style was trained on for free.
AI bros usually wave off the negatives of AI, cuz if there are no issues, then the positives conveniently outweigh the negatives.
"AI isn't gonna replace you guys, it's just a tool!" Like, mate, computers didn't do 90% of the writer's job just because the keys were different from the typewriter!
@@Fr3k3 well then something like chat gpt was trained on tons of text. Suppose we'll have to give credit to the entire humanity for making a.i learn language, possible. Same argument. What i see with these a.i tools is that the market wont be as saturated. Great artists will be noticed more as a lot simply give up. Also theres always going to be some niche need for human made art its not the end of the world. Its just that art by hand will need to be in the top 1-5% of artists in the world to make a living.
@@Mrhellslayerz @Fr3k3 Look I don't know your guy's whole stance on this, but those are not a fair comparisons, something more comparable would be the automation of factories which effectively decreases the manpower needed for the same output, and although it may create new jobs, it probably won't be enough to replace all the jobs it displaces, some people will adapt and work these new jobs, some people will move on to other fields. And that isn't a bad thing, because in the end we're just increasing our productivity and quality of life, less time from our limited time alive needs to be spent on tasks that we can delegate to machines. For me that's a good thing!
Now, what we'll do if eventually there's not enough jobs to go around, that's another discussion entirely, but as for the artists, they'll need to adapt and integrate the technology into their workflow to increase their output and remain competitive, because for fortunate and unfortunate reasons, this technology isn't going to stop existing. I for one, as a game developer who does art, am thrilled that I will get to take the ideas in my head and put them into the real world faster than ever before.
@@GabrielKoba The difference is that factory workers didn't dedicate decades of their life to learn how to work in the factory, it's like an hour of instructions how to do your step if even that. What's an artist who spent 30-40 years mastering their craft going to do when they're replaced by AI? And with everything getting replaced, where's everyone's going to go? There's not going to be enough jobs for everyone, so are people just gonna have to starve and die?
@@leetri That's true, but that's the closest comparison I could come up with. As I said, that's whole other discussion, but I do believe sometime in the future some kind of welfare system will have to be implemented to couteract these effects, how and when I'll leave to brighter minds than mine to figure out.
What I really don't want is for the solution to this problem to be prohibition or extreme regulation of automation and AI, as in the end these technologies can be extremely beneficial to us, IF we can adapt accordingly, and to do that we can't face these issues with fearmongering.
Remember that money is just a thing we made up, and we made it up to figure out who gets to have what, so if there are no more jobs there won't be any people with money to buy anything anymore so we'll have to figure out another way to decide who gets to have what, or simply give money away even to people who don't work, like a UBI, though I don't know how feasible that would be.
I just cannot get over how good the shot at 5:41 is. The orange light on one side, blue light on the other, the incredible focus on the facial detail. It looks amazing, it’s great to see talented artists use AI to evolve their workflow rather than substituting it for everything
What I can't get over is when Nikko claimed they were doing the right thing by making information free to everyone... then put it behind a paywall sub on their website. Scummy as hell.
7:23 "We blew out our vocal cords yelling as loud as we could" "SHOUUUUUUUUUUUUUT!" lmao I died
Ask your local musician if they're doing it for the money. Ask them if the venue takes a cut of their merch sales. If we imagine AI making an insanely intricate jazz piece that has soul, complex chords, and still can make a reference to a famous jazz song from the 80's, or a slow modern death metal song depicting the despair and anguish of losing a loved one to an incurable illness.
It's tough, but the bands we know and love in most genres in the days of music streaming, especially the smaller ones, pull through and play their shows, sleep on a bus on tour, shower once a week, and have kept going even through the invention of the Electric Guitar, Autotune, and even drum triggers, all very dividing inventions for said industry in terms of "what level of skill do you need to have to be considered a talented musician who WORKED for it".
I personally see 'drawn art' whether it's on pen and paper or a prompt someone thought of, and inspired learning that follows observation (which humans do as well, but differently)
It can be a scary time for artists relying on their work to be their income... But their industry is changing hands once again just like it did before. I am curious to see who will become the Rockstar(s) of art in the next generation of visual entertainment. I don't want to see artists die out, I wish for them to use AI as part of their toolkits in varying amounts and in varying weights, pre or post human input. I want to see the ever expanding definition of the traditional artists carry on too! There is so much to experiment with, and the rest may be left to fall in-between the cracks now that a new horizon is upon us.
I know the artists who adapt quick will skyrocket and do very well. The art industry just got shaken up once again, and the ones who are confident enough in their skills and knowledge to keep their jobs are typically the ones who aren't panicking.
This is insane! It’s so cool to see how everyone’s projects over the past few months, like Sam’s Unreal Engine work and Dean’s AI animation work, are able to come together to create an amazing product like this. Bravo to you guys!
10:08 It's designed by a human. What a time to be alive.
i'm gonna make a t-shirt that has some random artwork i have and on the chest written "designed by human"
better make a AI bot called human and have it design it
The answer to automation is a guaranteed minimum life standard, not defining empathy by making everyone else give up greater opportunities of any technology, entertainment-focused or otherwise, because it personally affects your livelihood. Especially when some of the artist community mock and insult anyone who enjoys the fruits of said technology, all while pretending to be arbiters of empathy, value, "soul" and whatnot.
As someone who couldn't find what I enjoyed but knew what aesthetics I cared for, I have taken much more to generating imagery I care for than to constantly browse in futility. It is enough of a statement of value that I'm willing to do that, no matter what I get for it outside of said images. No pretentious pricks who want to shove their idea of value down my throat will ever change this.
If your argument becomes that nobody should be doing this without suffering as you have, training, rather than ensuring that nobody should have to suffer as you did, then empathy is not the priority for you, outside of what you see of yourself in others.
An an animation student this technology makes me so so exited its amazing love love. People that are scared of ai just see this as stealing their jobs but this is the future learn to work with it or don't as for me i still think this is super human centric creativity there is so much work that goes into this. Amazing
What would really be scary if you could use ai to make a live action movie based off an anime
which is totally gonna happen and sooner rather than later
it's just making the opposite proccess
too late. im 3 steps ahead. 1 person and even had AI help me make fake celebrities as actors.
@@thejdirector6057 link to footage?
@@criticadelespacio I mean yeah, that makes sense actually. grab animated footage, use img2img with a live action dataset, go frame by frame, done
my opinion as a professional animator working for anime in the past 4 years:
no you have not changed animation. You only created a filter that you feed with art of someone else. Not even the character designs are drawn by hand, you only added your own pictures to generate these models.
this has nothing to do with animation, neither it has to do with anime.
Anime has and always will be associated with handdrawn craft. The creative freedom comes from direction, proper scriptwriting and the collaberation of animators, background artists, musicians, voice actors, the production managers who coordinate these things, etc. There are so many people involved in a single production to create an episode.
this production feels soulless and absolutely has no value, no plot, no heart. It's just a terrible copy of something that already exists in a way.
No credit was given to the people you took the 'artstyle' from. Only because it was free to watch online, it is not free to steal.
This is basically just next level tracing/rotoscoping.
Even in cgi anime, boards, characterdesigns are handdrawn. The models are rigged and animated by hand in most cases aswell. The foundation for some of the Keyanimation of the Cgi was crafted through handdrawn roughs to plan and figure out motion.
AI is not capable of utilising the 12 principles of animation.
it can not use squash and stretch, timing, figure out proper spacing, line control, staging etc. There is no stylistic and original choices for the artstyle and motion in your approach, it's only your human video reference.
I only see this as a try to profit from something that has no ethic value.
you have absolutely no respect and idea for the craft.
it's just insulting to think you changed animation in a positive way, while all you do is trying to devalue handdrawn 2D animation as a whole.
What's your opinion about hologram art
Yo, what a surprise to see you here Chris! I'm a big fan of your work and everything you said here was on point. Regardless of what happens, I'll always have respect for the dedication and hard work animators have for their craft!
Tell em Chris!!
Side note: for anyone who's wondering who Chris(Yenyen) is, he is an animator that has work on chainsaw man, One piece, Fate Grand Order and etc, btw almost all of his scene is difficult action scene so yeah..he know what he talking about
Thank you sir, well said. Also, amazing work!! You are an inspiration!
First, you obviously don't know much at all about how AI derives its output. It's not a filter. It's not rotoscoping. Absolutely nothing similar to either of those.
Second, I can smell your copium from here. Your industry will be adopting this tech within the next five years, if not sooner. It will 1000% displace a majority of traditional animators as the tech reaches maturity. You're boned, just like the coders.
For intense action/drama the remaining flicker is not distracting. For calmer scenes I think it would be.
except it is, and the only way it’s not is if you were just not paying attention to how bad it looks. there is no way that this looks good in any situation.
Can you add a direct link to the tutorial? Thanks for making one. Problem with linking to your entire site is that it is very busy and difficult to navigate.
It's not just the AI, but the cinematography, the visuals, music, the overall execution, that made this so good! Great work, guys.
Very small correction but actually in the Asian (japanese, korean, chinese, etc) animation industry, the voice recording is part of the post production, when the animation is finished. However in western animation, they do the voices before the animation.
That is because there are no specific mouth movement in most asian anime
@@shunbeats5431 yea they do it after and it fuckin shows lmao
@@highdefinition450 Eh not really. In dubs, sure, but more often than not, in the original language it's totally fine
If you're talkin about 6:37 all they said was a cartoon and they are Western why would you correct them about Asian animation when they didn't mention it? As westerners who are familiar in Western animation why would they be talking about Asian animation without mentioning it?
That's like correcting a western chef on Asian cooking methods when what they're making looks vaguely like an Asian dish but it's a European dish made by Europeans in Europe just because they said they like Japanese food once
Maybe from a post production vfx pipeline it will change peoples entry point to AI animations conceptually preserving traditional pipelines. I think the text description and labeling can get more localized to each film to prevent green-screening and target isolation with masking etc. Good composition and edit.
Feel like it’s still a decent size production involved. Interesting to learn how much cost savings have achieved.
As a professional animator, for what it's worth, I find this really exciting... This makes me feel like so many more personal projects are within reach now, where before, the time constraints of animation as a medium made achieving all of my dream projects insurmountable. What a cool tool to have available and play around with, especially if you're training it on your own work samples
god bless, what a time
training it on your own art seems really interesting and something that can actually be called a tool. This is one take on ai art that isn’t negative I can get behind.
Now their are many logistical leaps and hoping that users will be moral and won’t steal but promising none the less. Artists will always have the best takes when it comes to art. Thats just a rule.
@@Data-Expungeded I kind of see it how sampling has spread around the music industry. Unauthorized sampling still goes on, but its really tools that artists have chosen to use that have developed more recently from bottom up that's created more solutions. For example, things like splice, or producers trading and selling loop packs. Even platforms such as tracklib that provide pre-cleared samples. You're right when saying artists will have the best takes solving these problems. I can see something similar being used to smooth out unauthorized "sampling" in this field.
@@jp-is1is i have a real problem with ai in art that always says “all or nothing” instead of limited use and correction but i’m getting better
@@Data-Expungeded Honestly, same lol
I've done a few animated videos using Ebsynth with filmed footage and manually drawing keyframes with other artists. After watching this idk if its actually more work, I guess if you aren't an artist it is, but from my experience with that workflow you get a lot more consistency. I could see maybe a workflow where you did something like whats in this video for the rough draft of the scene and then had actual artists with ebsynth keyframe details like the faces so they don't lose consistency. I think what you guys did with this video is really cool, but it's also very obvious it was done with AI, even though it is really well done. I think this video touches a little bit on the "using AI as a tool" but it genuinely would have been a much more interesting video if you actually brought in a couple of artists to create a unique data set to train instead of just training off an existing film. That sorta dives headfirst in to the whole issue lots of people have with AI generation being considered "art theft" whether people agree on it or not.
Yes as an individual it would be a ton of work to draw a whole set of animation data to train off of, but it also gives the work its own artistry and creative vision, which ultimately I think is what people appreciate the most about the finished product over the process and tools (granted maybe not on this channel, since its all about process and tools here). Either way interesting video on how you went about trying to solve all those problems. I just would have loved to see this where you actually brought in some artist friends to guide the style and vision instead of just ripping an existing anime.
If you want an exaggerated anime style, Ebsynth is probably not going to be very helpful, because it doesn't do well with altered proportions. It just follows the movement of the input video.
I feel like if your criticism is that it feels like "too much ai" and your solution is to "bring in more human artists" then you missed the point of why this tool is useful . Also the solution is a little self serving
This approach does seem like a prime opportunity for the likes of concept artists, background artists, etc. Even if the AI dominates the animation, the program still needs data to work with; so hiring a select team to craft the visual style of a given project (instead of just telling the AI to "copy X/Y show") would be the ideal strategy for projects going forward.
I also see cleanup artists being an important position; there's still lots of jank in the individual frames (check out the eyes and hands in particular), so having artists on hand for "post-render" editing will improve the final product that much more - at least until the AI gets better at those details, I guess.
How about using motion capture suit and face capture to get realistic movements, put that in 3D model, then run it trough AI to get base frame and then artists have frame work to alter how they choose, so lots of it has been done already but fine details and fixes to AI crapping out can be fixed by human to get best result. Given anyone can do the motions based on what original artist drew and imagined. Hell one could 3D animate this and then run it trough the AI to least improve the shitty 3D animations. From 2D to 3D to back 2D via AI and human finalizing might be the best possible result one can hope for smaller budget artists that havent had chance to get their own animation series.
@@michaelmarshall8041 Corridor is made up of artists i think they were talking about getting like a 2D aminator to guide the process they really arent hard to find and jobs are needed. there was too much ai in the animation side of things but that was just bc this was a proof of concept
Take the image, remove the croma, make it b&w, increese saturation at max, put it an outline, now grab the real image again, remove the croma again, mutliply the result with our previous outlined binary inage, and finally select all the brigth areas to promediate theire color.
I think, that should make an even more clean anime style
I wish I was a good enough programmer to be able to make a (compartmentalized) "next-frame-threshold-gate" with the ability to scan and keep a section of a frame from updating until a certain pixel-change percentage threshold has been crossed. If only some parts of the image would update at a couple of frames per second (or less), that could fix that whole rotoscope effect and give a video made like this an even more animated feel. Poorly stitched images could even be fixed by AI afterwards I suppose.
I'm not 100% sure this would work if noise pattern moves it's position, but here is another idea.
Let's say you have 2 frames from original video, VideoA and VideoB.
1. You generate noise on VideoA (NoiseA)
2. You use motion vectors generator (like the ones from Nuke)
3. You move the noise based on motion vectors but fill the blank pixels (where no pixels came in from vectors) with VideoB noise (new noise)
4. Repeat...
The idea behind this is that you have patches of noise moving around with your subject from motion vectors.
The only issue I see if the stable diffusion is not only dependent on noise pattern but also posistion causing it to generate a completly new image
Video motion vectors aren't very good, it's basically just fixed blocks and diamond search, so it's either very coarse or very unstable, but there is a good way to propagate image information alongside apparent motion. The keyword you're looking for is optical flow, and the tool you may be looking for is the now-classic EbSynth. You just need to replace one target image with noise or whatever pattern you want to propagate; and then after it's done you'll notice some blank or distorted areas, and you put another image into the example set and fill the bad areas in, and usually just about any shot of reasonable length shouldn't take more than 3 examples to fully resolve. This tool is based on paper "Stylizing video by example" by Jamriska et al, it's edge mask enhanced motion flow. You could by all reason automate this fully, but this might cause issues of its own, since it doesn't really do disocclusion tracking, edge mask kind of stands in for that but it's pretty ambiguous.
@@SianaGearz optical flow is the algorithm that generates motion vectors, we're talking about the same thing
imagine if he put this effort towards drawing some lines.....................................................
@@passerinemotion Imagine putting that effort in some coding.
@@gridmeter2571 don't forget, the power to settle this lies in the palm of our hand 👊🖐✌
I like this conceptually, but I hate what it will most likely inevitably mean for proper animators. I'm worried traditional animation will become an indie only thing kind of like certain game genres. Unfortunately, Pandora's Box has been opened and there's no putting the lid back on this one.
I just hope AI art will die out like a trend
It's so annoying that they keep screaming their new stealing tools and these kids who have 0 skill rooting for these ppl
@@grandmastalin7796 It won't. As technology progresses, Lots of jobs are going extinct and HAVE gone extinct. Although it is hard to process seeing the extinction of many people's livelihoods, There also aren't any ways to prevent it.
So long as Human society develops, Progressions in technology such as AI is inevitable.
the idea that they just "ripped off" vampire hunter d's style just leaves a bad taste in my mouth not sure if im alone in this. I dont have any issues with the unreal church backdrop that was paid for. I wish they would have paid an artist to create a style for the training data. (even if it is inspired by VHD the person would still do a self rendition.)
im pretty sure they didnt get any permission by the creators of VHD to use that dataset. i am afraid that it will legitimize this way of working as it is already a big issue. as artists themselves they should be a bit more aware of this.
@@grandmastalin7796 this is such a dumb take
I think this will be an excellent tool for already established artists to use.
Wouldnt the candles go across the screen in the other direction to match the rotation of the room?