amazing video! I cant wait until more tools are out that can use character sheets to make a character (for example, using a character sheet to make an consistant anime character to make an ai anime show) i hope if you find some of these ai papers that you could maybe feature them in a future video
@@DracoTheNinja Seems like ACE can easily create a character sheet. (Character sheet it typically refered to as a sheet of mulitple views of a character to then create a 3d model from) If your talking about something to manually create a high res mesh from? Also the latest Runaway and changing camera angles may help fully realise characters.
I just tried it, it's not very good. And don't even think about using it for upscaling. I mean.. I guess it's OK for turning some tiny, blurry thumbnail mess into an almost OK 1024x1024 square image, but you can't use it to take a decent image, upscale and unblur it like I was hoping.
Impressive compilation! And what I like about your channel is the lack of ego. This is a faceless channel, straight to the point, unlike other TH-camrs putting their faces everywhere, in desperate need to become famous. You’re doing a pretty good job, congrats!!!
I am really exited for X-potrait 2. One of the disadvantage of live potrait is that it can not move the head. It seems like this one will solve the problem.
Always grateful for your videos. I really appreciate how you add a lot of open source and locally run AI. Have you managed to compare this AI upscaler compared to the dream one from your last video?
The reason they do such many videos because they can't earn on that, only paid courses and youtube. Fiverr and Upwork are not working platforms just a scam. So only one way make feel people they will earn a lot of money on that after buying their courses. TH-cam is a fucking scam.
I'm wondering if X-Portrait 2 works with initial faces in the images NOT facing the camera head on. In just a few demos on their preview, that seems to be the case when the videos start, however, we can't tell for sure if that's cherry picked and/or edited to begin on a later frame. But it is rather exciting that it works on different styles. Usually drawn hair in other portrait animators alike really broke apart with motion. In my opinion, portrait animation will really take off when we can plug in a side view of a face as the input and start working from there, or at least when slight side angles are reliable.
@19:51 Would be interested to know how it compares to time remappling AE plugins like Twixtor & Bullet time and such - are there any comparisons to those as I'd love to know how this stacks up!
I noticed on the second racecar example of GIMM-VFI that the video seemed to speed up and slow down - is that due to inconsistent framerate in the source? I’ve got some content with that issue that has no other known source that I’ve been trying to fix for a long time, wondering if I should try this tool (even if it’s inconsistent, I’m wondering if I can increase the framerate enough that when I sample back down to 24/30 fps, it’ll smooth out)
Is MVP paint textures are colors or also I don't know how you call it Basically does it also add texture maps like grooves and imperfections to make the object more realistic sorry English is not my first language
Really keeping an eye out for Recapture if it turns out to be something I can play with myself. I can see some very useful use cases with some stuff I am working on, but it's hard to be sure without testing.
32:30 - I would have to disagree about her face looking too polished. One thing that's always annoyed me about Flux are the plastic faces, but I'm not seeing them as much in the Ultra models.
17:21 the problem will always be “batch sequencing”…..we’re still gonna need controlnet for while until someone comes with something better (hopefully for Flux Dev)
MVpaint will be the Kling, Sora and Minimax killer. Soon it'll be able to create whole scenes and only extra processing time for keyframes. You'll be able to make a 30 minute clip that can render in 30 minutes with better coherence than any model out there using a game engine running of a normal PC. No more huge amounts vram and multiple GPUs just to be able to render
That joke at 7:52 makes you one of my heroes. Also, that GIMM-ick at 18:31 sounds cool, right? More frames equals smoother video. Except, humans have a limit as to how many frames per second we can see. So jumping from 30 to 60 is just going to explode the file size and do very little for your enjoyment.
while its true that we start having trouble getting the full use of framerates greater than 60, we still find good use of 120+ frame per second video. Yeah you're not going to get much benefit out of seeing some fast moving hair follicles, but any large object moving at considerable speed, or even small jostling movements in the camera will be considerably smoother
@@Misaki896 Important to note that modern monitors and televisions operate at 60Hz (exactly 60 frames per second). So anything north of that is highly impractical anyway because the machines literally can't display it--unless you were looking to do a "slow motion" effect by reducing your 120+ down to 60, in which case that's genius. My concern is that an obsession with "high-resolution" or "super-smooth" video may lead to needlessly high file sizes and bandwidth consumption where information is literally wasted.
@@dirtydevotee It's not common now until it is. Just like 4k video or 8k video. Insanely massive in size even before bumping to 60+ fps, until it becomes the standard.
be so helpful if in the notes you had link to huggingface/source code or NOT AVAILABLE... Main thing most of us want to do after viewing is trying these out
Mureka does not generate music, it does generate songs. What I mean, you can’t just create instrumental music, you have to write at least 50 words of lyrics.
Imagine a guy trying to render a video on blender or otherwise as a passion project without access to some massive render farm and he can only pull a couple frames an hour. Then you pipe it into 19:35 and interpolate all the extra frames that would take forever to render.
If you are afraid of AI nothing can help you. If you are serious in your animation career I'd suggest you to have deep knowledge of fundamentals and your craft obviously and also learn to use ai tools if it is helpful in some way. A true artist shouldn't fear
AI has come to stay. Instead use it to your advantage to make better work, and faster. For example, the storyboard thing from Nvidia still doesn't handle proper storyboards. They're very generic. Use the tools to work faster and better.
I know change is scary. But, I feel like you are seeing this the wrong way. You have the greatest opportunity of lifetime. Using your skills and the power of AI you can create your own animated production. AI is not a threat. It is an opportunity. You have your own ideas and creativity. Now you have the power to make them a reality.
Thanks to Mureka for sponsoring this video, a versatile AI platform to create music! bit.ly/4ehrdaq
amazing video! I cant wait until more tools are out that can use character sheets to make a character (for example, using a character sheet to make an consistant anime character to make an ai anime show) i hope if you find some of these ai papers that you could maybe feature them in a future video
@@DracoTheNinja Seems like ACE can easily create a character sheet. (Character sheet it typically refered to as a sheet of mulitple views of a character to then create a 3d model from) If your talking about something to manually create a high res mesh from?
Also the latest Runaway and changing camera angles may help fully realise characters.
Please consider ethical approaches to promoting these tools. Many men will use these things to harm and sexually exploit women and children.
how do i run the frame interpolation locally... its a 4090 so it should have enough vram
Yeah we can make a Kpop Idol realistic animation for monetize! 🎉
7:57 for por..trait video right?
he said porn videos, dont be shy we the adults say it as it is
HAHHAHAH
Pork videos
poiseex
cringe
7:53 ayo what
thats true though
lmao, that shit caught me off my guard.
Just straight up facts
He just said what we were thinking 😂
cat videos
1:20 ENHANCE is going from a meme to reality
it's actually more like "imagine"...
AI hallucinated information gonna be real useful to CSI investigations
now every nerd could do it
Except the details are made up
I just tried it, it's not very good. And don't even think about using it for upscaling. I mean.. I guess it's OK for turning some tiny, blurry thumbnail mess into an almost OK 1024x1024 square image, but you can't use it to take a decent image, upscale and unblur it like I was hoping.
Impressive compilation! And what I like about your channel is the lack of ego. This is a faceless channel, straight to the point, unlike other TH-camrs putting their faces everywhere, in desperate need to become famous. You’re doing a pretty good job, congrats!!!
Thanks!
I can't wait to make and print 3d models from video
7:55 Let be honest this is the main reason we look for new models upcoming and which one we can use locally
Where would you tell a noob to start? - Asking for a friend
@@mikol0070 right here
@@mikol0070 ciivitai
X-Portrait 2 is gonna make me go grab a 4090. One of the coolest things I've seen.
I am really exited for X-potrait 2. One of the disadvantage of live potrait is that it can not move the head. It seems like this one will solve the problem.
X-Portrait 2 face animator.... Yes! A tutorial as soon as it is available :D
I really like how the InstantIR model added nipples to the statue on the right...
Always grateful for your videos. I really appreciate how you add a lot of open source and locally run AI. Have you managed to compare this AI upscaler compared to the dream one from your last video?
*Few days later* :
Today we have a new ai for breathing.
The reason they do such many videos because they can't earn on that, only paid courses and youtube. Fiverr and Upwork are not working platforms just a scam. So only one way make feel people they will earn a lot of money on that after buying their courses. TH-cam is a fucking scam.
Few milliseconds later:
Today we have a new ai for teleporting.
Few nanoseconds later:
Today we have a new-
It me. God.
좋은 정보 너무나도 감사합니다 :) 매주 소식이 엄청나네요 >
GMM VFI + DINO + SAM 2 + PaintsUNDO = the BEST AI speedpaint
The video is very detailed and clearly explains this new AI technology! Thank you
You are welcome!
I'm wondering if X-Portrait 2 works with initial faces in the images NOT facing the camera head on. In just a few demos on their preview, that seems to be the case when the videos start, however, we can't tell for sure if that's cherry picked and/or edited to begin on a later frame.
But it is rather exciting that it works on different styles. Usually drawn hair in other portrait animators alike really broke apart with motion.
In my opinion, portrait animation will really take off when we can plug in a side view of a face as the input and start working from there, or at least when slight side angles are reliable.
@19:51 Would be interested to know how it compares to time remappling AE plugins like Twixtor & Bullet time and such - are there any comparisons to those as I'd love to know how this stacks up!
Excellent video, as always.
I'd LOVE to see a hands on for installing and using Consistory it so far seems AMAZING
Really appreciate your videos mate, however can you make a video on how different companies are using these intelligent AI models in their workflow
I noticed on the second racecar example of GIMM-VFI that the video seemed to speed up and slow down - is that due to inconsistent framerate in the source? I’ve got some content with that issue that has no other known source that I’ve been trying to fix for a long time, wondering if I should try this tool (even if it’s inconsistent, I’m wondering if I can increase the framerate enough that when I sample back down to 24/30 fps, it’ll smooth out)
it's probably due to the source. from their page, it seems like you can do up to 20x interpolation. doesn't hurt to give it a try!
Thanks for the awesome AI tests and reviews 👍👍
7:55 easy, we've already thought about that before you said it.
Is MVP paint textures are colors or also I don't know how you call it
Basically does it also add texture maps like grooves and imperfections to make the object more realistic sorry English is not my first language
Diffuse map only. PBR is still inaccurate for AI to generate consistently.
Thank you, your channel is one of the best!
That 2D to 3D thing reminds me of that new Adobe Illustrator feature that can convert a 2D vector graphic like a person into proper 3D.
Great vid, lots of tools that aren’t mainstream. Thank you!
I've never expected that the "enhance" bullshit on movies that we all laugh to is now a reality
For InstantIR with a 3080, on average how long should it for an upscale like the provided "dog" example?
Love your account man!
Thanks!
22:50 i wonder how did that big thing come out of that little body?
Portrait is cool for movie projects to get a story board across super fast
Amazing times and great vid!
Cool stuff. Can't wait to try some of the stuff. 🎉
amr?
@shmebuloc huh? 🤔
Really keeping an eye out for Recapture if it turns out to be something I can play with myself. I can see some very useful use cases with some stuff I am working on, but it's hard to be sure without testing.
32:30 - I would have to disagree about her face looking too polished. One thing that's always annoyed me about Flux are the plastic faces, but I'm not seeing them as much in the Ultra models.
This is why i love this channel. Very educational😂❤
thanks!
ca you run the InstantIR on cloudcomputing platforms ?.....
Can you make GIMM-VFI interpolation installation tutorial ?
ask Kijai, he built a wrapper on COmfy already
Flux has been a game changer. I'm at the edge of my seat wondering about their progress with open source text to video.
Can't wait to see ai + lidar
What a time to be alive
@7:56 That's the first time an AI News video has made me LOL 🤣
Really hoping they make X-Portrait 2 open source
When might we know if 2 is open source?
yep...now we can remake "culture" anime easily and cheaply. hopefully more tools will be develop in the future. haha
It would be a game changer for sure. I'm excited for TH-cam to have a lot high quality AI generated content.
I like how OmniParser got the icon understanding wrong because it’s an image of an X, it thought it was a delete or remove function.
CSI had this 15 years ago, remember that zoom into the license plate?
Virtual keynote event video! Promising!
Definitely videos will be amazing soon :D
Can you make a full video showcasing useful tools . Each for a short time and showcase most of the useful tools you know about. Thanks
We can download it and run it locally. What does this really mean? Does it use any online service or works offline?
it works offline
@theAIsearch thank you
I fully expect some DA to use something like InstantIR to "enhance" a photo showing a crime while NOT informing the judge that the did.
Merci beaucoup...... I learned a lot with this video..... The World is changing.
You are welcome!
Too many cool things I need to add to Melies AI
X-potrait 2 looks fantastic.
7:57 my first thought, exactly.
7:20 why bytedance ever released anything? x-portrait 1 for example?
Finally InstantIR something that can compete with Topaz
Imagine how good an AI based video compression coded could. be. 5x-10x. This would revolutionize the internet. 82% of internet traffic is video!
X Portrait 2 seems like a perfect tool for memes. Hope they do release the code! Keep us posted.
17:21 the problem will always be “batch sequencing”…..we’re still gonna need controlnet for while until someone comes with something better (hopefully for Flux Dev)
Waiting for AI to be able to figure out 2D photos and build a VR setting with characters moving from it.
You where going to say POGGERS clips
right
07:23 It looks like every character has the same tooth structure, meaning it replicates the tooth details from the input video exactly
why no video how to install MeGo
MVpaint will be the Kling, Sora and Minimax killer. Soon it'll be able to create whole scenes and only extra processing time for keyframes. You'll be able to make a 30 minute clip that can render in 30 minutes with better coherence than any model out there using a game engine running of a normal PC. No more huge amounts vram and multiple GPUs just to be able to render
I am an Ai generated profile mimicking a real person profile in YT comment section
this is an AI generated reply mimicking a real person
I'm Bert
@@MooseKnuckleWarrior hi bert
My name is Jeff
That joke at 7:52 makes you one of my heroes.
Also, that GIMM-ick at 18:31 sounds cool, right? More frames equals smoother video. Except, humans have a limit as to how many frames per second we can see. So jumping from 30 to 60 is just going to explode the file size and do very little for your enjoyment.
while its true that we start having trouble getting the full use of framerates greater than 60, we still find good use of 120+ frame per second video. Yeah you're not going to get much benefit out of seeing some fast moving hair follicles, but any large object moving at considerable speed, or even small jostling movements in the camera will be considerably smoother
@@Misaki896 Important to note that modern monitors and televisions operate at 60Hz (exactly 60 frames per second). So anything north of that is highly impractical anyway because the machines literally can't display it--unless you were looking to do a "slow motion" effect by reducing your 120+ down to 60, in which case that's genius.
My concern is that an obsession with "high-resolution" or "super-smooth" video may lead to needlessly high file sizes and bandwidth consumption where information is literally wasted.
@@dirtydevotee It's not common now until it is. Just like 4k video or 8k video. Insanely massive in size even before bumping to 60+ fps, until it becomes the standard.
7:55 I was wondering the same xd
I'm waiting for a real 3D model generator tool that is actually high quality enough to make final models, or close enough to final models.
I'm sure it'll get there. Eventually.
thanks for the video.how do i install instant ir?
Can ACE be used? The image I uploaded seems to be unrecognizable, and it always gives me completely different images.
Am i wrong to feel terrified about all of this new tech?!?!?
do a video on flux v1.1 ultra and show us the prompts
A.I really is going to be a game changer for "videos"
be so helpful if in the notes you had link to huggingface/source code or NOT AVAILABLE... Main thing most of us want to do after viewing is trying these out
Mureka does not generate music, it does generate songs.
What I mean, you can’t just create instrumental music, you have to write at least 50 words of lyrics.
"This is going to be a total game changer for po...videos" crept up on me hahahah
Great video
Thanks!
I hope we can convert 2D Movies into 3D Movies in the future.
All 3D movies are 1080p, because they are not using 4k Blu rays.
Bro please tell me what was your profession before entering on youtube, please bcz your knowledge and research are always fabulous,
You will be successful in life
Hi, can you compile a video in which you use a.i tools to make money...like creating a cartoon using a.i and trying to sell it or some other ideas
7:00 I hate that this is almost magic to me as a developer, but it will just be "eh, an expected feature" by people using "filter" apps.
Do some machine learning stuff with pytorch and it will feel less like magic. It's amazing tech though
7:59 caught 😂😂 and agreed 😅
1:31 Tried it and with the demo it did not work properly. This would be a game changer, if its works.
can it do hands and fingers yet?
Imagine a guy trying to render a video on blender or otherwise as a passion project without access to some massive render farm and he can only pull a couple frames an hour. Then you pipe it into 19:35 and interpolate all the extra frames that would take forever to render.
33:05 so no one gonna mention that everyone HAS THE SAME FACE??
I knew I wasn’t being racist
Day by day I am getting nervous 😢. One day it will surely come after my animation career. Oh god plss help me😢
If you are afraid of AI nothing can help you. If you are serious in your animation career I'd suggest you to have deep knowledge of fundamentals and your craft obviously and also learn to use ai tools if it is helpful in some way. A true artist shouldn't fear
AI has come to stay. Instead use it to your advantage to make better work, and faster. For example, the storyboard thing from Nvidia still doesn't handle proper storyboards. They're very generic. Use the tools to work faster and better.
I know change is scary. But, I feel like you are seeing this the wrong way. You have the greatest opportunity of lifetime. Using your skills and the power of AI you can create your own animated production. AI is not a threat. It is an opportunity. You have your own ideas and creativity. Now you have the power to make them a reality.
@@jonasjohnson1958yeah but so could I and I'm not an animator so that doesn't work
This tool will be game changer 🎯 for .... 7:55
Can GIMM generate such frames in real time ?
Can remove mosaic?
Consistory has been around for a while
MoGe 3d just need ai to generate the background and texture behind the models
But it's not restoration, correct? It's imagining detail that it thinks should be there
i wonder how gmm-vfi would handle anime / cartoons
MVP is not yet ready for movies or games, but for fun maybe!
thank god for chapter markers
According to the video introduction, in this program we will solve a mysterious question about the Loch Ness dinosaur