This AI Makes Beautiful Videos From Your Images! 🌊
ฝัง
- เผยแพร่เมื่อ 9 ก.พ. 2025
- ❤️ Check out Weights & Biases and sign up for a free demo here: www.wandb.com/...
❤️ Their mentioned post is available here: wandb.ai/autho...
📝 The paper "Animating Pictures with Eulerian Motion Fields" is available here:
eulerian.cs.wa...
GPT-3 website layout tweet:
/ 1283322990625607681
🙏 We would like to thank our generous Patreon supporters who make Two Minute Papers possible:
Aleksandr Mashrabov, Alex Haro, Alex Serban, Andrew Melnychuk, Angelos Evripiotis, Benji Rabhan, Bryan Learn, Christian Ahlin, Eric Haddad, Eric Martel, Gordon Child, Haris Husic, Ivo Galic, Jace O'Brien, Javier Bustamante, John Le, Jonas, Kenneth Davis, Lorin Atzberger, Lukas Biewald, Matthew Allen Fisher, Mark Oates, Michael Albrecht, Nikhil Velpanur, Owen Campbell-Moore, Owen Skarpness, Ramsey Elbasheer, Robin Graham, Steef, Taras Bobrovytsky, Thomas Krcmar, Torsten Reil, Tybie Fitzhugh, Ueli Gallizzi.
If you wish to appear here or pick up other perks, click here: / twominutepapers
Thumbnail background image credit: pixabay.com/im...
Károly Zsolnai-Fehér's links:
Instagram: / twominutepapers
Twitter: / twominutepapers
Web: cg.tuwien.ac.a...
You're telling me that red dwarf's "uncrop" now ACTUALLY EXISTS??
And it's only getting better a few more papers down the line! Thanks for dropping by Taran and congratulations, you folks are killing it over there! 👌
Didn't expect to see Taran in the comments & even pinned!
didn't expect a red dwarf reference of all things
Oh it's Taran. Hello
taran myman
You truly are theObi Wan Kenobi of AI. You always have the higher ground and squeeze your papers the hardest!
When you squeeze your paper so hard you need an AI to re-create it.
"May the papers be with you" - Károly Kenobi
"From a certain point of view."
beard with a LSD filter
Hello there!
This is my favorite channel on YT for years on end now. Please don't underestimate the work you do here, bringing the papers to the masses.
You are too kind. Thank you so much! 🙏
@@TwoMinutePapers Thank you for the videos! I wanted to ask how this method of animation is different from the similar animation apps such as Zoetropic? I downloaded this app it workflow and results look very similar to the Zoetropic's one, and I believe Zoetropic came out several years ago was not using deep learning.
When I first saw the waterfall loop I actually yelled "what!" out loud cause I was so impressed! These ai's keep improving and I'm very excited to see where they go next!
Cinemagraphs are extremely popular. Usually you take a video and loop/mask it to make a mostly still image where only one part is animated in a perfect loop. Now you're telling me that you can just take a single image and make a convincing cinemagraph from it! That's incredible.
@Umbrella Corporation stop spreading the virus
this is indeed amazing. the improvement in such a short time is extraordinary. also, being able to loop is fantastic, which saves having to film a background for longer (often much longer) than you think you will need it for in the comp. thanks!
30 seconds ago but I'm already squeezing my papers in advance.
i like how all your videos are narrated like your showing a paper to your friend that youre excited about
makes me miss college, and having people to talk to on an academic level
The “fails” where the ai applied motion to non moving surfaces (like the beard towards the end) are extremely similar to the visuals of drug induced hallucinations.
Yeah, I wander when artificial neuron nets will become complicated enough to show signs of psychiatric disorders.
Yah sign me up for some ‘fails’ please.
The wallpapers made with this are going to be sweet!
Like the emotion images of the last video, there is an 'archetypal' quality to the motion, like it is outside of time, giving it a dream-like quality, and making loops natural.
I seriously love all of your uploads... always blows me out!
🤜🏼🤛🏼🇦🇺🍀🍀🍀🤓😎
Yes, we like those insane ideas around here!!! 🤯 Was squeezing papers but still dropped them 😱 the fact that the algorithm seems to understand simple reflections is insane!! Amazing video as always!
How is your comment so old?
@@shaankapoor9074 Video was on scheduled release/unlisted and somehow this guy got the link.
@@MasterVertex Got the link because i am supporting the channel on Patreon
Always blows me away that no one talks about this anywhere else
I guess because it’s not finished yet and can take years
Thank you Oliver Wong, authors, and doctor Zsolnai-Fehér!
Imagine in the future seeing your old family photos animated as if they were short videos.
Like in Harry Potter
it already exists, on myheritage
Endo et al. is spot on for reconstructing a psilocybin visual.
this is in my top 3 channels on youtube
so inspiring, it taunts me to get back into animation and modelling - it was not like this in the 90s when i working in the field and teaching it at uni.
Gifs that flow into themselves seamlessly are always amazing, so another beautiful side-effect
Now I don't know what to be more amazed by.
The fact that the AI filled the cat image in way better than I ever would or the fact that it understands fluids movement way better than I ever could.
What a time to be alive...
Imagine
You generate a person with an ai
You give it a beard with a different ai
You animate it with another ai
You generate a landscape with an ai
You edit it with another ai
You put the person in the picture by telling an ai what to do
You expand the image with another ai
Then you animate landscape with this type of ai
Transfer human animation from another video with another ai
Type some words and synthesize speech that suits the age/gender/character with another ai
and of course blends the required speech animation with the previous animation with another ai
Then auto generate an entire propaganda youtube video with another ai
And finally boost views with autonomous ai accounts on twitter/reddit/fb/etc
and you make his beard move with an other IA
@@Thepher6 "Will we next create false gods to rule over us? How proud we have become, and how blind."
-- Sister Miriam Godwinson, "We Must Dissent"
Actually the loop motion morph algorithm is pretty old (there are already a lot of applications doing it), the only thing I see new here is the estimation of motion vectors from an image. And btw the issue at 5:14 can be fixed easy with a fill in (content aware) algorithm for the rigid parts (0 motion)
this channel is the one place for me to get these crazy papers explained, thanks a lot.
1:00 That cat knows to hold on to his papers.
"Machine learning is a subfield of AI. Deep learning is a sub-field of machine learning." in many textbooks or published works. The video gives an impression of making machine learning and deep learning two different things. Some people use a term like "shallow learning".
Finally, seamless looping backgrounds for my wallpaper engine
I can't stop watching those, they're satisfying no matter what.
You always keep me up to date on the coolest AI developments, every video is fascinating to me!
I would love to see how this does with trees moving from the wind… This would actually be actually a game changer!
This looks like LSD visuals. Told a friend to me of course
Edit: I was referring to the beard
That's exactly what I was thinking, I mean that's what my friend was thinking
@@matthewsharp1178 Seems like we all know that guy !
The beard part is just very cool. It's a feature, not a bug to me!
Haha, the hair animation wasn't bad. If you ignore the beard, it looks like it's just growing and being cut constantly.
It almost feels like a timelapse someone did with their hair!
@@OrangeC7 this is what I was think too
Finally an accurate LSD simulator
It is freaking perfect. And the looping though... mind blown
So as of now, this still isn't available to the public? So many good uses for this, oh my.
Great video as always, my papers are turned to mush for I have squeezed so hard. :D
the stuff some ai video generators make are so trippy sometimes
The image completion is still amazing.
That is awesome! This should be incorporated as middleware for videogames ASAP as this time of repeated fluid motion could save lots of hours!!!
I’ve been using apps like this since last year. They used to be used all over social media for people with waves or people that smoke or whatever.
Amazing! What a time to be alive!!
Haha the flowing beard is just straight out of an acid trip :D
Dear Károly Zsolnai-Fehér, all yor results in machine lerarning models looks just like magic, if there werent amazing background and overall proof references, could look like just fake scum. It's so unbelieviebly good. But your presentation just takes it to another whole another level. Every time I see new announcment, I just know somethig beautiful happend in your research field, something we all should be proud about (and hold on to our papers).
Amazing paper and Research, Exciting technology for the future to be honest
It looks kinda uniform, like there are few patches of images getting warped with smudge tool, it needs more random noise with smaller patches, and little bubbles noise on top when water moves.
You are my favorite professor. No joke, don’t doxx yourself but I would attend your class
The sum of it all will be high quality content generators.
Ok, wow, this shit is getting crazy, these AI are doing magic. It's up to you paper holders to stay on top of these damn AI! keep up the badass research, This stuff is the future.
Haha! The old techniques look amazingly trippy!
This AI makes reallife footage look like an video game water animation. Which is basicly a looping texture.
2 more papers down the line and I can throw away my degree in cg
I’m trying to become a web developer. I wonder if I’ll even have a job when I’m done.
I've made some tests with the sample videos, if you speed up, you can notice how the ai predict the water flow.. in any cases, amazing those videos were generated from from pictures..
Wow... Just wow... You never fail to amaze me!
I was not squeezing hard enough. This is so cool.
Amazing work. I wonder if the next paper could also animate filling in the blank. Imagine zooming out into a video image area that isn't there because it was cut to do image stabilization.
Thank you for all your videos, and thanks for being you. I'm trying to hold on to my paper even though it's so slippery :D
awesome content as always
These looping videos would be awesome for web design!!
Or distraction from things that matters when you looking for something
this would be awesome as a Facebook app to animate our photos
The Zsolnai-Fehér Beard Test became a standard for image manipulation AI.
If you ever make music, 4:25 should be your first album cover (:
I'm thinking of how useful it could be for video game particle artists, to make hyper-realistic, perfectly-looping smoke sims. holy crap
Unfortunately, generating this stuff in real time is not as easy as generating it in the first place. There's a reason these clips are all only a few seconds long. Gaming graphics are never going to look as realistic as bleeding edge simulations like this, simply because the sims will always be run on hardware that's like 100 times as powerful and don't have to be run from many different perspectives and have a very short duration and even after all that are only ever shown after several hours worth of computation time.
I will watch the video later but just wanted to say that the image in the thumbnail was on the cover of the lecture notes for my undergraduate fluid dynamics course 😁
Man, just imagine what ML&AI will be like in 10-15 years. Holy cow.
2:38 I failed to follow your instructions thinking much about what I was going to see and I now have to pick up all my papers now.
Can already see this becoming an mobile app. Feels weird its this good
Damn, wanted to try it. Hope they make source available soon.
these seamless video loops are gonna be HUGE with bank robbers :D
OH MY GOD, I want an animated beard and hair for all my photos! That's amazing!
Forecasting time with Nn is insane
why isn't this still available yettt sadddddddd
😥
I can't wait to get 1 piece of a 1000-piece puzzle analyzed, have the computer recreate the entire picture of what the puzzle was supposed to be, and then it animates it right there on the spot.
Whoops, dropped my papers.
This is pretty cool.
Now, the real challenge is in analyzing these failure cases in order to iron them out. However many papers down the line it takes. The real magic lies in what can be done with said AI algorithms right now.
Wow, really like this Orwellian Motion Synthesis!
Imagine one of those LED picture frames that has all this tech built into it with a super simple interface to drag and drop pics. This could exist, and be affordable. Shark tank?
Love your videos! So much good info!
I wanna see what it does with furs of various animal species, and things like sand and grains. Oh, and photos of planets, galaxies, nebulae and the Sun!
The movement in the animated pictures (the beard specifically) is exactly what you see when you take lsd or mushrooms.
you have a "hold onto your papers" icon. But you need a "squeeze onto your papers" icon as well. I was expecting that icon to grab the papers lmao. :D
"Dear fellow scholars, this is Two Minute Papers with Doctor Obi Wan Kenobi"
I was taking a shit while watching this and was unprepared when you told us to hold on to our papers so i had to hold the toilet paper
Smoke *is* a fluid. Fluid is not just a synonym for liquid.
Wooooah, you're so close to 1M
what is the name of the previous method from 2019? Looks so cool and would love to use it in a vid
Always love your amazing video's.
Insanely good
madness, absolute madness
God that is so beautiful
We need to find a use-case for the nifty flowing beard technique.
Do you think one more paper down the line, the beard would not be animated as it is not a fluid? Or maybe the option to enable/disable parts of the image that a user wants to animate even if it isn't a fluid, like beard hair?
Imagine Adobe silently sneaking this into photoshop and freaking users out.
Fun fact: tomorrow i have to finish a project in school with exactly this type of effect. So sad that there's no colab online yet.
I want this as my desktop wallpaper
Károly adding to his beard should be a running joke
quite amazing indeed
Incredible!
Man all of your videos keep amazing me.
Technology is going places.. both scary and incredible.
Mindblowing
Great videos like always
absolutely LOVE the beard movement LOL
Yum yum yum! I love it!