Not only that. The motion amplification is used at huge industrialplants to controll vibrations on machines and tubes which would destroy them over time. And as a control mechanism in research to card out wrong meassurements through visual evidence. Really cool tech
They do exactly this all the time. A pulse oximeter, the little thing a nurse clips onto your finger at the hospital, uses a photodetector like a photodiode, (basically a 1 pixel camera) to detect changes in brightness of red and infrared light that is passed through the finger, which provides iformation on both heart rate and the oxygen levels in the blood. So you see, we've been using camera to detect vital signs for many decades already. Jist not cameras in the way most people thing of a multipixel array of photodetectors with a high resolution. There are actually projects on TH-cam where people will make say, a 24x12 array of photodetectors and literally build a homemade digital camera. It's pretty neat, and shows how a single photosensor is just a 1 pixel camera more intuitively.
It's worth noting, factory engineers use this technology to detect broken machinery. Something can look completely still in real life and with 20x motion amplification when functioning normally, but a loose bolt will make the whole thing jiggle.
@@Dr.W.Krueger it's not just math because this existed 200 years ago and computers had plenty of power when the video was made. The innovation was finding useful ways to apply math to seemingly completely unrelated topics
@@JesusProtectsnewborn children and monitoring their vitals visually from home, checking industrial machine vibrations so you know the machine isn’t going to break, and any other area of use where small changes over time can indicate a larger problem.
The retina could create a similar effect. If you look at an unchanging scene with perfectly fixed eyes long enough, your vision will fade till you can't see. Small parts that are changed will then stick out.
high doses too ;P but for real, maybe any alteration to our sensory perception (such as huangs mentioned one) is due to some natural chemical change in our body. And with psychadelics, which simply inhibit reuptake or stimulate the release of dopamine serotonin and norepinephrine, those effects are just produced at an "unusual" time which make them more noticeable and classified as tripping when in actuality we are ALWAYS tripping haha @@DCrypt1
I have indeed experienced that. Looking at a fixed point intensively. (Not on drugs. No eyes problem). The scenery would switch to a a different visual frequency, what you call fading. But I didn't see this as an improvement in details. Actually if you were to create even the slightest change in your eye moving it, everything goes back to normal.
@@alanmlkbanda I guess it's more like long exposure photos (useful for imaging distant planets or what not) where the image becomes more defined and details that are not clear right away become apparent. But with our eyes that kind of overexposure just washes out the image creating that "fading" effect. (?)
One of the coolest uses for this technology was a company that would go into industrial buildings and film the equipment, then amplify that footage and find which machines were running rough, needed to be stabilized, or were the cause of vibrations throughout the building. Groundbreaking stuff.
I've seen a video where this method was used to show minute vibrations in a factory. It looked insane as the machinery and supports twisted and flexed. It clearly showed where all the stresses were being applied by the vibrations, and could protective solutions could be put in place. It is included in Steve Mould's video:- th-cam.com/video/rEoc0YoALt0/w-d-xo.html
all the people who are saying how different these approaches are must be working for the company featured in Steve Mould's video... the two approaches are functionally identical.
absolutely. I've seen some really amazing image enhancement programs and software over the years, but the cost of these things is far beyond what the average person would spend for a single piece of software.
Also there is no such thing as a ''single piece'' ''of'' ''software'' People really need to stop thinking of software as ''individual units'' as they can be replicated practically infinitely. People are too retarded when it comes to technology. I wish smartphones were never invented. Y'all ruined the internet.
amazing stuff, will play around with the open source code; so cool I was beginning to think the field of imaging software was getting stale, but my hopes are back up now
Like literally you're trying to gatekeep some open source software making people think you're the only ''company'' who it is available to? Stop pretending like you made the software and own it. Why aren't you explaining that people can do this themselves with a camera and software, both of which are readily available.@@AlphatecEngineering
When i was my kid, that scene in blade runner blew my mind. There was nothing like it at the time, now your smart phone can do things 1000s of times more complicated 😅
Looks akin to how motion vectors work in NVIDIAs DLSS 2+ very cool to see the history of this method. Motion artifacts remind me of low res ray tracing artifacts.
I see the beginning of a new TH-cam meme. Once the code is released, I'm sure that the site will get flooded by videos that apply Euler magnification to just about anything. Looking forward to that!
Wait so that super secret method that the "inventor" in Steve Mould's video wasn't actually secret at all and he just found an old idea, not even his own, and is trying to sell it? Less surprising than I might hope.
Ah this is really clever. Different levels of high pass filters to exagerate subtle motion. This would be cool for mechanical engineering like in factories or stress testing machines! Lot's of possibilities to try this on out on.
The interpretation of what you wrote is so ambiguous that it is impossible to discern a degree to which people who liked your comment agreed with you or just thought of something totally obscure.
The implications this research has not only for parents but for security and the medical field is great. Amplifying subtle motions to be more exaggerated looked like something kinda cool until you showed the video with the baby's heart rate and the baby breathing. Good research project.
Curious about the differences between the visual HR monitor and the machine monitor. Machine monitor stayed pretty constant at 150-151 while the other one varied between 148-156. Inaccuracy in the visual process? Or is the machine monitor actually flattening out variations for a smoother reading?
Am I the only one who reminds this motion and color magnification to the effects of the visuals of LSD? 😅 Maybe even thats what happens, when you take it: You get more sensitive to color/motion changes. That would also make sense because all your other senses feel to get more sensitive and amplified. Nevertheless: really great work and it has so many fields of application!
Miki, I'm a grad student working with ants, and I would love to use this amazing tool to look for cryptic patterns in ant behavior. Let me know whether you'd be interested in collaborating somehow!
To record a 150bpm heart rate wouldn’t the video have to be at least 300fps? (Nyquist) I especially don’t understand how it can get kHz frequencies like that guitar.
i can not believe this was 11 years ago. it seems so practical to extract the vital signs of a human with a camera
Not only that. The motion amplification is used at huge industrialplants to controll vibrations on machines and tubes which would destroy them over time. And as a control mechanism in research to card out wrong meassurements through visual evidence.
Really cool tech
Especially with today's level of camera.
The speed, the quality...
It makes the technology this video was made with seem older than dinosaurs.
probably a deep learning algorithm can extract it, with the added benefit the neural network would teach itself what image processing needs happening
They do exactly this all the time. A pulse oximeter, the little thing a nurse clips onto your finger at the hospital, uses a photodetector like a photodiode, (basically a 1 pixel camera) to detect changes in brightness of red and infrared light that is passed through the finger, which provides iformation on both heart rate and the oxygen levels in the blood.
So you see, we've been using camera to detect vital signs for many decades already. Jist not cameras in the way most people thing of a multipixel array of photodetectors with a high resolution.
There are actually projects on TH-cam where people will make say, a 24x12 array of photodetectors and literally build a homemade digital camera. It's pretty neat, and shows how a single photosensor is just a 1 pixel camera more intuitively.
@@camus83489Especially for important things it is better to have an explainable algorithm. Machine learning is not a solution to everything.
This is freaking insane. Great example of technology becoming so advanced that it seems like magic.
It's worth noting, factory engineers use this technology to detect broken machinery. Something can look completely still in real life and with 20x motion amplification when functioning normally, but a loose bolt will make the whole thing jiggle.
This paper is 11 years old
It's math...and not very complicated. The challenge, at the time, was having it run in real time.
stay in school kiddo :)
@@Dr.W.Krueger it's not just math because this existed 200 years ago and computers had plenty of power when the video was made.
The innovation was finding useful ways to apply math to seemingly completely unrelated topics
Why isn't this a more widely known about and used technology?
This is mind-blowing, and I feel like it could have plenty of applications.
Like what?
😂@@JesusProtects
@@JesusProtectsnewborn children and monitoring their vitals visually from home, checking industrial machine vibrations so you know the machine isn’t going to break, and any other area of use where small changes over time can indicate a larger problem.
@@JesusProtectsThere were many mentioned in the video. You don't have to ask, just use your brain
because the video has to be really stable to get stuff like veins pumping
The retina could create a similar effect. If you look at an unchanging scene with perfectly fixed eyes long enough, your vision will fade till you can't see. Small parts that are changed will then stick out.
That's not exactly real useful in the real world.
I believe low dose of psychedelics can do the same. Operative word is low dose.
high doses too ;P but for real, maybe any alteration to our sensory perception (such as huangs mentioned one) is due to some natural chemical change in our body. And with psychadelics, which simply inhibit reuptake or stimulate the release of dopamine serotonin and norepinephrine, those effects are just produced at an "unusual" time which make them more noticeable and classified as tripping when in actuality we are ALWAYS tripping haha @@DCrypt1
I have indeed experienced that. Looking at a fixed point intensively. (Not on drugs. No eyes problem). The scenery would switch to a a different visual frequency, what you call fading. But I didn't see this as an improvement in details. Actually if you were to create even the slightest change in your eye moving it, everything goes back to normal.
@@alanmlkbanda I guess it's more like long exposure photos (useful for imaging distant planets or what not) where the image becomes more defined and details that are not clear right away become apparent. But with our eyes that kind of overexposure just washes out the image creating that "fading" effect. (?)
One of the coolest uses for this technology was a company that would go into industrial buildings and film the equipment, then amplify that footage and find which machines were running rough, needed to be stabilized, or were the cause of vibrations throughout the building. Groundbreaking stuff.
Could you provide some more information/sources about this? - It sounds like a fascinating read
@@racnoff6726 Sure, they dont allow links (even internally) so search for Miscellaneous Motion Amplification here on the tube.
The motion amplification looks like the stuff magic is made of. That's just genius.
I've seen a video where this method was used to show minute vibrations in a factory. It looked insane as the machinery and supports twisted and flexed. It clearly showed where all the stresses were being applied by the vibrations, and could protective solutions could be put in place. It is included in Steve Mould's video:- th-cam.com/video/rEoc0YoALt0/w-d-xo.html
This video uses a different motion amplification algorithm
Thank you for reminding me of that link, such a beautiful video!
Unrelated, different approach.
Still Dre Day Das, Ak Das
all the people who are saying how different these approaches are must be working for the company featured in Steve Mould's video... the two approaches are functionally identical.
dude, this is a big milestone for image processing
I mentioned this technique in a comment a few days ago and it is really cool that TH-cam suggested this video again!
absolutely. I've seen some really amazing image enhancement programs and software over the years, but the cost of these things is far beyond what the average person would spend for a single piece of software.
Software doesn't cost anything to distribute or replicate. Once a software is made there is no additional cost for distribution.
Also there is no such thing as a ''single piece'' ''of'' ''software''
People really need to stop thinking of software as ''individual units'' as they can be replicated practically infinitely.
People are too retarded when it comes to technology. I wish smartphones were never invented. Y'all ruined the internet.
@@RobotronSage no shit theyre talking about how much it costs to buy
Wow, the use cases of motion amp. and color amp. is insane!
amazing stuff, will play around with the open source code; so cool
I was beginning to think the field of imaging software was getting stale, but my hopes are back up now
Where can I download this software?
See link in video description@@Rybz
This can be used to detect vibrations and vibration-related problems in industrial systems
Yes! and you can hire these services from RDI Technologies Inc., I-Care, RMS Ltd, GAMT, Erbessd-Instruments, among many others.
All you need is a camera and the software / algorithm. Nobody needs to pay some company to do it for them. Stop scamming people.@@AlphatecEngineering
Like literally you're trying to gatekeep some open source software making people think you're the only ''company'' who it is available to? Stop pretending like you made the software and own it. Why aren't you explaining that people can do this themselves with a camera and software, both of which are readily available.@@AlphatecEngineering
Man, those low sci high fi writers were really on to something with those "Enhance image!" lines.
When i was my kid, that scene in blade runner blew my mind. There was nothing like it at the time, now your smart phone can do things 1000s of times more complicated 😅
I was thinking this was some crazy brand new development, and then I saw this is from 11 years ago, insane lmao
wow it's already been 11 years? it feels like yesterday since i saw this first demonstrated. time really is merciless.
Looks akin to how motion vectors work in NVIDIAs DLSS 2+ very cool to see the history of this method. Motion artifacts remind me of low res ray tracing artifacts.
Nice, and 11 years ago!
Can't believe this was 11 years ago
Imagine AI knows your vital signs just by looking at you.
Scary.
An 11 year old video appeared in my video today. Glad it did... this is a very interesting topic, well-covered in the video.
I see the beginning of a new TH-cam meme. Once the code is released, I'm sure that the site will get flooded by videos that apply Euler magnification to just about anything. Looking forward to that!
This is like audio transient shaping, but video. Neat!
youtube algorithm decided it was time to suggest this video 11 years later...
Wait so that super secret method that the "inventor" in Steve Mould's video wasn't actually secret at all and he just found an old idea, not even his own, and is trying to sell it?
Less surprising than I might hope.
Added this to my public TH-cam Museum playlist
Amazing! please release this library in the openCV one :)
This is wonderful! This can literally change the world!
so amazing how you can track the hearbeat simply from a video
Wonderful technology that these days is doing a great job of finding vibration problems in industrial plants.
Great work, 2021 a live camera system is available . convelouting a 3x3 array over a bitmap . heady days.
I wonder if this could be used in astronomy and telescopes to get more information out of them
kassie2k4 That is a good question, perhaps the stars emit light at certain intervals this may be able to intensify that.
there should be interesting applications around exoplanets and/or exomoons... perhaps near-earth objects as well.
There are people in the world who do this.
So many applications. Perhaps even analyzing things like heart valves. Maybe CT or ultrasonic imagining?
Ah this is really clever. Different levels of high pass filters to exagerate subtle motion. This would be cool for mechanical engineering like in factories or stress testing machines! Lot's of possibilities to try this on out on.
try it on controversial historical footage ;)
What?
The interpretation of what you wrote is so ambiguous that it is impossible to discern a degree to which people who liked your comment agreed with you or just thought of something totally obscure.
Welcome to politics... Say vague things to get most people to agree with you!
He’s absolutely referring to September Eleventh.
What software can i use to do this
Why am I only seeing this now?
This feels like a summer of math exposition video
Steve Mould made a video about this technology application. really awesome.
The implications this research has not only for parents but for security and the medical field is great. Amplifying subtle motions to be more exaggerated looked like something kinda cool until you showed the video with the baby's heart rate and the baby breathing. Good research project.
This project deserves special atention.
11 YEARS AGO
How have we not seen more of this in modern implementations? lol
this is incredible research
It only took TH-cam's algorithm 11 years to get this knowledge out to the public lol
I bet this is a big noble prize candidate
This is so crazy, but so awesome at the same time.
Amazing job!
i wonder why this is taking off more so now. but this is some fascinating stuff.
Curious about the differences between the visual HR monitor and the machine monitor. Machine monitor stayed pretty constant at 150-151 while the other one varied between 148-156.
Inaccuracy in the visual process? Or is the machine monitor actually flattening out variations for a smoother reading?
Steve Mould has a video about similar technique. I'ts called "Reveal Invisible Motion With This Clever Video Trick"
So the whole CSI "make the image better button" could soon be a reality.
Fantastic possibilities to monitor patients non intrusive.
Am I the only one who reminds this motion and color magnification to the effects of the visuals of LSD? 😅
Maybe even thats what happens, when you take it: You get more sensitive to color/motion changes.
That would also make sense because all your other senses feel to get more sensitive and amplified.
Nevertheless: really great work and it has so many fields of application!
Well done guys, this is like black magic
Miki, I'm a grad student working with ants, and I would love to use this amazing tool to look for cryptic patterns in ant behavior. Let me know whether you'd be interested in collaborating somehow!
Does anyone know if this has ever been practically used in the medical field or if there are any devices being developed based on this technology?
Some of the effects this technology has on video footage remind me of the way things breathe and undulate while under the influence of a psychedelic
This is how the xbox one reads your heartbeat. Neato.
This was really cool and interesting. Thank you!
👏🏻 👏🏻 👏🏻 amazing work!
This is the opposite of deshaking algorithms. It would be cool to have a continuous slider, to smoothly slide from deshake to amplification.
Fascinating. I want this.
Very interesting. I had no idea what the applications might bew even after I sort of grasped how the video was being filtered.
We need to use this to debunk those viral ghost videos.
Wow, this is fascinating. I can see the government using this to their advantage...
This is amazing
zoom and enhance
but it actually works
I love this technology. It is like super human vision.
Technology is so fascinating...
I made it here. Am I smart ?
my mind is blown
Very interesting presentation. Well put together too.
This could be used in crime scene investigation.
would this need some sort of special highdef camera?
11y ago... and now I thinking, why actual security cams is so bad?
Wow. Fascinating stuff!
This is insane, wtf, we are getting into the type of technology from blade runner
Why does this exist
Why was this in my recommended
*Why did I click on this*
Motion amplification is soooooooooooo like an LSD trip :)
What if we make timelapse of human aging with this? or change in facial expressions? it would be awesome
it took 11 years, for me to see it
Now I know what acid does to my vision.
Very cool concept!
great video
Fascinating!
could the same thing be used for amplifying motion?
he did amplify american football
How sharpness adjustment really works..
this was 11 years ago wow
So is this motion amplification?
can it be used to magnify the pop filter on your microphone?
can this be done in reverse? to reduce motion in a video?
To record a 150bpm heart rate wouldn’t the video have to be at least 300fps? (Nyquist)
I especially don’t understand how it can get kHz frequencies like that guitar.
This is awesome!
yeah, this is what we do in elementary school today, genious ...
They use this stuff for security applications, like airports
This is neat!
11 YEARS AGO
bom trabalho
This was 11 year ago!😮
11 years prior, they didn't need no AI or GPT bullshit to make awesome technologies