See invisible motion, hear silent sounds. Cool? Creepy? We can't decide | Michael Rubinstein

แชร์
ฝัง
  • เผยแพร่เมื่อ 22 ธ.ค. 2014
  • Meet the “motion microscope,” a video-processing tool that plays up tiny changes in motion and color impossible to see with the naked eye. Video researcher Michael Rubinstein plays us clip after jaw-dropping clip showing how this tech can track an individual’s pulse and heartbeat simply from a piece of footage. Watch him recreate a conversation by amplifying the movements from sound waves bouncing off a bag of chips. The wow-inspiring and sinister applications of this tech you have to see to believe.
    TEDTalks is a daily video podcast of the best talks and performances from the TED Conference, where the world's leading thinkers and doers give the talk of their lives in 18 minutes (or less). Look for talks on Technology, Entertainment and Design -- plus science, business, global issues, the arts and much more.
    Find closed captions and translated subtitles in many languages at www.ted.com/translate
    Follow TED news on Twitter: / tednews
    Like TED on Facebook: / ted
    Subscribe to our channel: / tedtalksdirector
  • วิทยาศาสตร์และเทคโนโลยี

ความคิดเห็น • 255

  • @lisaboulton2887
    @lisaboulton2887 9 ปีที่แล้ว +38

    It would be interesting to see if magnifying the image of people in comas might lead to finding signs that indicate the patient is actually still "in there" somewhere.

    • @warpspeed8305
      @warpspeed8305 4 ปีที่แล้ว +5

      fMRI or BCI. With BCI it's even possible to communicate with patient. There was some video on this subject.

  • @DEO777
    @DEO777 9 ปีที่แล้ว +86

    If this technology was available in the 80s and 90s, we could have detected that Milli Vanilli was lip syncing and saved the people from buying their albums.

    • @MrVinceq
      @MrVinceq 9 ปีที่แล้ว +11

      Lol, it scarred you deeply ?

    • @DEO777
      @DEO777 9 ปีที่แล้ว +5

      David Munoz Milli Vanilli did more than just lip sync, they never sung the songs ever.

    • @codebeat4192
      @codebeat4192 6 ปีที่แล้ว

      Haha, good one! bullseye! haha.

    • @EnriqueHJ
      @EnriqueHJ 3 ปีที่แล้ว

      Jahahaha

  • @MuadDib1402
    @MuadDib1402 9 ปีที่แล้ว +5

    This kind of thing is the reason we watch TED talks. Amazing.

  • @MedEighty
    @MedEighty 9 ปีที่แล้ว +1

    I saw the talk about this a year or two ago and I was very impressed. Now I'm impressed all over again.

  • @E-99x
    @E-99x 4 ปีที่แล้ว +2

    This will be ground breaking for solving crimes that were committed where surveliance recorded situations regarding murder, rapes, and abduction where the camera had no sound.

    • @xponen
      @xponen 2 ปีที่แล้ว +1

      it cannot be used with camera that don't have HD and high-speed/high-frame-rate function, so it cannot be used for old surveillance footage.

  • @Kaizerg
    @Kaizerg 9 ปีที่แล้ว +17

    Note to self: Don't talk about important things in a room with empty chips bags laying around...

    • @warpspeed8305
      @warpspeed8305 4 ปีที่แล้ว +2

      If subvocal recognition works with video -- note - don't talk to yourself :-) even if you don't open mouth.

    • @brentfisher902
      @brentfisher902 4 ปีที่แล้ว +1

      If you tell about an important gory political event, it might never be able to happen. Loose lips sink ships.

  • @tarassu
    @tarassu 9 ปีที่แล้ว +2

    That same sound extraction technique was used in science fiction movie "Eagle Eye". I was pretty sure that extracting sound from vibrating water in glass was somehow even possible. Now I see the result.

  • @elloboblanco9111
    @elloboblanco9111 9 ปีที่แล้ว +2

    WOW! I'm blown away with this... the speech recognition from objects is awesome! Technology really is becoming incredible.

  • @sandrisaug
    @sandrisaug 3 ปีที่แล้ว +2

    To recover a sound from video you need to take that video with hi-speed cameras with frame rate at least 12000 hz.

  • @mamundavidebneahameddornse7407
    @mamundavidebneahameddornse7407 9 ปีที่แล้ว

    This is brilliant use of creativity! Hats off to the team that made this possible! (y)

  • @codebeat4192
    @codebeat4192 6 ปีที่แล้ว +2

    In one word: Speechless.
    Amazing. Mind Blowing.

  • @yurikolovsky
    @yurikolovsky 9 ปีที่แล้ว

    Amazing!!!!!! Best TED talk in a while!

  • @FranktheDachshund
    @FranktheDachshund ปีที่แล้ว

    Recovering sound from video is just amazing.

  • @Deusmecumest
    @Deusmecumest 9 ปีที่แล้ว

    Wow, Wow, Bravo. What an amazing breakthrough. What a amazing limitless application of science.

  • @fidelio1991
    @fidelio1991 9 ปีที่แล้ว +38

    Science gets more and more stunning. I dream of incredible possibillities in 100 years and on...

    • @MedEighty
      @MedEighty 9 ปีที่แล้ว +14

      This isn't science. It's engineering. As in, the application of science. There's no new science here. It's an application of known science in inventing new and impressive technology.

    • @matbroomfield
      @matbroomfield 9 ปีที่แล้ว +4

      I think that George Orwell's vision of the future will not be a fraction as bad as the real future.

    • @5to22a
      @5to22a 9 ปีที่แล้ว +1

      Mat Broomfield
      Unless we get rid of the state, then things will be awesome.

    • @fidelio1991
      @fidelio1991 9 ปีที่แล้ว

      MedEighty
      Doesn't really matter... i mean every aspect of progress happening in these days. It's a real pleasure for me to be part of an age, where humans once may be able to fight cancer or other dieseases and fly to other planets and settle down... that's what I'm talking about. Nobody would have thought this to be possible 60 years ago.

    • @fidelio1991
      @fidelio1991 9 ปีที่แล้ว +2

      becool365
      -.- It's clear to me, that most of the things have been thought about way earlier, but the speed with which inventions are made, is admireable... Dreams are no longer just dreamed but made or will be made possible to become reality (sorry for mistakes - I'm not a native speaker)

  • @AaronHendu
    @AaronHendu 2 หลายเดือนก่อน

    I have been messing with increasing color saturation in my photography to extreme levels, revealing a the full spectrum of intense coulor hidden behind the neutral exposure of our vision. Even a bland nearly gray scale scene is full of color variation and intensity. It is quite unteresting to wonder how other eye systems are able to interpret the same scenes.

  • @luis96xd
    @luis96xd 5 ปีที่แล้ว +1

    Wow, this technology is so amazing! Thanks for this video!

  • @Chronomatrix
    @Chronomatrix 9 ปีที่แล้ว +5

    Mind blown, this is incredible.

  • @BEPrimAnim
    @BEPrimAnim 9 ปีที่แล้ว +1

    This gives me an idea of a microphone made of some material super sensitive to motion, so it can record the sound in nearly perfect quality. This is like something from a sci-fi movie!

  • @IdioticPlatypus
    @IdioticPlatypus 9 ปีที่แล้ว +4

    i bet if we pointed this at stars and star systems, we can enhance how much they wobble so we can see which ones have planets without having to watch them for months.

  • @nubeslocas
    @nubeslocas 9 ปีที่แล้ว

    Best idea I've seen in years!!! Awesome!

  • @Bluemoondm1
    @Bluemoondm1 9 ปีที่แล้ว +20

    Pretty incredible. Will make people even more paranoid though (maybe rightly so?)

    • @MedEighty
      @MedEighty 9 ปีที่แล้ว +8

      Shhh! Close the blinds. Someone might be listening. :D

    • @shadowx089
      @shadowx089 9 ปีที่แล้ว +7

      MedEighty The vibration from the blinds would be the speaker.

    • @Bluemoondm1
      @Bluemoondm1 9 ปีที่แล้ว +3

      Given the right light, the window itself would probably be an amazing speaker

    • @MedEighty
      @MedEighty 9 ปีที่แล้ว +2

      shadowx089 You're right. Bluemoondm1, if you want to say something, just text it or send it by brain waves.

  • @RSP13
    @RSP13 9 ปีที่แล้ว +2

    Talks like that make me love TED

  • @HangOn2seconds
    @HangOn2seconds 9 ปีที่แล้ว

    This is amazing!!! I wonder if the video has to be hd quality?

  • @amortalbeing
    @amortalbeing 3 ปีที่แล้ว

    Magnificent work. loved it

  • @jhe9521
    @jhe9521 ปีที่แล้ว

    would've been cool to see HOW crisp packet movement was translated to sound ~ all else was explained wonderfully, but on that we had to take a leap of faith...

  • @olliloco
    @olliloco 9 ปีที่แล้ว

    Thanks for sharing.. And darn good work.. :-)

  • @FELICIENRo
    @FELICIENRo 9 ปีที่แล้ว +1

    BRAVO and thank you.

  • @joshjeggs
    @joshjeggs 9 ปีที่แล้ว +1

    most of the sound clips were unintelligible if you didn't know the original clip. but this is still stunning Would love to go back to those scilent black and white videos and recover some remarkable insights.

  • @rickysukhi
    @rickysukhi 9 ปีที่แล้ว

    so fascinating !

  • @ShoaibKhan
    @ShoaibKhan 9 ปีที่แล้ว +1

    Reminds me of the movie "Eagle Eye" where an super smart AI 'listens' to a secret meeting by just observing the sound waves produced in a glass of water placed on a table.

  • @saxyboyraw
    @saxyboyraw 9 ปีที่แล้ว

    this is huge. it basically gives everyone a sixth sense worth of information on everything ever video recorded.

  • @Anakele20
    @Anakele20 9 ปีที่แล้ว

    I'm in awe. This is so incredible. I'm just stunned at the brilliance...between this and sending signals via lasers...this is an exciting time to be alive.

  • @kulovsky1
    @kulovsky1 9 ปีที่แล้ว

    This is so awesome!!!!!!

  • @steffahn
    @steffahn 9 ปีที่แล้ว

    I would like seeing actors playing dead bodies breathing, moving slightly or showing pulse.

  • @MarkKislich
    @MarkKislich 9 ปีที่แล้ว

    Very HIGHLY interesting..
    Shared left right and center.

  • @alekseyalexej9665
    @alekseyalexej9665 3 ปีที่แล้ว

    Where can I get software to enhance the visibility of motion in the frame? (required to solve technical problems)

  • @Mike165987
    @Mike165987 9 ปีที่แล้ว

    what kind of video quality is needed in order to extract the information needed for this software? Do they all have to be high FPS films?

  • @ShaiBarack
    @ShaiBarack 9 ปีที่แล้ว

    Fantastic!

  • @wyrwshwsrey463y
    @wyrwshwsrey463y 9 ปีที่แล้ว

    thats absolutely brilliant- science is so awesome

  • @katiekawaii
    @katiekawaii 9 ปีที่แล้ว

    Incredible. Absolutely incredible.

  • @acekel7040
    @acekel7040 9 ปีที่แล้ว +1

    Awesome video just one question how would this technology work in environments such as outdoors. For example does wind obscure an objects reaction or light may be modified by angles of sunlight?

  • @heyolast4464
    @heyolast4464 9 ปีที่แล้ว

    Amazing!!! just WOW!

  • @DmitryShevkoplyas
    @DmitryShevkoplyas 2 ปีที่แล้ว

    Brilliant!

  • @avedic
    @avedic 9 ปีที่แล้ว

    Sometimes I'm so happy to be alive now. We don't realize just how lucky we all are to be born at a time where we get to come of age....the same time the human race is exponentially coming of age. We get to live during the elbow of that curve....the _most_ exciting time. Also the most potentially frightening and stressful time. Lots of challenges ahead. But, human's innate desire to learn, connect, create, and dream is what gives me my sense of long-term optimism & hope.

  • @AtamMardes
    @AtamMardes 9 ปีที่แล้ว

    Interesting. Laser devices already exist that convert vibrations from a window into audible sound. The video sound detection and laser sound detection can be utilized depending on conditions. The laser detection system can be used to detect sound from the window where windows are covered by a curtain where video cannot see the potato chips bag. The video sound detection system can also be used to detect sound out of curtain vibrations.

  • @AlexDings
    @AlexDings 9 ปีที่แล้ว +1

    I haven't seen anything this brilliant AND this creepy in a long time. One should be very careful in saying that something will change our world, but I think that's quite possible to happen here.

  • @potemkin505
    @potemkin505 9 ปีที่แล้ว

    Best Ted Talk I've seen

  • @buddy77587
    @buddy77587 9 ปีที่แล้ว

    Fabulous!

  • @JackassJimbo
    @JackassJimbo 9 ปีที่แล้ว +15

    This is amazing, cant wait to see what this will develop into! I really wish I could live several hundred years sometimes just to experience what the future will be like :/ Hurry up science, I dont have forever you know!

    • @v-22
      @v-22 8 ปีที่แล้ว +3

      Just so you know, if you live for the next 50 years, you will have forever.

    • @nikkibridgewater4223
      @nikkibridgewater4223 2 ปีที่แล้ว

      Well you dont have to long none of us do hope your right with jesus christ everyone needs to repent if they didnt already

    • @eeyoresbutt3747
      @eeyoresbutt3747 2 ปีที่แล้ว

      @@v-22 Explain your statement please.

    • @v-22
      @v-22 2 ปีที่แล้ว +1

      @@eeyoresbutt3747 In 50 years, things will have progressed to the point where we should have achieved immortality. Life expectancy is going to increase exponentially, until it reaches infinitum, death will be optional. Printed organs, nano bots, crspr, being uploaded to some virtual reality, this is just the beginning.

  • @TheLazyKey
    @TheLazyKey 9 ปีที่แล้ว

    I'm gana have to try this out...

  • @vaibhavshoran
    @vaibhavshoran 7 ปีที่แล้ว

    amazing!

  • @250108
    @250108 9 ปีที่แล้ว

    This is totally amazing.

  • @3dsman
    @3dsman 9 ปีที่แล้ว

    Very cool!!

  • @sidneyhart6221
    @sidneyhart6221 9 ปีที่แล้ว

    Thanks science dudes. This is truly awsome tool.

  • @YosuaSimanjuntak
    @YosuaSimanjuntak 9 ปีที่แล้ว

    This is waaaaay tooooo coooool!!!

  • @HangOn2seconds
    @HangOn2seconds 9 ปีที่แล้ว +1

    Where is the link TED?

  • @woobiesftw
    @woobiesftw 9 ปีที่แล้ว +2

    I imagine this is how fictional cyborgs like Seven of Nine and RoboCop monitors another character's heart rate and stuff.
    If they turn this technology on every piece of silent historical footage, we might learn some very interesting and shocking things.

  • @Mink0twink
    @Mink0twink 9 ปีที่แล้ว +3

    I want this tech in realtime goggles, oh the possibilities.....! lol

    • @warpspeed8305
      @warpspeed8305 4 ปีที่แล้ว

      lie detector built inside google glass or something similar.

  • @ybefutile
    @ybefutile 9 ปีที่แล้ว

    Amazing.

  • @Telleryn
    @Telleryn 9 ปีที่แล้ว

    Wish they'd provide some relevant links in the description

  • @nikhilkumarm7445
    @nikhilkumarm7445 9 ปีที่แล้ว

    Awesome ...

  • @sam-zy2dn
    @sam-zy2dn 4 ปีที่แล้ว

    I wonder how the filter setting are selected to reduce the noises. Also what are the nature noises that he speaks about . Is it like noises due to movement of camera or what?

  • @sallysassa
    @sallysassa 9 ปีที่แล้ว

    That's brilliant. I see many applications. Just wondering if Steve has a tooth issue lower left jaw at 1:31.

  • @rorychin8670
    @rorychin8670 4 ปีที่แล้ว

    Amazing technology! Out of curiosity, has anyone used this on supposed paranormal entities captured on video?

  • @bruney6
    @bruney6 9 ปีที่แล้ว +1

    Wow!! So cool, do you think the NFL could use this to watch players before the ball snaps to uncover what is the likely play they will play based on their micro actions?! :)

  • @Infertilityandmepodcast
    @Infertilityandmepodcast 9 ปีที่แล้ว

    Amazing

  • @madmark458
    @madmark458 9 ปีที่แล้ว

    Super amazing you might be able to get back your relatives speeches as well. amazing

  • @JohnBastardSnow
    @JohnBastardSnow 9 ปีที่แล้ว +1

    This is extremely impressive. I've heard of people using infrared cameras as a remote lie detector to assist capturing facial micro-expressions (Paul Ekman aka Lie To Me style). And that was YEARS ago. In the future, an average Joe will be able to gaze into your soul. They will see your involuntary muscle micro-reflexes. They will know your pulse, your breathing rate, perspiration. With the addition of molecule sensors, they will be able to perceive your biological processes; imagine small amounts of molecules smelling as distinct as an onion breath or as hydrogen sulfide. I think that interesting social patterns can arise, when your body will give more honest signals than your words or appearance; and when you can perceive so much more.

  • @mastereymaster8180
    @mastereymaster8180 4 ปีที่แล้ว

    Amazing technology wow

  • @iviewthetube
    @iviewthetube 9 ปีที่แล้ว +2

    Wouldn't you need 3000 video frames per second or more to get any reasonable sound resolution from this technique?

  • @kingofmaiars
    @kingofmaiars 9 ปีที่แล้ว

    Oh boy. "Samaritan" will definitely want a piece of this technology.
    I see this advancement implemented to the story of POI.

    • @pseudonym4893
      @pseudonym4893 9 ปีที่แล้ว

      I think it has already been used in POI by The Machine in earlier episodes. I also saw it in the movie Eagle Eye and thought it was total bullshit, but boy was I wrong.

  • @christophhenninger6440
    @christophhenninger6440 9 ปีที่แล้ว

    My first thought about the audio-thing was: Hey, we could use it to see what those referees are talking to the players.

  • @Cars701
    @Cars701 2 ปีที่แล้ว

    Skynet will love this. Thanks

  • @ICOD73
    @ICOD73 9 ปีที่แล้ว

    8:59 that girl looked too amazed

  • @Dishmab
    @Dishmab 9 ปีที่แล้ว +2

    This is really fucking amazing

  • @Mastikator
    @Mastikator 9 ปีที่แล้ว

    This is beyond science fiction!

  • @MaxLohMusic
    @MaxLohMusic 8 ปีที่แล้ว +1

    12:40 mind = blown

  • @breaneainn
    @breaneainn 9 ปีที่แล้ว

    You could process scenes in movies and recover the directors cues and instructions.

  • @venusmarina
    @venusmarina 9 ปีที่แล้ว

    Super!

  • @Kris_A
    @Kris_A 9 ปีที่แล้ว +11

    This is all very awesome, it really is; in trustworthy hands.
    But in the future... when those armed robotic drones are hunting you down for a parking violation or stealing a can of beans to feed your starving family, and you hold your arms up and go *shhhhhhh!!!!* And in a quiet whispering voice you tell everyone to "stay as still... and as *quiet* as you can"...
    ...The machines will see your slightest movement.
    The machines will tell that you aren't *reeeeaally dead* as you fake it on the ground.
    They will magnify your every sound, and can see you piss your trousers at a mile away..
    The machines will see all, and you will not escape.
    Or something like that.
    If that doesn't frighten your pants off, I don't know what will. :)
    Sidenote: I keep making these quips about this kind of thing, and non of them are actually funny because of the cold and unfortunate reality opening up before our very eyes. There are some great robot killer terminator film concepts in there though :P

  • @misbahashraf961
    @misbahashraf961 3 ปีที่แล้ว

    Plz describe how image processing can b used in silent sound technology
    ?

  • @truedeadandlife
    @truedeadandlife 9 ปีที่แล้ว

    Omg. The world has changed, biggest innovation since THis!

  • @ICOD73
    @ICOD73 9 ปีที่แล้ว

    the website isn't working. anyone got a link for the program?

  • @battmarn
    @battmarn 9 ปีที่แล้ว

    The exaggerated motion is kinda trippy

  • @MonsterSlayer14
    @MonsterSlayer14 9 ปีที่แล้ว

    That's amazing. They should get a Buddhist monk meditating and see if they can literally still themselves from motion.

  • @itsjustmedanny
    @itsjustmedanny 9 ปีที่แล้ว

    The possible applications will lead to incredible discoveries! Paranormal activity anyone?

  • @rogue_spirit
    @rogue_spirit 7 ปีที่แล้ว

    The second part about sound is the same principle in the movie Eagle Eye when the computer records the Defence secretary discussion from the vibrations in his cup of coffee :)

  • @religiondestroyer
    @religiondestroyer 9 ปีที่แล้ว

    wow!

  • @TheHellz0r
    @TheHellz0r 9 ปีที่แล้ว

    This is amazing......but I see it becoming very sinister, very quickly loooooooooll

  • @hotenenko
    @hotenenko 9 ปีที่แล้ว +3

    Странная толпа собралась в зале: при объяснении серьёзных вещей, когда нужно задуматься, они ржут, как в цирке.

  • @sentmode
    @sentmode 7 ปีที่แล้ว

    Use this camera and video tape those moving relics in Egypt.

  • @ramondetorres4880
    @ramondetorres4880 2 ปีที่แล้ว

    Would it be possible if this app analyzes each pixel's differences, to induce differences in the pixels and change what a person says?

  • @acdcrules0896
    @acdcrules0896 9 ปีที่แล้ว

    We need to put it in contact lenses and be able to have multiple views. iPhone app gives you options. Satellites, microscopes, heat seaking, night vision, telescopes, our normal eyes, a mechancial fly following you so that you could see in third person through your eyes, and this one. This is crazy.

  • @knolly57
    @knolly57 9 ปีที่แล้ว

    Listen in on the people in the Space Station just by pointing a telescopic camera and hear them talking - without the need for radio.I suppose to make it 2 way, the Space Station crew would need a camera of their own - so Hasselblads are out.

  • @nebrasayoub9722
    @nebrasayoub9722 9 ปีที่แล้ว

    did anyone try the link??
    its doesn't seem to be working..!!!!

  • @jamesdonaghy6758
    @jamesdonaghy6758 4 ปีที่แล้ว +4

    Bet the 3 letter agencies LOVE this ; )

  • @battleax9789
    @battleax9789 9 ปีที่แล้ว

    I'd like to see this done on someone strength training or an mma fight or a car accident.

  • @IreneEnriquez
    @IreneEnriquez 9 ปีที่แล้ว

    Cal Lightman would love this technology. :D

  • @zeeMuniStacksBundles
    @zeeMuniStacksBundles 9 ปีที่แล้ว +3

    NSA will probably like this