Playing piano with a mind-controlled robotic arm
ฝัง
- เผยแพร่เมื่อ 11 ก.ย. 2024
- The first person to live with a mind-controlled robotic arm is teaching himself piano. Johnny Matheny has spent the last five months with an advanced prosthetic, designed to replace the human hand and arm.
The robot arm is part of a research project run through the Johns Hopkins University Applied Physics Lab, and funded, in part, by the US Department of Defense. Data that researchers collect could revolutionize future mind-controlled robotics.
This is the second video in a series following Johnny has he spends the year with the arm.
Watch the arm being delivered: • Living with a mind-con...
SUBSCRIBE: goo.gl/kdDpXu
FOLLOW QUARTZ:
Facebook: goo.gl/DsmLvx
Twitter: goo.gl/rY7pSX
Check out the rest of our videos: goo.gl/A8gZvx
Quartz is a digitally native news outlet dedicated to telling stories at the intersection of the important and the interesting. Visit us at qz.com/ to read more.
Yall need to make it faster so he can play Chopin
FANTASIE IMPROMPTU!!
And flight of the bumblebee
We do not speak of that
eventually these will get so good that they won;'t be limited by physical structure of biological arm and therefore be able to play faster.
@@yogurtsplace I can imagine
Arminger is a great name for someone who designs arms
better than Disarm
Arminger armstrong
(actually spelled "Armiger" without the 'n')
Dean Lawrence right?? Lol
That's a Kojima name right there
There is seriously no other person for a better project to start off with this good man.
I couldn't agree more, he's the best.
Agreed. If it was given to a child, they wouldn't be able to live without it after they get used to it.
Indeed he's the man for the job for sure
i need profile picture sauce
I love how he's wearing his wedding ring on it too.
Shows some serious commitment :D
Gobo Kinje wow I did not notice that?! That’s crazy (:
As a pianist i would literally kill myself having to deal without an arm.
As a pianist i would probably be very discouraged with an arm like that.
There is a huge gap there, thank god for technology and these amazing people for their mind boggling work.
Penist**
Yea exactly... I wouldn't probably kill myself but Jesus Christ
Dandelg - I've contemplated doing the same if i ever lost an arm or even a finger
Michael Mora nice
Dandelg I doubt that
Say my name.
"Heisenborg."
You're goddamn right.
You and me, if hell exists, we're both screwed.
Underrated comment lol
2019: robot arm can almost play amazing grace
2022: robot arm plays flight of the bumblebee at 2x speed
PianoTutorials333 he learns how to play fotb at 15 notes a second
Now that is sacrilegious
inzane123123 aaaaah yes!! Twoset fans here!!
PianoTutorials333 in the year 2025 it auto swipes at a wasp sending a whole nest of them after the wearer the robotic rebellion has begun.
Really happy to see history being made.
I WANNA SEE A PERFECT BIONIC ARM SO HARD
@@alamdaali8776 Me too but it won't be perfect yet, I think..
Given how fast we are advancing, as a species, we should see near-perfect replacement limbs before the end of 2050. New breakthroughs will happen exponentially, making the future a paradise, albeit an imperfect one.
420 likes nice
Johny you're making us proud
You're patient, hardworking, and really want it to work.
You're no labrat, you're a part of the team.
In the Future He can Play black midis that are "impossible"
Still has 5 fingers tho
@@diddy_dante Doesn't mean he can't add more.
@@CrapZackGames well a mind can't control more than 5 fingers (If you're not born with it), so not sure man
@@tomasjosefpiano8902 I was thinking that too. Brain mod surgery?
@@CrapZackGames Yeah, perhaps. I kinda feel like we're getting too deep into this xD. Let science surprise us!
I'm really glad you did a follow up video for this!
MrSeals1000 same here I really wanted to see if you learned to play the piano Go Johnny Go🍻
We will continue to follow Johnny throughout his journey so there will be at least 1 more update this year.
moral lesson: next time dont use human transmutation
Is this FMA refrence?
Screams in Nina and Alexander
Nina and alexander:
4:32
Extra credit: Watch where your limbsies are before you hit the "on" button.
YOU BASTARD ;C
0:46 sneaky lil boi got me
Lmao
Human hand movement can be very precise. It'll take decades until bionics will be able to fully replace its functions.
I've been waiting for an update on this dude.
It will take many years, probably decades till we can come up with a truly life-like arm in terms of speed and functionality, but someone has to do all the pioneering and research. This project is so interesting.
2019: Playing piano with a mind-controlled robotic arm
2021: Playing Video Games with a mind-controlled robotic arm
honestly it sounds cool
2022: SAO
TheNameless Channel actually its 2018
2022: People will start complaining this is a form of cheating lol
2040: Having sex with a mind-controlled robotic penis
This video shows to me how important programming is a skill & tool. Like as important as a wrench or spanner.
Almost all things nowadays are programmed.
i would like to have the skill of programming but its simply too boring for me. i cannot stand the boredom of it.
You go dude, I'm so happy he's actually doing it!
0:44 play close attention to the robot fingers
It did it!
It pulled a fast one lol
I hope for a day real soon where a prosthetic arm has just as much flexibility and "respond time" per say as an original arm. God bless this man, and the technology he's helping create :)
In the future it will be smoother than now for sure
Aww, seeing this nice man slowly trying to play the piano with the arm is kinda sweet c;
Full metal alchemist.
ASIAN GUY 🍻
KENNETH I actually thought about that too...
𝓕𝓾𝓵𝓵𝓶𝓮𝓽𝓪𝓵 𝓐𝓵𝓬𝓱𝓮𝓶𝓲𝓼𝓽
@@coffeeris how'd you do thaaat °,°
Juuzuo Suzuya fontgenerator
I think this was only recommended to people who's been looking at piano tutorials or videos a lot xd
nope
nope
That’s a negative
Yep
Yeah
This is amazing, the history books better not forget this guy.
Johnny Matheny.
It warmed my heart when I realized he was playing Amazing Grace on the piano!!
Me when i sees title: *Hmmm, Liszt transcendental etudes here i come!
Reality: 0:01
Give it a few years
Nah the Paganini caprices on violin
Kaya Beautymantra harder*
@Kaya Beautymantra Not really. You have a much wider palette so to speak on a piano, even if you factor in that the violin is continuously tuned and not chromatic.
Tim Stockelberg lmao
Keep up the incredible work, Johnny! Watching this process is remarkable and inspiring, you are a pioneer for our species. Thank you John's Hopkins research for creating such an amazing feat of technology! Together, you all represent a brighter, better future for humanity.
This is called good investment
Keep up the good work, Johnny. Your new arm is gonna change the lives of a lot of people like it did for yours in the future.
Johnny’s commitment, astounding. So much respect for him.
Just watched the first video not long ago, then this one came out, wow
Incredible
Though visually, some 3d printed attachments could fill the spaces between his flesh and the arm, basically a bicep shaped plastic
Pretty awesome technology of the future! I use an arm powered prosthetic since birth and I'm doing well playing the drums and piano as a
career, but when his mind controlled hand gets perfected that's going to be the best! Thanks for sharing, Johnny!
Thank you so much Johnny, because of willingness to participate in this study all amputees one day might be able to use this technology. Thanks Sir👏🏾👏🏾
What a time to be an engineer ❤
This is so cool ... It gives ppl the chance to feel human and valued again in the ways they were missing 🙏
10 years later this will be available for everyone
i love this new update for Deus Ex Mankind Divided
David Vonderhaar
Keep working on BO4.
Hearing this man speak of patience... someone needs to marry this man.
Jared Murphy, dude he’s wearing a wedding ring...
@@loafingloaf8633 I appreciate what you are saying, but people who lose their spouse can keep wearing a ring. It's a small house, based on the video, and the home, he seems to be living alone. But I could be wrong.
I can't wait to see how this prosthetic's design gets optimized over the years for him and new people!
This is honestly one of biggest dreams for the future. If people need and amputation doctors won’t just have to leave them without a limb but can give them something like this. I hope someday this will become widely available, and more advanced.
We need this for every amputee out there please. Amazing. Time by time he will be able to control his new arm better n better
It’s incredible how far technology has come we are getting close to having bionic arms that are better than our natural human arms
I wouldn't say we are close to that, but we are definetely on our way there
You know this bionic arm is not even on the same level to be compared with your real arm right? Just you know this bionic arm is more like a controller they jam a rod into your arm in which there are buttons/sensor from inside the arm situated near your muscles so when you press the sensor part that is inside your arm the bionic arm receives x command. It is a controller convenient if you do not have fingers to press them but your arm is on another level in everything it does do not sell it cheap.
I thought it was a science fiction short film when i clicked on it
@@xxx10353 This lessens it a bit too much. It isn't just a bunch of random movements of the arm's muscles that then triggers the machine to move. What they are doing with the input is actually amazing because they're trying to go back to the same nerves we normally use when moving our fingers/hand/wrist so that when Johnny decides to move (what once were) HIS fingers the robotic ones respond instead. So advancing this technology will give us arms that actually FEEL like part of us, he's not pressing buttons, he's moving his fingers in the natural way and the machine is interpreting that very roughly but it's just the beginning. Incredible. Remember that the human body is not (easily) scalable or upgradable, machines and computers are, so this has much more potential than a regular biological arm and it WILL surpass the latter in 20 years or so.
Jonny and his arm are both amazing . Hopefully one day I can help the team that's working on it to make Jonny the world's best cyborg
it's incredible what humans are capable of already.
Nobody:
Lady that got you with ok gesture with mind-controlled robotic arm: 0:45
This is fascinating ! I would be glad to see his progress on piano !
This is fantastic. So happy for you Sir.
The wedding ring on the finger is so poetic and beautiful to see while playing piano
What makes the difference between thinking about moving the hand, and actually trying? Actually i wonder this about my own body parts.
Tesla Death Ray thanks, now i cannot SLEEP anymore
I guess its the same thing, you have to think about writing a comment before actually writing one, so I guess the only difference is that you feel, but this man doesn't. Or does he?
Shit, I can't stop thinking about this. When you feel it's all in the mind. Your brain tells you what this feels like so I have no fucking idea.
He does feel, the nerves recive signals from the hands sensors
I still wonder about flesh and bone. I can think and tell my hand to lift, and it won't but will if i actually try. So what is the difference in the brain? Why aren't we all paralyzed?
0:45 AAARGH SHE GOT ME
He should record one of his practicing sessions with the hand, I'd watch it for hours.
It looked like K2SO was playing the piano in the thumbnail.
It’s like his arm has a mind of its own!
Imagine if you had arms with minds of their own....
It will be cool...
Until you found out that one of your arms was an asshole.
You’d be playing a never ending game of “Why ya hittin yourself?”
0:45 SIKE!
This is the full metal alchemist
“You have a metal arm? That is awesome dude!”
At school
Student: Teacher can I charge my arm?
Teacher: wait what...
2:19 Robert Armiger lmfao
I can barely play piano with two hands and this guys with a mind controlled mechanical arm can
this reminds me of the scene from a not so good movie robocop (2014) where the guy tries to play the guitar and slowly gets the hang of it
i cant express enough how cool this is holy heck
Ikr. Think about how complex the arm is. Just move your fingers and think about how amazingly complex that is. We as a species managed to recreate that with freaking metal. Literally. We made a working body part from rocks! Think about how this will improve in the upcoming years.
AT 4:32 YOU CAN SEE A RING ON HIS ARM THIS MAN
I’m dreaming of the day where robotic limbs become advanced enough to play rush E
Amazing Grace is a fitting song
Imagine if they advanced it so much it could be programmed to play unplayable piano music
0:44 Y E E T
I can imagine pianist playing a 4 hand duet by themselves
1.The future would be filled with new musicians who think extremely outside the box
but
2. Ten handed gun men with military training
3. Six handed mother/father cleaning and taking care of the kid at the same time
4.a triple necked guitar with six handed guitarist
5. Person with 8 arms that trys to take over world seams he has the name of Octavious
This has potential for good and evil
Interesting to see the MYO is finally being used for something
I like that the guy that works on the software has the last name ARMiger
As a guitarist I'm always super paranoid about my hands because if something happens to them my entire career will fall to shambles. Hopefully if anything ever does happen to my hands technology will be good enough to fix/replace them or even make it better than before
God bless you for bringing hope to Johnny. Johnny dont give up you will play amazing grace. God bless you for not giving up. Our heavenly father wont let you give up. Johnny I'm praying for your success
Kis desh me he he or ye vale hath kanha se milenge bato brother
I hope this technology gets better my I want my sister to have one
I freakin love this guy
Once this becomes fully finished and world wide avaliable, i hope they make like an apple watch, but with your palm.
He did it!
can't wait to become a scientist for robotic prosthesis too, someday.
At a concert
Hears someone playing piano but also a louder robotic hand
Hell yeah! This is awesome!
Once they fix all the glitches and get these things fully operational a ton of people with missing limbs will be able to love normal lives again and instead of people asking how they lost their arm or leg they’ll ask if they could take a picture with them cause the cybernetics look so cool...
But can it play Fantaisie Impromptu Op.66 by Chopin?
Walt, I don't know man. Been sus lately. Looks like we have an imposter among us
this is awesome!
him playing the piano is literally the scene from the RoboCop movie
How does this not have like a zillion views wtf
The real question is can they make a hand with receptors so he can have some feel of touch.
They could probably, but they”ll probably have to make technology that can detect feel and replicate it once they connect the prosthetic to the nerves.
It has a field of touch 😀
@@zyxeldominus7527 They already have haptic feedback gloves for VR that simulate touch and feel. I'm sure they could find a way to transfer that knowledge to this!
Maybe in fifteen years when I'm a grown man these arms will be just like human arms and maybe even better.
Imagine he starts going gamer on us and plays Library Piano from Luigi's Mansion 2
He even wears Ring on this hand how sweet!
Adjustibility depends upon personal preference and instincts. It may varies from person to person.
I bet he feels like a jedi
Needs to upgrade the operating system?
I remember when he said he wanted to learn the piano in another video a few years ago
actually this is not mind controlled directly this is an extension of each nerve which obviously runs from the brain down to to each part of a limb so whether it catches the signal up in your head or down your arm, the robotic arm will follow the signal, kind of like what motion capture does, now the real question is if we are able to catch that signal can we have any sort of influence on it again mecanically that might help with brain diseases....
here we are in the future.
Couldn't they put small sensors in the finger tips so if he needs a pinching motion, a finger can try to make both sensors meet?
The only concern i have is if you fell and were to catch your fall with your hands. Would that extention that comes out of your arm hurt you or is it braced pretty well?