Live-caption glasses let deaf people read conversations using augmented reality
ฝัง
- เผยแพร่เมื่อ 2 ต.ค. 2024
- Subscribe to our TH-cam channel for free here:
sc.mp/subscrib...
These smart glasses show real-time subtitles of conversations, which could be useful to deaf people. The XRAI Glass software turns speech into text, which is then displayed on the inside of the lenses.
Support us:
subscribe.scmp...
Follow us on:
Website: www.scmp.com
Facebook: / scmp
Twitter: / scmpnews
Instagram: / scmpnews
Linkedin: / south-china-morning-post
#scmp #Technology #Virtualrealityandaugmentedreality(VRandAR)
Imagine having this to help communicate with ppl across different languages. Really support the project
Well it's very hard to translate speech in real time to another language because words and sentences are structured differently in different languages so it would have to listen to the whole sentence or multiple sentences before it could actually accurately translate it, and there could still easily be akward mistakes. It could work somewhat on languages that are related to each other
Their accent is rly...
I don't really see the need for paying $400 for this glasses. Guys, our phones can already do that. just open the translator app and choose conversation. and it will subtitle all the conversation automatically. I do not see any need for these glasses...
@@n1ppe true - plus, there's all these little intricacies to languages, like metaphors and idioms, which would be quite difficult to translate
@@Drop_The_Mic $400 is very inexpensive for these glasses. Deaf people already use phones to communicate with people, and it's very cumbersome and inefficient. Plus, you always need to have your head in your phone, which isn't so favorable.
I'm deaf and have thought this up years ago. I'm impressed that it did happen. I bet it uses auto-caption so it won't be 100% effective, maybe 80%?
glad to hear that. oh wait... shouldn't have said that
On the go Speech to text is really hard, and its something only Google has managed to do effectively, even then it lags behind sometimes.
i'm skeptical of this product
@@L4zyasz 💀
@@durururururururu true. It especially made me consider being in loud or crowded environments too
more like thirty percent.
Science and technology never ceases to amaze me. The joy and happiness it can bring to people is just priceless.
But all this project need fossil oil, and many activities are protesting to get rid of it.
Yes but it could be dangerous relying on private companies on this. If they lose the budget to maintain them, they could get abandoned and break down. 400usd is really cheap.
We did it boys. Now we can finally have subtitles irl
go to Japan with eng sub💀
Otaku detected.
Yes!!!
@@Renosen 🤣🤣🤣🤣🤣
this tech is really a blessing to the world
This is one of the coolest pieces of technology I've seen in a while.
It's like having captions in real life
Bro u are everywhere
fr
Finally subtitles invented in real life
Or even a dialog in real life
Love how technology is embracing everyone with varying abilities.
Old technology.
@@supremegreaser2399 put to a new use 🙂
It’s usually preferable to say “disabled people” or “people with disabilities” 🙌💯✨
more than anything, this is really just a groundbreaking moment for the deaf and hard of hearing community. it’s still at its starting point, of course, but as research on the subject becomes more intensive and technology continues to evolve, so will the efficacy and accessibility of these glasses. i’m so happy in behalf of inclusivity for all!
does it matter how clearly the person speaks for the subtitles to be correct? i’ve had issues with some speech to text apps because of some health related speech issues.
edit: 0:15 her speech is pretty clear and easy to understand. i’m talking about speech that is not as clear, slurred to varying degrees, etc.
Some software's actually learn your speech habits over time and adjusts to them accordingly. I've learned over the years that speech to text softwares aren't all created equal. Since this device's entire existence and credibility is banking solely on that one feature then I would hope that it would be among the best there is.
@@someblaqguy but your speech doesn't matter, it's other people's
@@justinpark2946 point of bringing that up is that it can possibly identify others and create a voice profile for frequent speakers.
The clearer you speak, the better the transcription naturally, but it's designed to work with normal, not perfect, speaking.
Did you not see the Co-founder (who is deaf) talking to the other deaf woman? You can tell she lost her hearing later in life thats why her 'accent' has changed, and the software seemed to pick it up with ease.
It’s like having video game subtitles in your very own life’s story!
You are a really cultured cinema aficionado I see.
Lovely. This is what we should be using our human intelligence for.
This could also be useful for non-deaf people if translation becomes more effective in the future.
The joy and happiness I felt with this invention..even though I don't personally know anyone who is hearing impaired, is tremendous. Donno why. I guess with everything going on in this world now a days , bad news one after the other... This video brought a feeling that I almost haven't had in a long time.
i feel like this technology could have been released years ago. we've had speech to text technology for over a decade now and the google glass was made in 2013.
uP
Maybe copyrights patent prevent it to be release to the public. Remember when Microsoft was first invented the window system, no can replicate because they have hold 20 years of copyrights legal. After that over, Apple can come up with their own OS.
We needed the right glasses. Google glass the original was ahead of its time!
Hi, I’m Mitchell one of the founders of XRAI Glass 😎. Thank you for liking our video 🙏 This is the most profound and rewarding initiative I’ve ever been involved with. There is nothing better than empowering people to enjoy a richer and more inclusive life.
Myself and all the XRAI team are extremely humbled and proud. 😍
That’s amazing
Thank you and bless you for bringing these to all that need them. I cannot express how much these would help me. When do you anticipate them being available in the US?
Also, are they designed to be worn over regular glasses?
Where can I follow you to know when they're available?
This glasses feels Like a surreal moment I literally had goosebumps 😍
I think this kind of glasses can also be used to translate languages so two different persons with two different native languages can communicate and understand each other. What do you guys think?
I think watch this space 😉
Imagine being alone at night and your glasses say "twin girls laughing menacingly"
Oh noo not the Netflix captions 😭
Now create another version of this but for translating conversations in real-time. Sort of like subtitles for videos, except real-time subtitles.
Google Glass did this a decade ago.
Alphabet released a new version of translation lenses back in May.
If funded enough, it’ll be wireless and be able to translate multiple languages
We need better batteries first! Qualcomm are working on wireless glasses though. Hopefully we should have some in the coming year or so.
This is going to make life so much easier for alot of people.
Imagine someone who doesn’t speaks perfect/fluent ” English “ wrong subtitle, it might cause emotional damage. Lol 😂
Did you watch the full video?
@@jellonbillona1548 seems he is not
This is a great invention, I hope their able to polish the speech so it can be subtitle more accurately.
This will also means another efficient way to communicate and overcome that language barrier. New & improved translator incomin soon.
Technology is just amazing! Super happy for those who can use these glasses.
Hopefully there will be a day where I can finally understand japanese with english subtitles
This can also be used for live translation when abroad
Exactly! We are excited to take these traveling as we add more languages! 🌍
It'll be harder for the app to work in noisy crowded areas. Also, speech to text isn't perfect, & the app relies on your phone's mic quality. Not to mention, the glasses don't exactly display conversations in real time. You still gotta wait for the app to process all the words & then display them. That's not to say this product is useless; it's still responsive enough to be quite helpful, but it's certainly not foolproof. Still, this is a nice step toward a better future.
Thank you for sharing and absolutely! We've been working hard to make this platform usable in various situations as we enhance our features. It uses a technology called Beam Forming, which effectively places a wall around you and the speaker so as to not pick up the conversation around you especially when our built in noise cancellation is enabled. However, we recommend using audio mic options dependent on your environment e.g. in a boardroom, or in a noisy bar.
Cant wait until more features are added in. Sounds promising to me as someone born with Auditory Processing Disorder
I have APD too, but I'm also deaf (go figure). I need this like... yesterday, kinda thing. It would seriously help people like us, definitely. Will have to look into this.
Thanks for the people who developed this amazing tech !
I said deaf parents sign language family I don't know voices to speak Turkish subtitles 😔🇹🇷
Finally, I can now go to Japan with subtitles on!
That's gonna massive help with meetings I had involved with struggle to turn head to see who speak. I hate meetings with big groups but see this new subtitles glasses just what I need and not turn head too much. Excellent!!
This is a breakthrough
Her: My eyes are up here
Me: Sorry I'm reading your subtitles
This guy is gonna be rich, imagine the broader use of translating one language into another
I want it.. It would change my life.
This is great because it can also help deaf people learn/train how to talk, apart of giving them “hearing” capabilities
It's a scenario we hadn't thought of but works perfectly!
How? 🤔
Simple but excellent invention!
This is just a start for endless possibilities in the future
When you realise you can have subtitles when you go to Japan
Now I can finally go to Japan and turn on subtitles!
Now not to worry go to Japan with this subtitles glasses 👍
This could be weeb finest dream. Now they can watch subtitle while being in Japan.
finally someone made irl subtitles. japan here i come!
Next step, universal translator all across the world
Now we just need to perfect automatic tranlations and were golden
ANIME IN REAL LIFE is becoming REALITY
We can now see subtitles when we fly to Japan !!!!
I like it when we human invent something that helps other people. This made my day.
this is really helpful for also borndeaf people, they can practice alone on how they speak WOW! grats technology, u did it again!
" why can't we subtitle the world?" 💕
Next step: Automatically extract information from speech, simple fact check, give examples of autoreplies, keep keywords in visual field..
Hold on a Second...
Why dont We Subtitles The World ?
Amazing Quotes 👏🏻👏🏻👏🏻👏🏻
Now this is a Smart invention that we need somerhibg that ACTUALLY benefits mankind..not the ROBOTS.. !
Invest more in such inventions plz billionaires!!
I want a pair for the languages! This would help so much at work!
I've always imagined this there's some tech in some form out there that can literally translate languages at a moments notice also when you speak it translates English or your language into the native tongue
this is a beautiful invention
This will be really helpful today and next generation. Great job
Oh my.. I just misunderstood deaf as blind.. And was very much confused how subtitles help blind people
My mother in law can read lips like a pro. And from far distances too. I don't think she would like this, she's proud of who she is. But I would love to surprise her with this.
She's definitely ex-spy
So basically now we have Subtitles in real life huh? Nice & Wholesome.. 🙃 Still waiting a Camera-like Technology but for Smell (Smells Recorder Devices) tho...
We had to order a pair like this for one of our workers. Insurance won't cover it. but the quality-of-life improvement will be well worth it.
Finally. I can see the subtitles when I go to Japan.
Can we just talk about using this in cinema?!
The glasses write sounds for the hearing impaired, they translate, I want Turkish subtitles, take, no give😔🙏
The glass is called Nreal Air and selling in Japan and UK right now.
Hopefully it can be sold in more countries.
Yeah it needs to come to the USA especially. The USA has a very large deaf community because of the lack of government funding for hearing technologies especially cochlear implants. But all countries should have this technology offered.
@@greego5952 i think some develop companies should pay attention on this , it is big market and government may give some allowances on this
This was always my passionate idea of graduation project but I couldn’t have enough support to do it
The genius contributes to mankind
so finally we can have subtitles in real life
Not too late for the smart glasses to pick up as a trend. Every technology is already present.
Finally now i can go to japan and experience real life anime
I want Turkish subtitles for hearing impaired to get😔
Urdu translate left the chat. Arabic Farsi Pashto join the chat
Anime people going to Japan like "Finally, subtitles!"
I have a deaf roommate and he can't read lips very well. I think this could help with a lot of the violence he gets in the streets with hearing people.
Overall I still think of the many deaf people who are discriminated with work finding it impossible to buy one.
Ngl though, lip reading is probably a very useful skill
well optimised for an invention, but i still think learning to lip read is important
Amazing technology!
Isn't Google making the same product?
I don't know, but I think this is kind of annoying when you use it on the crowds, great concept btw this could go far.
I HAVE TO SENT THIS TO A BIG COMPANY ISH NE LUCK
Technology constantly shaping the way we live
This is so amazing, this is kind of technology that the world needs.
This is the best glasses coming out of tech yet
Me and the boys going to japan using those glasses *
First step to a pair of Tony Stark glasses.
This is so cool, such a simple idea that can change so many peoples lives 😎
I don't really see the need for paying $400 for this glasses. Guys, our phones can already do that. just open the translator app and choose conversation. and it will subtitle all the conversation automatically. I do not see any need for these glasses...
Because it's easier to read when it's there right in front of you without having to keep looking at your phone. You're absolutely right though, the same could be achieved using your phone
Japan tourism after the glasses 📈📈📈
I can finally go to japan and read subtitles
Google meet has auto generated subtitles but i am guessing this is better.
Same concept, in AR, with speaker identification
$400??? That is an amazing price !!
I can go to japan now i only needed subtitles
This is insanely cool!!!
Finally, we have subtitles in real life like animes.
i hope this is better than *youtube auto caption*
Weebs be like : finnaly i can go to japan
Finally, I can be a real life anime character!
Is the company public? Can I invest in this?
Not yet 🙂