Say hello to GPT-4o, our new flagship model which can reason across audio, vision, and text in real time. Learn more here: www.openai.com/index/hello-gp...
The whole translation and interpretation industry is sweating right now, and has been for a long time. The only thing stopping them getting wiped out is that you cannot hold AI accountable.
@@ldkevin2 I strongly doubt automatic fabrication and advanced fertilizers will come from a chatbot. It's good technology, but not an industrial revolution.
@@Kaienhere Not quite to the same capability. I've used Google translate in clinic and every now and then I have to hit the microphone button to keep the conversation going. It's not efficient at all when I'm looking at their eyes with the slit lamp and then I have to move all the equipment to go tap the microphone button. Also, if you say the wrong words or want to change what you said, you have to wait for it to finish speaking. And on top of that, it's really not that great of a translator. This is way better and I'm relieved I can finally freaking communicate with the patients.
There are two types of people: 1) people who see AI and say "Wow, what an amazing tech, I'm so lucky to be alive now!" 2) people who see AI and say "Wow, this is very scary, AI will doom us all!"
@@pisky5067 unfortunately they are both right. Do utopian view would be that AI and automation can take over dangerous, boring or repetitive tasks and basically start doing the work that is necessary for survival for us, us freeing up humans for better pursuits, such as creating and personal connection and the sorts of things that technology won’t ever be able to do. Unfortunately, that would require some sort of universal basic income possibly funded through taxes on automation or something of that sort, and that won’t happen until things are dire. We have structured society in such a way that we are woefully unprepared for such a massive shift.
I love how people make fun of awkward tech bros, while they use all the technology made by tech bros. Tell me Mr. social butterfly, how would you interact with a person who spoke a different language than you. Does your super awesome social skills allow you to overcome language barriers?
Yes, finally! This is actually something useful. Thank you. I saw a demo from Google doing live translations years ago, but I have no idea what happened to it. Also, we need to translate text and audio files as well so that anybody could access any knowledge they want regardless of language barriers.
As a native Spanish speaker I can tell you that chatgpt4 speaks more clearly and smoothly in English than in Spanish, and at types speaks with a Spanish accent from Spain and at times speaks with a latin American Spanish accent. Sounds a little bit robotic still, but it's an amazing tools though
As Interovert, I can imagine myself have more confidence to learn a new language in a more convenient and responsive way, can't wait, it looks so good. 🔥
@@mohammadiaa Thankfully, I don't have to resort to artificially inflating my own comments or posts. My contributions can stand on their own merits without needing to give myself an insincere thumbs up or upvote. Self-promotion of that kind comes across as insecure and desperate for validation. I'd rather let the quality of my words and ideas speak for themselves and be judged authentically by others. A little self-confidence goes a long way - no need to pat yourself on the back artificially.
You don't learn a second language to necessary be a translator, you want to talk face to face to other people not by using a phone, and u also want to engage with them, so no, it's worth it learning a second language.
No because google translate has already been able to do this exact thing for years now, no matter which language you talk in, it will instantly read it out loud in the other. It even shows the translation on the screen as you talk. It also responds at the same speed. It’s going to be more accurate since it’s programmed to be a translator and this is not.
Definitely, the way it speaks Spanish is much less natural and fluid. Also, the guy is clearly speaking Spanish from Spain, but ChatGPT is translating with a pretty strong Mexican accent.
I love how you were struggling to rotate the camera the whole time 😂 It was kind of weird that the table was detected as a stylish person with a leather jacket.
Very useful for traveling to countries you don't know the language, but I think real time translators and interpreters are still needed because conversations depends a lot of the context, and sometimes you don't need to translate literally all the information to the other person to understand the message. Anyway, nice tool
Hi OpenAI, first off, thank you. Thank you for continuously providing not only Opened Sourced ChatGPT for more technically inclined individuals to continue in the research and development and enabling such an upgraded GPT-4o for users to fully grasp AI’s rapid expansion and evolution in the industry. With that said, thanks again for the extended free prompts for testing such features. As mentioned within a WIRED article recently published, “Just know that you’re rate-limited to fewer prompts per hour than paid users, so be thoughtful about the questions you pose to the chatbot or you’ll quickly burn through your allotment of prompts.” Kudos. I can’t wait to be able to pick and choose between consented personality voices of individuals partnering with OpenAI for a more personalized “voice” of preference when interacting with GPT and enabling its latests search and translation features.
This is amazing, but only if there isn't any background noise. Great for one on one meetings in a quiet room, but this will not work well outside of that.
Thank you for the video. I am currently living in Osaka, Japan and I am very interested in Instant Translation with AI models. However, what I understand by "Instant Translation" is not: "I say a sentence - The model translates it after a few seconds and I can hear it - I say another sentence - The model translates it after a few seconds and I can hear it..." What I understand by Instant Translation is: "You are talking in Japanese and, while you are talking in Japanese (with a delay of a few senconds), I listen your speech in Spanish. No matter how long it is the speech. May be the Japanese speech is 10 minutes long and I can begin to listen to it after 5 seconds in Spanish and will end 5 seconds after finishing in Japanese". Basically it is like having a interpreteur by your side who doesn't have to wait until the end of the speech to begin translating. That way, the conversation gets more fluid. I know this is not an easy task, as there are SOV and SVO languages. However, I think that Seamless m4t model is able to take this into account aswell. Do you think is it possible to implement such a thing with this model?
damn thats pretty impressive/cool no ones gonna have to learn a language lol! that being said the spanish one does sound slightly robotic compared to the english one
The rippling in the water, would seem to indicate that a feeding frenzy of some sort is underway and things might start to get, what was that heathen's 'theory' called again. I remember the theory was eponymously titled. Ahhhh, now I get it. "It" being exactly just what, I'm not so sure about."
Uh to get the right amount of intonation in Spanish is real crazy / people talk about job lost - but imaging having an universal translator at all times
Soon they will have translation automatic where you can talk to someone on the phone and it will instantly translate to you and vice versa. We'll have the real-life Star Trek voice interpreter. In fact, it's already here.
I'd be curious to see how well this works as a private language teacher. I could see myself use this for hours trying to learn and practice a language. My worry is it not pronouncing words correctly or it not being able to switch between english and another language mid sentence
There are still plenty of words and sayings that don't have direct translations. I wonder how this would handle those situations. Also, what if someone is speaking sarcastically? Will it convey that to the other person?
It can summarize what they're saying, it doesn't have to directly translate it, it depends on the context. Just pretend you're talking to a human in regard to it's ability to understand sarcasm.
I tried this with the current voice model and it forgets to translate after a short time and starts responding directly to what is being said. Has anyone else experienced this? I'm wondering if it will work better with the new voice mode. The demos always show only very short conversations.
Hi, very interesting but which app I can use to achieve what you showed in this video. I've downloaded official ChatGPT app but not able to succeed to what you did in this video
![โจทย์โหดเหมือนโกรธเป็ดถีบ [อะไรอยู่บนหัวกูวะ ... EP.4]](http://i.ytimg.com/vi/Dqlb7EZ9PGk/mqdefault.jpg)
How many startups were just bankrupted?
Startups? My man the entire economy is going down(well way up actually, but people will lose jobs in the interim period).
Several 😆
Answer: yes
The whole translation and interpretation industry is sweating right now, and has been for a long time. The only thing stopping them getting wiped out is that you cannot hold AI accountable.
The reminding call center husk just evaporated
You guys are changing the path of humanity in real time 😅
Exactly!
4th industrial revolution baby!
I don't know Rick, that voice in Spanish sounds really bad
😅😅😅😅😅🗿🗿🗿🗿🗿🗿💀💀💀💀💀
@@ldkevin2 I strongly doubt automatic fabrication and advanced fertilizers will come from a chatbot. It's good technology, but not an industrial revolution.
It's over for google translator
And translators as well
If your live translation fits within the daily limit of allotted tokens
Google iz a shiiit in translation
I'm not sure about it because you can do the exact same thing in Google translator already, no AI involved. The voices here are better though
@@Kaienhere Not quite to the same capability. I've used Google translate in clinic and every now and then I have to hit the microphone button to keep the conversation going. It's not efficient at all when I'm looking at their eyes with the slit lamp and then I have to move all the equipment to go tap the microphone button. Also, if you say the wrong words or want to change what you said, you have to wait for it to finish speaking. And on top of that, it's really not that great of a translator. This is way better and I'm relieved I can finally freaking communicate with the patients.
No wonder Apple closed the deal with OpenAI yesterday. Sam must’ve showed them a demo and Apple new they couldn’t compete lmao
what deal? can you give a link?
@@klirmio21 Siri will be ChatGPT in the future.
Ong 😆 WWDC about to 🔥
@@hayden3865 Not surprised, it's basically the perfect use for this. It's what Apple envisioned but could never make
@@djbombba That deal wont effect this years WWDC. Probably next year at the earliest.
Wow! What a great time to be alive! This will be useful on my travels.
There are two types of people:
1) people who see AI and say "Wow, what an amazing tech, I'm so lucky to be alive now!"
2) people who see AI and say "Wow, this is very scary, AI will doom us all!"
@@pisky5067none are wrong hahaha
@@reachthezora1912 Haha this!!
Perfect for communicating with my future wife in Kazakhstan who speaks zero English, and me zero Kazakhstani
@@pisky5067 unfortunately they are both right. Do utopian view would be that AI and automation can take over dangerous, boring or repetitive tasks and basically start doing the work that is necessary for survival for us, us freeing up humans for better pursuits, such as creating and personal connection and the sorts of things that technology won’t ever be able to do. Unfortunately, that would require some sort of universal basic income possibly funded through taxes on automation or something of that sort, and that won’t happen until things are dire. We have structured society in such a way that we are woefully unprepared for such a massive shift.
OpenAI shocked the world today - great product release!
You copy and pasted this on every single video, purely for likes. Do you even mean it? 💀
@@Cainny I hate it when people do that. But.. they did indeed shock the world. again.
I was not mentally prepared for this.
For what?
It's OK, you're only human. Lol! Humans, lol
I wasn’t either
this may seem like a really uncomfortable interaction for normal humans, but this is an accurate depiction of tech bros interacting.
Talking through a device is the only way to get them to converse 💀
I love how people make fun of awkward tech bros, while they use all the technology made by tech bros. Tell me Mr. social butterfly, how would you interact with a person who spoke a different language than you. Does your super awesome social skills allow you to overcome language barriers?
@@generichuman_ relax there, knight in shining armor. It’s a joke. I’m in software and even we joke about our introversion all the time.
@@generichuman_ ask chatgpt to explain the joke cuz u clearly don't get it
@@generichuman_ you learn the language and you can freely speaking to each other.
Yes, finally! This is actually something useful. Thank you.
I saw a demo from Google doing live translations years ago, but I have no idea what happened to it.
Also, we need to translate text and audio files as well so that anybody could access any knowledge they want regardless of language barriers.
Vastly better than anything I've seen.
As a native Spanish speaker I can tell you that chatgpt4 speaks more clearly and smoothly in English than in Spanish, and at types speaks with a Spanish accent from Spain and at times speaks with a latin American Spanish accent. Sounds a little bit robotic still, but it's an amazing tools though
yea I've noticed how it switches accents at random.. doesn't happen with all non english languages though, just some
Lets gooo OpenAi!
As Interovert, I can imagine myself have more confidence to learn a new language in a more convenient and responsive way, can't wait, it looks so good. 🔥
more covfefe
Focus on English for now.
@@mohammadiaa Thankfully, I don't have to resort to artificially inflating my own comments or posts. My contributions can stand on their own merits without needing to give myself an insincere thumbs up or upvote. Self-promotion of that kind comes across as insecure and desperate for validation. I'd rather let the quality of my words and ideas speak for themselves and be judged authentically by others. A little self-confidence goes a long way - no need to pat yourself on the back artificially.
@@mohammadiaa 2 minute reply with 1 like, yeah, of course.
Angry@@terrafray
So you're telling me my 10 years of painfully learning a second language have amounted to a hill of beans?
You don't learn a second language to necessary be a translator, you want to talk face to face to other people not by using a phone, and u also want to engage with them, so no, it's worth it learning a second language.
Or as ChatGPT-4o would say, “Una colina de frijoles” 🫘
Consider you have gpt model of that second language implanted into your brain
If there’s no data or battery.
No because google translate has already been able to do this exact thing for years now, no matter which language you talk in, it will instantly read it out loud in the other. It even shows the translation on the screen as you talk. It also responds at the same speed. It’s going to be more accurate since it’s programmed to be a translator and this is not.
Hi Openai, remember me...we used to be friends.
New num, who dis
UFC Post Fight interviews going to go A LOT FASTER 😂
Ahah I was thinking the same thing. 😂
lol 😂
How come english voice sounds so natural and spanish so crazy ridiculous 😂
Definitely some improvement still needed there
It’s designed to speak all languages with a slight American accent.
It sounds like a Spanish lisp so definitely Spanish from Spain but also kind of American.
Definitely, the way it speaks Spanish is much less natural and fluid. Also, the guy is clearly speaking Spanish from Spain, but ChatGPT is translating with a pretty strong Mexican accent.
This will definitely be useful, while lost in a different country and needing directions
Let's Gooo OpenAI 🚀🚀
Вот это действительно полезно...👍👍👍
So excited!
Need that OpenAI coffee mug in my life
So Morpheus here again 🎉🎉🎉
balls
I love how you were struggling to rotate the camera the whole time 😂
It was kind of weird that the table was detected as a stylish person with a leather jacket.
What camera?
This is great. Upgrading now.
this is beyond amazing, it's almost unbelievable that AI is progressing this quickly
This is amazing. If this Feature is someday available offline its gonna be crazy.
Nothing works offline sorry 2024 this is to big
Now that’s the beginning of a new era.
Amazing!
ChatGPT can understand all known different varieties of Spanish without having to indicate it as you would in Google Translate.
Incredible
Damn, the future is here.
Hopefully we get an anger translator like Luther... would come in handy.
insane
Awesome, I just used it with a plumber at my home to translate between Finnish and English. Thank you so much, great timing in releasing this.
Very useful for traveling to countries you don't know the language, but I think real time translators and interpreters are still needed because conversations depends a lot of the context, and sometimes you don't need to translate literally all the information to the other person to understand the message.
Anyway, nice tool
I think the AI is capable of interpreting slang. If not, it will learn anyway and eventually 😄
I can't wait to have this app
It will be useful when you have to prepare for an interview. Just upload the resume and ask Chatgpt to practice with questions.
Amazing
thank y for realizing "Her"🎉
Наконец-то инопланетные технологии нашли применение в жизни обычных людей!
omg incredible :0
Gemini feels like GPT 2 compared to this, and they're the most direct competitor
Gemini is far better than GBPT when it comes to factual things ie. Anything STEM related.
This will be very useful to Roger from American dad
I hope this can be available for everyone, not a pay to use
In a future gpt4 free, gpt5 no
Where are they getting their money from ? U can't expect people to accomplish such a thing for free. Do you work for free just to help people?
連通上帝的巴別塔被OpenAI重建了！？💯
Hi OpenAI, first off, thank you. Thank you for continuously providing not only Opened Sourced ChatGPT for more technically inclined individuals to continue in the research and development and enabling such an upgraded GPT-4o for users to fully grasp AI’s rapid expansion and evolution in the industry. With that said, thanks again for the extended free prompts for testing such features. As mentioned within a WIRED article recently published, “Just know that you’re rate-limited to fewer prompts per hour than paid users, so be thoughtful about the questions you pose to the chatbot or you’ll quickly burn through your allotment of prompts.” Kudos. I can’t wait to be able to pick and choose between consented personality voices of individuals partnering with OpenAI for a more personalized “voice” of preference when interacting with GPT and enabling its latests search and translation features.
Duo is sooo cooked, another netflix might happen, but to them 😂
This is amazing, now learning a second language will be a choice, not an obligation, thanks
If I am studying a degree of translation in university, whether need to drop it tomorrow?
Don't worry you are still useful when electricity goes out
@@yak-machiningbro😂😂
@@yak-machining savage😂😂😂
@@yak-machining People will say that and turn around and call Bitcoin a scam lmao
Yes
This is amazing, but only if there isn't any background noise. Great for one on one meetings in a quiet room, but this will not work well outside of that.
I have to try communicating with non-English speaking japanese people at work every single day. This just made my job 80% less frustrating.
Well thank got I've got my 2nd education. I think I could be a teacher for about 2 more years... definitely need to get 3rd education ASAP
I'm so glad I decided to switch career paths from translation to finance. This will put a lot of people out of jobs
you think finance is safe? ... Interesting
This is like that scene from Demolition Man, where Phoenix translates from English to Spanish in real-time. :D
Thank you for the video. I am currently living in Osaka, Japan and I am very interested in Instant Translation with AI models. However, what I understand by "Instant Translation" is not: "I say a sentence - The model translates it after a few seconds and I can hear it - I say another sentence - The model translates it after a few seconds and I can hear it..." What I understand by Instant Translation is: "You are talking in Japanese and, while you are talking in Japanese (with a delay of a few senconds), I listen your speech in Spanish. No matter how long it is the speech. May be the Japanese speech is 10 minutes long and I can begin to listen to it after 5 seconds in Spanish and will end 5 seconds after finishing in Japanese". Basically it is like having a interpreteur by your side who doesn't have to wait until the end of the speech to begin translating. That way, the conversation gets more fluid.
I know this is not an easy task, as there are SOV and SVO languages. However, I think that Seamless m4t model is able to take this into account aswell.
Do you think is it possible to implement such a thing with this model?
少なくともスマホ一台だと自分の話している声で、AIの声が聞こえなくなりそう
@@user-ub6sw6jt8r はい。スマホ2台以上です。
nah this crazy..the future is about to go crazy
damn thats pretty impressive/cool no ones gonna have to learn a language lol! that being said the spanish one does sound slightly robotic compared to the english one
I would love to see if this new model with the vision can translate ASL to English.
The rippling in the water, would seem to indicate that a feeding frenzy of some sort is underway and things might start to get, what was that heathen's 'theory' called again. I remember the theory was eponymously titled. Ahhhh, now I get it. "It" being exactly just what, I'm not so sure about."
Wait for this to be incorporated into game lobbies and chatrooms (discord, zoom, skype etc.)
LETS GOOOO
When will it be available?
Today
As OpenAI said, in the next weeks for plus users
WOW
Duo is sweating rn
wow!
❤
Great
Drake finna cook with this 😂
Its a 'translator' when its written text, its an "interpretor" when its spoken language
can someone explain how exactly you download this for your phone and use it like they are here.
It switched from European Spanish to Latin American Spanish based on the guy’s lack of a lisp. That was good.
ChatGPT is translating in Mexican Spanish even though he is clearly speaking Spanish from Spain.
I wonder when it will approximate the voice as well (ie translate a masculine voice with deep AI voice)...
nother one bites the dust !
if you are seeing this from the future, just know that I will be the first person to edge to ASMR of chatgbt when it releases.
Uh to get the right amount of intonation in Spanish is real crazy / people talk about job lost - but imaging having an universal translator at all times
my key takeaway is that it can easily recognize fast paced type languages like spanish. dang.
I hope they can get rid of this robotic voice crack side-tone with the next update, otherwise all this stuff is super impressive
How many Nigerian kings we are having now with this one 👑
Soon they will have translation automatic where you can talk to someone on the phone and it will instantly translate to you and vice versa. We'll have the real-life Star Trek voice interpreter. In fact, it's already here.
how to get 4.O?
I'd be curious to see how well this works as a private language teacher. I could see myself use this for hours trying to learn and practice a language. My worry is it not pronouncing words correctly or it not being able to switch between english and another language mid sentence
im guessign the app used is a prototype ive been unable to find it anywhere even for sale
Is this available now? Or is this coming soon...? If available now. Please share how the spoken interaction is initiated.
When he said berberberber I understood that.😅
oh my...
Is that on outside the US?
There are still plenty of words and sayings that don't have direct translations. I wonder how this would handle those situations. Also, what if someone is speaking sarcastically? Will it convey that to the other person?
It can summarize what they're saying, it doesn't have to directly translate it, it depends on the context. Just pretend you're talking to a human in regard to it's ability to understand sarcasm.
It will collect data and improve itself
its not a word to word translation. the AI understands the context and translates based on that.
break a leg! -> buena suerte! (good luck!)
I tried this with the current voice model and it forgets to translate after a short time and starts responding directly to what is being said. Has anyone else experienced this? I'm wondering if it will work better with the new voice mode. The demos always show only very short conversations.
Ther should be some way to set it as a default to not have to go trough the "tranlsate x to y and y to x" everytime you pull it out
When will this be available? I upgraded to this and it says it doesn’t support this function 🤔
It has a thick accent in spanish but impressive nonetheless
How chat pgt understand yall easily and I almost fight with it
When I tried the same thing, I received very delayed answers. Is the internet speed used in this presentation 9g or so?
You guys already showed that in the live stream..
This would be so much better if they both were wearing AirPods.
holy shit you’re right lol that would look scifi af
And look in different directions
isnt that feature was already in the older virsion?
It wasn't nearly that effective.
Hi, very interesting but which app I can use to achieve what you showed in this video. I've downloaded official ChatGPT app but not able to succeed to what you did in this video
Para cuándo estarán disponibles esas funciones que muestran en su demo donde puede hablar y hacer video llamada con el robot
Dam ik alot of companies are shaking right now. OpenAI is really changing the game