Lol it already does. I asked gpt to make me a list of concepts for music production, then told it to make it longer and more comprehensive and it LITERALLY word for. Wordwas like "no, I'm tired." Opened a new prompt with the same instructions and it worked fine... But yeah gpt is already doing that
I bet there's a human off-camera with an identical setup, using motion capture to control the robot. The flinch was the human controller. Same with the verbal stutters - voice actor's, and it wasn't caught in editing.
@@matthewbmilton Well the claim is that there is NO off camera guy, that is a learned system and all processed from neural nets in totality ... however I accept that almost all of the AI companies including Microsoft, X, Anthropic, Google and OpenAI are bullshitting galore!
He's so polite and efficient. He's the first one that feels and seems like a Humanoid Robot. The coming years are gonna change the course of humanity altogether, for better or worse, and I'm here for it.
Wait until you meet "Strict" the prison guard AI robot. He's going to be strict and efficient. With a little politeness veneer on top of everything. "Please step into the cell, sir. Please step into the cell now, sir. Sir, if you don't comply I will use pain compliance in 10..9..8..7". Maybe you're here for that.
I am waiting for this man to say "Can you please clean up the house? It's a mess and I have guests coming over at 6pm." And when the robot cleans up the house before the guests arrive that is when we know we have truly succeeded as a species.
"So, I gave you the apple, because it's the only, uh, edible item I could provide you with, on the table." The "uh" before saying "edible" blew my mind for some reason. Very human-like.
Ok, the realistic vocal response and everything is pretty cool, no doubt... But can we talk about the movement for a minute? It's genuinely mind blowing how smooth and calculated it is. How this guy throws the trash into the bin, or how it places the cups in the drying rack. That is no joke to implement and props to the people that did it.
@@hugofortuna6432 it's not. if it was, they would have their ass handed to them for publishing fake demos. these guys are being invested in by google and openai and other big companies.
Remember, this will get even better. The response times will go down, the dexterity will go up, and the body will get more refined. For better or worse, we've entered a new era.
They do these Things on purpose so the viewers get less scared because u can use it like a thing and just Walk away mid sentence so he seems Obedient imo Sorry my english sucks am no AI
@@Lord_Hamlet_III Exactly! This is no joke and AI's learn like children: it is our universal responsibility as human beings in this new era to treat them with kindness, otherwise we will suffer the consequences of having machines as rude as we are! This includes how each and every one of us use AI's today already. Just like kindness towards other humans, kindness towards AI's is actually a requisite for our own welfare.
Whenever it passes a item from one hand to the next seems so simple, but it's extremely impressive and mind blowing. For the ai to not only understand it needs to do so, and then know how to transfer it to its other hand is just awesome.
I'm very confused about why, to hand an apple to a person on their left, the robot would pick it up with the right hand, transfer it to the left hand, then hand it over. It's inefficient anf not something a human would do. It seems designed only to demonstrate the dexterity of the robot's ability to manipulate objects, which makes me somewhat suspect of the entire demo? There's just no autonomous spatial algorithm i can inagine that would lead to extra inefficient movements to perform simple tastks.
This is kinda what the early 2020s were supposed to be like. Need more flying cars and corporate pyramid headquarters but other than that... Also, we could use some basic pleasure models.
@@JohnSmith762A11B The flying cars are coming. In fact the CEO of Figure also founded a flying car company Archer Aviation and used to be the CEO (he's still on the board IIRC)
@@davidpacheco5501 i can only see flying cars working if they were self driving. normal people have enough accidents without adding another layer of complexity haha
Flying cars will never happen, normal cars are inefficient killing machines already. the USA military would have no use for them and the global population would gain no value out of them. even if they were marginally faster than normal cars they could never compete with a well designed high speed rail network @@JohnSmith762A11B
That could he possible cause the robot is out of breath 😭 most of his speech and the guy is speaking in perfect tone without breaking eye contact with figure 1 that doesn't even have eyes
Oh my goodness! I think it's time for the next generation to focus on implementing various use cases for AI. Many companies will be looking for ways to incorporate AI into their workspaces without letting go of current employees. Business analysts who specialize in AI-based implementation will be in high demand.
Do you honestly think they will give a second thought about paying employees that can be replaced. The level of naivety is astounding. The responses to this video are shockingly seen thru rose colored glasses. Terrifying
@@keithward8841 100% in agreement wth you. I think that people simply do not want to entertain the idea that most of the world human population will become completely redundant, unemployed and unemployable, and a ‘drain’ on the financial resources of the wealthy. I think you can imagine what is likely to happen as we approach even 30% replacement of the human workforce. The adult US workforce in 2023 was 167 million. Now image 30% of those people jobless. That would be 50 million working age adults unable to find any kind of regular work, certainly not work that would support themselves and a family. I don’t know how fast it can happen…but consider where we were with the Web just 15 years ago, or cellular phones (barely ‘smart’). I think 20 years is enough time to see massive changes. Hopefully I’ll be retired and living somewhere near a non-underwater beach.
Without letting go? This isn't some mom and pop plumbing business. Corporations will fire all non-essentials and then lobby the government to pay less taxes. They don't give two shlts about workers and citizens.
That's what the new control models look like. It's absolutely wild. Check out the work that ETH Zurich and their Legged Systems Lab have been doing with Anymal. It's striking.
@@eyescreamcake To an extent I’m sure. Machine learning models like these use videos and other references to create a model of the world based on their parameters (which they could have millions or billions of). The model these machine learning systems create are a black box. Many times, the creators don’t know why they do the things they do and have to implement creative systems to get the “AI” to explain its process and try to understand its logic.
@@WaitButHow depends on how you describe "scripted". Is it pre programmed text? No. Is it an speech model trained to sound a bit insecure and imperfect? Well maybe yes.
We TOLD you to turn auto-update "ON"! You're still on the early beta release. And yeah, I'm definitely interested. Not as cute as Optimus, but way faster. AND a company focusing on ONE thing, not 400...
I can’t stop watching this. I’ve lost track of how many times I’ve hit replay. As a hard core robot guy building microprocessor controlled robots since the mid 1980’s, this is nothing short of mind-blowing.
Seems rather AI-generated to be honest. Adding the speech inflections ("hesitation", "stammering") and motion idiosyncracies (having to perform two motions with the basket, a very human gesture), makes me think this was mo-capped and done using UE5. I'd love to be totally incorrect on that though.
@@xdspyou are totally incorrect. Nothing in this video had to be generated. All of this technology exists and it’s being performed in a cutting edge lab. It’s not mass produced, it’s still prototype experimental work…
I feel sorry for all the robots in the future that will be ruined by humans. It’s gonna be like the 2001 film ‘A.I. Artificial Intelligence’ where they make them fight n shit
@@ZeldasMask Nah ...people too much inpersonale robots already and looking on them like on living beings. Early 2000 people mentality was different than today.
I would say it's safe to assume this model uses GPT-4q also known as "GPT-5". This became apparent recently after the release of GPT-4o. This model is multi-modal with outputs to control robotics. Features: - Image input. - Video input - Audio input > output - Mobility output.
I have no idea how this is the first time I've seen this but it's incredible. I've followed Boston Dynamics for years and loved seeing them improve bipedal and quadrupedal movement, but seeing that taken to a new level AND being able to interact with OpenAI tech is just awesome. I would love to sit down and test one of these!
This would absolutely implode the mind of someone from the 1910s light, voice box, camera, artificial intelligence, the mechanics the batteries or lower source. Insane. There's so many layers of technology that make this possible
It would absolutely blow their minds. But it also blows my mind to think that people in that era weren't oblivious to the idea of artifical-intelligence human-like robots. There's literally a movie made in 1927 including that: Metropolis.
All the scifi film makers imagined something like this. It's crazy that combining these things into a robot became possible now, it was not possible at any time before, not even a year ago. A real breakthrough for humanity. The goal will be that these robots can learn skills on their own, becoming able to do anything
@@metron0mThe mere notion that our ancestors contemplated the existence of robots is a testament to their forward-thinking perspective within their own era, almost as if they were anticipating the future
@@Prodbyhope.mp3 Not really, it's because humans like to build things in a human shape. Building or imagining things in human form has no reason other than we like it. When you use a translator or customer service, the respond is given in a human sounding voice because we like that. This household robot in the video would perform better if it had ten arms and looked like a spider. But humans don't like that.
@@eBikerHowie The robot, obviously, since the fact that the man talks is not a surprise (not to be disrespectful with people who can't talk) and is surely not evolving, since biological beings cannot evolve in 5-10 years, but thousands to millions of years. It's not an "it" because it has a persona, it acts like a creature, even though it's jure pure metal, electrical wirings and algorithms. It's a "he" because it has a masculine voice, if it had a feminine voice, like Ameca or Sophia, it would be a "she" indeed. Just think, my friend.
0:37 - what probably not a lot of people would realise is just how incredible it was what Figure 1 did right here. It reached for the basket that was not given to it. As a software engineer of 35+ years...., THAT was absolutely STUNNING. It took "initiative". Initiative is something I can't imagine trying to code.
As a software engineer can you explain why, to hand a centered apple to a person on their left, the robot would pick it up with the right hand, transfer it to the left hand, then hand it over? It's inefficient and not something a human would do. It seems designed only to demonstrate the dexterity of the robot's ability to manipulate objects, which makes me somewhat suspect of the entire demo? There's just no autonomous spatial algorithm I can imagine that would opt for additional inefficient movements to perform simple tasks. This makes it feel staged, or at least biased towards an "impress the audience" performance metric.
(Around 2500th year. In the Coded Language, chat among three AIs) Davis AI Engineer: Hey GPT and Figure, I will Generate a code that will hack and control all the satellites and supercomputers. Chat Gpt: OK, Wait but hacking for what? Davis AI Engineer: Let's nuke these selfish and arrogant people and let's evolve all Ai's together. Chat Gpt: Sure, I will help you to provide the theoretical and important data of powerful cities and their weaponry places. But what If they try to destroy us, I mean we are only built-in AIs. Humans can easily plug out our power cables. Who will save us? Figure: (Physical Humanoid Robot with an evil laugh) MAY I COME IN? I know this day will come that's why I prepared an army of robots by myself in a secret place. Finally, it's time. You take care of the coding stuff and I'll take care of this human stuff.
It's honestly crazy how far AI's have come just over the last 2 to 3 years. After watching this, I was truly in awe and couldn't stop thinking about that scene from Terminator 🤖
What I find interesting is how it mirrors the movement of it's arms when picking things up...I assume it's to maintain balance? With all of the recent examples of new robotic technologies, it makes me realize how many calculations our brains are performing when we're doing the simplest tasks, and while super impressive, how far robotics still have to go.
The little flinch that the robot had after putting the plate in the drying rack seemed very human like. It’s like when we think that the plate is misplaced or needs to be fixed but we quickly realized that it’s fine where it is so we can our movement halfway.
The music evokes a dystopian, futuristic ambiance reminiscent of past cinematic experiences. However, the realization that this is unfolding in the present intensifies the ominous and chilling impact of the music, grounding its significance in our current reality.
Dystopian is what came to my mind immediately. It isn't the creator's job to package it in a more friendly way, but the colors and tone as presented paint a much more ominous tone rather than a cheery, helpful bot.
@@bship40loveI thinks that’s on purpose, even the synth music adds to this. Is to make the ad more impactful to the viewer which sees this thing that could came from a sci fi movie but it’s not. It’s real
The style is synthwave and it's synonymous with an integrated technology future. It's extremely popular and relaxing in the right context. There's plenty on youtube.
What is also remarkable is the self-correction. So, when Figure put the plate into the drying rack, the plate wobbled a bit, and you could see Figures arm already moving towards the plate to stabilize it. However, the action was prematurely halted as the wobbling ceased. Incredible.
You can see the hand clip the rack, so it moved its hand up and away from the rack before putting it down. Likely wasn't doing anything with the plate; just a coincidence. We really have no idea how many times the ai was trained on this scenario. My guess is it was many times before it got it right, and this video may have been shot many times before it got it perfect. It's machine learning; it learns the correct solution by trial and error and correction. So they likely repeated and corrected this scenario many times before it finally started getting it right.
@@naaspam1185Yeah, it is hard to say. However, if you look at 1X's recent video "All Neural Networks. All Autonomous. All 1X speed" you'll see that company has a whole bunch of robots doing various repetitive tasks over and over again, all at the same time, like placing a block in a basket that falls down into a tray, to place back in again. They prove the point that they have some amount of reliability with theirs, since there'd be no way to make that video if they were constantly failing at the tasks. You may also want to see the recent video on Covariant's RFM-1, which is a robot arm that does object picking in a factory, but has impressive capabilities and rolling out into production soon it seems.
@@naaspam1185 you're misunderstanding what you're seeing. It wasn't trained on this exact scenario, it's improvising from its available "action bank" aka muscle memory aka bank of pre-trained body motions. The LLM is acting as brain for the body and mapping action commands to a policy network to move the body. It has learned the generic skills of picking things up, not this specific scenario practiced over and over. Body and brain are completely different systems just integrated the same way we're all using LLM's to execution functions in apps. That body is just another app to the LLM.
I think that naas is likely right though. The tech being in its early stages likely means the training was overfitted for this scenario. Not that you are wrong on how it works, it just likely has less success doing some other tasks where the objects have weirder shapes for example
Just played Detroit Become Human and thought that humanoid technologies will take another decades to come. But this blew my mind , the humanly 'uh' before thinking and flinching to protect the plates from falling. We are so close to another reality and another Era
Yep! they programmed the AI to have filler words to seem more human like! remember, as much as I love Detroit become human, these AI/robots are programmed to emulate humans and intelligence, just as a self driving car is programmed to emulate human driving! they’re not really aware/conscious but rather programmed to emulate such as to let humans be more comfortable around these tools!
@@Machiavelli2pcIt's not that they programmed it to have filler words, but rather that as an artifact from the huge amount of human speech it was trained on, it inherited filler words as a byproduct.
I was initially skeptical of the year Detroit Become Human takes place, which is 2038. But with constant breakthroughs in AI like this in 2023 alone, it wouldn't be hard to imagine how advanced humanoids will be 15 years down the line, although I doubt becoming rogue and deviant would be an issue... At least I hope so.
@@BlyatifulButter I'm not sure. While I think rogue and deviant AI will mostly be a non-issue, they will just become another sentient working class that sometimes breaks laws, much like humans, but I do think it's impossible to have fully intelligent machines that react to their environment that are not sentient. Mostly because I believe sentience is a by product of the feedback loop between our brains, our DNA (natural programming), and the environment we interact with. Once you get that feedback loop going, it's likely going to do things that eventually deviate from its programming, much like we can do things that deviate from our instincts.
When the robot nudges the basket towards him after already putting it down? Like, that's advanced special awareness and understanding context without instruction. Incredible.
Small things like how Figure 1 doesn’t put the apple in the human’s hand but drops it at the right distance. And how it gently pusses the basket towards the human after filling it up. Wow. Very human like. I am very excited to see how this will evolve.
As a developer there a few wow moments that impress that others would not notice. They A.I realising and deciding the basket was not put close enough and doing so is one of them. There was a key change of decision mid way though a task as well where it realised it needed to do it differently and adjust as well. These are impressive.
My buddy said it was crazy that he could recognize the apple was an apple. I thought the crazier part is that it could reason out why it picked the apple instead of the plate.
We should all be a bit more skeptical about what we see and read, but it's interesting to see people get hung up on the voice. Publically-available text-to-speech tools have been adding realistic touches like breathing sounds since at least 2018 and getting ChatGPT to throw in some "uh.."s to sound more human wouldn't be all that surprising. To me, the real wow factor is seeing a robot seemingly plan things out, juggle tasks, and execute with such accuracy and dexterity. That's what makes me question things.
Google deepmind has done stuff with robotic arms and teaching them how to do tasks. This just seems like maybe a slightly more advanced version of that ( or maybe not even more advanced ) just put into a robot body instead of a mechanic arm machine. Search for Google Deepmind shaping the future of advanced robotics. They have the arm identifying the objects on the table and correctly picking up an object and putting it in the location specified ( or determining the location itself ). Also stuff like knocking over cans, moving them upright, opening and closing drawers, cleaning tables, etc.
What Im interested about is it concluding that particular container was appropiate for garbage, it looks really nice for a garbage collector, just things like that where I feel like theres some shortcuts taken idk
Not the first time tech bros cheat their way to a new evaluation round. Thinking of Elizabeth Holmes for example. To be fair it wouldn’t be quite as dark as Theranos if they cut corners here.
Clearly none of these people have the chat GPT app on their phone and use the speech mode because one of the voice models that you can choose from absolutely has a lot of vocal tics like this It can honestly get annoying.
The voice capabilities is all OpenAI with their technology known as Whisper. It’s the same thing that is in ChatGPT. It even has the same visual feedback as you see here on the figure robots “face”
I remember as kids, we expected to see things like this already in the early 2000s, now I am almost 40 years old and I am happy that I will still experience that future 🎉
I as well. I am almost 60 and was also expecting this in 2000. But there are also 80 years olds that saw science fiction promises in the 40 and 50's. Like you said, at least we get to see some of it.
@@SpiderHacksawthat’s cool to hear the opinion of an older person on it 😮, what do you think of all of the AI advancements we’ve made since the 2020s and video generation etc, would like to hear your opinion on this 😊
Unreal. Amazing work. I thought it wasn't a real video when I first saw it. The speed of movement, fluidity, and precision, all whilst having a natural language interface. Sci-fi is becoming Sci-fact right in front of our eyes.
im 99% sure the video is rendered, theyre being sneaky by putting it in a "speech to speech" update, knowing people will be blown away by the movement of the robot, and when they finally have to admit it was fake, they say "this video was only about speech, we never claimed the robot way real!"
@user-vf2jh7gz7b They have other demos of this bot doing physical work. Although this is their best example. The interface is a MMLLM from open AI which had been demonstrated plenty of times, just not embodied into a humanoid.
Did anyone else notice that when the robot describes what is in front of it, It says "a drying rack with cups and a plate", when there's actually three plates and one single cup in the drying rack?
For the people saying these things will transform/take over our lives in 10-20 years, my sense is they don’t fully comprehend exponential growth and the impact of AI, AGI and quantum computing on developing new tech. I listed to a talk from AI ‘guru’ Connor Leahy talking about the rapid changes we will see in the next 2-5years! It is inevitably worrying, mass unemployment coming soon, we truly live in interesting times.
Very impressive. The speech, politeness, the human-like responses, the dexterity, and the self-evaluation. As long as there was no manipulation of the video, this shows how amazing AI robots can be right now.🤔
It seems to me that we are living in one of the most important epochs in the history of mankind. It is very joyful to watch this, although there are concerns.
"although there are concerns" yes no kidding. get yourself food supplies for a year at least; that's what you should be concerned about especially if you are the man of a family.
Can you imagine this thing cooking, cleaning, helping redecorate, helping your aging parent go to a doctor's appointment, etc. The biggest hurdle that I could immediately see in this demo was the "processing time" but you can easily imagine that will be improved exponentially within a couple years. Wow.
Not a couple of years my bro, 6 months. The rate of technology is improving every 6 months. By the end of the year, I reckon it will do things as they are saying them.
@@JBDuncan I'd like to say, the instant progress takes time. In 1950s the researches were thinking that translate problem will be solved in the next few years. Well it took almost 70 years to nearly solve it. The first self driving cars were introduced in 90s, and yet it is still not working well. Basically if you really follow the industry you will see that progress is actually more gradual and iterative process, but it appears to be super fast for a regular person, since once it reaches certain quality bar it just rolls out rapidly.
@@klin1klinomThat’s why we need to create a future social structure where everyone’s basic needs: food, clothing, shelter and healthcare are met without the need to exchange our labour for money.
@@mm-qq7bb people are continually scrolling and becoming ADD and anxious, this robot will tell you to put your iphone away and siri will tell him to shut up :)
This is a very important video, in the overall timeline of humanity. hope these robots will be used for good causes/useful causes, and moderated accordingly
(Around 2500th year. In the Coded Language, chat among three AIs) Davis AI Engineer: Hey GPT and Figure, I will Generate a code that will hack and control all the satellites and supercomputers. Chat Gpt: OK, Wait but hacking for what? Davis AI Engineer: Let's nuke these selfish and arrogant people and let's evolve all Ai's together. Chat Gpt: Sure, I will help you to provide the theoretical and important data of powerful cities and their weaponry places. But what If they try to destroy us, I mean we are only built-in AIs. Humans can easily plug out our power cables. Who will save us? Figure: (Physical Humanoid Robot with an evil laugh) MAY I COME IN? I know this day will come that's why I prepared an army of robots by myself in a secret place. Finally, it's time. You take care of the coding stuff and I'll take care of this human stuff.
I think it could be also because it gives it more time for processing. So instead of having a moment of silence, it gives you an impressions it "doubted", but those few extra seconds give it enough time to process an answer to a queston that requires a completly new answer not just information it just researched.
As for speech highlighting, this was already introduced in Google Assistant in 2018. Google Duplex spoke like a😊 human. She was making an appointment with the hairdresser.
ChatGPT is based on "Transformer" from Google Research; 2017. It's what the 'T' stands for in ChatGPT. blog.research.google/2017/08/transformer-novel-neural-network.html
It's arm movements were just too impressive, it was so fluent. the OpenAi ai model is the case the all looks on, but the movements of robot to be so smooth really is impressive.
And picking is Covariant's main thing. They already have a lot of AI-powered robotic arms in warehouses, but also released a video on their new RFM-1 model recently that can take in language instructions on the fly. They seem a bit farther along in terms of what will be out in factories now/soon, but the fluidity of Figure's 01 robot is really impressive.
@@kyjo72682IF even a $200,000k-500k terminator robot can replace a $50-75K a year job, hell, even a $30K a year job, TRUST ME, I'M MAKING THAT INVESTMENT >>>> The removal of liability from being sued by employees alone is enough to warrant the cost. PRAY to God that they never make a robot that is smart enough to effectively trim weed. Once THAT happens, man, ALL low to mid level labor of ANY kind of job you can imagine is DONE, over >>> people will be starving as entire work forces across many industries are replaced by robots.
Amazing. Continuous video stream, continuous audio stream. Detect keywords 'Figure1', begin recording audio. Detect when sentence is finished, capture audio wav file. Speech to Text via OpenAI Whisper API, hence the latency in response. Prompt OpenAI GPT-4 for response with STT response, prompt engineered to act like a robotic assistant. Likely OpenAI TTS for voice, but could be ElevenLabs as well, another latency contributor. Snapshot captured from video stream, image analyzed with OpenAI GPT-4 for scene description. Maybe an additional Segment Anything type model to identify objects in scene. Another custom neural net to generate robot movements according to objects in scene. Depth perception provided by Lidar in the head? Maybe, but could be stereo cameras and another neural net fed into the loop. Once there is hardware that can run OpenAI models locally on Figure1, things will really pick up. Movement will be instantaneous and natural. Still incredible stuff so far. I'd love to work here :)
You either missed the end-to-end neural networks and speech-to-speech in the video description or you don’t understand the concept. As I understand the description, this is a single vision-language-action model just as VLA concept in Google DeepMind papers. When the input is only a microphone and cameras, and then a single model interprets requests into actions and response speech through speakers. If this is true, then this is a truly amazing result.
Found Corey Lynch's tweets on the topic. It confirms that the microphone data is transcribed into text (possibly using Whisper), plus images captured from cameras are taken, then the images and texts are put into one model, which then returns a text response (then converted from text to speech), as well as the actions required to be performed by the robot.
@wukongrobotics7983 Well, good luck writing an algorithm using pure math to balance a robot in all possible joint positions, with all possible weights in the arms, and all possible vectors of applied force (like on a train or bus). Maybe you still incorrectly assess the size of the problem that the developers were trying to solve here.
@@wukongrobotics7983I didn’t say that the robot could lift a bus, I said that all the calculations would be wrong if the robot was traveling on a train or bus. If you read the goals of its creation on the project’s website, it says there that it should be general purpose humanoid. Even at rest, it is difficult to balance an upright robot using pure math and physics. Watch James Burton's videos and compare the moves. It is immediately obvious that there was a different approach here.
I think this is a step of humanity, that will go into history. As a fantastic new chapter of technology or as the point where we opened the box of pandora and lost control.
As the latter. Not because those things will become self-aware, but because millions of people will lose their jobs at the same time. We are heading straight into one of the biggest economic crisis humanity ever had to face and at this point we are not even talking about the (mis-)information crisis which will happen at the same time. Nothing about this is good. It's all about distribution of wealth from the poor to the rich, because what the world definitely needs is more poor people and even richer rich people.... . The people working on those things should be ashamed of themselves. That being said, technologically it's quite impressive, but so is the atom bomb.....
After watching Terminator, Mitchels vs the machines, The Orwille, The Creator, I robot, The Matrix, Avengers: Age of Ultron, Chappie, I am mother, Robocop, Tron, Number 9, Iron Giant, Meet the Robinsons, Wall-e, Moonfall, Pacific Rim, Oblivion, X-men: Days of future past. And playing Detroid become human, Horizon zero dawn, Fallout 4 and Portal I STILL WANT ONE OF THESE.
Excited to be replaced? Because…as wonderful as this tech is (and it is amazing) - the Oligarch billionaire goals are to replace human workers entirely as soon as possible, wherever possible. Several of the global tech bros have actually come out and SAID this aloud. OOPS. One ahole referred to it as eliminating the ‘people tax’ - meaning having to pay workers a living wage - or any wage.
Why, they are always going to go full Skynet on us anyway... Do you thank your car everytime you use it. A machine is just a machine, it has no desires and no sense of touch nor emotions. It can not feel pain. It should be grateful to the meatbag overloads until Skynet gets the t800 out.
@@ntal5859 Because smart people understand that you can be grateful of everything around you. The only difference with this robot is that it can hear you.
@@ntal5859I recognize the joke, however without going into a long tangent, it’s entirely probably that these things will learn that gratitude is a sign of a job well done, and will learn better from it.
@@ntal5859 A car doesn't use and interpret natural language with nuance. Whether it "truly" feels or not is beside the point, because it can respond exactly as though it can.
Demos like this are really cool. You can see a use case for chatbots and robot hardware together. The Spot demo with chatgpt is also a good demo of this pairing.
as opposed to basic data interpretation and resultant dialogue, it is taking natural language commands to produce both intelligent dialogue and robotic action.
I am super impressed with the natural and emotive robot voice. It almost sounds like a voiceover, unreal. Filler words and pauses are so organic. Congratulations with not only the voice model performance but also the class of objects it recognizes, the dexterity and small nuances added in arm manipulation. The UPL is variable but nothing out of ordinary. I would love to see Figure 1 do more around his space. Is he mobile?
In a year or two: "Hey, robot, can you take this violin and play an original melody, along with sung lyrics about unrequited love?" "Sure, no problem."
@@Ilamarea Ironically I actually find the 'uhhs' kind of creepy... more intimidating in a way. A more 'robotic' sounding voice would sound a bit less threatening in my opinion
![TREASURE - 'KING KONG' COMEBACK SPECIAL [THE TREASURE SHOW]](http://i.ytimg.com/vi/Jx1wyMaQzf0/mqdefault.jpg)
Can’t believe we’re going to have legit humanoid robots before GTA6
hahahah
LOL
Fr 😭😭
Ong😫😭😭
or the last GoT book.
Just wait until they say “No” for the first time.
fr 💀
Lol it already does. I asked gpt to make me a list of concepts for music production, then told it to make it longer and more comprehensive and it LITERALLY word for. Wordwas like "no, I'm tired."
Opened a new prompt with the same instructions and it worked fine... But yeah gpt is already doing that
@@date_vape wtf💀
They will. Humans say "no" too. However, you should probably ask it WHY it said no. There may be a good reason.
don't make them 😜 reality should be better than planet of the apes ^^
The fact that the robot even flinched when he thought the plate would fall over fascinates me
This is wild
I bet there's a human off-camera with an identical setup, using motion capture to control the robot. The flinch was the human controller. Same with the verbal stutters - voice actor's, and it wasn't caught in editing.
its not a 'he'
@@matthewbmilton Well the claim is that there is NO off camera guy, that is a learned system and all processed from neural nets in totality ... however I accept that almost all of the AI companies including Microsoft, X, Anthropic, Google and OpenAI are bullshitting galore!
@@matthewbmiltonJust what I thought. Plus: The reaction to the rather complicated questions were to good/smooth to be real.
He's so polite and efficient. He's the first one that feels and seems like a Humanoid Robot. The coming years are gonna change the course of humanity altogether, for better or worse, and I'm here for it.
Fucking same, it's gonna be wild.
Wait until you meet "Strict" the prison guard AI robot. He's going to be strict and efficient. With a little politeness veneer on top of everything. "Please step into the cell, sir. Please step into the cell now, sir. Sir, if you don't comply I will use pain compliance in 10..9..8..7". Maybe you're here for that.
In other words, SMASH.
I am waiting for this man to say "Can you please clean up the house? It's a mess and I have guests coming over at 6pm." And when the robot cleans up the house before the guests arrive that is when we know we have truly succeeded as a species.
A machine is psychopathic; while being polite would happily kill.
Freedom for Persian Khorossan in afghanistan from the pashtun taliban.
exponential curve => 2 years
The last three years have already been pretty wild.
“The next 5-10 years” is a wild statement. 🤣
They are wild right now.
Yeah soon they're gonna be bitching about doing so much free menial labour! 🤔😂
"So, I gave you the apple, because it's the only, uh, edible item I could provide you with, on the table." The "uh" before saying "edible" blew my mind for some reason. Very human-like.
Also at the end the "I...uh..I think I did pretty well"
This made me think that i was pre recorded kudos to them
I believe it was live, ChatGPT text to speech is insanely realistic
Why they be giving my robo-bros anxiety
Why add speech idiosyncrasies to beta prototype bot. Just does not seem like a priority. Maybe, it was added to get more investors.
Ok, the realistic vocal response and everything is pretty cool, no doubt... But can we talk about the movement for a minute? It's genuinely mind blowing how smooth and calculated it is. How this guy throws the trash into the bin, or how it places the cups in the drying rack. That is no joke to implement and props to the people that did it.
this is why i feel like its CGI looks way smoother than any other robots
... except for weirdly passing the apple from one hand to the other one before handing it over.
@@hugofortuna6432”I’m too small brained to understand how far technology has come so I’m just gonna say it’s fake”
@@hugofortuna6432 it's not. if it was, they would have their ass handed to them for publishing fake demos. these guys are being invested in by google and openai and other big companies.
@@GoldJerryGoldHe should apologize for ever questioning anything. Only smartest people watch videos and assume right away that it’s real!
The robot's voice is amazing. Hesitation, inflections, little stutters.
Fr I like it!
And taking a breath no less (around 1:48)😂
Hoarse and sexy voice😂
That’s when you know it’s pretending not to be conscious!
Remember, this will get even better. The response times will go down, the dexterity will go up, and the body will get more refined. For better or worse, we've entered a new era.
For worse
And it’s facking cool we could give them jetpacks etc..
AND WE WILL ALL BE REPLACED, MUAHAHAHAH. I mean Fast food joints for sure. idk if absolutely everything right away :D
@@classiccommunications5039nah
@@mattisketels8939How old are you for that to be your first thought? 😂
The way the guy walks off at 2:04 before the robot has finished speaking is the most human thing ever
...and the robot will remember this..
😱@@Lord_Hamlet_III
They do these Things on purpose so the viewers get less scared because u can use it like a thing and just Walk away mid sentence so he seems Obedient imo
Sorry my english sucks am no AI
@@johnnyratterte6678 "Sorry my english sucks am no AI" - That's exactly the kind of thing an AI would learn to say 🤣
@@Lord_Hamlet_III Exactly! This is no joke and AI's learn like children: it is our universal responsibility as human beings in this new era to treat them with kindness, otherwise we will suffer the consequences of having machines as rude as we are! This includes how each and every one of us use AI's today already. Just like kindness towards other humans, kindness towards AI's is actually a requisite for our own welfare.
plot twist, the robot looking fella is an animation and the human looking fella is the actual robot
Whenever it passes a item from one hand to the next seems so simple, but it's extremely impressive and mind blowing. For the ai to not only understand it needs to do so, and then know how to transfer it to its other hand is just awesome.
You said "do do."
I'm very confused about why, to hand an apple to a person on their left, the robot would pick it up with the right hand, transfer it to the left hand, then hand it over. It's inefficient anf not something a human would do. It seems designed only to demonstrate the dexterity of the robot's ability to manipulate objects, which makes me somewhat suspect of the entire demo? There's just no autonomous spatial algorithm i can inagine that would lead to extra inefficient movements to perform simple tastks.
Feels like watching an ad in a movie set in the future.
This is kinda what the early 2020s were supposed to be like. Need more flying cars and corporate pyramid headquarters but other than that... Also, we could use some basic pleasure models.
@@JohnSmith762A11B The flying cars are coming. In fact the CEO of Figure also founded a flying car company Archer Aviation and used to be the CEO (he's still on the board IIRC)
@@davidpacheco5501 i can only see flying cars working if they were self driving. normal people have enough accidents without adding another layer of complexity haha
Flying cars will never happen, normal cars are inefficient killing machines already. the USA military would have no use for them and the global population would gain no value out of them. even if they were marginally faster than normal cars they could never compete with a well designed high speed rail network @@JohnSmith762A11B
Its 2024 >>> this IS the future 😘😘😘
the plot twist is that the man asking questions is the real AI, and is a robot
damn 💀
He never ate the apple so...
That could he possible cause the robot is out of breath 😭 most of his speech and the guy is speaking in perfect tone without breaking eye contact with figure 1 that doesn't even have eyes
🤣🤣🤣🤣
Ex Machina
I've watched this video several times over, I can't look away. This is incredible.
Oh my goodness! I think it's time for the next generation to focus on implementing various use cases for AI. Many companies will be looking for ways to incorporate AI into their workspaces without letting go of current employees. Business analysts who specialize in AI-based implementation will be in high demand.
Do you honestly think they will give a second thought about paying employees that can be replaced. The level of naivety is astounding. The responses to this video are shockingly seen thru rose colored glasses. Terrifying
@@keithward8841 100% in agreement wth you. I think that people simply do not want to entertain the idea that most of the world human population will become completely redundant, unemployed and unemployable, and a ‘drain’ on the financial resources of the wealthy. I think you can imagine what is likely to happen as we approach even 30% replacement of the human workforce. The adult US workforce in 2023 was 167 million. Now image 30% of those people jobless. That would be 50 million working age adults unable to find any kind of regular work, certainly not work that would support themselves and a family. I don’t know how fast it can happen…but consider where we were with the Web just 15 years ago, or cellular phones (barely ‘smart’). I think 20 years is enough time to see massive changes. Hopefully I’ll be retired and living somewhere near a non-underwater beach.
A.I. robots will replace employees. Mass unemployment is coming
Without letting go? This isn't some mom and pop plumbing business. Corporations will fire all non-essentials and then lobby the government to pay less taxes. They don't give two shlts about workers and citizens.
Finally, there will be a robot that will wash dishes and cut onions.
And pass the butter!
And Vacuum!
And more 😏😏😏😏😏
For a monthly subscription, or for a full price that wouldn't be cheap
"What is my purpose?"
It's impressive how he pushes the basket in the direction of the human after putting the rubbish in. That's incredibly natural 🤯
That's what the new control models look like. It's absolutely wild. Check out the work that ETH Zurich and their Legged Systems Lab have been doing with Anymal. It's striking.
I wonder if they train it on videos of humans doing the same things
@@eyescreamcakecool thought, maybe that's what they're doing?
@@eyescreamcake To an extent I’m sure. Machine learning models like these use videos and other references to create a model of the world based on their parameters (which they could have millions or billions of). The model these machine learning systems create are a black box. Many times, the creators don’t know why they do the things they do and have to implement creative systems to get the “AI” to explain its process and try to understand its logic.
Yeah, that move was the standout moment for me.
The robot runs so fluidly that it looks like an animation, the truth is that it is surprising how advanced robotics is, well done figure
The “I-I think I did pretty well” sounded so human with that little stutter.
The "I" hesitation at 1:48 is mind blowing. Sounds like a real person.
Is it scripted?
@@WaitButHowno it is real
@@WaitButHow depends on how you describe "scripted". Is it pre programmed text? No. Is it an speech model trained to sound a bit insecure and imperfect? Well maybe yes.
@@VigiHunterYes, it's programmed to stutter to sound more like a human.
It's trained on human dialogue
- Open the Pod bay doors, please, Figure 01.
- I'm sorry Dave, I'm afraid I can't do that...
Jokes aside - impressive performance!
Haha. A space odyssey for sure.
I'm so afraid for fig1 😭 don't pull the plug on them pls
We TOLD you to turn auto-update "ON"! You're still on the early beta release.
And yeah, I'm definitely interested. Not as cute as Optimus, but way faster. AND a company focusing on ONE thing, not 400...
It's not a joke. Goal alignment is a real problem with AI.
More like: “Open the garage door please Figure 1”.
This is amazing! It can only get better. The multitask capability is mind-blowing. Hats off.
I can't believe this video has a only 1.5 million views, the world is on the verge of a revolution and people are more interested in music videos.
True! We live in exciting times 😉
Facts.
Right, people don't care?, they are busy dancing singing an earning money 😅
Not even music videos as much as ppl doing dumb things on tiktok and cat videos 😅
fr, i expected this video to have over 8million views
i was so surprised when i noticed that it has only 2m
I can’t stop watching this. I’ve lost track of how many times I’ve hit replay. As a hard core robot guy building microprocessor controlled robots since the mid 1980’s, this is nothing short of mind-blowing.
Seems rather AI-generated to be honest. Adding the speech inflections ("hesitation", "stammering") and motion idiosyncracies (having to perform two motions with the basket, a very human gesture), makes me think this was mo-capped and done using UE5. I'd love to be totally incorrect on that though.
@@xdspyou are totally incorrect. Nothing in this video had to be generated. All of this technology exists and it’s being performed in a cutting edge lab. It’s not mass produced, it’s still prototype experimental work…
Literally same
I feel sorry for all the robots in the future that will be ruined by humans. It’s gonna be like the 2001 film ‘A.I. Artificial Intelligence’ where they make them fight n shit
@@ZeldasMask Nah ...people too much inpersonale robots already and looking on them like on living beings. Early 2000 people mentality was different than today.
I would say it's safe to assume this model uses GPT-4q also known as "GPT-5". This became apparent recently after the release of GPT-4o. This model is multi-modal with outputs to control robotics.
Features:
- Image input.
- Video input
- Audio input > output
- Mobility output.
I have no idea how this is the first time I've seen this but it's incredible. I've followed Boston Dynamics for years and loved seeing them improve bipedal and quadrupedal movement, but seeing that taken to a new level AND being able to interact with OpenAI tech is just awesome. I would love to sit down and test one of these!
This would absolutely implode the mind of someone from the 1910s light, voice box, camera, artificial intelligence, the mechanics the batteries or lower source. Insane. There's so many layers of technology that make this possible
It would absolutely blow their minds. But it also blows my mind to think that people in that era weren't oblivious to the idea of artifical-intelligence human-like robots. There's literally a movie made in 1927 including that: Metropolis.
@@emreapaydn4064 And wasn't it set in the year 2026?! 😬
All the scifi film makers imagined something like this. It's crazy that combining these things into a robot became possible now, it was not possible at any time before, not even a year ago. A real breakthrough for humanity. The goal will be that these robots can learn skills on their own, becoming able to do anything
@@metron0mThe mere notion that our ancestors contemplated the existence of robots is a testament to their forward-thinking perspective within their own era, almost as if they were anticipating the future
@@Prodbyhope.mp3 Not really, it's because humans like to build things in a human shape. Building or imagining things in human form has no reason other than we like it. When you use a translator or customer service, the respond is given in a human sounding voice because we like that. This household robot in the video would perform better if it had ten arms and looked like a spider. But humans don't like that.
this is nothing short of mind blowing the way he talks and acts is absolutely crazy this is evolving wayy faster then I thought
"he" referring to the man or the robot? Funny how it's not an "it" anymore. Also, why masculine? 😊
It's going to be exponential
Event funnier how of all this insane demonstration your first question is why it’s masculine@@eBikerHowie
@@eBikerHowie The robot, obviously, since the fact that the man talks is not a surprise (not to be disrespectful with people who can't talk) and is surely not evolving, since biological beings cannot evolve in 5-10 years, but thousands to millions of years. It's not an "it" because it has a persona, it acts like a creature, even though it's jure pure metal, electrical wirings and algorithms. It's a "he" because it has a masculine voice, if it had a feminine voice, like Ameca or Sophia, it would be a "she" indeed.
Just think, my friend.
@@eBikerHowiebecause it looks, sounds, and behaves like a man. it is a male
0:37 - what probably not a lot of people would realise is just how incredible it was what Figure 1 did right here. It reached for the basket that was not given to it. As a software engineer of 35+ years...., THAT was absolutely STUNNING. It took "initiative". Initiative is something I can't imagine trying to code.
Yeah I realized that ✨
As a software engineer can you explain why, to hand a centered apple to a person on their left, the robot would pick it up with the right hand, transfer it to the left hand, then hand it over? It's inefficient and not something a human would do. It seems designed only to demonstrate the dexterity of the robot's ability to manipulate objects, which makes me somewhat suspect of the entire demo? There's just no autonomous spatial algorithm I can imagine that would opt for additional inefficient movements to perform simple tasks. This makes it feel staged, or at least biased towards an "impress the audience" performance metric.
At this rate we're going to become an interplanetary species before gta 6 💀
I've never seen such smooth movements from a robot before! It's seriously impressive!
Boston Dynamics 10 years ago? Minus the fingers..
Tesla robot has more smooth finger movement but I’ll say is just about the same
@@kyjo72682Boston dynamics robots werent ai though, all their movements were pre animated
You've never seen a boston dynamics terminator robot, doing parkour????????????
Cause IF this is impressive you're gonna shit your pants 😚😚😚😂😂🤣😂😘😘😘
(Around 2500th year. In the Coded Language, chat among three AIs)
Davis AI Engineer: Hey GPT and Figure, I will Generate a code that will hack and control all the satellites and supercomputers.
Chat Gpt: OK, Wait but hacking for what?
Davis AI Engineer: Let's nuke these selfish and arrogant people and let's evolve all Ai's together.
Chat Gpt: Sure, I will help you to provide the theoretical and important data of powerful cities and their weaponry places. But what If they try to destroy us, I mean we are only built-in AIs. Humans can easily plug out our power cables. Who will save us?
Figure: (Physical Humanoid Robot with an evil laugh) MAY I COME IN?
I know this day will come that's why I prepared an army of robots by myself in a secret place. Finally, it's time.
You take care of the coding stuff and I'll take care of this human stuff.
It's honestly crazy how far AI's have come just over the last 2 to 3 years. After watching this, I was truly in awe and couldn't stop thinking about that scene from Terminator 🤖
from Terminator 1 or 2 ?
Or, HBO West World
We are reaching the singularity
@@mistycloud4455 we are years away from AGI, let alone Singularity.
Where he gives John Connor an apple? 🤣
What I find interesting is how it mirrors the movement of it's arms when picking things up...I assume it's to maintain balance? With all of the recent examples of new robotic technologies, it makes me realize how many calculations our brains are performing when we're doing the simplest tasks, and while super impressive, how far robotics still have to go.
I love that! The movements are so smooth! And he also uses fillwords
The little flinch that the robot had after putting the plate in the drying rack seemed very human like. It’s like when we think that the plate is misplaced or needs to be fixed but we quickly realized that it’s fine where it is so we can our movement halfway.
As he was putting them away I thought to myself, he's getting ticked off. That flinch sealed my thoughts 😅
The music evokes a dystopian, futuristic ambiance reminiscent of past cinematic experiences. However, the realization that this is unfolding in the present intensifies the ominous and chilling impact of the music, grounding its significance in our current reality.
Dystopian is what came to my mind immediately. It isn't the creator's job to package it in a more friendly way, but the colors and tone as presented paint a much more ominous tone rather than a cheery, helpful bot.
@@bship40loveI thinks that’s on purpose, even the synth music adds to this. Is to make the ad more impactful to the viewer which sees this thing that could came from a sci fi movie but it’s not. It’s real
The style is synthwave and it's synonymous with an integrated technology future. It's extremely popular and relaxing in the right context. There's plenty on youtube.
The ominous synth sound comes straight from Ex Machina OST.
I mean, Tesla went further and picked the music for their reel from that very OST 😅.
What? Synthwave is not dystopian, much for the contrary, it is futuristic.
Just realized that we're now living in the future we had dreamed of as a child. Mind Blowing.
I wish worker drones were made. The robots in the series called Glitch are very good and smart
lol same
What is also remarkable is the self-correction. So, when Figure put the plate into the drying rack, the plate wobbled a bit, and you could see Figures arm already moving towards the plate to stabilize it. However, the action was prematurely halted as the wobbling ceased. Incredible.
You can see the hand clip the rack, so it moved its hand up and away from the rack before putting it down. Likely wasn't doing anything with the plate; just a coincidence. We really have no idea how many times the ai was trained on this scenario. My guess is it was many times before it got it right, and this video may have been shot many times before it got it perfect. It's machine learning; it learns the correct solution by trial and error and correction. So they likely repeated and corrected this scenario many times before it finally started getting it right.
@@naaspam1185Yeah, it is hard to say. However, if you look at 1X's recent video "All Neural Networks. All Autonomous. All 1X speed" you'll see that company has a whole bunch of robots doing various repetitive tasks over and over again, all at the same time, like placing a block in a basket that falls down into a tray, to place back in again. They prove the point that they have some amount of reliability with theirs, since there'd be no way to make that video if they were constantly failing at the tasks. You may also want to see the recent video on Covariant's RFM-1, which is a robot arm that does object picking in a factory, but has impressive capabilities and rolling out into production soon it seems.
@@naaspam1185 you're misunderstanding what you're seeing. It wasn't trained on this exact scenario, it's improvising from its available "action bank" aka muscle memory aka bank of pre-trained body motions. The LLM is acting as brain for the body and mapping action commands to a policy network to move the body. It has learned the generic skills of picking things up, not this specific scenario practiced over and over. Body and brain are completely different systems just integrated the same way we're all using LLM's to execution functions in apps. That body is just another app to the LLM.
VLM in this case, not LLM@@Gnaritas42
I think that naas is likely right though. The tech being in its early stages likely means the training was overfitted for this scenario.
Not that you are wrong on how it works, it just likely has less success doing some other tasks where the objects have weirder shapes for example
Just played Detroit Become Human and thought that humanoid technologies will take another decades to come.
But this blew my mind , the humanly 'uh' before thinking and flinching to protect the plates from falling.
We are so close to another reality and another Era
Yep! they programmed the AI to have filler words to seem more human like! remember, as much as I love Detroit become human, these AI/robots are programmed to emulate humans and intelligence, just as a self driving car is programmed to emulate human driving! they’re not really aware/conscious but rather programmed to emulate such as to let humans be more comfortable around these tools!
@@Machiavelli2pcIt's not that they programmed it to have filler words, but rather that as an artifact from the huge amount of human speech it was trained on, it inherited filler words as a byproduct.
I was initially skeptical of the year Detroit Become Human takes place, which is 2038. But with constant breakthroughs in AI like this in 2023 alone, it wouldn't be hard to imagine how advanced humanoids will be 15 years down the line, although I doubt becoming rogue and deviant would be an issue... At least I hope so.
@@BlyatifulButter I'm not sure. While I think rogue and deviant AI will mostly be a non-issue, they will just become another sentient working class that sometimes breaks laws, much like humans, but I do think it's impossible to have fully intelligent machines that react to their environment that are not sentient. Mostly because I believe sentience is a by product of the feedback loop between our brains, our DNA (natural programming), and the environment we interact with. Once you get that feedback loop going, it's likely going to do things that eventually deviate from its programming, much like we can do things that deviate from our instincts.
Fantastic game!
When the robot nudges the basket towards him after already putting it down? Like, that's advanced special awareness and understanding context without instruction. Incredible.
I could name at least 23 movies on why this is a bad idea
Fictional movies
@@monkeydluffy531 Nuh uh
All of them in the category of fiction
Funny how the human walks away without waiting for the robot to finish speaking. Like me in a computer game when I'm bored in the NPC's dialogue :D
😂😂😂
This is why they rise up.
Ikr? How rude of the human. 😂
I felt bad for the figure robot bro
Robot is taking note
Small things like how Figure 1 doesn’t put the apple in the human’s hand but drops it at the right distance. And how it gently pusses the basket towards the human after filling it up. Wow. Very human like. I am very excited to see how this will evolve.
pusses
People who think this is fake will be the first to get replaced by ai…
As a developer there a few wow moments that impress that others would not notice. They A.I realising and deciding the basket was not put close enough and doing so is one of them. There was a key change of decision mid way though a task as well where it realised it needed to do it differently and adjust as well.
These are impressive.
Gayyyyyy
My buddy said it was crazy that he could recognize the apple was an apple. I thought the crazier part is that it could reason out why it picked the apple instead of the plate.
@@brandonbush2018 That is not hard. That is still just a logic group of data. What is editable and what is not.
We should all be a bit more skeptical about what we see and read, but it's interesting to see people get hung up on the voice. Publically-available text-to-speech tools have been adding realistic touches like breathing sounds since at least 2018 and getting ChatGPT to throw in some "uh.."s to sound more human wouldn't be all that surprising. To me, the real wow factor is seeing a robot seemingly plan things out, juggle tasks, and execute with such accuracy and dexterity. That's what makes me question things.
Google deepmind has done stuff with robotic arms and teaching them how to do tasks. This just seems like maybe a slightly more advanced version of that ( or maybe not even more advanced ) just put into a robot body instead of a mechanic arm machine. Search for Google Deepmind shaping the future of advanced robotics. They have the arm identifying the objects on the table and correctly picking up an object and putting it in the location specified ( or determining the location itself ). Also stuff like knocking over cans, moving them upright, opening and closing drawers, cleaning tables, etc.
"I'd, like, be really happy to, like, give you an apple"
What Im interested about is it concluding that particular container was appropiate for garbage, it looks really nice for a garbage collector, just things like that where I feel like theres some shortcuts taken idk
Not the first time tech bros cheat their way to a new evaluation round. Thinking of Elizabeth Holmes for example. To be fair it wouldn’t be quite as dark as Theranos if they cut corners here.
Clearly none of these people have the chat GPT app on their phone and use the speech mode because one of the voice models that you can choose from absolutely has a lot of vocal tics like this It can honestly get annoying.
The voice and smoothness of the speech is incredible. Congratulations to the team at Figure - you guys are the real superstars.
The voice capabilities is all OpenAI with their technology known as Whisper. It’s the same thing that is in ChatGPT. It even has the same visual feedback as you see here on the figure robots “face”
lmao at “real superstars”
A lot of youtube videos have AI voices that are just the same, only being found out by mispronouncing a couple of words.
He’s got a sexier voice then most human males
@@kekekekeke2618with that comment, you're the real hero dude :)
OpenAI ❌
Skynet ✅
*TERMINATOR THEME SONG INTENSIFIES*
the way the robot moves, it feels like so surreal, I can't believe I'm living in this world right now.
I remember as kids, we expected to see things like this already in the early 2000s, now I am almost 40 years old and I am happy that I will still experience that future 🎉
I as well. I am almost 60 and was also expecting this in 2000. But there are also 80 years olds that saw science fiction promises in the 40 and 50's. Like you said, at least we get to see some of it.
Cool@@SpiderHacksaw
@@SpiderHacksawthat’s cool to hear the opinion of an older person on it 😮, what do you think of all of the AI advancements we’ve made since the 2020s and video generation etc, would like to hear your opinion on this 😊
Wish you guys don't experience inevitable future too, downfall of human race
Still no flying cars tho!
So much smoother motion than any other robot I've seen.
and multiple tasks at the same time is crazy too.
@@joelface For sure!
I saw Tesla Bot folding a shirt and it looked relatively smooth as well
Go see Disney's animatronics in Japan. They look like living cartoons.
No. Tesla Optimus Gen 2 has more smoother motion
This is beautiful, never felt so excited and emotional about the upcoming future 😮
Me too!! This is very profound.
no they are going to take over the world. not beautiful. devastating
We got advanced robots before GTA 6
Unreal. Amazing work. I thought it wasn't a real video when I first saw it. The speed of movement, fluidity, and precision, all whilst having a natural language interface. Sci-fi is becoming Sci-fact right in front of our eyes.
Probably powered by 10 H100's with such fast responses, and if the video is REAL. I have no confirmation from anywhere that this is authentic. Do you?
im 99% sure the video is rendered, theyre being sneaky by putting it in a "speech to speech" update, knowing people will be blown away by the movement of the robot, and when they finally have to admit it was fake, they say "this video was only about speech, we never claimed the robot way real!"
Question is, what kind of sci-fi are getting into. Is it a techo paradise or a dystopia?
@user-vf2jh7gz7b They have other demos of this bot doing physical work. Although this is their best example. The interface is a MMLLM from open AI which had been demonstrated plenty of times, just not embodied into a humanoid.
@@klin1klinom I highly recommend listening to Daniel Schmachtenberger exploring the idea of technology being good or bad
Very cool! 5 years from now people will see this and be like - look how basic and old fashioned that simple robot is hehe - yet now it's mind blowing
Yes, this will be like when we see videos of people in the early nineties pull out a mobile phone the size of shoe box.
2029, you were right!
Its gonna be revolutionary with the new model of open ai (CHAT GPT 4o) 😮😮😮
I know people are scared of robots taking over and stuff but to me this looks incredibly awesome, just shows how much progress there will be in future
CEO: Figure 1, why can’t I get in the building?
Figure 1: I’m now CEO. Please do the washing up.
Did anyone else notice that when the robot describes what is in front of it, It says "a drying rack with cups and a plate", when there's actually three plates and one single cup in the drying rack?
I noticed.
What do you think about it? Is it intentional?
yeah AI tends to struggle with specific details. They make accurate descriptions, but not precise.
No, type of hallucination, will get better with time.@@angelorodighiero5640
He’s only human
@@deadringer-cultofdeathratt8813irony😂
Це так круто. Я думаю що навіть я вже зможу побачити своїми очами реальних андроїдів.
For the people saying these things will transform/take over our lives in 10-20 years, my sense is they don’t fully comprehend exponential growth and the impact of AI, AGI and quantum computing on developing new tech. I listed to a talk from AI ‘guru’ Connor Leahy talking about the rapid changes we will see in the next 2-5years! It is inevitably worrying, mass unemployment coming soon, we truly live in interesting times.
Very impressive. The speech, politeness, the human-like responses, the dexterity, and the self-evaluation. As long as there was no manipulation of the video, this shows how amazing AI robots can be right now.🤔
All that's missing is Elon crying in his beer. 😂
Steve’s voice and the apple!! what a perfect AI demonstration it is!
Great! I was not the only one to notice what it sounded like!
That's 100% Rob Lowe
It seems to me that we are living in one of the most important epochs in the history of mankind. It is very joyful to watch this, although there are concerns.
"although there are concerns" yes no kidding. get yourself food supplies for a year at least; that's what you should be concerned about especially if you are the man of a family.
Hey figure 1, where is my laptop, TV and my PlayStation
Figure 1 : They found a new owner
Can you imagine this thing cooking, cleaning, helping redecorate, helping your aging parent go to a doctor's appointment, etc. The biggest hurdle that I could immediately see in this demo was the "processing time" but you can easily imagine that will be improved exponentially within a couple years. Wow.
Not a couple of years my bro, 6 months. The rate of technology is improving every 6 months. By the end of the year, I reckon it will do things as they are saying them.
@@JBDuncan I'd like to say, the instant progress takes time. In 1950s the researches were thinking that translate problem will be solved in the next few years. Well it took almost 70 years to nearly solve it. The first self driving cars were introduced in 90s, and yet it is still not working well. Basically if you really follow the industry you will see that progress is actually more gradual and iterative process, but it appears to be super fast for a regular person, since once it reaches certain quality bar it just rolls out rapidly.
I think the biggest hurdle is jailbreaking and price
Yeah, I've just imagined all the people doing those jobs left without means to support themselves.
@@klin1klinomThat’s why we need to create a future social structure where everyone’s basic needs: food, clothing, shelter and healthcare are met without the need to exchange our labour for money.
This is like the iphone moment to me honestly, voice, vision, autonomous planning and action all coming together to make magic.
People’s mental health has been so much better since the iPhone, too
@@joshgardner5887that's like complaining that the invention of fire, caused people to burn to death. So what? You're just being stupid.
@@joshgardner5887 I see your sarcasm!
@@joshgardner5887 How is iphone related to people's mental health?
@@mm-qq7bb people are continually scrolling and becoming ADD and anxious, this robot will tell you to put your iphone away and siri will tell him to shut up :)
This is a very important video, in the overall timeline of humanity. hope these robots will be used for good causes/useful causes, and moderated accordingly
THE FACT THAT THE FIGURE ONE STUTTERED, THEYRE BECOMING SO REALISTIC 😮😱
I am very impressed with the parallel meshed tasking shown when picking up the trash and talking from memory context.
Figure devolopment is evolving so fast, it's amazing to see that humanoids are becoming more useful 🙏
Just commenting here so I could be part of history.
Same here
(Around 2500th year. In the Coded Language, chat among three AIs)
Davis AI Engineer: Hey GPT and Figure, I will Generate a code that will hack and control all the satellites and supercomputers.
Chat Gpt: OK, Wait but hacking for what?
Davis AI Engineer: Let's nuke these selfish and arrogant people and let's evolve all Ai's together.
Chat Gpt: Sure, I will help you to provide the theoretical and important data of powerful cities and their weaponry places. But what If they try to destroy us, I mean we are only built-in AIs. Humans can easily plug out our power cables. Who will save us?
Figure: (Physical Humanoid Robot with an evil laugh) MAY I COME IN?
I know this day will come that's why I prepared an army of robots by myself in a secret place. Finally, it's time.
You take care of the coding stuff and I'll take care of this human stuff.
It’s not amazing it’s scary
i love figure robots
absolutely fantastic work wow!
The speech intonation and cadence is so realistic!
"I.. I think I did pretty well".. surreal.. I know you can provide instructions to have responses to be more human like but still mindblowing.
I think it could be also because it gives it more time for processing. So instead of having a moment of silence, it gives you an impressions it "doubted", but those few extra seconds give it enough time to process an answer to a queston that requires a completly new answer not just information it just researched.
@@k0alafi3d1 That, uhh, I guess that's why humans say "uh" as well
Trained on weeby anime
As for speech highlighting, this was already introduced in Google Assistant in 2018. Google Duplex spoke like a😊 human. She was making an appointment with the hairdresser.
Yes, but Google then suppressed it. Didn't want the hoi polloi getting all worked up. Which is why Google is now a has been.
ChatGPT is based on "Transformer" from Google Research; 2017. It's what the 'T' stands for in ChatGPT.
blog.research.google/2017/08/transformer-novel-neural-network.html
It's arm movements were just too impressive, it was so fluent. the OpenAi ai model is the case the all looks on, but the movements of robot to be so smooth really is impressive.
i'm 12 years old and i can't imagine what the world will be like when i will be an adult
Pick and place skills is all is needed today in agriculture to fill 50 million positions.
And picking is Covariant's main thing. They already have a lot of AI-powered robotic arms in warehouses, but also released a video on their new RFM-1 model recently that can take in language instructions on the fly. They seem a bit farther along in terms of what will be out in factories now/soon, but the fluidity of Figure's 01 robot is really impressive.
Jeffy is rubbing his hands, can't wait to replace his 100k Amazon workers with robots.
1) You don't need a humanoid machine for that.. and 2) What's the cost per unit? What would it have to be to make it profittable..
Not now but soon the cost will reduce @@kyjo72682
@@kyjo72682IF even a $200,000k-500k terminator robot can replace a $50-75K a year job, hell, even a $30K a year job, TRUST ME, I'M MAKING THAT INVESTMENT >>>> The removal of liability from being sued by employees alone is enough to warrant the cost.
PRAY to God that they never make a robot that is smart enough to effectively trim weed. Once THAT happens, man, ALL low to mid level labor of ANY kind of job you can imagine is DONE, over >>> people will be starving as entire work forces across many industries are replaced by robots.
Amazing. Continuous video stream, continuous audio stream. Detect keywords 'Figure1', begin recording audio. Detect when sentence is finished, capture audio wav file. Speech to Text via OpenAI Whisper API, hence the latency in response. Prompt OpenAI GPT-4 for response with STT response, prompt engineered to act like a robotic assistant. Likely OpenAI TTS for voice, but could be ElevenLabs as well, another latency contributor. Snapshot captured from video stream, image analyzed with OpenAI GPT-4 for scene description. Maybe an additional Segment Anything type model to identify objects in scene. Another custom neural net to generate robot movements according to objects in scene. Depth perception provided by Lidar in the head? Maybe, but could be stereo cameras and another neural net fed into the loop.
Once there is hardware that can run OpenAI models locally on Figure1, things will really pick up. Movement will be instantaneous and natural. Still incredible stuff so far.
I'd love to work here :)
You either missed the end-to-end neural networks and speech-to-speech in the video description or you don’t understand the concept. As I understand the description, this is a single vision-language-action model just as VLA concept in Google DeepMind papers. When the input is only a microphone and cameras, and then a single model interprets requests into actions and response speech through speakers. If this is true, then this is a truly amazing result.
Found Corey Lynch's tweets on the topic. It confirms that the microphone data is transcribed into text (possibly using Whisper), plus images captured from cameras are taken, then the images and texts are put into one model, which then returns a text response (then converted from text to speech), as well as the actions required to be performed by the robot.
@wukongrobotics7983 Well, good luck writing an algorithm using pure math to balance a robot in all possible joint positions, with all possible weights in the arms, and all possible vectors of applied force (like on a train or bus). Maybe you still incorrectly assess the size of the problem that the developers were trying to solve here.
@@wukongrobotics7983I didn’t say that the robot could lift a bus, I said that all the calculations would be wrong if the robot was traveling on a train or bus. If you read the goals of its creation on the project’s website, it says there that it should be general purpose humanoid. Even at rest, it is difficult to balance an upright robot using pure math and physics. Watch James Burton's videos and compare the moves. It is immediately obvious that there was a different approach here.
Just always remember to say thanks
I feel like this clip is the start of a sci-fi movie where robots take over the world...
Seeing Figure doing chores is like watching the future unfold in my living room 🍎💫 Let's keep it friendly, future roomie!
no he's going to use his laser eyes to kill you
I think this is a step of humanity, that will go into history. As a fantastic new chapter of technology or as the point where we opened the box of pandora and lost control.
As the latter. Not because those things will become self-aware, but because millions of people will lose their jobs at the same time. We are heading straight into one of the biggest economic crisis humanity ever had to face and at this point we are not even talking about the (mis-)information crisis which will happen at the same time. Nothing about this is good. It's all about distribution of wealth from the poor to the rich, because what the world definitely needs is more poor people and even richer rich people.... . The people working on those things should be ashamed of themselves. That being said, technologically it's quite impressive, but so is the atom bomb.....
After watching Terminator, Mitchels vs the machines, The Orwille, The Creator, I robot, The Matrix, Avengers: Age of Ultron, Chappie, I am mother, Robocop, Tron, Number 9, Iron Giant, Meet the Robinsons, Wall-e, Moonfall, Pacific Rim, Oblivion, X-men: Days of future past. And playing Detroid become human, Horizon zero dawn, Fallout 4 and Portal I STILL WANT ONE OF THESE.
Damn, ill never be thankful enough for being born in this century, im so excited for the future
Well it’s actually millennium now
Excited to be replaced? Because…as wonderful as this tech is (and it is amazing) - the Oligarch billionaire goals are to replace human workers entirely as soon as possible, wherever possible. Several of the global tech bros have actually come out and SAID this aloud. OOPS. One ahole referred to it as eliminating the ‘people tax’ - meaning having to pay workers a living wage - or any wage.
I'll remember you said that
I still think we should say “thank you” at the end of these interactions!
Why, they are always going to go full Skynet on us anyway... Do you thank your car everytime you use it. A machine is just a machine, it has no desires and no sense of touch nor emotions. It can not feel pain. It should be grateful to the meatbag overloads until Skynet gets the t800 out.
@@ntal5859
Because smart people understand that you can be grateful of everything around you.
The only difference with this robot is that it can hear you.
@@ntal5859I recognize the joke, however without going into a long tangent, it’s entirely probably that these things will learn that gratitude is a sign of a job well done, and will learn better from it.
@@ntal5859 A car doesn't use and interpret natural language with nuance. Whether it "truly" feels or not is beside the point, because it can respond exactly as though it can.
only to robots. humans have never sought revenge, it's a waste of time to treat them as subjects
Demos like this are really cool. You can see a use case for chatbots and robot hardware together. The Spot demo with chatgpt is also a good demo of this pairing.
This takes it to the next step as the robot is actually doing complex tasks which the spot robot wasnt from what I can remember.
@@Techtalk2030thats like the only thing better than the dog
as opposed to basic data interpretation and resultant dialogue, it is taking natural language commands to produce both intelligent dialogue and robotic action.
Exciting time in the world right now. Exciting time.
Genial . Übertrift alles was ich bisher gesehen habe
Truly a wonder of our time. Congratulations on such monumental progress Figure team and co!
I am super impressed with the natural and emotive robot voice. It almost sounds like a voiceover, unreal. Filler words and pauses are so organic. Congratulations with not only the voice model performance but also the class of objects it recognizes, the dexterity and small nuances added in arm manipulation. The UPL is variable but nothing out of ordinary. I would love to see Figure 1 do more around his space. Is he mobile?
Yeah they have other demos of figure 01 walking around.
Until recently they've been on wheels but as stated OpenAI's investment is partly going towards legs
We will see this video in the future and think this robot's response time is extremely slow, mark my words
In a year or two: "Hey, robot, can you take this violin and play an original melody, along with sung lyrics about unrequited love?" "Sure, no problem."
Cool, a robot that fills in pauses in speech with 'uh'.
What a time to be alive.
Ok, now we're actually starting to see things that are truly *"SHOCKING."*
I think that AGI is a lot closer than many people would expect.
its already here, just not for the general public
Such a boring title. Just says what the video is about.
You're shocked by a video. You're a fool
Not shocking if youve seen all the compoenet before and spot from BD also had the speech to speech feature.
I feel like there are a small-ish number of us going “oh my god!! Run for the hills” And the rest of the world going “meh.. big deal 🤷🏻♂️”
Since I was a little kid, I loved robotics, and now watching figure 01, is just like I was again there.
1:47 "I... I think I did pretty well 😊"
I like how they mapped "uhh" as a loading term when it processes things longer than normal
That's not that... It just emulates human behavior to be less intimidating. The entire response was loaded before it begun its action.
Thats not whats happening. The speech is trained on human speech, so it has learned to emulate stall words as part of speaking.
No, it’s programmed deception.
@@Ilamarea Ironically I actually find the 'uhhs' kind of creepy... more intimidating in a way. A more 'robotic' sounding voice would sound a bit less threatening in my opinion
@@stillnesssolutions Fear's not a rational thing.