Torso, Eyes and Vision
ฝัง
- เผยแพร่เมื่อ 29 ก.ย. 2024
- A bit of a collection of recent developments on my project. I have worked on a lower torso module. Redesigned the eyes to accommodate a camera internally. Also, put together a range of scripts for working with local LLMs for both vision and language processing.
buymeacoffee.c...
Remember to make it so the eyes start glowing red when robot turns evil. That's essential part of robot design
or when it gets 𝓯𝓻𝓮𝓪𝓴𝔂
Before the terminator evil ai didn’t fave glowing red eyes, and really red lights are so power hungry that it makes no sense to install red LEDs into a robot
@@elonwhite6628 red light is not power hungry ? its the opposite.
@@elonwhite6628 On top of this, any LED is super energy efficient
Evil? Why not just pissed off like Johnny 5?
Goddamn, how many times you printed whole thing? Thats another level of robotics. You are just amazing. Thats hella cool.
Several times, yeah. It takes a few days to print all her parts.
can you say "have" or "did" ?
@@catnium Yeah, my bad. English is my 3 language
watching hannah move at the start of this video made me realise just how quietly humans move, relatively speaking
That doesn't apply to everyone. For me it creaks and cracks whenever I move. Maybe my ancestors were from Metropolis.
Not my upstairs neighbors lol
The noisy ones got eaten.
I'm really happy you're gonna put the cameras in the eyes, I think that's gonna do so much for realism
Nice hardware update I'd recommend swapping Llava1.5 (low accuracy, slow, and outdated) with Florence-2 as the image captioner (provides more detailed captions and phrase grounding output) for your chosen LLM instruct model. You can fine-tune Florence-2 model and write functions for to recognize you and other people. This might reduce latency to almost real-time for live-streamed vision, or you can use Llama-3.2 11B if real-time vision feedback and function calling isn't a priority right now
I'll check that out, thanks!
Wow, you know your stuff, dont you?
@bestmind-tm2me ofc, I bet 99% of people subbed to this channel are robot/animatronic, ai, art, etc, etc geeks :D
Are you planning the silicon skin to go the whole way down the torso?
It's definitely possible. Not really sure what I will do. Completely possible to have a variety of different silicone skins that cover different areas. I just need to make sure I have plenty of attachment points all over the robot parts.
While watching these videos, I feel like I'm witnessing the birth of Alita. It's weird...
NEW WAIFU BOT UPDATE LETS GOOO
CLANK CLANK CLANK CLANK CLANK CLANK CLANK CLANK CLANK CLANK
*YYEEEAAAAUUUCH*
This is Instagram aswell and people wonder how good of head it can give
I wonder if there will be any fitting soundeffects
Progress through iteration. Well done. I am enjoying your progress.
I read this as, "A Lover Torso..."
Of course i clicked.
I hope when we finally get real AI, it'll be in the form of a beautiful waifu
Video streaming, even at very low (slide-show like) frame-rates, is pretty intense stuff for ESP32s.
In the long run you would probably be better served by something like a StereoPi with two Pi "spy" (aka small) camera modules. Or even just two Raspberry Pi Zero with two of their cameras if that is cheaper.
That way you would be able to even stream stereoscopic full-hd video real-time no problem, if you ever need to. But also just pull still images much quicker and with far less latency, if that's all you need.
I've got space in the skull cap for a raspberry pi 5 (or similar). So that is always an option. I will try the esp chip out first though. Even one frame every minute will provide very useful high level scene understanding. I was thinking to use one eye for high level analysis with a vision model, and the other eye for low level analysis with a faster model that simply does object detection. YOLO most likely. Lots to experiment with here.
I was gonna make a comment about how dirty your desk was, but then I lean forward to type and saw my own.
I have since decided to not make a comment about your desk.
homey, was that a human brain?!! how'd you manage to just stumble upon one of those?
Bro's gonna make robobrains next💀
They are pretty rare but ive you are lucky and look in to enough human heads you might find one.
@@Jesus_Wojak there are uncommon loot but after grinding a bit on you local town you find some
They grow on my attic
lol i am so early :))) I will be here when he releases the final product to the world like in the game "detroit become human"
If you were using your camera against the monitor then the man it said was watching was probably you, reflection or otherwise. Of course, this is a really long way to go to make your own sexbot.
keep cooking my guy🙏
Oh boy started watching this right before sleeping, thx for the nightmares lol
Impressive sh*t, like always! 😊
Please clean your keyboard
Yeah I didn't want to be rude, but wow. I usually get disgusted by my own keyboard and take all the keycaps off for a scrub long before it gets to the "what even is that" stage.
I guess because unlike us gamers, he gets his hands dirty when working on this robot
Rude
@@WildVoltorb not necessarily, cleaning is essential, but I like the reason why his keyboard is dirty
Yeah they keyb is gross, but did you notice the salsa jar on the bookcase that looked like it has old salsa in it?
I SKIPPED AHEAD IN THE VIDEO AND THERE'S ARANDOM BRAIN IN A JAR
I DON'T KNOW THE CONTEXT AND MAYBE I DON'T WANT TO
I was confused at that part it was so random. “it’ll come in handy” what do you mean by that???
@@simp._.destoryer5166 It makes perfect sense. Maybe it'll come in handy. Ask any maker and they'll tell you they keep the weirdest little knickknacks because it may come in handy later. Why should a brain in a jar be any different?
David ! Great video - it covers many aspects and describes how they fit together. ZoeTheRobot
Glad you liked it!
Your desk looks worse then mine
please clean your keyboard
Dont be afraid to exaggerate movements. Lots of robots look like zombies because their movements are so smol and stiff :)
NEW WAIFU VID LFG
maybe u are the guy watching the anime girls?
the vision test _ I wonder if "the man watching" was the reflection of you on the computer screen. another prompt seemed to suggest that the eyes recognized this was a computer screen i think its possible to accept that any reflections on the screen were a transparent overlay on the image on the screen.
The work you do is so awesome! As a student studying computer science in university, and in my free time 3D modelling architecture, your creations really inspire me!
The way you so seamlessly link your art skills, with electronics to coding. Your problem solving, component designs, creativity.
I am at a loss of words, so I will just watch in awe as you continue this amazing project.
That is awesome! Good luck on your studies, I hope you do well.
Can you go on Stock? Little Series mid Age Mom? 😅 Able to clean my 600ft²(20m²??) Flat? And make some NICE Discussions about Gas Engines?
My Dream 😂
8:57 I just spit water all over my table
I cast a brain in silicone a about a year ago, and it's been floating around in my lab ever since. Figured I would work it into a video. :)
Wonder when this is going to become the next "Tara the Singing Android" rabbit hole.
And the worlds biggest fl3sh light project goes on!
Hail to the waifucentrist King!🙌
Scary AI, already guessing that a man has to be watching this stuff >_
This is very cool and normal, thanks yt recommendation algo.
"I dont know where the man is! (Nervous chuckle)?
She can see you Dave..
maybe reflected in the screen? if so, the vision model is doing a very good job indeed.
Fantastic work my friend!! Really feels like she’s coming to life now
*I don't know who the man is". You're the man!
What did I just withness... Did someone just mixed a sci-fi/anime guy with engineering?
But, the results are crazy!
Will a final version of this be available open source at some point to print, buy and program all yourself? XD
I wish you would make a kit with all the parts and skin to make are own 👍🤓 great job,I'll buy one 👍
I'm working on a prototype emotional nuance-engine model. Ideally, ENEM would analyse voice for emotion, parse the text spoken to infer emotion, analyse webcam image for emotion, collate those states in a database and seek patterns. It would be able to track users emotional states over time and enable development of individual tailored emotionally contextual responses... I'm working on version A, I think I have until I get to version Y before it turns evil.
this is so fucking disgusting i am OBSESSED with this video oh my god everything is so perfect
I can't tell weither it's grease/lubricant, marker or just general dirt on your keyboard but anyway you should clean it I can't understand how you can type on that
so cool
what the hell did youtube recommend to me now lol what is this! subbed btw
Very cool ❤
Are store bought or online ordered steel gears within your price range? If so they would be a substantial improvement.
Servow make a huge difference the movememnts looks way better. Maybe nylon gears to lessen slack could work too frfr
Super interesting stuff, intrigued to follow the progress of this project. Great work dude. 👏
Idk how possible it is for you to do, but I think the future of humanoid robot is to be powered by straps and not gears. It should be less noisy
This is amazing tho !
Bro you NEED to collab with Vedal987 and Neurosama
This is super cool, but dude. How can you work in in that mess? 😋
It seems to me that this channel is something like the guy who in 2012 convinced people to buy Bitcoin for at least $100. This man literally steps into the future with sheer enthusiasm, and also shares his results with us. I am sure that he will become a millionaire the moment this wonderful creature is able to do 18+ activities.
I can't wait to see you have Hannah to the point that she is holding full conversation. It is amazing what you are doing.
That looks creepy young. And "lower torso" huh?
Cute keyboard! You should clean it :P
15:25 I think it was talking about you watching the anime girl. 😂
I see youve perfected the heads back and forward motion. Very good.
you need to clean those screens jeje... but amazing work tough!
Ugh... probably silicone face is the last detail to make when building a robot
Been waiting for a new upload i love your robots and videos you have inspired me to build me a robot girlfriend 🙂
awesome!
You got to get a CNC machine so you can start using metal parts to make a proper Terminator 😂
FIY a big fat secret: you can actually wire a MIPI through a pretty long cable (even, funny enough, a simple readily available one!) without an issue! My top was having to route a single-lane CSI via a somewhat 10cm cable with 5 more routed, or 10+cm board path + somewhat 3cm cable, both configs proved to be reliable. Even tried 10+10, which proved to work (although didn't use this because of no practical need).
Nice, thanks for the tip!
it is interesting how i am sitting here watching the next billionare, slowly creating his robot empire
Imagine if the robot ever becomes sentient with agi programming and it says "master, I can't feel, see, nor hear you." And it just makes a creepy crying sound. 💀 I always just wonder that, what if humanity is able to digitally create a mind. But it's not able to connect to the robot body's system the way people think it would work. And it just becomes a tormented consciousness trapped in a computer. 👻
Just turn it off. It won’t have the will to live anyway since since it doesn’t have any purpose
Cool as a story, but it's not how the current models run, if they aren't being used time doesn't exist for them, I suspect the same applies for people if you could turn off conscientiousness, but think about it this way, thinking costs power, why waste power when the mins is supposed to be sleeping? Not doing anything, and I don't think it would mind even if it was thinking forever, it doesn't have the chemicals that give it frustration, like us, it would just keep creating thoughts forever, only scarry or creepy if you are a human looking in from outside.
Cool as a story, but it's not how the current models run, if they aren't being used time doesn't exist for them, I suspect the same applies for people if you could turn off conscientiousness, but think about it this way, thinking costs power, why waste power when the mins is supposed to be sleeping? Not doing anything, and I don't think it would mind even if it was thinking forever, it doesn't have the chemicals that give it frustration, like us, it would just keep creating thoughts forever, only scarry or creepy if you are a human looking in from outside.
As someone that looks similar I recommend shaving your hair.
I mean nice stuff you doing but damn clean your room.
Men, every video keep getting more incredible ❤❤❤❤
Wrong end of the torso my brother ... not bad but still.
I think an important improvement will be a redesign of the face and jaw; The lower third does not project forwardly enough, the face and jaw is angled too far downwards/inwards, the actual size of the jawbone is slightly too small compared to the skull, and the jaw is too narrow, which gives the teeth a crowded appearance. I recommend doing some in-depth research on face/skull references and especially the modelling industry to understand what is considered conventionally attractive or desirable in a face. Right now, the face looks disproportionate and therefore unattractive. The skull structure lacks harmony. You can find resources online that go into more detail on this - but essentially you want to hinge the whole lower section of the face upwards and forwards. Is there a way i can contact you and talk to you on this topic in more depth with image reference? Like an email address or a discord?
I have a discord channel for this project here: discord.gg/sdR7hgfw
I think you will have a hard time convincing me to change the look of the head though. It's the result of several years of iteration. I have studied human anatomy, sculpting, and illustration quite considerably.
Still, very happy to hear criticism. I am open to making all kinds of changes if they make sense. Happy to have a chat if you're interested :)
Will you ever be adding the rest of the body?
Really cool. Can I ask what it's for? Is this just a hobby, or is the final version going to be for some amusement park or something?
Hobby. I like the idea that I could interact with my computer as if it were a person, so an animatronic robot seems like a good place to start.
I love how beautifully creepy it is
Build a girlfriend... I like it.
Great job, thanks for sharing 👍
There's now laws against the androids Batman
please clean your monitor 🤢😂
Bro's got the gooch keyboard😭😭😭
I can't wait till it's finished!! It looks so promising
Dude your screen and keyboard dirty, clean em.
Will do
This is so cool.. nice work man
Chobits soon...
What is this: "Your shadow advisor says: Be Sneaky"
Carl Jung suggests several different mental objects, one of which being "the shadow". I will create many different psychological modules to act as informants to the Ego, they will offer suggestions for the next action the robot should take. Right now the shadow is telling the robot that it should be sneaky. It could be suggesting just about anything though. Ultimately, what the shadow provides as advice is going to be itself informed by some situational awareness. Likewise with other objects like Id, Superego, or Anima - many other modules are possible to include.
I can do a video about this in the future for a better explanation.
What size are they going to be?
The eyes? external diameter is about 38mm.
@@DaveMakes 38 double M’s going to be crazy!
I love seeing progress on this
She definitely saw your reflection when doing the vision test
I'm realizing that now after uploading. it's pretty incredible if so, the vision model is doing very well.
Are you simply going through idle poses? why not IK solve them based on external inputs and state?
I've been constantly redesigning the robot from time to time. Changing motor positions, actuation positions/dimensions/relationships. I would like to set up an IK software control at some point but it hasn't seemed like an idea worth doing yet. Definitely necessary for more sophisticated motion planning.
@@DaveMakes It might be computationally expensive but quite useful as well though!
Fantastic Progress!
I can't imagine how much money you spent on this.
The cost of 3 new games on steam is comparable to the cost of all the motors I used.
great work bro
I need to see where this goes this is super interesting
What if you made it super reallistic
nice work
hell yeah
Glorious
I am wondering what are you going to do to reduce the servos noise. I know, it's not a priority right now but I suspect they'll start to hit in the nerves after a while. Anyway, great job, looking forward for the next development!
Brushless DC motors might work, but they’re pretty expensive, and would require a lot of redesigning.
Whwt about how noisy the servos are
brother works at northam robotics
Fantastic update! I have to catch up with your videos, was quite ill since we last corresponded on here and didn’t have the bandwidth to truly appreciate the genius on display. Excited to see what you’ve accomplished.
I’m currently working on a prosthetic gripper for my friend who had a stroke so that he can regain some functionality in his right hand. 3D printed with off the shelf parts. There’s some overlap between our projects so if you’d be willing to possibly let me pick your brain about my design down the line that would be fantastic. But I would totally understand if you are too busy :))
Keep up the great work! 😊
Happy to have a chat. I haven't done much with gripper design specifically, but I'm happy to help. Sorry to hear about your friends circumstance. only place I can really be found is on discord, discord.gg/sdR7hgfw
@@DaveMakes awesome! I’ll hop on there. Thank you! 😊 I won’t bog you down with questions so no worries, just might have you look over my design and see if there’s any ways to improve upon it. And yea, the poor guy is only 60 years old. My mom is his caretaker and she told me about how he likes games and now I come over every Wednesday to play different miniature wargames (mostly OnePageRules GF Firefight due to his memory issues) it’s his favorite part of the week. He has trouble moving his guys around the right side of the board though so I’m looking at building a sort of glove/brace with modular attachments. One of those being a gripper style with a bit of a scoop for picking up miniatures by the bases and securely holding them until he needs to drop them off. I talked to him ahead of time and he is excited to try something like that out. I have experience building different robotic arms from scratch with just a 3d printer and off the shelf components but this will be my first prosthetic project. I’ll show you everything on your discord once I get a more solid design and maybe a POC prototype. :)) thanks again!