As someone who is only just starting with robotics I think this is an 10/10 video. Everything is explained clearly and with a lot of detail, the robot looks sick, and everything is open source. I honestly think YT needs more videos like this one.
Excellent well thought out and executed project utilizing multiple scientific disciplines as well as software development to facilitate the mechanical and electrical needs. Well done Sir !!! Maybe this is the next multi-million dollar science toy / teaching tool for engineering, physics, and software disciplines.
I really enjoyed this and could see the huge amount of work that went into it. I ran away with the idea though that you were going to have the ball returning to centre, but it doesn't look as though you would find that difficult to achieve. Thanks for the entertainment and learning.
I'm definitely curious to see where this project goes. I hope you keep keeping the technical bits in, even if it doesn't always flow with the algorithm.
amazing video!!! well done in my control class (which is years ago) I remember something about using the Fourier transform to fine tune Kp, Kd, and Ki, would be cool if you include that in the next video, would be cool even without, thank you!
You need to adjust the vertical position of the ball by knowing the difference in its size. 60 FPS seems more than what is needed. This way, you can determine the vertical speed and also control the overshoot.
Ive seen many of these videos but the impressive part is how clean and compact it is.Just a few pointers: •You could use a much powerful overhead camera. •Ball joints are producing a little unrequited wobble for the plate. •The algorithm to reject noise could pose a problem during bouncing the ball as it needs to determine the size of the ball. Overall this is a great project considering how well you explained it.👍🏻
These kinds of robotics projects are way more interesting to me than the usual attempts to make something more humanoid, as fun as those can be, because the potential applications are so much more broad. For example, the principles and formulas you used here are also used to adjust solar and mirror arrays as the sun moves across the sky.
Great video! I hope you get deeper in the weeds, maybe with IK motion interpolation, and predictive PDI control loops, In future videos. It looks on visual inspection, like the platform can't move fast enough to bounce the ball, so to my eyes it's an impedance problem.
Very well done! But, I can't resist. "Fix the motor to the base and attach the link to the motor." Interlinked! "The motor can now transmit power to the link." Interlinked! "Place the bearing at the end of the link and attach another link." Interlinked! Interlinked! Within cells interlinked! Within cells interlinked! Within cells interlinked! :)
was looking to build a test or control environment with a balance or camera case based on the magnetic levitation action, or a magnetic testing device to calibrate or measure the necessary placement of magnets within a case or mount to have a more reliable gimbals or drone like camera for mountain hiking, rock climbing.but my question becomes how to build something like this more for magnetic or motion detection to weight and consistently understand the more reasonable positioning of magnets within the case; contacting to understand software demands, establishing what sensors or device architecture would make a realistic controlled environment. im not sure there's software similar to what you've used in your project, but i love your work and would challenge you take your applied sciences toward the world of magnets and make a completely better selfie stick, no hands required!
Stopping bounces should be started by tracking the target height (and therefore the target size): starting from what (smaller than the size "on the surface") should one start reacting to its presence in the field of "vision" (pull the surface up as much as possible), and then track the rate of size increase (approach speed). When the target enters the "probable touch" zone (one should calibrate for the size of the target lying on the "surface" pushed up as much as possible), interpolating the progression of size increase between frames - begin the "bounce-damping surface fall" maneuver, proportional to the calculated target approach speed. One will probably have to calibrate for the target's "jumpiness" as well, to determine the effective number of target touches, before the bounces stop, relative to the maximum possible surface "fall" speed. Also, to more accurately determine the target size, one will have to use a camera with a higher resolution, which will load the graphic function... in the near future it is possible - to use shadowed side of target, for specifically orient the target on the "surface".
It's really cool. I was wondering if you'd be kind enough to pls share how you formulated the inverse kinematics. Perhaps as a document, in the description?
Super cool! I wonder how much more difficult this task would be if a second ball was introduced. I'm guessing it would be exponentially more difficult. Just guessing.
Fantastic video, but i think getting the robot to bounce the ball may not be as hard as you think. For one, there seems to be a impedance mis-match between the material you have chosen, so the ball doesn't bounce very high off the first bounce, and without a second camera to help predict where the ball is going to land, your robot has very short reaction window. So improving the impedance mis-match between the two materials you have chosen (hardness, density, elasticity) will get the ball to bounce higher, and you may need to add a second camera to help with position when the ball is in the air. but overall great video.
To bounce the ball wouldn't you need to code it in a way that identifies the changes in the pink ball size (moving closer or farther) and maybe put some marks on the glass platform to have the camera also identify the location and the altitude of that?
You can estimate height by the size of the image of the ball. Calibrating images of the ball on the platform at known heights could even give you a lookup table of size::height estimates as a baseline.
@@wilkstube I assumed it was something like. With a known default position of the platform, and assuming the object is a ball, it's diameter can be calculated based on the image. I know he's good for the math on that one, after the inverse kinematics lol.
I like this, i would like a video how to connect OV7670 wires... Friend and i got stuck trying to connect robot eyes to follow fingers and ball. Fantastic experience and effort.
Ping Pong 🏓 would be a great idea…Then make two and have em play each other with the ability to improve accuracy. (automatically maybe) Great video. BTW 😁
Excellent work! Thanks for sharing! I'm using the same servos(RS304MD) for one of my projects. I wonder for multiple servo control, did you use the "TB-RV71EH" and the "TB-22PP Hub" as shown in the RS304MD Instruction Manual for this robot? I didn't seem to see them in this video though.
Great video. I’ve seen many TH-cam channels complete this project and gloss over the inverse Kinematics. A full video working through this derivation would be extremely helpful. How does the control algorithm work if it’s over constrained with 3 actuators instead of just 2?
@@Koshiro_Robot_Creator All it would take - if I'm thinking about this right - is longer arms and a quick update to the arm length in the kinematics of the Brains.
Fluids are tricky and watching the cup from below doesn't help much. The car suspension and acceleration/turning are doing the spilling, so instead using a gyro/accelerometer would be the way to go. But don't drive too fast, or your calculations might need to predict the future...
if the camera detects when to move the platform based on how small it looks ( this is to bounce it) I assume u did it like that then would it be that the height change isn't big enough to accurately detect when to bounce the ball you would need an extra camera to detect distance well enough
It would be interesting to have another robot pick up the fallen ball back on the plate and then do million bouncing tries to train an AI that could bounce the ball even with the "low" framerate
Hi, are you based in Japan? I'm a software engineer very intrigued by AI, i want to know if there are communities or labs dedicated there...thx for your work btw, superb.
Wow, I had no idea this was an AI voice until I saw all the kanji on your math homework. And this is the fanciest one of these ball balancer thingies I've seen on YT, those are some primo high-end servos, weird they couldn't do the ball bounce trick? But only, two wires only coming from the pi. Nice. Also, why does everyone on YT always solve all the IK from scratch, is there really no existing libs or code written for this very specific case that's been done over and over that are grokable enough to be reused?
As someone who is only just starting with robotics I think this is an 10/10 video. Everything is explained clearly and with a lot of detail, the robot looks sick, and everything is open source. I honestly think YT needs more videos like this one.
Amaizing video, this is the project she tells me not to worry about.
nerdd
1:48 very nice cup ;-)
Best explanation of PID control I have ever seen in 18 years !!
It's just so nice when TH-cam does recommend something great in the feed.
This vid gonna blow up someday for sure... Subbed! Brilliant video
Thank you!
it kinda is blowing up
Great video, excellent explanation of PID control. Beautiful design too.
7:44 nice explanation of PID controller 🙌
The build quality is amazinggg!!!
Excellent well thought out and executed project utilizing multiple scientific disciplines as well as software development to facilitate the mechanical and electrical needs. Well done Sir !!!
Maybe this is the next multi-million dollar science toy / teaching tool for engineering, physics, and software disciplines.
You explained this in a very easy to digest manner.
I really enjoyed this and could see the huge amount of work that went into it. I ran away with the idea though that you were going to have the ball returning to centre, but it doesn't look as though you would find that difficult to achieve. Thanks for the entertainment and learning.
Thank you!
right. very detailed and thought out. then "guess" the pid 😅😊😂
Incredible project, with a high technical level. Congratulations on your work, Greetings from Spain
Bro just open my eyes on PID control
Just the fact that you're using Blender in Japanese is pretty badass and deserves a sub 🤣👌🏻 Not to mention the great content 👏🏻
I'm definitely curious to see where this project goes. I hope you keep keeping the technical bits in, even if it doesn't always flow with the algorithm.
amazing video!!! well done
in my control class (which is years ago) I remember something about using the Fourier transform to fine tune Kp, Kd, and Ki, would be cool if you include that in the next video, would be cool even without, thank you!
Awesome build
a great explanation on a PID controller
You need to adjust the vertical position of the ball by knowing the difference in its size. 60 FPS seems more than what is needed. This way, you can determine the vertical speed and also control the overshoot.
Very nice project!
I like the usage of a camera lo track the ball, and having it underneath for a compact design.
Very interesting and simple explanation with all the elements needed. Loved it and subscribed!
Thank you for sharing this project, this is one of the best videos showing a balancing robot. I subscribed to you man, keep up the good work.
Very difficult task, very impressive project and solution.
thumbnails: "never falls"
1st 10 seconds: falls
Ive seen many of these videos but the impressive part is how clean and compact it is.Just a few pointers:
•You could use a much powerful overhead camera.
•Ball joints are producing a little unrequited wobble for the plate.
•The algorithm to reject noise could pose a problem during bouncing the ball as it needs to determine the size of the ball.
Overall this is a great project considering how well you explained it.👍🏻
The issues of this robot are accurately pointed out. Thank you!
cool as heck. the design of the robot is also very well aesthetically pleasing; the math is made simple thanks to the explanations. good job. sub'ed
These kinds of robotics projects are way more interesting to me than the usual attempts to make something more humanoid, as fun as those can be, because the potential applications are so much more broad. For example, the principles and formulas you used here are also used to adjust solar and mirror arrays as the sun moves across the sky.
That's an interesting perspective!
This ball balancing robot will control the world one day with it's magic.
You can get FPS up to 120fps by playing with resolutions. Make sure 4 lane is enabled for faster transfer.
Cool video and project!
Very cool, if you ever do it again, make it a Robotern holding a ping pong Paddel. That could develop into a full blown ping pong robot
That sounds like an interesting project.
Very nice presentation, I discovered you today and I have subcribed to your channel. Well done! Thanks for sharing!
Nice work ! Very well explained
Great video! I hope you get deeper in the weeds, maybe with IK motion interpolation, and predictive PDI control loops, In future videos.
It looks on visual inspection, like the platform can't move fast enough to bounce the ball, so to my eyes it's an impedance problem.
I appreciate the great advice! I'm really interested in those topics!
Great work! Good way of learning PID indeed.
Awesome work my friend👍👏
Thank you for sharing🌟
Cheers 🕊️
Very well done! But, I can't resist. "Fix the motor to the base and attach the link to the motor." Interlinked! "The motor can now transmit power to the link." Interlinked! "Place the bearing at the end of the link and attach another link." Interlinked! Interlinked! Within cells interlinked! Within cells interlinked! Within cells interlinked! :)
Well played, maybe it could even run from 2049 blades
Amazing work!
それは素晴らしいのプロジェクトですよ。I am so impressive. I like it.
Nice video, really cool.
A great project, thanks for sharing.
was looking to build a test or control environment with a balance or camera case based on the magnetic levitation action, or a magnetic testing device to calibrate or measure the necessary placement of magnets within a case or mount to have a more reliable gimbals or drone like camera for mountain hiking, rock climbing.but my question becomes how to build something like this more for magnetic or motion detection to weight and consistently understand the more reasonable positioning of magnets within the case; contacting to understand software demands, establishing what sensors or device architecture would make a realistic controlled environment. im not sure there's software similar to what you've used in your project, but i love your work and would challenge you take your applied sciences toward the world of magnets and make a completely better selfie stick, no hands required!
Really great work!
Excellent project and hope you keep them coming! Subbed for the inspiration
nice video, i'm a beginner in the world of robotics
Stopping bounces should be started by tracking the target height (and therefore the target size): starting from what (smaller than the size "on the surface") should one start reacting to its presence in the field of "vision" (pull the surface up as much as possible), and then track the rate of size increase (approach speed). When the target enters the "probable touch" zone (one should calibrate for the size of the target lying on the "surface" pushed up as much as possible), interpolating the progression of size increase between frames - begin the "bounce-damping surface fall" maneuver, proportional to the calculated target approach speed. One will probably have to calibrate for the target's "jumpiness" as well, to determine the effective number of target touches, before the bounces stop, relative to the maximum possible surface "fall" speed. Also, to more accurately determine the target size, one will have to use a camera with a higher resolution, which will load the graphic function... in the near future it is possible - to use shadowed side of target, for specifically orient the target on the "surface".
nice project, you won a sub, i hope you'll do more :D
It's really cool. I was wondering if you'd be kind enough to pls share how you formulated the inverse kinematics. Perhaps as a document, in the description?
Or a separate video. I would watch it, for sure! I was a bit sad that he just brushed it off as tedious and boring.
Let's make that video! Please wait a few days.
Mission accomplished! Great work!
jumping may be hard because of the camera position, it hard to determine height
This was awesome man. New subscriber ✌🏻
Super cool! I wonder how much more difficult this task would be if a second ball was introduced. I'm guessing it would be exponentially more difficult. Just guessing.
Fantastic video, but i think getting the robot to bounce the ball may not be as hard as you think. For one, there seems to be a impedance mis-match between the material you have chosen, so the ball doesn't bounce very high off the first bounce, and without a second camera to help predict where the ball is going to land, your robot has very short reaction window. So improving the impedance mis-match between the two materials you have chosen (hardness, density, elasticity) will get the ball to bounce higher, and you may need to add a second camera to help with position when the ball is in the air. but overall great video.
Great insight! I'll incorporate it into future projects. Thank you!
To bounce the ball wouldn't you need to code it in a way that identifies the changes in the pink ball size (moving closer or farther) and maybe put some marks on the glass platform to have the camera also identify the location and the altitude of that?
Great video, thank you for sharing
awesome!! such a channel is exactly what I was looking for 🤩
3D printet Robots for tinkerers 😁
Why does the narration sound like AI text-to-voice?
Because you don't know how it sounds
I think it is since the creator is Japanese and the narrators english is way too fluent(not saying it isn’t possible)
@@beekdorrr Ah I see! Didn't realize the creator was japanese, thanks!
Because it is.....
My friend uses AI to get rid of his thick Polish accent.. It works great. It's still the persons voice sans "dialectical imperfections"
Just thinking the difficulty level if we try to balance two balls at the same time :)
BTW, great work. highly appreciated.
for doing the balancing you wouldn't need a second camera? that will lead to a more precise calculation of distance. Nice project!
Thanks for taking a look...I think using two cameras is a great way to go.
You can estimate height by the size of the image of the ball. Calibrating images of the ball on the platform at known heights could even give you a lookup table of size::height estimates as a baseline.
no you don t need 2 cameras, you need a wide angle cam only / ball radius. enough to bounce the ball
@@wilkstube I assumed it was something like. With a known default position of the platform, and assuming the object is a ball, it's diameter can be calculated based on the image. I know he's good for the math on that one, after the inverse kinematics lol.
I like this, i would like a video how to connect OV7670 wires... Friend and i got stuck trying to connect robot eyes to follow fingers and ball. Fantastic experience and effort.
I’m curious to hear more about how you used the golden ratio in the design
The golden ratio is incorporated into the lengths of the links and the size ratio between the platform and the robot's base.
Ping Pong 🏓 would be a great idea…Then make two and have em play each other with the ability to improve accuracy. (automatically maybe) Great video. BTW 😁
Making the robots play ping pong against each other sounds interesting.
@@Koshiro_Robot_Creator …especially interesting if they could be taught how to improve themselves. One step at a time though.
Machine learning? @@wearemany73
Excellent work! Thanks for sharing! I'm using the same servos(RS304MD) for one of my projects. I wonder for multiple servo control, did you use the "TB-RV71EH" and the "TB-22PP Hub" as shown in the RS304MD Instruction Manual for this robot? I didn't seem to see them in this video though.
Derivations should deserve one video on this own right, think about it
Have you been following Harrison Low's juggling robot experiments?
www.youtube.com/@harrisonlow
Maybe you two could collaborate in future?
I just followed him. The movements of his robot are beautiful. It would be amazing if we could collaborate in the future.
@@Koshiro_Robot_Creator I sent him a link to you video. He does regular live streams and I am sure he would be very happy if you reached out.
Oh, the robot butlers are close, I can feel it! LOL
Great video. I’ve seen many TH-cam channels complete this project and gloss over the inverse Kinematics. A full video working through this derivation would be extremely helpful. How does the control algorithm work if it’s over constrained with 3 actuators instead of just 2?
I plan to make a video about that. Please wait a bit.
Can you turn it upside down and make it balance on top of the ball?
This robot cannot do that. However, creating a project to make such a robot sounds interesting.
@@Koshiro_Robot_Creator All it would take - if I'm thinking about this right - is longer arms and a quick update to the arm length in the kinematics of the Brains.
At a glance you are using sight to know the position of the ball, I’d like it to use weight so it can be a never spill coffee cup holder for the car.
That sounds interesting.
Fluids are tricky and watching the cup from below doesn't help much. The car suspension and acceleration/turning are doing the spilling, so instead using a gyro/accelerometer would be the way to go. But don't drive too fast, or your calculations might need to predict the future...
Possibly a gyro suspension can do the job mechanically, with no robot or calculations needed. Good luck!
I love your work.
if the camera detects when to move the platform based on how small it looks ( this is to bounce it) I assume u did it like that then would it be that the height change isn't big enough to accurately detect when to bounce the ball you would need an extra camera to detect distance well enough
I love that you're using Blender
Great topic, thanks 👍
お願いしますが、どの音声AIを使ってナレーションしているか教えてください。とて何かはかっこよくて、声もいいですね
3D movement requires 3D/2.5D vision, like a camera from the side, to be accurate.
ball have fixed constant size, and camera is not telecntric, so you can track height by measuring pink circle size.
Hello, Is there a subsitute for the futaba motor. It is quite expensive. Thank you
Thank God, or rather, robotics. Now, all my life's problems can be solved by a ball balancing automaton.
I kinda wanna find light weight version of this , and mounted on my rc 75mm tinywhoop. If the price very cheap, and available in my country.
I wonder how you can resolve the delay of camera and fix it into the code. :D
Awesome Project. Are you gonna release complete plans and STL's for it?
Thanks for watching! You can download it here.
github.com/KoshiroRobot/Ball-Balancing-Robot
Sir what filament material did you used?
Why i am seeing PID in all electronic projects this is insane.
Really cool! Could it absorb the bounce prior to balancing?
ball control and cameras, am I missing something in the description,
How about using ML to train the control - w/o explicit "math" - by learning from sucesses and failures?
0:28 откуда советский объектив ?
Wow - I confidently predicted you would need to use fuzzy logic to control the platform but it seems I was wrong.
It would be interesting to have another robot pick up the fallen ball back on the plate and then do million bouncing tries to train an AI that could bounce the ball even with the "low" framerate
Great stuff
Echo... nice video!
I am a computer science student currently in university. Can you please make a video on the mathematics of the project?
Awesome
where are the servos getting power from?
This is awespmeee
Next step: use Reinforcement Learning to do these tasks! Perhaps you can solve the bouncing ball problem with it.
Importance of Mathematics explained!
Try using a global shutter camera module
Weird question but is this your voice or text-to-speech?
How is this relevant to the video ?
@@robotboy3525 I'm just asking a question
I am using voice generation from Filmora.
@@Koshiro_Robot_Creator Thanks, I was just asking as I was second-guessing myself, since it's very convincing!
Hi, are you based in Japan? I'm a software engineer very intrigued by AI, i want to know if there are communities or labs dedicated there...thx for your work btw, superb.
to me, this is a project illustrating cybernetics.
It is terrific awesome
Amazing project.
How many hours did you spend on building this robot?
Thanks for watching! Maybe a month or so?
Wow, I had no idea this was an AI voice until I saw all the kanji on your math homework. And this is the fanciest one of these ball balancer thingies I've seen on YT, those are some primo high-end servos, weird they couldn't do the ball bounce trick? But only, two wires only coming from the pi. Nice. Also, why does everyone on YT always solve all the IK from scratch, is there really no existing libs or code written for this very specific case that's been done over and over that are grokable enough to be reused?