I have to say that this was the best coding video I have ever watched, by a long mile. Slick, quick and straight to the trick. The half hour I’ve spent watching this has saved me about two days on my project. Many thanks.
thank you very much nicholas, I was on the verge of giving up on my research work. but thanks to you and your videos I was able to have a new lease of life to continue. Thank you very much again.
😅 thought you might like it! This code base isn't but when I took a look it's super similar to what's available using Tensorflow.Js. I think I'm eventually going to extend out some of the TF.js use cases but with the additional components, e.g. kinematics, rep counting etc!
you are the best on youtube really, please keep up, thank you, will be useful if you can make a tutorial about how to define a particular hand gesture and how to send it to be assigned for an action like play a video or something else. thanks again
Thank you for this video. what lines of code are needed to display angles on the screen. Also, how can I save the angles to a dataset or an excel file. Thank you
What is the hardware you're running mediapipe on? I've tried running gesture recognition on Raspberry PI4 and noticed quite a lag between image capture and hand tracking...
Bro you are superb. Buddy just one favor bro can you please please make one video in real time object detection along with frame around object in React Native (mobile) using tensorflow . Trust me buddy I am struggling a lot since a long but can't find any good resources to completely execute it
Ya! It's been on the cards for a while, just need to tighten up my RN coding. But definitely it's on the list @Adarsh, ideally using tflite and RN for end to end object detection!
@@NicholasRenotte Thanks buddy for your reply. If you are gonna go for it in coming days, I would request you to do something similar to this heartbeat.fritz.ai/turning-the-mobile-camera-into-a-real-time-object-detector-with-flutter-and-tensorflow-lite-f412962b1805
Hi, I have a quick question. I'm really new to this but I followed everything like you did but when I run "mp_hands.HAND_CONNECTIONS" I get a somewhat empty result. Even though the tracking works and the XYZ coordinates too this is part of the 'result' i get: frozenset({(0, 1), (0, 5), (0, 17), (1, 2), (2, 3), (3, 4), (5, 6), (5, 9), (6, 7), . . . Do I have to import something else for those missing landmark connections? Sorry if this is a silly question
hello.....each time i try to run the code,,,i face this kind of error ' cv2.VideoCapture' object has no attribute 'isOpend' ' can you please help me???
I'm a beginner at this, could you please tell me how to do foot pose estimation (there's no model specifically for foot pose in the mediapipe framework right?)
I get "ImportError: libGL.so.1: cannot open shared object file: No such file or directory" when it tries to import mediapipe... just copied everything to pycharm and works fine, ignore this
This is a great video, I loved it! One question I have though that I hope you could answer: is this a 2D hand pose estimation or 3D? I seem to have a bit of trouble figuring if it’s 2D or 3D so I would appreciate it if you could explain as to which one it is!
I can't install !pip install mediapipe , it throws me error ERROR: Could not find a version that satisfies the requirement mediapipe ERROR: No matching distribution found for mediapipe help
Hi this is very helpful. Actually I have to detect hands in a video where the person is wearing gloves, the mediapipe is not giving consistent detections, any suggestions to get better detections?
Dear Nicholas, How can i input those finger skeleton points into Recurrent Neural Network to training a gesture recognition model. Can you please make a tutorial about it? Thank you for your help.
How do you capture the movements and bring it to the Blender? I've hit myself all over the internet, including with the BlendArMocap addon and I couldn't
excuse me, i read the documentation of mediapipe it said that hand detection model depends on palm detection model and hand landmark extraction model for my application it just need the palm position do you know how can i stop the process when i detect the palm just in case to increase the fps
Oh man, actually got the code working but it looks like the library is broken so it maxes out at 293 words generated. Been meaning to raise a GH error for it. But yep, will eventually be coming @Rob!
hey, I want to ask a question about the confidence score for each joint. Mediapipe doesn't provide these scores but is there a way to get these confidence scores for each joint of a hand??
Hi Nicholas a great video I extracted the key points trained them but while detecting I am getting this error "X has 63 features, but this StandardScaler is expecting 84 features as input" (I used your holistic code for detection) any idea bro how to solve it?
Heya @Rupendra, might be missing features when passing through. 63 features is synonymous with the handpose keypoints, but 84 I think is close to the posenet features. Might need to retrain if you're making a model for handpose detection!
hi, im trying to get an executable output of this project but i get an error of none existing path of solution in mediapipe and the .exe doesnt run. could you create a video of how to create a .exe file from these kind of projects like hand detections?
Hi Nicholas, very nice tutorial really, I have followed last year already. I got one question I did not find any answer so far and maybe can help someone else as well. I hope you can help me out. Can I get the confidence level of only particular hand's landmark? I mean e.g. for somewhat reason the confidence level of landmark n. 8 - INDEX_FINGER_TIP solely. Is there any way to obtain/extract that? THX and keep up very good job!
Traceback (most recent call last): File "D:/pythonProject2/name.py", line 2, in import mediapipe as mp File "D:\pythonProject2\app_d\lib\site-packages\mediapipe\__init__.py", line 16, in from mediapipe.python import * File "D:\pythonProject2\app_d\lib\site-packages\mediapipe\python\__init__.py", line 17, in from mediapipe.python._framework_bindings import resource_util ImportError: DLL load failed: The specified module could not be found. please help iam getting this error
Dear Nicholas, Can you please make a hand sign recognition with google colab using our webcam in python that does real time recognition? Please it would help because the other video you posted about real time sign language detector does not work for google colab. From a college student
Heya @SharCie, unfortunately the latecy between colab and your webcam doesn't really make this feasible, that's why I do it locally. Training on colab is fine but inference should ideally be done on a local machine!
Hi, I keep getting this error, can anyone help me ? binary_graph_path=os.path.join(root_path, binary_graph_path)) FileNotFoundError: The path does not exist. [ WARN:0] global C:\Users\appveyor\AppData\Local\Temp\1\pip-req-build-oduouqig\opencv\modules\videoio\src\cap_msmf.cpp (434) `anonymous-namespace'::SourceReaderCB::~SourceReaderCB terminating async callback
Good afternoon! I decided to write the code one - to-one as in the video. As a result, I reached the usual output of the image from the camera. Then I inserted the code: with mp_hands.Hands(mine_detection_confidence=0.8, min_tracking_confidence=0.5) as hands: and gave a bunch of errors. Although mediapipe has installed (pip install mediapipe on the command line). What should I do? Mistakes: Traceback (most recent call last): File "C:\python_work\hello_world.py", line 13, in with mp_hands.Hands(min_detection_confidence=0.8, min_tracking_confidence=0.5) as hands: File "C:\Users\Виктор\AppData\Local\Packages\PythonSoftwareFoundation.Python.3.9_qbz5n2kfra8p0\LocalCache\local-packages\Python39\site-packages\mediapipe\python\solutions\hands.py", line 129, in __init__ super().__init__( File "C:\Users\Виктор\AppData\Local\Packages\PythonSoftwareFoundation.Python.3.9_qbz5n2kfra8p0\LocalCache\local-packages\Python39\site-packages\mediapipe\python\solution_base.py", line 229, in __init__ validated_graph.initialize( FileNotFoundError: The path does not exist. [ WARN:0] global C:\Users unneradmin\AppData\Local\Temp\pip-req-build-1hfhc_rd\opencv\modules\videoio\src\cap_msmf.cpp (438) `anonymous-namespace'::SourceReaderCB::~SourceReaderCB terminating async callback
@@NicholasRenotte tfod is good but I don’t prefer doing it with JS or react js I can do it with tfod for object detection yolov4 is mostly used for object detection
Hi mp.solution.drawing_utils where can we find ‘solutions’ in mediapipe as to know what this function does and weather to put something in it or not because the whole code is given on mediapipe, can you help me with this?
I have to say that this was the best coding video I have ever watched, by a long mile.
Slick, quick and straight to the trick.
The half hour I’ve spent watching this has saved me about two days on my project.
Many thanks.
Cheers Charlie, so pumped you enjoyed it!
thank you very much nicholas, I was on the verge of giving up on my research work. but thanks to you and your videos I was able to have a new lease of life to continue. Thank you very much again.
Nice intro 🔥🤘😂
Media Pipe is quite interesting, I saw it's repo on GitHub, not very compatible with JS huh? Yet lol
Can't wait for part 2 of this! 🔥
😅 thought you might like it! This code base isn't but when I took a look it's super similar to what's available using Tensorflow.Js. I think I'm eventually going to extend out some of the TF.js use cases but with the additional components, e.g. kinematics, rep counting etc!
Really loved it. We need a long playlist on this. Make more videos.
I'm so appreciative of you! I could not understand this until your broke each step down-thank you so much!!
Great content! This was the exactly kind of introduction to mediapipe that I was looking for. Thank you so much!
you are the best on youtube really, please keep up, thank you, will be useful if you can make a tutorial about how to define a particular hand gesture and how to send it to be assigned for an action like play a video or something else. thanks again
Yesss, will definitely dig into this @Lory4 Kids!
Really appreciate your work. well explained and a breeze to follow.
Another amazing video man, please do the learning without forgetting and incremental learning, keep up the great content bro 😉
Definitely got it planned for one of my non-techy vids!
Heya @Hugo, the vid is out! th-cam.com/video/cCmGg_Pn9K8/w-d-xo.html
Great content !!!
Hope you continue making awesome videos like this.
Bravo, Nick. Without words. It helped me so much Thanks!
Amazing again bro you always bit faster than me
Baby steps man! Have you checked it out?
Thank you for this video. what lines of code are needed to display angles on the screen. Also, how can I save the angles to a dataset or an excel file. Thank you
Thank you for this tutorial. Very concise and clear!
I ALWAYS read the description 😂
Me too!! 😂
There's always one! 😂
Me too.. It's a fun summary :)
friend thank you very much for this great video, I'm ready to see the next video.
Thank you so much for teaching us such great things.
It says unexpected indent on cv2.imshow(‘Hand Tracking’, image)
What do I do
What is the hardware you're running mediapipe on? I've tried running gesture recognition on Raspberry PI4 and noticed quite a lag between image capture and hand tracking...
Bro you are superb. Buddy just one favor bro can you please please make one video in real time object detection along with frame around object in React Native (mobile) using tensorflow . Trust me buddy I am struggling a lot since a long but can't find any good resources to completely execute it
Ya! It's been on the cards for a while, just need to tighten up my RN coding. But definitely it's on the list @Adarsh, ideally using tflite and RN for end to end object detection!
@@NicholasRenotte Thanks buddy for your reply. If you are gonna go for it in coming days, I would request you to do something similar to this heartbeat.fritz.ai/turning-the-mobile-camera-into-a-real-time-object-detector-with-flutter-and-tensorflow-lite-f412962b1805
@@adarshjaiswal7334 awesome, will take a look into it!
It is impossible for me to install MediaPipe Library
really good content, love your work!!!
Thanks so much @Codista!
how would i get the x and y values for my left and right hand?
Will run through this on Sunday!
Hi, I have a quick question. I'm really new to this but I followed everything like you did but when I run "mp_hands.HAND_CONNECTIONS" I get a somewhat empty result. Even though the tracking works and the XYZ coordinates too
this is part of the 'result' i get:
frozenset({(0, 1),
(0, 5),
(0, 17),
(1, 2),
(2, 3),
(3, 4),
(5, 6),
(5, 9),
(6, 7),
. . .
Do I have to import something else for those missing landmark connections? Sorry if this is a silly question
not printing results.multi_hand_landmarks
even after i show my hand pls help
Got hand landmarks in the frame? Double check your hand is in the last frame and see if it is still apparing there.
@@NicholasRenotte thank you
оууу😱🔥🔥🔥🔥 будет чем вечером заняться😁😁😁 Thank you very much! 🥰🥳
YESSSS! So pumped you liked it!
Amazing tutorial, gonna try this for sure, thanks for the tutorial, subscribing u for some more such videos
hello.....each time i try to run the code,,,i face this kind of error ' cv2.VideoCapture' object has no attribute 'isOpend' ' can you please help me???
Can the capture data be output as a fbx or bvh animation format for 3d applications?
A few people have been asking for it! Will be working on it soon!
I'm a beginner at this, could you please tell me how to do foot pose estimation (there's no model specifically for foot pose in the mediapipe framework right?)
I get "ImportError: libGL.so.1: cannot open shared object file: No such file or directory" when it tries to import mediapipe...
just copied everything to pycharm and works fine, ignore this
Excellent video, thanks a bunch.
It is neither giving any error nor any output. What to do now
This is a great video, I loved it! One question I have though that I hope you could answer: is this a 2D hand pose estimation or 3D? I seem to have a bit of trouble figuring if it’s 2D or 3D so I would appreciate it if you could explain as to which one it is!
It's 3D, x,y,z with z being estimated depth from the camera @Rohit!
hey dude can you do the sign language detection using this one
Yup, working on something special with it!
Where is my images saves in jupyter. I can not finds my images like video time duration 34:50. how to find my directory where the images save
In one word, Awesome...
I can't install !pip install mediapipe , it throws me error
ERROR: Could not find a version that satisfies the requirement mediapipe
ERROR: No matching distribution found for mediapipe
help
What version of Python are you using? Could try Python 3.7.3?
same error
Hey, great video! Just a question, is it necessary to set writeable to False initially?
Helps speed things up but not necessary!
Hi this is very helpful. Actually I have to detect hands in a video where the person is wearing gloves, the mediapipe is not giving consistent detections, any suggestions to get better detections?
Thank you. How do you grab a specific landmark from a specific hand ?
Stay tuned, will go through it in pt two!!
Dear Nicholas,
How can i input those finger skeleton points into Recurrent Neural Network to training a gesture recognition model.
Can you please make a tutorial about it?
Thank you for your help.
Check this out: th-cam.com/video/doDUihpj6ro/w-d-xo.html
@@NicholasRenotte Thank you very much.
How do you capture the movements and bring it to the Blender? I've hit myself all over the internet, including with the BlendArMocap addon and I couldn't
excuse me, i read the documentation of mediapipe
it said that hand detection model depends on palm detection model and hand landmark extraction model
for my application it just need the palm position
do you know how can i stop the process when i detect the palm just in case to increase the fps
Great video! Can you please do GPT3 level content creation?
Oh man, actually got the code working but it looks like the library is broken so it maxes out at 293 words generated. Been meaning to raise a GH error for it. But yep, will eventually be coming @Rob!
great video 🔥🔥🔥 , Can you do an activity recognition AI using MediaPipe pose estimation next?
Thanks a bunch @Javian! Like this: th-cam.com/video/We1uB79Ci-w/w-d-xo.html
Can i know which algorithm is used in detecting the hands..
Posenet :)
Instead of using my webcam feed can I use a prerecorded video? And how do I do this? Pretty new to this stuff, thanks.
Sure can, just sub out the 0 in cv2.VideoCapture(0) for the path to your video. E.g. cv2.VideoCapture('pathtoyourvideo.mp4')
Can someone tell me when I do results.multihandlandmarks, it's empty, why?
How do fix this problem
If cv2.waitKey(10) &0 *FF = ord('q'):
Problem is FF is not defined
it is this:
if cv2.waitKey(10) & 0xFF == ord("q"):
break
hey, I want to ask a question about the confidence score for each joint. Mediapipe doesn't provide these scores but is there a way to get these confidence scores for each joint of a hand??
Hello friends, is there any way to use it to export FBX to blender or connect to blender in real time? It would be great, thank you
Working on it @day spring :)
@@NicholasRenotte ohhhhhhhhhhhhhhhhh，yes，yes
can you do a video about installation about mediapipe for python?
Really amazing. Keep it up.
Tnx a Lot !!!! That was great !!!
Hi Nicholas a great video I extracted the key points trained them but while detecting I am getting this error "X has 63 features, but this StandardScaler is expecting 84 features as input" (I used your holistic code for detection) any idea bro how to solve it?
Heya @Rupendra, might be missing features when passing through. 63 features is synonymous with the handpose keypoints, but 84 I think is close to the posenet features. Might need to retrain if you're making a model for handpose detection!
Besides the code, I'm curious about the screen recorder you're using. What is it ??
OBS obsproject.com/
hi, im trying to get an executable output of this project but i get an error of none existing path of solution in mediapipe and the .exe doesnt run. could you create a video of how to create a .exe file from these kind of projects like hand detections?
Ya, can do.
@@NicholasRenotte thanks man, im looking for to it
Sign Language with mediapipe.
Ya! Been thinking about how to best do this!
Hand tracking is not responding while I move my hand then what should I do ?
What's happening, just not picking it up or?
@@NicholasRenotte when I move my hand ...then system stop performing ,look like hanging my system..
@@RohitKumar-oz7wn any errors in the terminal or notebook?
@@NicholasRenotte no sir
I really like your video
Ayyyee, thanks!
What's the difference between connections and landmarks?
Landmarks = dots
Connections = lines
Why use the "& 0xFF" if the comparison will work anyway? Is it somehow making the execution of the comparison faster overall?
waitKey checks if a key is pressed, the second part checks what key was pressed!
Only can use jupyter to train the dataset?
Hi Nicholas, very nice tutorial really, I have followed last year already. I got one question I did not find any answer so far and maybe can help someone else as well. I hope you can help me out. Can I get the confidence level of only particular hand's landmark? I mean e.g. for somewhat reason the confidence level of landmark n. 8 - INDEX_FINGER_TIP solely. Is there any way to obtain/extract that? THX and keep up very good job!
Traceback (most recent call last):
File "D:/pythonProject2/name.py", line 2, in
import mediapipe as mp
File "D:\pythonProject2\app_d\lib\site-packages\mediapipe\__init__.py", line 16, in
from mediapipe.python import *
File "D:\pythonProject2\app_d\lib\site-packages\mediapipe\python\__init__.py", line 17, in
from mediapipe.python._framework_bindings import resource_util
ImportError: DLL load failed: The specified module could not be found.
please help iam getting this error
Check this out: github.com/google/mediapipe/issues/1839
Hello i want to collect data and train the model with mediapipe, how should i use?
Dear Nicholas,
Can you please make a hand sign recognition with google colab using our webcam in python that does real time recognition?
Please it would help because the other video you posted about real time sign language detector does not work for google colab.
From a college student
Heya @SharCie, unfortunately the latecy between colab and your webcam doesn't really make this feasible, that's why I do it locally. Training on colab is fine but inference should ideally be done on a local machine!
@@NicholasRenotte Oh okaie..cebause
I don't have a gpu :(
Thank you for the reply tho.. Your content is so much fun to learn.
@@shayinmontreal137 anytime! Stoked you're enjoying it!
Hi, I keep getting this error, can anyone help me ?
binary_graph_path=os.path.join(root_path, binary_graph_path))
FileNotFoundError: The path does not exist.
[ WARN:0] global C:\Users\appveyor\AppData\Local\Temp\1\pip-req-build-oduouqig\opencv\modules\videoio\src\cap_msmf.cpp (434) `anonymous-namespace'::SourceReaderCB::~SourceReaderCB terminating async callback
thanks!
thank! How I can get coordinates some point?
can someone tell me how i can make these green lines thick cz these are too thein in my case
got it at 25:00
if someone else need it
how can we import a json file to the above code ?
How did you set up the enviroment?
When i raise my hand my webcam window gets stuck😢😢
Good afternoon! I decided to write the code one - to-one as in the video. As a result, I reached the usual output of the image from the camera. Then I inserted the code:
with mp_hands.Hands(mine_detection_confidence=0.8, min_tracking_confidence=0.5) as hands:
and gave a bunch of errors. Although mediapipe has installed (pip install mediapipe on the command line). What should I do?
Mistakes:
Traceback (most recent call last):
File "C:\python_work\hello_world.py", line 13, in
with mp_hands.Hands(min_detection_confidence=0.8, min_tracking_confidence=0.5) as hands:
File "C:\Users\Виктор\AppData\Local\Packages\PythonSoftwareFoundation.Python.3.9_qbz5n2kfra8p0\LocalCache\local-packages\Python39\site-packages\mediapipe\python\solutions\hands.py", line 129, in __init__
super().__init__(
File "C:\Users\Виктор\AppData\Local\Packages\PythonSoftwareFoundation.Python.3.9_qbz5n2kfra8p0\LocalCache\local-packages\Python39\site-packages\mediapipe\python\solution_base.py", line 229, in __init__
validated_graph.initialize(
FileNotFoundError: The path does not exist.
[ WARN:0] global C:\Users
unneradmin\AppData\Local\Temp\pip-req-build-1hfhc_rd\opencv\modules\videoio\src\cap_msmf.cpp (438) `anonymous-namespace'::SourceReaderCB::~SourceReaderCB terminating async callback
Python 3.9.5
Not sure if this is the source of the error, but this should be min_detection_confidence not mine_detection_confidence?
Hi, Can you please tell me how to implement a "real-time 3d virtual trial room using webcam."
In theory this is what I think is needed @Arun:
1. Detect keypoints
2. Convert keypoints to a rig
2. Render 3D overlay for clothes to a rig
Is there any chance to get landmarks for every 2 frames?
Yup, you could just pause or skip a frame as you're running through each!
@@NicholasRenotte Thank you very much :d
why do you use jupyter??
I like it! In all honestly it allows for rapid prototyping and exploratory analysis.
Sir write the program for yolov4 object detection
you will find lots of code on github but I'm sure this will create the video on that
Yeah I've been hearing a lot about it. Any reason why yolov4 versus something like TFOD?
@@NicholasRenotte tfod is good but I don’t prefer doing it with JS or react js I can do it with tfod for object detection yolov4 is mostly used for object detection
@@_ShrutiRawat but you can use TFOD in Python as well for Object Detection!
Hi mp.solution.drawing_utils where can we find ‘solutions’ in mediapipe as to know what this function does and weather to put something in it or not because the whole code is given on mediapipe, can you help me with this?
how to fix this NameError: name 'cv2' is not defined?
Run !pip install opencv-python