I tried like 8 other face mocap concepts and software (free downloadable ones only so far, no subscription based, or AI based, etc.) and this is the only method that's worked for me so far with my webcam, didn't even need my Android phone and I am not getting an iPhone any time soon, so I'm elated to see that there's a solution that is actually fairly decent! My only gripes so far are: 1. I think some sensitivity will have to be tweaked/adjusted in the LiveLink plugin in Unreal (or in MeFaMo?) because the Metahuman's movement is messy and offset. 2. When you add a sequencer to animate and all the face controls show up next to the Metahuman's face, suddenly all you can move is the head. All facial motion tracking stops in order for you to adjust them as animation parameters. But hey, it's something so far 👍👍👍
This video helped a lot thank you! I noticed in his video and previous development he has head rotation. Mine is similar to yours where the head is static. Is there additional stuff that is needed to rotate the head?
My pleasure! :) The previous video is using LIVE LINK which needs an iphone. If you are interested on highing accuracy and head rotation, I would recommend you maybe to buy an iphone that support truedepth like iphoneXR.
@@RelaxKiral thank you i will look into that! Maybe the head rotation part is still being developed, on the github page there is a gif of him rotating his head! Still really good for a free option and thanks again for covering it
This method works but seems really inaccurate. Not sure how to replicate what the author of the script is able to do. His face movements look really natural and synced up with the metahuman. But I'm having the same result as you have here, in that the neutral face is contorted, and the metahuman doesn't follow my facial movements well.
I am not sure your question, hope this might help After you download the zip file and it unzip it, you should a be le to see the exe file. After that you just run the exe in commend line with the correct camera(like the video) then it should work as the live link camera. Since it is packaged , you do not need to install tensor flow yourself
I tried like 8 other face mocap concepts and software (free downloadable ones only so far, no subscription based, or AI based, etc.) and this is the only method that's worked for me so far with my webcam, didn't even need my Android phone and I am not getting an iPhone any time soon, so I'm elated to see that there's a solution that is actually fairly decent!
My only gripes so far are:
1. I think some sensitivity will have to be tweaked/adjusted in the LiveLink plugin in Unreal (or in MeFaMo?) because the Metahuman's movement is messy and offset.
2. When you add a sequencer to animate and all the face controls show up next to the Metahuman's face, suddenly all you can move is the head. All facial motion tracking stops in order for you to adjust them as animation parameters.
But hey, it's something so far 👍👍👍
I've been waiting for Kira-san's update!
good job!
Thx for the support ❤️
Good that bro,
Could you one day explain how to use it for cinematics and that, you explain very well. thank you :))
Thanks and Good idea! I will definitely put that into the to-do list !! :)
This video helped a lot thank you! I noticed in his video and previous development he has head rotation. Mine is similar to yours where the head is static. Is there additional stuff that is needed to rotate the head?
My pleasure! :)
The previous video is using LIVE LINK which needs an iphone.
If you are interested on highing accuracy and head rotation, I would recommend you maybe to buy an iphone that support truedepth like iphoneXR.
@@RelaxKiral thank you i will look into that! Maybe the head rotation part is still being developed, on the github page there is a gif of him rotating his head! Still really good for a free option and thanks again for covering it
Thanks man superb
My pleasure :)
yeah finaly
noice
This method works but seems really inaccurate. Not sure how to replicate what the author of the script is able to do. His face movements look really natural and synced up with the metahuman. But I'm having the same result as you have here, in that the neutral face is contorted, and the metahuman doesn't follow my facial movements well.
After packaging, the livelink not work, why?
I did all the steps but the mouth and eyes is not moving but there is head rotations what do i do to fix this
how you link the plug into the unreal? He doesn't explain it in the video
@@windows11zumba95 you just run the software bruh, like, double click the exe file and it runs
how i can create Tensor Flow lite XNpack delegate for Cpu ????
I am not sure your question, hope this might help
After you download the zip file and it unzip it, you should a be le to see the exe file. After that you just run the exe in commend line with the correct camera(like the video) then it should work as the live link camera.
Since it is packaged , you do not need to install tensor flow yourself
Thank you so much! But how to plug this software into unreal?
the 'python livelinkface' Not appearing in the unreal
Make sure LinkLink and ARKit Face Support plugins are turned on the UE plugins
@@SlumpogMillionaire They're activated, and yet I'm not getting any information from the software to the unreal. Did it work for you?
Is it work on custom metahuman?
Hi there! Yes it should if your custom metahuma head is the same from unreal metahuman creator.