To use FaceCap on custom non-Daz characters, whats the workflow for that? Do I use FaceIt, or Autorig pro, or a different addon to create facial rig. Also once I have that rigged how would i import the data from the txt file onto the characters face rig.
My go to would be Auto Rig Pro since I already have that for transferring body motion capture. Once you set up the facial rig, you'll be able to import the FaceCap file via Auto Rig Pro. I can't recall if AutoRig Pro supports Unreal LiveLink. At least that one doesn't require a purchased license at the moment.
I've played around with the idea. I was able to do so by sending the Daz character to Unreal Engine and using a number of plugins. The video below was one of the results. th-cam.com/users/liveEO0Gsg5RWjA
This video has helped me so much! BUT! I am still facing one critical issue: The eye tracking seems to be offset by 90° - so when I look to the right, my character looks up. if I look to the left, my character looks down. If I look up, they look to the left, and if I look down, they look to the right. I've tried this with both Facecap and Livelink, and with Gen 9 & Gen 8, the issue still persists. using blender 4.0 Any help would be so appreciated.
I haven't run across that specific issue. What version of Genesis are you using? Since I have other issues with eyes (like not knowing where to focus during motion capture), I have started to use Object Constraints > Track To on the eye bones to keep them looking in the direction I want them to.
Very interesting tutorial. I think this is among the rare tutorials that clearly explain how to do face motion capture in detail via diffeomorphic, thank you very much. You are doing good work for the community However, how do you animate the other parts of the body by combining it with face motion capture? do you have a video on this? if yes, please give me the link,
Thanks. I was actually going to make a video to finish off my latest Daz to Blender series but never finished that video. Generally, I would import body animation or manually keyframe. After that, I would import the facial animation data, but uncheck the New Action option during import. This prevents the facial mocap data from overwriting everything I did to the rest of the body.
The method for motion capture is great. It's that every time I try, I have trouble lip syncing the audio. There is always one that shifts than the other, even when I am in object mode. My second concern is how do you avoid having your head too sensitive to movement? Let's say the head can't move too much?I
@@zigyhouseofficial7751 The lip synching could be a frame rate issue. If you use FaceCap, it could be 24 or 30 fps the last I remember. LiveLink Face is 30 fps. So you will have to account for that. Using the diffeomorphic plugin in import facial motion capture, I believe there are options to control the influence of the head, eyes, neck, and torso. That may help. Other than that, you may have to manually edit in the graph editor.
Hi brother. I use blender 3.4.1 when I import my character from daz3d to blender bia diffeomorphic it goes well except when I try to import my facial animation via facecap or live link face I receive this error message " Daz importer error: Bone lEye is driven. make extraface bones first" what to do?
I might have come across this but I can't remember. Does the Daz Character have any special morphs to it? Does the error actually stop the import from working? Is it the same thing with multiple Genesis types?
how did you make the live facial motion capture that you showed in the introduction? I cannot seem to be able to connect FaceCap to blender to make them work live :(
That part wasn't live, but a prerendered animation. It is possible, but as far as I know, you need a plugin such as FaceMotion. It's a paid app and I haven't tried it out. There will be some in between work to make it work.
So helpful. Thanks bother. Gonna increase my skills👍🏿
Glad it was helpful.
Thank you so much for sharing it's very hard to find information about this Diffeomorphic add-on
Thanks. I have some others explaining the plugin, including: th-cam.com/video/UqD7NOgKXUo/w-d-xo.html
To use FaceCap on custom non-Daz characters, whats the workflow for that? Do I use FaceIt, or Autorig pro, or a different addon to create facial rig. Also once I have that rigged how would i import the data from the txt file onto the characters face rig.
My go to would be Auto Rig Pro since I already have that for transferring body motion capture. Once you set up the facial rig, you'll be able to import the FaceCap file via Auto Rig Pro. I can't recall if AutoRig Pro supports Unreal LiveLink. At least that one doesn't require a purchased license at the moment.
Can you also do a stream via osc?
I've played around with the idea. I was able to do so by sending the Daz character to Unreal Engine and using a number of plugins. The video below was one of the results. th-cam.com/users/liveEO0Gsg5RWjA
This video has helped me so much!
BUT! I am still facing one critical issue:
The eye tracking seems to be offset by 90° - so when I look to the right, my character looks up. if I look to the left, my character looks down. If I look up, they look to the left, and if I look down, they look to the right.
I've tried this with both Facecap and Livelink, and with Gen 9 & Gen 8, the issue still persists.
using blender 4.0
Any help would be so appreciated.
I haven't run across that specific issue. What version of Genesis are you using? Since I have other issues with eyes (like not knowing where to focus during motion capture), I have started to use Object Constraints > Track To on the eye bones to keep them looking in the direction I want them to.
does this work with genesis 9 characters
Yes it does.
Very interesting tutorial. I think this is among the rare tutorials that clearly explain how to do face motion capture in detail via diffeomorphic, thank you very much. You are doing good work for the community
However, how do you animate the other parts of the body by combining it with face motion capture? do you have a video on this? if yes, please give me the link,
Thanks. I was actually going to make a video to finish off my latest Daz to Blender series but never finished that video. Generally, I would import body animation or manually keyframe. After that, I would import the facial animation data, but uncheck the New Action option during import. This prevents the facial mocap data from overwriting everything I did to the rest of the body.
The method for motion capture is great. It's that every time I try, I have trouble lip syncing the audio. There is always one that shifts than the other, even when I am in object mode. My second concern is how do you avoid having your head too sensitive to movement? Let's say the head can't move too much?I
@@zigyhouseofficial7751 The lip synching could be a frame rate issue. If you use FaceCap, it could be 24 or 30 fps the last I remember. LiveLink Face is 30 fps. So you will have to account for that.
Using the diffeomorphic plugin in import facial motion capture, I believe there are options to control the influence of the head, eyes, neck, and torso. That may help. Other than that, you may have to manually edit in the graph editor.
Do you have video on how to convert the fbx to a txt file?
You wouldn't convert the file itself. Before recording, you have to choose your output format in the settings.
Hi brother. I use blender 3.4.1 when I import my character from daz3d to blender bia diffeomorphic it goes well except when I try to import my facial animation via facecap or live link face I receive this error message " Daz importer error: Bone lEye is driven. make extraface bones first" what to do?
I might have come across this but I can't remember. Does the Daz Character have any special morphs to it? Does the error actually stop the import from working? Is it the same thing with multiple Genesis types?
how did you make the live facial motion capture that you showed in the introduction?
I cannot seem to be able to connect FaceCap to blender to make them work live :(
That part wasn't live, but a prerendered animation. It is possible, but as far as I know, you need a plugin such as FaceMotion. It's a paid app and I haven't tried it out. There will be some in between work to make it work.
Mine said error mesh fitting set to dbz json
Did you already export json file from Daz Studio?
I'm following but it doesn't work
What part doesn't work?
I have android :(
I had that same sadness. I ended up getting a used iPhone X on ebay without a data plan. That was the cheapest route I could find.