This video is still informative, but I made a newer video that costs doesn't require paying for FaceCap App!! Check it out! th-cam.com/video/eahwACx0Uyg/w-d-xo.html
How can you use Valve Index Controllers and use the keyboard and mouse at the same time? Valve Index Controllers don't make it difficult to use mouse and keyboard?
@fofamit Are you using Quest 2 or Valve Index? Vive tracker 2018 or 3.0? Do I need to buy a Headset if I only need face tracking and not play VR games?
the future is looking bright ^^ Thank you for compiling all of this together :] hope to see more vtubers of your caliber in the near future :DDD as a vtuber musician, i hope to see a combination of leap motion and vive trackers that'll finally allow my viewers to see me strum a vguitar XD
I'd love to do that as well some day. It would be so cool if some kind of AR technology would allow to make a room look animated and replace a person with an avatar. That way you could interact with anything in the room and it would look like an anime. Even replacing a person with an avatar without doing anything to the room would be cool
@@Fofamit Alright so I actually started tackling the software side of it because the hardware part is going to be a long running goal... But I feel like I'm missing something with all those Unity packages (ExternalReceiver, OSC) I don't see them with any of the DLs or I must be blind as heks
Hi! Your channel is a huge help! I do have some questions though. I'm wanting to do full body tracking but have never done it before. Once you buy those Vive trackers, what do you DO with them? Do they need that expensive base station? Are you wearing a head tracker AND a VR headset, or is it possible to just use the hand trackers from, say, the Oculus Rift S alongside the 4 HTC trackers? I imagine the headset would only be for if you're actually playing in VR. I know these are noob questions but I really need some help!
What if your on Mac? Do I have to use Vroid Studio and 3tene?? Is there anything else to use because I want FBT like you but im on MAC, I also have Oculus Quest 2.
Man, this is so disappointing to see that they built this for apple... I guess they didn't want to largest consumer base or were afraid of support for random android phones manufacturing varients... Well off to find an alternative.
Не получается у меня сделать контроллеры. Не появляются. У меня их нет. Жаль, что нет нормальной подробной инструкции как пользоваться программой. Ничего не получилось. Хотя я не новичок в 3d
Hi Fofamit. In the case of the fingers, it can works ony with the Valve Index Controller? I mean without the complete pack, just with the pair of Index Controllers. Thank you!
I think its cool AF that you're soon going to hit 1k subs, looking through your channel is def helping me to get set up for vtubing and stuff :) keep up the good work!
Thanks for the video! I have three vive trackers and a leap motion and I'm grabbing an iphone soon. If I wanted to full body vtube without wearing my index or the controllers, do I just need that one extra vive tracker for my head?
When it comes to face tracking do I wear a vive tracker instead of the headset? I dont understand how it will see my eyes with the headset on and vice versa how the headset will see the controllers if I'm not wearing it
If I understand you correctly, you are not using the blendshapes Vroid studio gives you. You make 52 ARKIT blendshapes. Which is a lot of work. What I would like is a script that retargets the VRM blendshapes to ARKIT blendshapes. Is there something like this?
well the video was amazing and detailed but as a beginner, I put a lot of time to make my avatar (2 days) and it still looks like crap can you review it and fix it?
This video was so interesting and helpfull seriously! Anyways I wanted to ask you something I don't see anywhere: How can I use the vseeface app with my valve index headset and controllers, and playing all vr games while Im streaming my body and face on the full room! Pls I can't find it anywhere
Heyo! Sweet tutorial! Definitely handy and rather thorough, however I do have one question. Is there anyway to have the face tracking and just use leapmotion? So liek, IOS face tracking but with leapmotion for hands? So uh like luppet, but using IOS face tracking instead of webcam and leapmotion? 030
No offense, but I’m up to 2:53 and every software application you presented thus far seem better then the one used in this tutorial. The way the mouth moved (even from a distance), and hand gestures. Well I’ll finish watching. Great job by the way👍🏽
COOL VIDEO U R AWESOME. I DON'T HAVE I PHONE. IS THERE A WAY CAN I SKIP THAT??? I MEAN.MAYBE USING MY ANDROID SMART PHONE I WILL GET THE WHOLE FEATURES
This video was soooooo helpful! Also I love your model, I make 3D models as well. If you want me to help you out with the elbow weight painting let me know!
is it possible to use only your vive controllers (no headset (so you can do facial expressions) or extra trackers) to track your hands for in vseeface?
@@Fofamit i want full body tracking with face tracking. that video you linked me only tells me about half body tracking. question is this: do i need leap motion if ill be using: iphone and vive trackers for each part of the body + software to make it all work.
Have you tested a perfect synch vroid in luppet to see if the outcome is any better? I swear it feels like that's the one program I just can't be sold on 🤣
VROID is a software used to make VRM models. Luppet uses VRM models. And Perfect Sync also uses VRM models. VRM can be VROID models and OTHER kinds of models. And yes I've tried it. It works great.
I'm vtubing because it's literally free to vtube and I very much enjoy it, I don't have a $300-$1000 vr headset or full body tracking or any vr stuff at all and I don't have an expensive phone or any apple products. I really hate how new technology is almost always vendor locked forcing you to switch to that vendor. Apple suddenly has a firm monopoly over vtuber technology and why is this even on a cell phone when I vtube from my PC. I run my stream deck through lioranboard on my phone which makes more sense than a face tracking app that's better suited for my pc
I wish all your videos didn't rely on apple products so much, because I don't use apple products and don't know what the best alternatives are. Hope you can make suggestions for alternatives moving forward! Thanks for the content!
@@Fofamit so I was trying waidayo and I notice it doesn’t capture the expression well. Should I try another face motion capture that you can recommend?
@@GIJOEG36 I was speaking about the Unity being more user friendly. Also even though it is possible to do facial tracking with Blender using OpenCV... there aren't a lot of user friendly methods for getting motion capture data from your VR trackers / Webcam / iPhone (if you decided to go that route). Also you can just use an iPhone X, which if you already have one will work for the real time facial tracking.
@@Fofamit blender simply lets you use a simple webcam and a model with limits. Also it works the same if youre on a mac, windows, linux. I also tried a kinect that worked pretty easily. I for my self are more familiar with blender. Also you maybe looked at an old version. There are premade plugins and scripts that can achive realtime tracking of face and body on a level that many of the commerical trackers can. I did a quick search for the recent blender long term support version using the internal python interpreter and a computer vision library. th-cam.com/video/O7nNO3FLkLU/w-d-xo.html
@@GIJOEG36 Like I am not disagreeing with you I've personally tried it and worked with using mocap in Blender, I am just saying Blender isn't NEW user friendly. And when you start diving into OpenCV and other kinds of scripts in Blender specifically, it can be very hard for people completely new to Blender.
I think its cool AF that you're soon going to hit 1k subs, looking through your channel is def helping me to get set up for vtubing and stuff :) keep up the good work!
This video is still informative, but I made a newer video that costs doesn't require paying for FaceCap App!! Check it out! th-cam.com/video/eahwACx0Uyg/w-d-xo.html
Wkw
pro trick: you can watch movies at Flixzone. Me and my gf have been using them for watching all kinds of movies lately.
@Mathias Hunter definitely, have been watching on Flixzone for years myself =)
How can you use Valve Index Controllers and use the keyboard and mouse at the same time? Valve Index Controllers don't make it difficult to use mouse and keyboard?
@fofamit Are you using Quest 2 or Valve Index? Vive tracker 2018 or 3.0? Do I need to buy a Headset if I only need face tracking and not play VR games?
Im always jealous of the vtubers who show the facial tracking and can wink with both eyes
the future is looking bright ^^ Thank you for compiling all of this together :] hope to see more vtubers of your caliber in the near future :DDD
as a vtuber musician, i hope to see a combination of leap motion and vive trackers that'll finally allow my viewers to see me strum a vguitar XD
Now that sounds amazing!
I'd love to do that as well some day. It would be so cool if some kind of AR technology would allow to make a room look animated and replace a person with an avatar. That way you could interact with anything in the room and it would look like an anime. Even replacing a person with an avatar without doing anything to the room would be cool
@@danielhughes3758 maybe greenscreen suits is our only option right now XD
this is amazing and so good! Sounds very complicated but looks well worth it
Thanks for the tutorial! I haven't been able to watch it thoroughly yet, but I hope I can get body capture working whenever I get to it ^^
Let me know how it goes!
@@Fofamit Alright so I actually started tackling the software side of it because the hardware part is going to be a long running goal... But I feel like I'm missing something with all those Unity packages (ExternalReceiver, OSC) I don't see them with any of the DLs or I must be blind as heks
@@overlord_ora7648 Oh there is going to be a new video coming out which might be worth waiting for before making any purchases
I know this can be done but i remembered im far too lazy.. I just stayed for the cute dance at the end.
you went into so much detail, great work !
Hi! Your channel is a huge help! I do have some questions though. I'm wanting to do full body tracking but have never done it before. Once you buy those Vive trackers, what do you DO with them? Do they need that expensive base station? Are you wearing a head tracker AND a VR headset, or is it possible to just use the hand trackers from, say, the Oculus Rift S alongside the 4 HTC trackers? I imagine the headset would only be for if you're actually playing in VR. I know these are noob questions but I really need some help!
Hello I just wanna say I love this channel
Thank you :)
If someone can help translate the subtitles to Japanese let me know!
誰かが字幕を日本語に翻訳するのを手伝ってくれるなら、私に知らせてください！
What if your on Mac? Do I have to use Vroid Studio and 3tene?? Is there anything else to use because I want FBT like you but im on MAC, I also have Oculus Quest 2.
Do you have a tutorial in which it is only with the PC and perhaps applications purchased there on steam? I dont have an iPhone or something like that
Man, this is so disappointing to see that they built this for apple... I guess they didn't want to largest consumer base or were afraid of support for random android phones manufacturing varients... Well off to find an alternative.
Same here, I feel disappointed as well. There needs to be an alternative for android phones.
It'd because android dosent have as detailed a camera
@@jettanyx1 what- since when I’ve had both android and Apple phones android is much more detailed and realistic with shadows and textures
Yeah, I hate that after looking into this stuff that I need to drop $200 on a used iPhone X or something just to use a more accurate face capture.
With the valve index controllers and trackers do you stand up when doing your videos?
Не получается у меня сделать контроллеры. Не появляются. У меня их нет. Жаль, что нет нормальной подробной инструкции как пользоваться программой. Ничего не получилось. Хотя я не новичок в 3d
You whould need vr controllers for this???
Hi Fofamit. In the case of the fingers, it can works ony with the Valve Index Controller? I mean without the complete pack, just with the pair of Index Controllers. Thank you!
I think its cool AF that you're soon going to hit 1k subs, looking through your channel is def helping me to get set up for vtubing and stuff :) keep up the good work!
What would you recommend me to do, if I will use valve index headset+controllers, and a webcam (withoutnvive trackers) ? Only VMC(no patreon version)?
Thanks for the video! I have three vive trackers and a leap motion and I'm grabbing an iphone soon. If I wanted to full body vtube without wearing my index or the controllers, do I just need that one extra vive tracker for my head?
When it comes to face tracking do I wear a vive tracker instead of the headset? I dont understand how it will see my eyes with the headset on and vice versa how the headset will see the controllers if I'm not wearing it
Why is no one answering this question
If I understand you correctly, you are not using the blendshapes Vroid studio gives you. You make 52 ARKIT blendshapes. Which is a lot of work. What I would like is a script that retargets the VRM blendshapes to ARKIT blendshapes. Is there something like this?
If I only want to use this to track, my hand and head but no face expression(no emotion), would the setting be different?
Do you have any other webcam recommendations? The c920 sold out
well the video was amazing and detailed but as a beginner, I put a lot of time to make my avatar (2 days) and it still looks like crap can you review it and fix it?
а что нужно, чтобы руки двигались? секрет?
This video was so interesting and helpfull seriously!
Anyways I wanted to ask you something I don't see anywhere:
How can I use the vseeface app with my valve index headset and controllers, and playing all vr games while Im streaming my body and face on the full room! Pls I can't find it anywhere
This is so awesome while I can't do most of it at the moment I like all the other options of for vtubing you've covered! You got a subscriber here!!!
Maybe this would be better? th-cam.com/video/wzWHhohVzjQ/w-d-xo.html
@@Fofamit oh yes I started using vseeface and its been working fantastic! I hope I can get an iphone with face tracking soon!
has anyone figured out what link to click for the patreon version of VMC bc I am so lost owo
I love these programs. It's amazing.
you are the best!
Heyo! Sweet tutorial! Definitely handy and rather thorough, however I do have one question. Is there anyway to have the face tracking and just use leapmotion? So liek, IOS face tracking but with leapmotion for hands? So uh like luppet, but using IOS face tracking instead of webcam and leapmotion? 030
Yes: th-cam.com/video/wzWHhohVzjQ/w-d-xo.html
@@Fofamit Oh lol sorry! Literally posted yesterday! Thanks!
Also do I only need to do the blendshape stuff once and then I can use it for other avatars or do I need to do it for each avatar?
I cant help but notice your chest has a tracker too
To be honest, after watching your other tutorial video, this looks much less daunting and really is doable.
Hi do you need a virtual headset for this
Ah.. I keep stumbling over the VR headset and 3 additional trackers.. too expensive ;_;
Have you played around with snake strike?
There is a new application to use for FREE instead of FaceCapApp, check it out in this video: th-cam.com/video/4aFOrHLR91Y/w-d-xo.html
forfamitt do u need vr to do like that?is there a way u can do without a vr?
Yes with a kinect v2 Xbox one
Hahahahahahaa I was watching your videos to see when will pop up BLENDER ;3
Can I use the valve index base stations instead of vive trackers ?
Base stations are needed to track vive trackers
I wish there's an app like FaceCap or similar facial motion capture app but for Android. I have a Samsung Galaxy Note 20 Ultra.
for stuff like VMC, do you have to keep paying monthly to use it?
Great capture😲
Welp...there goes my wallet 🤷😂
Question, does all this work with webcams?
No offense, but I’m up to 2:53 and every software application you presented thus far seem better then the one used in this tutorial. The way the mouth moved (even from a distance), and hand gestures. Well I’ll finish watching. Great job by the way👍🏽
If you check my latest video using basically the same technique you can see the improved face tracking.
@@Fofamit YES!!! Thanks great video and personality 😇
COOL VIDEO U R AWESOME. I DON'T HAVE I PHONE. IS THERE A WAY CAN I SKIP THAT??? I MEAN.MAYBE USING MY ANDROID SMART PHONE I WILL GET THE WHOLE FEATURES
Why must all the good things cost money or only for ios
This video was soooooo helpful! Also I love your model, I make 3D models as well. If you want me to help you out with the elbow weight painting let me know!
is it possible to use only your vive controllers (no headset (so you can do facial expressions) or extra trackers) to track your hands for in vseeface?
VSeeFace allows for facial expressions with hotkeys
@@Fofamit true, but can you assign those hotkeys to buttons on the vive controllers? otherwise it'd be kind of difficult to do the hotkeys
why use vive trackers when you have a kinect?
Can a kinect work with vtuber softwares?
do i need facecap to achieve face+body tracking with all other apps or can i skip it and use VMC4U?
You can use this app I mentioned in this video instead of facecap th-cam.com/video/4aFOrHLR91Y/w-d-xo.html
@@Fofamit that's useful, thank you! not sure if i missed, but you have leap motion linked in the description. do i need that?
@@Fofamit or can i just use valve index controllers? is that just either or?
@@iamme1996 Please see this video th-cam.com/video/wzWHhohVzjQ/w-d-xo.html
@@Fofamit i want full body tracking with face tracking. that video you linked me only tells me about half body tracking. question is this: do i need leap motion if ill be using: iphone and vive trackers for each part of the body + software to make it all work.
Have you tested a perfect synch vroid in luppet to see if the outcome is any better? I swear it feels like that's the one program I just can't be sold on 🤣
VROID is a software used to make VRM models. Luppet uses VRM models. And Perfect Sync also uses VRM models. VRM can be VROID models and OTHER kinds of models. And yes I've tried it. It works great.
I'm vtubing because it's literally free to vtube and I very much enjoy it, I don't have a $300-$1000 vr headset or full body tracking or any vr stuff at all and I don't have an expensive phone or any apple products. I really hate how new technology is almost always vendor locked forcing you to switch to that vendor. Apple suddenly has a firm monopoly over vtuber technology and why is this even on a cell phone when I vtube from my PC. I run my stream deck through lioranboard on my phone which makes more sense than a face tracking app that's better suited for my pc
I wish all your videos didn't rely on apple products so much, because I don't use apple products and don't know what the best alternatives are.
Hope you can make suggestions for alternatives moving forward!
Thanks for the content!
I did just notice an android specific video you've put out, thanks!
Is the face capture available on PC? Or just on IOS
VSeeFace has maybe the best you can get with Webcam face tracking on PC. It's not comparable to the iOS face tracking though.
@@Fofamit so I was trying waidayo and I notice it doesn’t capture the expression well. Should I try another face motion capture that you can recommend?
Will this work for VR chat?
Android? Is there ANYTHING for android users? Seriously everywhere I go it's iOS iOS iOS! WTF?!
only with iphone?
ME: Don't have the luxury of any of that so will be back when I do XD
I cant even get my trackers to move with my wrists let alone everything else x.x
Make sure your playspace is set up.
Fofa is totes adorbs
Do you use vroid to make your model?
No it's a kit bash of things I bought on Booth.
@@Fofamit thank you, just saw you made a video about booth I'll check it out
Technically blender has all you need
This is true, it does, but it isn't as beginner friendly.
@@Fofamit Shure, but I feel more comfortable that spending 1000€ on an iPhone....
@@GIJOEG36 I was speaking about the Unity being more user friendly. Also even though it is possible to do facial tracking with Blender using OpenCV... there aren't a lot of user friendly methods for getting motion capture data from your VR trackers / Webcam / iPhone (if you decided to go that route). Also you can just use an iPhone X, which if you already have one will work for the real time facial tracking.
@@Fofamit blender simply lets you use a simple webcam and a model with limits. Also it works the same if youre on a mac, windows, linux. I also tried a kinect that worked pretty easily. I for my self are more familiar with blender. Also you maybe looked at an old version.
There are premade plugins and scripts that can achive realtime tracking of face and body on a level that many of the commerical trackers can.
I did a quick search for the recent blender long term support version using the internal python interpreter and a computer vision library.
th-cam.com/video/O7nNO3FLkLU/w-d-xo.html
@@GIJOEG36 Like I am not disagreeing with you I've personally tried it and worked with using mocap in Blender, I am just saying Blender isn't NEW user friendly. And when you start diving into OpenCV and other kinds of scripts in Blender specifically, it can be very hard for people completely new to Blender.
So you need 3,000 dollars...for the phone and the VR set. then $100
thats a cute voice right there
only 1 word
THICC
>Has an android
Well I guess it's time to pay an arm and a leg to get an iPhone just for fucking face tracking and nothing else 👿
too much APPLE!
Oh my god can I marry you...?
Deleting comments Fofamit?? Horrible been avid follower for months that's wack! Especially. If I broke no guidelines and commended you?!
I have no idea what you're talking about.
im an android guy lol
Same
Deadass can't understand
nice just need $1,000 iPhone lol
You can get an iphoneX for $350 here in Korea.
Ok
Ew iPhone, no I don't buy Apple products. Too unethical.
I think its cool AF that you're soon going to hit 1k subs, looking through your channel is def helping me to get set up for vtubing and stuff :) keep up the good work!