I'm very glad that you directly categorized iPhone as a pricey option. I feel like many of the other tracking comparison videos I've seen (that are at least a couple years old now, to be fair) kind of just assume that you already have an iPhone. I think I've even heard "just use your phone" with no direct mention of (new-ish) apple, but it's pretty obvious that that's all they're considering.
Thanks so much for this! I just commissioned a vtuber model and the artist just told me that I needed an iPhone to use it, which wasn't mentioned before, so I was like "can't I just use a webcam?". This was extremely helpful
The tracking you're using, plus the model settings, is very smooth compared to most models I've seen. And I like that it's functioning well with glasses for the webcam option. I have a poor quality webcam so this will work well enough for me.
a lot of it is the rigging behind the model but the tracking options make a big difference too!! generally I find webcam has similar tracking quality regardless of the type as long as it's a HD webcam (which most are nowadays!)
This is extremely helpful! I'm glad to see how much just the RTX improves tracking quality, as an Android user. Thank you for making it clear and easy to understand as well
For android users, meowface can be downloaded on android phones (tho im unsure if all android models work, i use a samsung A13) and connected to Vbridger tho its still kind of meh with glasses. Especially when it comes to closing the eyes. Kinda wonder if thickness of the glasses effect the tracking as my glasses are very thick and can possibly be mistaken for my eyebrows 😂... I would very much like to try too see if thinner rims will make it better, especially ones that can blend with my skin tone so the camera can pick it up better or something.
The glare of light reflected from the lenses may prevent the tracker from seeing your eyes clearly too. I've noticed you can see the ring light in a lot of people's glasses when they do live action streaming.
if you know what to look for you can also just turn the eye tracking off/delete the tracking, noted it does make the model closer to a png model and less expressive but i'm also broke and have to wear glasses so it was my solution
I guess it should be mentioned too, with vbridger, you need to have a complex mouth rig too, not just open and close ir it wont work. So it's good to decide how your model is going to be rigged before getting vbridger. Im going to update mine because i learned that. It's really good for eyes though like mentioned in the video. Though at least for me, blinking doesn't fully close the eyes like VTS, but I mean.. we blink so fast XD
It does also work as a general tracking upgrade even without the fancy mouth! But it's definitely an even bigger upgrade to be able to use a more complex rig, the extra mouth parameters are optional! Also for the blinking issue, try turning down the smoothness in VTS!
@@CutieDragon I'll try that out. I was playing around with the parameters before vbridger and didn't change them after, so I can play around that way, thanks for the tip! :D
I had no idea about the RTX option. I just got a graphics card for my pc Finally, I had to wait out the Crypto craze. I'll definitely be giving it a go.
I struggle to see a big improvement from iphone tracking to vbridger. I'll need to see a more in-depth video of vbridger's features. Thankfully, I was able to buy a used iphone :D
You can actually get an iPhone with true depth for $600+ still a lot but the 13 mini and 12 cost that much so that may be a bit more reasonable for some
I use the XR which is one of the oldest models that has the true depth camera! You can pick them up 2nd hand for a fraction of the price too so it's good to keep an eye out!
I have an iPhone SE 2020 and VTube studio on my phone. At first I thought it could use the LiDAR tracking, but it wasn't on the list of avaliable devices, so I'm not sure anymore...
Hey! I have a burning question - did you try using your logitech brio 4k with vbridger? It should have the came infrared capabilities as iphones 'true depth' camera (which is literally infrared cam). If not could u test it and tell me how it did? I have the webcam, i just don't have a rigged model and vbridger and i would like to know if i should get the 'extra' done/bought, if it will or wont work :/
There's a few I believe! Sadly I think it's mostly the pro models that include it (aka. More prohibitively expensive stuff o.o;), cheapest option for the truedepth route is to find a 2nd hand older model that has the feature
I'm guessing Google Media pipe must have been added after you created this video? That's typically my go-to when it comes to tracking without an iPhone as I find it to be a little more accurate than RTX and for me personally RTX typically has a weird bouncing effect for me that I don't get with Google media pipe.
Anyone know impact to PC performance using the rtx option? I remember when I used Webcam, it used a decent amount. Swapped to iPhone and it helped to make streams smoother.
as far as I've seen, RTX puts more strain onto your GPU over your CPU which means you may notice some impact to performance especially if you're using your GPU as your stream encoder! If you have an iphone available it's the best option in terms of PC performance!
Your settings set for your model in vtube studio must be awesome because I'm trying to use a laptop webcam with the RTX tracking and I'm barely hitting 80 percent accuracy for tracking, let alone the results you are getting. I am wearing glasses so that doesn't help, but the eyes on my model don't blink together (it's super funny), and my model's mouth kind of moves like mine (still trying to figure out vtube studio settings) this was definitely super helpful but also a little confusing on what I should adjust on my part 😮💨🤔
Yeah some of it is down to parameter settings specifically but that always needs to be tweaked for your facial movements specifically! What makes the biggest different I think is adjusting down the inputs on face x and y in VTS specifically, I'd reduce the numbers by 5 until you feel like it's moving a bit better to your face As for the blinking, it can also depend on what glasses type you have, for example thicker framed glasses will have a harder time than thin or rimless! If you're still experiencing issues with the blinking specifically there's a setting to link the eye blinking (but you won't be able to wink with this on!)
so far there's meowface that tries to mimic iphone level of tracking - but it's highly dependent on your phone specifically! Though my own test with it + accounts from some fellow vtubers that tested it, it's around abouts RTX level and tends to have some stutters or lag issues
Just curious, I not sure if this is a rhetorical or self explanatory question, but for the RTX, you still need a face-cam, monitor-cam or a webcam right...
I've become frustrated. My VBridger's model doesn't even move for me. I'm unsure what i'm doing wrong but there isnt' anything I can use with steps on how to make things work. I've tried with both my iphone and NVIDIA. She just stares at me with no movement. I've tried to find a tutorial video on how to use it. But i've either worded things wrong or it doesn't exist. If anyone sees this and can help, i'd be forever greatful
so the blue vbridger model isn't even moving? which app are you connecting to on the iphone? it *might* be a port issue where you'll need to change the port number in the settings of both vbridger and whichever iphone app you're using
there is! It's called meowface! sadly in all my testing of it it's been a touch laggy for tracking (and similar issues for others I've seen using the app) so I didn't include it in this one
wtheck i have iphone and webcam and i thought JUST i thought being a vtuber is easy cause i just don't like to do make up (though I really show my face in my main channel). this is soooo troublersome aaahhhadk lsjdljd
I'm very glad that you directly categorized iPhone as a pricey option. I feel like many of the other tracking comparison videos I've seen (that are at least a couple years old now, to be fair) kind of just assume that you already have an iPhone. I think I've even heard "just use your phone" with no direct mention of (new-ish) apple, but it's pretty obvious that that's all they're considering.
For sure! I'm typically an android user when it comes to phones myself since apple is on the pricey end!
Bless you for showing how good these were with glasses.
I had to for all my fellow glasses wearers!
Thanks so much for this! I just commissioned a vtuber model and the artist just told me that I needed an iPhone to use it, which wasn't mentioned before, so I was like "can't I just use a webcam?". This was extremely helpful
The tracking you're using, plus the model settings, is very smooth compared to most models I've seen. And I like that it's functioning well with glasses for the webcam option. I have a poor quality webcam so this will work well enough for me.
a lot of it is the rigging behind the model but the tracking options make a big difference too!! generally I find webcam has similar tracking quality regardless of the type as long as it's a HD webcam (which most are nowadays!)
This is extremely helpful! I'm glad to see how much just the RTX improves tracking quality, as an Android user.
Thank you for making it clear and easy to understand as well
For android users, meowface can be downloaded on android phones (tho im unsure if all android models work, i use a samsung A13) and connected to Vbridger tho its still kind of meh with glasses. Especially when it comes to closing the eyes.
Kinda wonder if thickness of the glasses effect the tracking as my glasses are very thick and can possibly be mistaken for my eyebrows 😂... I would very much like to try too see if thinner rims will make it better, especially ones that can blend with my skin tone so the camera can pick it up better or something.
Thinner rims do help.
The glare of light reflected from the lenses may prevent the tracker from seeing your eyes clearly too. I've noticed you can see the ring light in a lot of people's glasses when they do live action streaming.
Fantastic video! I haven't seen RTX comparison before.
I want to start making 3D vtuber models so this video was perfect for me to get to know the market!
if you know what to look for you can also just turn the eye tracking off/delete the tracking, noted it does make the model closer to a png model and less expressive but i'm also broke and have to wear glasses so it was my solution
Absolutely fantastic video, super handy :3
Nice video, I didn't know about the RTX option, I already have an RTX gfx card + a camera so I'm excited to experiment with it!
But how!?????
how do u turn on rtx tracking?
Very informative, thanks!
Aight, RTX it is from now on! Thanks for sharing ♥
I guess it should be mentioned too, with vbridger, you need to have a complex mouth rig too, not just open and close ir it wont work. So it's good to decide how your model is going to be rigged before getting vbridger. Im going to update mine because i learned that. It's really good for eyes though like mentioned in the video. Though at least for me, blinking doesn't fully close the eyes like VTS, but I mean.. we blink so fast XD
It does also work as a general tracking upgrade even without the fancy mouth! But it's definitely an even bigger upgrade to be able to use a more complex rig, the extra mouth parameters are optional!
Also for the blinking issue, try turning down the smoothness in VTS!
@@CutieDragon I'll try that out. I was playing around with the parameters before vbridger and didn't change them after, so I can play around that way, thanks for the tip! :D
I had no idea about the RTX option. I just got a graphics card for my pc Finally, I had to wait out the Crypto craze. I'll definitely be giving it a go.
really nice video, damn this one time I will say it.... I wish I had an iphone XD
I struggle to see a big improvement from iphone tracking to vbridger. I'll need to see a more in-depth video of vbridger's features. Thankfully, I was able to buy a used iphone :D
a lot of the vbridger side of things is rigging specific! I'll likely do a standard/vbridger showcase at some point in the future
You can actually get an iPhone with true depth for $600+ still a lot but the 13 mini and 12 cost that much so that may be a bit more reasonable for some
I use the XR which is one of the oldest models that has the true depth camera! You can pick them up 2nd hand for a fraction of the price too so it's good to keep an eye out!
Thanks for the video explanation.
I'm using the rtx option never had an impact on my perfomance because I mostly stream art or less heavier games.
You are a godsend 🙏
Bump for the alogrithm
Can you make a video tutorial on how to set up a new model with vbridger tracking on vtubestudio + vbridger?
I'll add it to my list!!
Ah yes fellow dragon I see...
is there a way around the iphone stopping the face tracking after five minutes or do i have to buy vtube studio pro?
so vbridger is the most expensive one if you do not have an iPhone $710+ (unless you go second hand)
How do you get your webcam to connect to Vtube Studio? Do you have to purchase the DLC to use a webcam?
I know! That’s my question!
I have an iPhone SE 2020 and VTube studio on my phone. At first I thought it could use the LiDAR tracking, but it wasn't on the list of avaliable devices, so I'm not sure anymore...
No, you can not. You basically need any iPhone with a “notch” (with Face ID)
Hey! I have a burning question - did you try using your logitech brio 4k with vbridger? It should have the came infrared capabilities as iphones 'true depth' camera (which is literally infrared cam).
If not could u test it and tell me how it did? I have the webcam, i just don't have a rigged model and vbridger and i would like to know if i should get the 'extra' done/bought, if it will or wont work :/
Hi can you make a video on body x y movement plzzz
How do you use your built in webcam? Cuz I don’t have a portable webcam
Hmm... an iPhone is prohibitively expensive, but what about an iPad? I've heard there are iPad models that come with TrueDepth cameras.
There's a few I believe! Sadly I think it's mostly the pro models that include it (aka. More prohibitively expensive stuff o.o;), cheapest option for the truedepth route is to find a 2nd hand older model that has the feature
Hey the link for the iPhone that has the tracking doesn't work I believe. Its crossed out for me and idk maybe it's cuz I'm on mobile
I'm guessing Google Media pipe must have been added after you created this video? That's typically my go-to when it comes to tracking without an iPhone as I find it to be a little more accurate than RTX and for me personally RTX typically has a weird bouncing effect for me that I don't get with Google media pipe.
Thanks for the comparison, the traking with iphone is done with the front or rear camera?
front. face id camera
SUPER!
I know this video is a bit old, but I am wondering how the tobii tracker 5 performs.
I haven't been able to test it myself yet! (Mostly due to the extra cost for the tracker)
Anyone know impact to PC performance using the rtx option? I remember when I used Webcam, it used a decent amount. Swapped to iPhone and it helped to make streams smoother.
as far as I've seen, RTX puts more strain onto your GPU over your CPU which means you may notice some impact to performance especially if you're using your GPU as your stream encoder! If you have an iphone available it's the best option in terms of PC performance!
Is ipad pro m1/m2 also have true depth camera? I need to buy ipad for drawing but i dont know about their camera
Your settings set for your model in vtube studio must be awesome because I'm trying to use a laptop webcam with the RTX tracking and I'm barely hitting 80 percent accuracy for tracking, let alone the results you are getting. I am wearing glasses so that doesn't help, but the eyes on my model don't blink together (it's super funny), and my model's mouth kind of moves like mine (still trying to figure out vtube studio settings)
this was definitely super helpful but also a little confusing on what I should adjust on my part 😮💨🤔
Yeah some of it is down to parameter settings specifically but that always needs to be tweaked for your facial movements specifically!
What makes the biggest different I think is adjusting down the inputs on face x and y in VTS specifically, I'd reduce the numbers by 5 until you feel like it's moving a bit better to your face
As for the blinking, it can also depend on what glasses type you have, for example thicker framed glasses will have a harder time than thin or rimless! If you're still experiencing issues with the blinking specifically there's a setting to link the eye blinking (but you won't be able to wink with this on!)
would love to see a parameter sort of tutorial/explanation/tips from you
I'll add it to my list! @@EvilSpartan220
I would be interested to see how android compares to these!
so far there's meowface that tries to mimic iphone level of tracking - but it's highly dependent on your phone specifically! Though my own test with it + accounts from some fellow vtubers that tested it, it's around abouts RTX level and tends to have some stutters or lag issues
@@CutieDragon got it, ty!
Thank you so much for this! It's so lovely to see comparions with the RTX and also wearing glasses! 🥹 I had no idea it also tracked mouth X!
Please how use rtx version? I have nvidia 4070. And i wanna use this type of tracking.
Just curious, I not sure if this is a rhetorical or self explanatory question, but for the RTX, you still need a face-cam, monitor-cam or a webcam right...
Does it matter what I use in vbridger like iPhone is better than rtx webcam vbridger ? Or iFacialMocap+vbridger ect
what happened to the list of iphones?
it seems that the original link broke! I've gone ahead and fixed it!
I've become frustrated. My VBridger's model doesn't even move for me. I'm unsure what i'm doing wrong but there isnt' anything I can use with steps on how to make things work. I've tried with both my iphone and NVIDIA. She just stares at me with no movement. I've tried to find a tutorial video on how to use it. But i've either worded things wrong or it doesn't exist. If anyone sees this and can help, i'd be forever greatful
so the blue vbridger model isn't even moving? which app are you connecting to on the iphone? it *might* be a port issue where you'll need to change the port number in the settings of both vbridger and whichever iphone app you're using
what version of the iphone are you using? 🥺
Is VBridger only for computers or can I use that on iPhone as well? 🤨
vbridger is PC only!
Luckily, used iPhone X's and up are quite affordable and 3x less than the price you put up.
But what if I have an Samsung 22 ultra?
So do you need to pay for the phone version? does an iphone 11 work?
iphone 11 will work! Most iphones X and above should work (specifically they have the 'truedepth' camera)
What about Android? I believe there's an app for this.
there is! It's called meowface! sadly in all my testing of it it's been a touch laggy for tracking (and similar issues for others I've seen using the app) so I didn't include it in this one
I'm just too broke for an iPhooone.
hello :>
Is the phone xr a new enough iphone?
Yep! That's actually the model I use!
did you type ur intro with chatgpt? because I hear something very similar 👀👀😂😂
Moore Kenneth Young Jennifer Harris Maria
😏
Idk if my GPU is gud enough. I have a something something 4090
wtheck i have iphone and webcam and i thought JUST i thought being a vtuber is easy cause i just don't like to do make up (though I really show my face in my main channel). this is soooo troublersome aaahhhadk lsjdljd
am i an uncultured caveman if I think they all kind of look the same? XD